`search_tweets` returning fewer columns since today (11/03)
jcrodriguez1989 opened this issue · 2 comments
jcrodriguez1989 commented
Problem
search_tweets returning fewer columns since today (11/03)
Some columns seem to have disappeared from the returned object, like:
is_retweet, screen_name, reply_to_screen_name, status_id, status_url.
Expected behavior
Reproduce the problem
> search_tweets("(rstat OR rstats)", type = "recent", include_rts = FALSE) |> dplyr::glimpse()
Rows: 96
Columns: 43
$ created_at <dttm> 2022-11-03 21:02:45, 2022-11-03 20:58:06, 2022-11-03 20:46:37, 2022-11-03 20:45:28,…
$ id <dbl> 1.588321e+18, 1.588320e+18, 1.588317e+18, 1.588316e+18, 1.588315e+18, 1.588315e+18, …
$ id_str <chr> "1588320811873886208", "1588319641272999936", "1588316751736946688", "15883164614369…
$ full_text <chr> "@SMAS presents the Annual Statistical Science Lecture on Thurs17Nov22 @UOW given by…
$ truncated <lgl> FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, …
$ display_text_range <dbl> 227, 211, 227, 245, 269, 26, 268, 76, 111, 225, 267, 270, 264, 95, 276, 275, 274, 98…
$ entities <list> [[<data.frame[4 x 2]>], [<data.frame[1 x 2]>], [<data.frame[2 x 5]>], [<data.frame[…
$ metadata <list> [<data.frame[1 x 2]>], [<data.frame[1 x 2]>], [<data.frame[1 x 2]>], [<data.frame[1…
$ source <chr> "<a href=\"https://mobile.twitter.com\" rel=\"nofollow\">Twitter Web App</a>", "<a h…
$ in_reply_to_status_id <dbl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, 1.588304e+18, NA, NA, NA, NA, NA…
$ in_reply_to_status_id_str <chr> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, "1588304374417489920", NA, NA, N…
$ in_reply_to_user_id <dbl> 1.769165e+07, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, 1.218834e+07, NA, NA, …
$ in_reply_to_user_id_str <chr> "17691648", NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, "12188342", NA, NA, "121…
$ in_reply_to_screen_name <chr> "smas", NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, "Mike_Kaminsky", NA, NA, "Mi…
$ geo <list> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA,…
$ coordinates <list> [<data.frame[1 x 3]>], [<data.frame[1 x 3]>], [<data.frame[1 x 3]>], [<data.frame[1…
$ place <list> [<data.frame[1 x 3]>], [<data.frame[1 x 3]>], [<data.frame[1 x 3]>], [<data.frame[1…
$ contributors <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ is_quote_status <lgl> FALSE, FALSE, FALSE, FALSE, FALSE, TRUE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, F…
$ retweet_count <int> 1, 1, 4, 3, 1, 2, 3, 1, 1, 1, 0, 2, 8, 1, 2, 4, 1, 2, 3, 5, 4, 1, 7, 17, 10, 3, 0, 1…
$ favorite_count <int> 0, 2, 4, 1, 0, 1, 8, 0, 0, 0, 1, 8, 7, 0, 4, 4, 4, 1, 1, 1, 2, 0, 8, 17, 15, 2, 0, 0…
$ favorited <lgl> FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, …
$ retweeted <lgl> FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, …
$ possibly_sensitive <lgl> FALSE, NA, NA, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE,…
$ lang <chr> "en", "en", "en", "en", "en", "en", "en", "en", "en", "en", "es", "en", "en", "en", …
$ quoted_status_id <dbl> NA, NA, NA, NA, NA, 1.588304e+18, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, 1.588304e+…
$ quoted_status_id_str <chr> NA, NA, NA, NA, NA, "1588304242863144960", NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, "…
$ quoted_status <list> [<data.frame[1 x 27]>], [<data.frame[1 x 27]>], [<data.frame[1 x 27]>], [<data.fram…
$ text <chr> "@SMAS presents the Annual Statistical Science Lecture on Thurs17Nov22 @UOW given by…
$ favorited_by <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ scopes <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ display_text_width <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ retweeted_status <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ quoted_status_permalink <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ quote_count <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ timestamp_ms <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ reply_count <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ filter_level <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ query <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ withheld_scope <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ withheld_copyright <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ withheld_in_countries <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ possibly_sensitive_appealable <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …rtweet version
packageVersion("rtweet")
[1] ‘1.0.2’Session info
sessionInfo()
R version 4.2.1 (2022-06-23)
Platform: x86_64-apple-darwin17.0 (64-bit)
Running under: macOS Monterey 12.6
Matrix products: default
LAPACK: /Library/Frameworks/R.framework/Versions/4.2/Resources/lib/libRlapack.dylib
locale:
[1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
attached base packages:
[1] stats graphics grDevices utils datasets methods base
other attached packages:
[1] stringr_1.4.1 dplyr_1.0.10 rtweet_1.0.2 RStatsJobsBot_0.1.0
loaded via a namespace (and not attached):
[1] rstudioapi_0.14 magrittr_2.0.3 hms_1.1.2 progress_1.2.2 bit_4.0.4 tidyselect_1.1.2
[7] R6_2.5.1 rlang_1.0.6 fansi_1.0.3 httr_1.4.3 tools_4.2.1 utf8_1.2.2
[13] cli_3.4.1 withr_2.5.0 askpass_1.1 ellipsis_0.3.2 bit64_4.0.5 openssl_2.0.2
[19] tibble_3.1.8 lifecycle_1.0.2 crayon_1.5.2 purrr_0.3.4 vctrs_0.4.2 curl_4.3.2
[25] glue_1.6.2 stringi_1.7.8 compiler_4.2.1 pillar_1.8.1 generics_0.1.3 prettyunits_1.1.1
[31] jsonlite_1.8.0 pkgconfig_2.0.3 llrs commented
Some of the fields you mention were removed since the release of 1.0.2. Have you updated the package?
You might benefit from reading this post about the changes in this version.
jcrodriguez1989 commented
This is perfect, thanks!
And sorry for not finding that post before submitting the issue.