MatthewWolff/TwitterScraper

Twitter Doesn't Allow Search Without Logging In - Causes Scraper To Find 0 Tweets

MatthewWolff opened this issue · 0 comments

MatthewWolff commented

Context

I noticed when running in --debug mode that the browser will re-direct to https://twitter.com/i/flow/login until the user logs in. Not sure what to do about this...

Possibilities

  • Implement some sort of login mechanism
    • cookies?
      • complicated
      • unclear how to implement—unsure if able to log in with just API credentials to browser...
    • make scraper provide username/password information?
      • simplest, but most insecure