Tools to scrape data
p-null opened this issue · 0 comments
p-null commented
Hi, i am wondering what tools did you use to scrape the twitter data?
The official API restrict a span of only one past week. And some python library like GetOldtweets only return results with too much noise, like 2017-12-30 17:09:53 $ BTC $ SPX $ NASDAQ $ DJIA $ CAC $ DAX $ FTSE $ JPM $ TSLA $ ES_F $ CL_F $ GC_F $ TLT $ WMT $ JNJ $ FB $ GOOGL $ MSFT $ INTC $ AMD $ TWTR $ NFLX $ AMZN $ MA $ AAPL $ MO $ PG $ GE $ BA $ UTX $ LOW $ HD $ ORCL $ CSCO $ VZ $ DIS $ PCLN $ TSLA $ USB $ AMGN $ SLB $ V $ ICT $ FTI $ IBM $ MS # bitcoin # speculations # GaryShillingpic.twitter.com/EZ4d6Fh6Fs
Or did you use some pre-processing techniques to eliminate such sequences?