keitakurita/twitter-past-crawler

Issues

• can't commence crawling

  #31 opened 3 years ago by DonLeeFK
  1

• Runtime error on Windows machine

  #24 opened 5 years ago by nnahito
  2

• FileNotFoundError: [Errno 2] No such file or directory: 'useragent_windows.dat'

  #27 opened 6 years ago by ChrisPalmerNZ
  2

• [blank]

  #30 opened 5 years ago by BradKML
  0

• Even the simplest example fails

  #28 opened 6 years ago by ChrisPalmerNZ
  0

• ENH: Change the html parser to lxml

  #23 opened 8 years ago by keitakurita
  0

• Profile and optimize the crawler

  #22 opened 8 years ago by keitakurita
  0

• Write a parser to get basic items from the tweet

  #2 opened 8 years ago by keitakurita
  0

• Handle connection error better

  #21 opened 8 years ago by keitakurita
  0

• Make the crawler available as a package from pip

  #19 opened 8 years ago by keitakurita
  0

• create list of user agents for windows

  #20 opened 8 years ago by keitakurita
  1

• write unit tests

  #10 opened 8 years ago by keitakurita
  0

• Update README

  #18 opened 8 years ago by keitakurita
  1

• find out why some tweet objects do not have text

  #17 opened 8 years ago by keitakurita
  0

• convert the links from a tweet into a format that is compatible with csv files

  #12 opened 8 years ago by keitakurita
  0

• allow the user to write their own html to tweet converter

  #13 opened 8 years ago by keitakurita
  0

• make clean text function actually clean the text

  #16 opened 8 years ago by keitakurita
  0

• write docstrings

  #11 opened 8 years ago by keitakurita
  0

• write a sample program that counts the word usage of any user based on input

  #15 opened 8 years ago by keitakurita
  0

• test the crawler to see how long it can keep crawling without errors

  #14 opened 8 years ago by keitakurita
  0

• Enable the user to choose how to handle each tweet generated by the parser

  #9 opened 8 years ago by keitakurita
  0

• Abstract process for converting tweets into a csv file

  #8 opened 8 years ago by keitakurita
  0

• get all the links from the html of the tweet

  #7 opened 8 years ago by keitakurita
  0

• Print the finish reason upon crawling end

  #5 opened 8 years ago by keitakurita
  0

• Examine which user agents can be used without error and which cannot

  #6 opened 8 years ago by keitakurita
  0

• Intialize the output file programatically

  #4 opened 8 years ago by keitakurita
  0

• Get the initial response to return a min_position to begin crawling with

  #3 opened 8 years ago by keitakurita
  0

• Get the initial request to return a 200 response

  #1 opened 8 years ago by keitakurita
  0