/ai_hwk3

Primary LanguagePython

hwk3_tr

Pre-Processing Library: a Python library to perform preprocessing for a sentiment analysis task with a CNN + Embedding model.

methods:

  1. clean_text Remove RT, handler and url
  2. tokenize_text Also filter out stop words
  3. replace_token_with_index
  4. pad_sequence
  5. one_for_all Do all conversion at once