/Natural-Language-Processing

Natural Language Processing from text to embedding!

Primary LanguageJupyter Notebook

Text : The quick brown fox jumps over the lazy dog.

Machine : ['quick', 'brown', 'fox', 'jumps', 'lazy', 'dog']

What is NLP (Natural Language Processing)?

Natural language processing (NLP) is a subfield of linguistics, computer science, information engineering, and artificial intelligence concerned with the interactions between computers and human (natural) languages, in particular how to program computers to process and analyze large amounts of natural language data.(as per wikipedia)

Where NLP is used?

Speech recognition,document summarization, machine translation, spam detection, named entity recognition, question answering, autocomplete the way gmail does, predictive typing and many more...

[Normalization] of sentence → [Tokenization] → removal of [Stopwords]

[Name Entity Recognition][Bag of Words TF-IDF](Term-Frequency and Inverse Document Frequency)

READ Me:

TODO:

  • BERT/XLNET on colab on self train dataset
  • Transformers on colab on self train dataset