/Refugee-Issue-Text-Analysis

Analyzing prevalent topics of news media about refugee issue in South Korea and sentiment in the comments

Primary LanguagePythonMIT LicenseMIT

Refugee-Issue-Text-Analysis

Explore prevalent topics of news media about refugee issue in South Korea and sentiment in the comments

Process

  1. Parse HTML of online news article including the term 'refugee'(in Korean) in Naver and Daum (portals where serve most of the news articles in South Korea)

  2. Scrape news article and comments

  3. Classify topics of the article with unsupervised method (structural topic modeling)

  4. Caculates negative sentiment score of the user comments

  5. Compare the relationship between the topics and sentiments of the user comments.