{
"cells": [
{
"cell_type": "markdown",
"metadata": {},
"source": [
"# このドキュメントの目的\n",
"\n",
"半手動で行うテキストへのタグ付けプロセスを、その手順を含めてまとめること。\n",
"\n",
"# 必要な環境情報\n",
"\n",
"- MacOS\n",
"- python3.6\n",
"- anaconda\n",
"- mecab-python3\n",
"\n",
"# 手順の概要\n",
"\n",
"### オペレーション_その１\n",
"\n",
"1. はじめにドキュメントをファイルに分けて用意します。\n",
"2. 読み込んだデータをMeCabで形態素解析して品詞分解する。(この品詞分解には独自にカスタマイズしたモジュールを使っています)\n",
"3. 2で検出した単語（＝品詞の自然活用系（ ×:飲める → ○：飲む ））を、スペース区切り文字列（わかち書き）に変換。\n",
"4. 3の結果をsklearnのtopic_modelを実行します。\n",
"5. 各ドキュメントの予測トピックカテゴリをファイルとして出力します。\n",
"\n",
"### オペレーション_その2\n",
"\n",
"1. オペレーション_その１で出力されたテキストのカテゴライズデータをエクセルで見ながら、手動でtagをつけたファイルを作成します。（半手動部分）\n",
"2. この時、全てのテキストにtagをつける必要はありません。パッと見て判断がついたものだけにします。\n",
"3. 手動でtagづけされたデータを再学習します。\n",
"4. まだtagを手動でつけていないテキストも含めて、tagを予測します。\n",
"5. 予測タグのデータがファイル出力されますので、間違った予測タグを修正します。\n",
"6. 修正したファイルを、3に入力し直して、もう一度再学習します。\n",
"7. 以下、3~6を繰り返して、精度を改善します。\n"
]
},
{
"cell_type": "code",
"execution_count": 1,
"metadata": {
"collapsed": true
},
"outputs": [],
"source": [
"from module.mecab_wrapper import keitaiso\n",
"import os\n",
"import re\n"
]
},
{
"cell_type": "code",
"execution_count": 2,
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"悪評が次から次へと溢れ出る川越シェフ 最近、TVでも人気者の川越シェフ。代官山のおしゃれなイタリアンレストランのオーナーシェフでありながら、タレントとも軽妙なトークを交わすマルチな才能で、TV業界でもその地位を不動のものとしつつある。また、その甘いマスクに魅せられた、「川越女子」なる固定ファンまで存在するという。 しかし、ここにきて川越シェフの悪評がどんどん噴出しているようだ。最近では、ミニストップの川越シェフプロデュースクリスマスケーキが、1万円という超高額で売り出されることが話題となった。 【関連記事】 ミニストップの川越シェフプロデュースクリスマスケーキがバカ高いと話題に http://news.livedoor.com/topics/detail/5899457/ 普通のケーキなら、原価は200円程度。川越シェフプロデュースだけに、多少豪華に作ってあるかもしれないが、それでも「ぼったくり」というネット上の反応が多かった。また、それ以上に、「有名になった途端、ここぞとばかりに金儲けしている」という声も散見された。 また、普段のマスコミ対応の悪さもかなりのものだ。数年前までは、川越シェフなどほとんど誰も知らないような状態だったが、有名となった今は手の平を返すように、週刊誌の記者なを見下すような態度が見られるようになったという。 マスコミのおかげで有名になっておきながら、恩知らずとはこのことだろう。 【関連記事】 シェフのタレント化はもうたくさん!? マスコミが嫌うタレントシェフ http://news.livedoor.com/topics/detail/5801160/ しかし、単なるシェフ風情が調子に乗ってしまうのも無理はない。何せ、「株式会社TATSUYA KAWAGOE」の年商は約9,000万円、さらにTVへの出演料も高額に上る。 また、6月にTV番組で「バツ2」の独身であることを告白している。あの甘いマスクに有名人とくれば、モテないはずはない。つまり、カネもオンナも“やりたい放題”なのだろう。 【関連記事】 離婚告白川越達也シェフ 週1ネイルサロン、収録時は口紅も http://news.livedoor.com/topics/detail/5655259/ 川越シェフの15才年下美人秘書「シェフとデキてる」説を否定 http://news.livedoor.com/topics/detail/5865240/ その天狗っぷりが盛んに報道されるようになった最近では、収録現場で、「はよやれや！」とブチギレすることもあるようで、現場で働くスタッフからの評判もかなり悪いのではないだろうか？ 【関連記事】 川越シェフが我慢の限界でブチギレ「はよやれや！ あとでこいよ……」 http://news.livedoor.com/topics/detail/5558182/ 肝心の料理の腕に関しては、「デパ地下の惣菜レベル」という意見もある。それを聞くと、TVでの上から目線の評論にも、疑問符が付いてしまう。いずれ化けの皮が剥がれても、もう十分儲けているので、本人としては「どうでもいい」のかもしれないが……。 【関連記事】 大人気イケメンシェフ 川越達也氏のカネと評判 http://news.livedoor.com/topics/detail/5858898/ そもそも、川越シェフに褒められた程度で“買い”に走ってしまう視聴者のレベルも問題である。こういった、メディアの戦略に面白いように引っかかる頭の残念な人には、かける言葉もないが、せいぜい日本の景気を良くするためにパーっとお金を使っていただきたいものだ。 【関連記事】 川越達也プロデュース商品が出まくりな件について / 川越ドッグフードも存在 http://news.livedoor.com/topics/detail/5828874/ 川越達也が好きすぎて毎日川越達也監修商品を食べている『川越女子』！ 川越達也メニューが出続けないと死ぬ http://news.livedoor.com/topics/detail/5759728/ 川越シェフのキムチに川越達也のドヤ顔が無くなり川越女子ブチギレ！「私を殺す気ですか」 http://news.livedoor.com/topics/detail/5801859/ やっぱり気になる！！川越達也シェフ http://news.livedoor.com/topics/detail/5571502/ \n"
]
}
],
"source": [
"# ドキュメントファイルの読み込み\n",
"DIR_TEXT_FILE = 'data/text/topic-news'\n",
"doc_files = [os.path.join(DIR_TEXT_FILE, f) for f in os.listdir(DIR_TEXT_FILE) if re.match('^topic-news-.*.txt$', f)]\n",
"doc_texts = list()\n",
"\n",
"# テキストの前処理関数を定義する\n",
"def remove_top2line(text):\n",
" # 初めの2行は記事のURLと掲載開始日時なので省く\n",
" text = ' '.join(text.split('\\n')[2:]) \n",
" return text\n",
" \n",
"def text_cleaning(text):\n",
" transform_dict = {',':'、', '\\t':' '}\n",
" for f,t in transform_dict.items():\n",
" text.replace(f, t)\n",
" return text\n",
"\n",
"for df in doc_files:\n",
" with open(df, 'r') as f:\n",
" text = f.read()\n",
" text = remove_top2line(text)\n",
" text = text_cleaning(text)\n",
" doc_texts.append(text)\n",
"\n",
"# 中身の確認\n",
"doc_files[0]\n",
"print( doc_texts[0] )"
]
},
{
"cell_type": "code",
"execution_count": 3,
"metadata": {},
"outputs": [
{
"data": {
"text/plain": [
"[[0, '名詞', '悪評'],\n",
" [2, '名詞', '次'],\n",
" [4, '名詞', '次'],\n",
" [9, '名詞', '川越'],\n",
" [10, '名詞', 'シェフ'],\n",
" [11, '名詞', '最近'],\n",
" [16, '名詞', '人気'],\n",
" [17, '名詞', '者'],\n",
" [19, '名詞', '川越'],\n",
" [20, '名詞', 'シェフ'],\n",
" [22, '名詞', '代官山'],\n",
" [24, '名詞', 'おしゃれ'],\n",
" [26, '名詞', 'イタリアン'],\n",
" [27, '名詞', 'レストラン'],\n",
" [29, '名詞', 'オーナー'],\n",
" [30, '名詞', 'シェフ'],\n",
" [35, '名詞', 'タレント'],\n",
" [37, '名詞', '軽妙'],\n",
" [39, '名詞', 'トーク'],\n",
" [42, '名詞', 'マルチ'],\n",
" [44, '名詞', '才能'],\n",
" [48, '名詞', '業界'],\n",
" [52, '名詞', '地位'],\n",
" [54, '名詞', '不動'],\n",
" [56, '名詞', 'もの'],\n",
" [66, '名詞', 'マスク'],\n",
" [73, '名詞', '川越'],\n",
" [74, '名詞', '女子'],\n",
" [77, '名詞', '固定'],\n",
" [78, '名詞', 'ファン'],\n",
" [80, '名詞', '存在'],\n",
" [87, '名詞', 'ここ'],\n",
" [91, '名詞', '川越'],\n",
" [92, '名詞', 'シェフ'],\n",
" [94, '名詞', '悪評'],\n",
" [97, '名詞', '噴出'],\n",
" [101, '名詞', 'よう'],\n",
" [104, '名詞', '最近'],\n",
" [108, '名詞', 'ミニストップ'],\n",
" [110, '名詞', '川越'],\n",
" [115, '名詞', '万'],\n",
" [116, '名詞', '円'],\n",
" [119, '名詞', '高額'],\n",
" [123, '名詞', 'こと'],\n",
" [125, '名詞', '話題'],\n",
" [131, '名詞', '関連'],\n",
" [132, '名詞', '記事'],\n",
" [134, '名詞', 'ミニストップ'],\n",
" [136, '名詞', '川越'],\n",
" [139, '名詞', 'バカ'],\n",
" [142, '名詞', '話題'],\n",
" [158, '名詞', '普通'],\n",
" [160, '名詞', 'ケーキ'],\n",
" [163, '名詞', '原価'],\n",
" [166, '名詞', '円'],\n",
" [167, '名詞', '程度'],\n",
" [169, '名詞', '川越'],\n",
" [170, '名詞', 'シェフ'],\n",
" [171, '名詞', 'プロデュース'],\n",
" [176, '名詞', '豪華'],\n",
" [190, '名詞', 'くり'],\n",
" [193, '名詞', 'ネット'],\n",
" [194, '名詞', '上'],\n",
" [196, '名詞', '反応'],\n",
" [203, '名詞', 'それ'],\n",
" [204, '名詞', '以上'],\n",
" [208, '名詞', '有名'],\n",
" [212, '名詞', '途端'],\n",
" [214, '名詞', 'ここ'],\n",
" [219, '名詞', '金儲け'],\n",
" [225, '名詞', '声'],\n",
" [227, '名詞', '散見'],\n",
" [234, '名詞', '普段'],\n",
" [236, '名詞', 'マスコミ'],\n",
" [237, '名詞', '対応'],\n",
" [240, '名詞', 'さ'],\n",
" [242, '名詞', 'かなり'],\n",
" [244, '名詞', 'もの'],\n",
" [247, '名詞', '数'],\n",
" [248, '名詞', '年'],\n",
" [249, '名詞', '前'],\n",
" [253, '名詞', '川越'],\n",
" [254, '名詞', 'シェフ'],\n",
" [257, '名詞', '誰'],\n",
" [261, '名詞', 'よう'],\n",
" [263, '名詞', '状態'],\n",
" [268, '名詞', '有名'],\n",
" [272, '名詞', '今'],\n",
" [274, '名詞', '手の平'],\n",
" [277, '名詞', 'よう'],\n",
" [280, '名詞', '週刊'],\n",
" [281, '名詞', '誌'],\n",
" [283, '名詞', '記者'],\n",
" [287, '名詞', 'よう'],\n",
" [289, '名詞', '態度'],\n",
" [293, '名詞', 'よう'],\n",
" [300, '名詞', 'マスコミ'],\n",
" [302, '名詞', 'おかげ'],\n",
" [304, '名詞', '有名'],\n",
" [311, '名詞', '恩知らず'],\n",
" [315, '名詞', 'こと'],\n",
" [320, '名詞', '関連'],\n",
" [321, '名詞', '記事'],\n",
" [323, '名詞', 'シェフ'],\n",
" [325, '名詞', 'タレント'],\n",
" [326, '名詞', '化'],\n",
" [329, '名詞', 'たくさん'],\n",
" [331, '名詞', 'マスコミ'],\n",
" [334, '名詞', 'タレント'],\n",
" [335, '名詞', 'シェフ'],\n",
" [354, '名詞', 'シェフ'],\n",
" [355, '名詞', '風情'],\n",
" [357, '名詞', '調子'],\n",
" [362, '名詞', 'の'],\n",
" [364, '名詞', '無理'],\n",
" [371, '名詞', '株式会社'],\n",
" [376, '名詞', '年商'],\n",
" [382, '名詞', '万'],\n",
" [383, '名詞', '円'],\n",
" [389, '名詞', '出演'],\n",
" [390, '名詞', '料'],\n",
" [392, '名詞', '高額'],\n",
" [399, '名詞', '月'],\n",
" [402, '名詞', '番組'],\n",
" [405, '名詞', 'バツ'],\n",
" [409, '名詞', '独身'],\n",
" [412, '名詞', 'こと'],\n",
" [414, '名詞', '告白'],\n",
" [421, '名詞', 'マスク'],\n",
" [423, '名詞', '有名人'],\n",
" [430, '名詞', 'はず'],\n",
" [436, '名詞', 'カネ'],\n",
" [443, '名詞', '放題'],\n",
" [446, '名詞', 'の'],\n",
" [451, '名詞', '関連'],\n",
" [452, '名詞', '記事'],\n",
" [454, '名詞', '離婚'],\n",
" [455, '名詞', '告白'],\n",
" [456, '名詞', '川越'],\n",
" [457, '名詞', '達也'],\n",
" [458, '名詞', 'シェフ'],\n",
" [460, '名詞', '週'],\n",
" [464, '名詞', '収録'],\n",
" [465, '名詞', '時'],\n",
" [467, '名詞', '口紅'],\n",
" [483, '名詞', '川越'],\n",
" [484, '名詞', 'シェフ'],\n",
" [487, '名詞', '才'],\n",
" [488, '名詞', '年下'],\n",
" [489, '名詞', '美人'],\n",
" [490, '名詞', '秘書'],\n",
" [492, '名詞', 'シェフ'],\n",
" [497, '名詞', '説'],\n",
" [499, '名詞', '否定'],\n",
" [515, '名詞', '天狗'],\n",
" [516, '名詞', 'っぷり'],\n",
" [518, '名詞', '盛ん'],\n",
" [520, '名詞', '報道'],\n",
" [523, '名詞', 'よう'],\n",
" [527, '名詞', '最近'],\n",
" [531, '名詞', '収録'],\n",
" [532, '名詞', '現場'],\n",
" [545, '名詞', 'こと'],\n",
" [548, '名詞', 'よう'],\n",
" [551, '名詞', '現場'],\n",
" [554, '名詞', 'スタッフ'],\n",
" [557, '名詞', '評判'],\n",
" [561, '名詞', 'の'],\n",
" [570, '名詞', '関連'],\n",
" [571, '名詞', '記事'],\n",
" [573, '名詞', '川越'],\n",
" [574, '名詞', 'シェフ'],\n",
" [576, '名詞', '我慢'],\n",
" [578, '名詞', '限界'],\n",
" [587, '名詞', 'あと'],\n",
" [608, '名詞', '肝心'],\n",
" [610, '名詞', '料理'],\n",
" [612, '名詞', '腕'],\n",
" [618, '名詞', '地下'],\n",
" [620, '名詞', '惣菜'],\n",
" [621, '名詞', 'レベル'],\n",
" [624, '名詞', '意見'],\n",
" [628, '名詞', 'それ'],\n",
" [636, '名詞', '上'],\n",
" [638, '名詞', '目線'],\n",
" [640, '名詞', '評論'],\n",
" [644, '名詞', '疑問符'],\n",
" [651, '名詞', '化けの皮'],\n",
" [658, '名詞', '十分'],\n",
" [664, '名詞', '本人'],\n",
" [672, '名詞', 'の'],\n",
" [681, '名詞', '関連'],\n",
" [682, '名詞', '記事'],\n",
" [684, '名詞', '大人気'],\n",
" [687, '名詞', '川越'],\n",
" [688, '名詞', '達也'],\n",
" [689, '名詞', '氏'],\n",
" [691, '名詞', 'カネ'],\n",
" [693, '名詞', '評判'],\n",
" [710, '名詞', '川越'],\n",
" [711, '名詞', 'シェフ'],\n",
" [716, '名詞', '程度'],\n",
" [719, '名詞', '買い'],\n",
" [725, '名詞', '視聴'],\n",
" [726, '名詞', '者'],\n",
" [728, '名詞', 'レベル'],\n",
" [730, '名詞', '問題'],\n",
" [738, '名詞', 'メディア'],\n",
" [740, '名詞', '戦略'],\n",
" [743, '名詞', 'よう'],\n",
" [746, '名詞', '頭'],\n",
" [748, '名詞', '残念'],\n",
" [750, '名詞', '人'],\n",
" [755, '名詞', '言葉'],\n",
" [761, '名詞', '日本'],\n",
" [763, '名詞', '景気'],\n",
" [767, '名詞', 'ため'],\n",
" [769, '名詞', 'パー'],\n",
" [771, '名詞', 'お金'],\n",
" [777, '名詞', 'もの'],\n",
" [781, '名詞', '関連'],\n",
" [782, '名詞', '記事'],\n",
" [784, '名詞', '川越'],\n",
" [785, '名詞', '達也'],\n",
" [786, '名詞', 'プロデュース'],\n",
" [787, '名詞', '商品'],\n",
" [792, '名詞', '件'],\n",
" [795, '名詞', '川越'],\n",
" [798, '名詞', '存在'],\n",
" [813, '名詞', '川越'],\n",
" [814, '名詞', '達也'],\n",
" [819, '名詞', '毎日'],\n",
" [820, '名詞', '川越'],\n",
" [821, '名詞', '達也'],\n",
" [822, '名詞', '監修'],\n",
" [823, '名詞', '商品'],\n",
" [829, '名詞', '川越'],\n",
" [830, '名詞', '女子'],\n",
" [833, '名詞', '川越'],\n",
" [834, '名詞', '達也'],\n",
" [835, '名詞', 'メニュー'],\n",
" [856, '名詞', '川越'],\n",
" [857, '名詞', 'シェフ'],\n",
" [859, '名詞', 'キムチ'],\n",
" [861, '名詞', '川越'],\n",
" [862, '名詞', '達也'],\n",
" [865, '名詞', '顔'],\n",
" [868, '名詞', '川越'],\n",
" [869, '名詞', '女子'],\n",
" [876, '名詞', '気'],\n",
" [895, '名詞', '気'],\n",
" [900, '名詞', '川越'],\n",
" [901, '名詞', '達也'],\n",
" [902, '名詞', 'シェフ']]"
]
},
"execution_count": 3,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"# 自作のmecab wrapperで形態素解析の設定を行う。\n",
"# この形態素解析のwrapperでは、動詞は自動的に自然活用形に変換される。\n",
"\n",
"kei = keitaiso(use_PoW=['名詞'], stop_words=['彼女', '彼', '私', 'する', '*'])\n",
"\n",
"# 以下、実行サンプル\n",
"kei.tokenize(doc_texts[0])"
]
},
{
"cell_type": "code",
"execution_count": 4,
"metadata": {},
"outputs": [
{
"data": {
"text/plain": [
"'悪評 次 次 川越 シェフ 最近 人気 者 川越 シェフ 代官山 おしゃれ イタリアン レストラン オーナー シェフ タレント 軽妙 トーク マルチ 才能 業界 地位 不動 もの マスク 川越 女子 固定 ファン 存在 ここ 川越 シェフ 悪評 噴出 よう 最近 ミニストップ 川越 万 円 高額 こと 話題 関連 記事 ミニストップ 川越 バカ 話題 普通 ケーキ 原価 円 程度 川越 シェフ プロデュース 豪華 くり ネット 上 反応 それ 以上 有名 途端 ここ 金儲け 声 散見 普段 マスコミ 対応 さ かなり もの 数 年 前 川越 シェフ 誰 よう 状態 有名 今 手の平 よう 週刊 誌 記者 よう 態度 よう マスコミ おかげ 有名 恩知らず こと 関連 記事 シェフ タレント 化 たくさん マスコミ タレント シェフ シェフ 風情 調子 の 無理 株式会社 年商 万 円 出演 料 高額 月 番組 バツ 独身 こと 告白 マスク 有名人 はず カネ 放題 の 関連 記事 離婚 告白 川越 達也 シェフ 週 収録 時 口紅 川越 シェフ 才 年下 美人 秘書 シェフ 説 否定 天狗 っぷり 盛ん 報道 よう 最近 収録 現場 こと よう 現場 スタッフ 評判 の 関連 記事 川越 シェフ 我慢 限界 あと 肝心 料理 腕 地下 惣菜 レベル 意見 それ 上 目線 評論 疑問符 化けの皮 十分 本人 の 関連 記事 大人気 川越 達也 氏 カネ 評判 川越 シェフ 程度 買い 視聴 者 レベル 問題 メディア 戦略 よう 頭 残念 人 言葉 日本 景気 ため パー お金 もの 関連 記事 川越 達也 プロデュース 商品 件 川越 存在 川越 達也 毎日 川越 達也 監修 商品 川越 女子 川越 達也 メニュー 川越 シェフ キムチ 川越 達也 顔 川越 女子 気 気 川越 達也 シェフ'"
]
},
"execution_count": 4,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"# doc_textsをスペース区切り文字列に変換する。\n",
"convert_wakachi = lambda text: ' '.join([token[2] for token in kei.tokenize(text)])\n",
"doc_wakachis = [convert_wakachi(text) for text in doc_texts]\n",
"\n",
"doc_wakachis[0]"
]
},
{
"cell_type": "code",
"execution_count": 5,
"metadata": {},
"outputs": [],
"source": [
"# doc - word matrix を作成する（bags of words, 単なる出現数カウント）\n",
"from sklearn.feature_extraction.text import CountVectorizer\n",
"count_vectorizer = CountVectorizer(\n",
" max_df=0.50, # 50%以上のdocに含まれる単語は無視する。\n",
" min_df=0.05, # 5%以下のdocにしか含まれない単語は無視する。 \n",
" )\n",
"doc_word_matrix = count_vectorizer.fit_transform(doc_wakachis)\n",
"\n",
"# 学習済みの count_vectorizer はpickleで保存しておく。\n",
"import pickle\n",
"file_name = 'data/processed/count_vectorizer.pickle'\n",
"with open(file_name, 'wb') as f:\n",
" pickle.dump(count_vectorizer, f)\n"
]
},
{
"cell_type": "code",
"execution_count": 6,
"metadata": {},
"outputs": [
{
"data": {
"text/html": [
"<div>\n",
"<style scoped>\n",
" .dataframe tbody tr th:only-of-type {\n",
" vertical-align: middle;\n",
" }\n",
"\n",
" .dataframe tbody tr th {\n",
" vertical-align: top;\n",
" }\n",
"\n",
" .dataframe thead th {\n",
" text-align: right;\n",
" }\n",
"</style>\n",
"<table border=\"1\" class=\"dataframe\">\n",
" <thead>\n",
" <tr style=\"text-align: right;\">\n",
" <th></th>\n",
" <th>topic00</th>\n",
" <th>topic01</th>\n",
" <th>topic02</th>\n",
" <th>doc_file</th>\n",
" <th>doc_text</th>\n",
" </tr>\n",
" </thead>\n",
" <tbody>\n",
" <tr>\n",
" <th>0</th>\n",
" <td>0.783779</td>\n",
" <td>0.048281</td>\n",
" <td>0.167940</td>\n",
" <td>data/text/topic-news/topic-news-5903225.txt</td>\n",
" <td>悪評が次から次へと溢れ出る川越シェフ 最近、TVでも人気者の川越シェフ。代官山のおしゃれなイ...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>1</th>\n",
" <td>0.991185</td>\n",
" <td>0.004218</td>\n",
" <td>0.004596</td>\n",
" <td>data/text/topic-news/topic-news-5903373.txt</td>\n",
" <td>写真が流出し“堕ちていった”アイドルたち アイドルが男性と一緒に写ったプリクラやニャンニャン...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>2</th>\n",
" <td>0.697792</td>\n",
" <td>0.007239</td>\n",
" <td>0.294969</td>\n",
" <td>data/text/topic-news/topic-news-5907376.txt</td>\n",
" <td>紳助とたけしの明暗を分けたものとは 今年で20回目を迎えたTBSのオールスター感謝祭に、1回...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>3</th>\n",
" <td>0.726012</td>\n",
" <td>0.075422</td>\n",
" <td>0.198567</td>\n",
" <td>data/text/topic-news/topic-news-5908396.txt</td>\n",
" <td>ガールズバンドSCANDAL、今年着た水着を告白 9月24日から10月2日までの4日間、お台...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>4</th>\n",
" <td>0.841284</td>\n",
" <td>0.005133</td>\n",
" <td>0.153583</td>\n",
" <td>data/text/topic-news/topic-news-5910461.txt</td>\n",
" <td>読売テレビ広報部長の無礼千万メールにジャーナリスト烏賀陽（うがや）弘道さんが激怒 ジャー...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>5</th>\n",
" <td>0.019118</td>\n",
" <td>0.303659</td>\n",
" <td>0.677223</td>\n",
" <td>data/text/topic-news/topic-news-5910462.txt</td>\n",
" <td>iPhone5、auに独占供給か 米国版ウォールストリートジャーナルが報じたiPhone5に...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>6</th>\n",
" <td>0.021851</td>\n",
" <td>0.956097</td>\n",
" <td>0.022052</td>\n",
" <td>data/text/topic-news/topic-news-5911453.txt</td>\n",
" <td>“辛ラーメンにゴキブリ”ネットで話題に 日本でも目にすることが多くなった韓国のインスタントラ...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>7</th>\n",
" <td>0.301523</td>\n",
" <td>0.626453</td>\n",
" <td>0.072024</td>\n",
" <td>data/text/topic-news/topic-news-5913367.txt</td>\n",
" <td>韓国がハブられたiPhone4S発表会 米アップルが4日に発表したiPhone4S。iPh...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>8</th>\n",
" <td>0.125260</td>\n",
" <td>0.017644</td>\n",
" <td>0.857095</td>\n",
" <td>data/text/topic-news/topic-news-5913447.txt</td>\n",
" <td>GREEの退会引き止めにユーザーの不満が爆発 グリー株式会社が運営するSNS「GREE」の退...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>9</th>\n",
" <td>0.979616</td>\n",
" <td>0.008712</td>\n",
" <td>0.011671</td>\n",
" <td>data/text/topic-news/topic-news-5914835.txt</td>\n",
" <td>毎年話題になるベストジーニスト賞の偏り 今年のベストジーニスト一般選出部門に相葉雅紀、黒木メ...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>10</th>\n",
" <td>0.959785</td>\n",
" <td>0.018268</td>\n",
" <td>0.021946</td>\n",
" <td>data/text/topic-news/topic-news-5918064.txt</td>\n",
" <td>みのもんた引退で変わる芸能界の勢力図 東スポは、林家三平と国分佐智子の披露宴に出席してほろ酔...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>11</th>\n",
" <td>0.013668</td>\n",
" <td>0.175755</td>\n",
" <td>0.810577</td>\n",
" <td>data/text/topic-news/topic-news-5921231.txt</td>\n",
" <td>チェルノブイリ再来か、福島で恐れていた事態が遂に… 福島第一原発事故から約半年、ついに恐れて...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>12</th>\n",
" <td>0.675838</td>\n",
" <td>0.072343</td>\n",
" <td>0.251819</td>\n",
" <td>data/text/topic-news/topic-news-5927166.txt</td>\n",
" <td>ゆうこりん、ハワイでの結婚写真を公開 タレントの小倉優子（27）が、ヘアメークアーティスト・...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>13</th>\n",
" <td>0.864931</td>\n",
" <td>0.125192</td>\n",
" <td>0.009877</td>\n",
" <td>data/text/topic-news/topic-news-5927208.txt</td>\n",
" <td>HEY！HEY！HEY！に寄せられたメッセージがK-POP押しばかり… 10日に放送されたフ...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>14</th>\n",
" <td>0.978147</td>\n",
" <td>0.010085</td>\n",
" <td>0.011768</td>\n",
" <td>data/text/topic-news/topic-news-5927215.txt</td>\n",
" <td>吉本の“タテ”の実態 ダウンタウンのガキの使いやあらへんで！！”10月9日放送回で、ダウンタ...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>15</th>\n",
" <td>0.975393</td>\n",
" <td>0.012167</td>\n",
" <td>0.012441</td>\n",
" <td>data/text/topic-news/topic-news-5927968.txt</td>\n",
" <td>安めぐみと結婚報道の東ＭＡＸ、生放送で思わず「結婚したんだよ！」と口走る 安めぐみとの結婚が...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>16</th>\n",
" <td>0.808134</td>\n",
" <td>0.085173</td>\n",
" <td>0.106692</td>\n",
" <td>data/text/topic-news/topic-news-5928611.txt</td>\n",
" <td>ついに萌えキャラに手を出し始めた野球界 球界のマスコットキャラと言えば中日ドラゴンズの「ド...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>17</th>\n",
" <td>0.046439</td>\n",
" <td>0.462378</td>\n",
" <td>0.491184</td>\n",
" <td>data/text/topic-news/topic-news-5930156.txt</td>\n",
" <td>米ファンドがすかいらーくを買収 米ファンド、ベインキャピタルがすかいらーく買収で合意したと日...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>18</th>\n",
" <td>0.948240</td>\n",
" <td>0.024846</td>\n",
" <td>0.026914</td>\n",
" <td>data/text/topic-news/topic-news-5930399.txt</td>\n",
" <td>漫画家の青山景さんが自殺か 講談社イブニングで漫画を連載していた漫画家の青山景さんが自殺した...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>19</th>\n",
" <td>0.102666</td>\n",
" <td>0.103415</td>\n",
" <td>0.793919</td>\n",
" <td>data/text/topic-news/topic-news-5931121.txt</td>\n",
" <td>横浜で放射性物質ストロンチウムを検出、横浜市内では初 放射性物質のストロンチウムが横浜で検出...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>20</th>\n",
" <td>0.724867</td>\n",
" <td>0.007789</td>\n",
" <td>0.267344</td>\n",
" <td>data/text/topic-news/topic-news-5931153.txt</td>\n",
" <td>ＡＫＢ大島優子に非難殺到 「性格が悪すぎる」 インターネット掲示板２ちゃんねるで、AKB4...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>21</th>\n",
" <td>0.288591</td>\n",
" <td>0.009958</td>\n",
" <td>0.701451</td>\n",
" <td>data/text/topic-news/topic-news-5931164.txt</td>\n",
" <td>2ちゃんねるの創設者ひろゆきの発言で波紋 2ちゃんねるの創設者として知られる西村博之氏がtw...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>22</th>\n",
" <td>0.124518</td>\n",
" <td>0.758792</td>\n",
" <td>0.116689</td>\n",
" <td>data/text/topic-news/topic-news-5931334.txt</td>\n",
" <td>角川グループがメディアファクトリーを買収 リクルート傘下だったメディアファクトリーが角川グル...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>23</th>\n",
" <td>0.361225</td>\n",
" <td>0.019461</td>\n",
" <td>0.619314</td>\n",
" <td>data/text/topic-news/topic-news-5931335.txt</td>\n",
" <td>ＮＨＫ広報局がTwitterで皮肉タップリ 今やＮＨＫ＝「視聴者の皆様のための優等生」では...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>24</th>\n",
" <td>0.716994</td>\n",
" <td>0.242888</td>\n",
" <td>0.040118</td>\n",
" <td>data/text/topic-news/topic-news-5933217.txt</td>\n",
" <td>iOS5アップデートで大混乱 日本時間13日未明（米国時間12日）、iOS4を大型アップデ...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>25</th>\n",
" <td>0.018010</td>\n",
" <td>0.018835</td>\n",
" <td>0.963155</td>\n",
" <td>data/text/topic-news/topic-news-5933360.txt</td>\n",
" <td>メディアに情報操作されるウォール街占拠デモの実態 米ニューヨークのウォール街で始まった**...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>26</th>\n",
" <td>0.248381</td>\n",
" <td>0.374934</td>\n",
" <td>0.376685</td>\n",
" <td>data/text/topic-news/topic-news-5934144.txt</td>\n",
" <td>千葉県船橋市で毎時5.82マイクロシーベルトを検出 千葉県船橋市にある「ふなばしアンデルセン...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>27</th>\n",
" <td>0.004974</td>\n",
" <td>0.802660</td>\n",
" <td>0.192365</td>\n",
" <td>data/text/topic-news/topic-news-5934315.txt</td>\n",
" <td>ピザの起源は“韓国”とするCMが話題に ピザの起源を韓国だとする広告動画を韓国のピザ会社「ミ...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>28</th>\n",
" <td>0.882995</td>\n",
" <td>0.020719</td>\n",
" <td>0.096286</td>\n",
" <td>data/text/topic-news/topic-news-5934332.txt</td>\n",
" <td>たけしが結婚披露宴でタブーに触れる ビートたけしの、林家三平の結婚披露宴での祝辞全文を書き起...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>29</th>\n",
" <td>0.977453</td>\n",
" <td>0.010051</td>\n",
" <td>0.012496</td>\n",
" <td>data/text/topic-news/topic-news-5934334.txt</td>\n",
" <td>アンジャッシュ渡部の発言に「最低！」の声が続出 10月12日放送「グータンヌーボ」で新企画「...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>...</th>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>740</th>\n",
" <td>0.734489</td>\n",
" <td>0.250698</td>\n",
" <td>0.014813</td>\n",
" <td>data/text/topic-news/topic-news-6859857.txt</td>\n",
" <td>青木裕子アナのハプニング、ネットでは「ギャグかと思うほど見事」「かわいい」 15日に放送され...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>741</th>\n",
" <td>0.015324</td>\n",
" <td>0.825540</td>\n",
" <td>0.159136</td>\n",
" <td>data/text/topic-news/topic-news-6859873.txt</td>\n",
" <td>竹島まで泳ぐもパニック障害に。ネットでは呆れる声が続々と 15日、韓国人歌手の金章勲（キム・...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>742</th>\n",
" <td>0.008520</td>\n",
" <td>0.982225</td>\n",
" <td>0.009254</td>\n",
" <td>data/text/topic-news/topic-news-6860367.txt</td>\n",
" <td>韓国政府“野田内閣と対話中断宣言”、日韓通貨スワップ中断は“日本も打撃” 16日、複数の韓...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>743</th>\n",
" <td>0.006808</td>\n",
" <td>0.777772</td>\n",
" <td>0.215420</td>\n",
" <td>data/text/topic-news/topic-news-6861303.txt</td>\n",
" <td>李明博大統領の“嘘”に韓国ネットユーザーから非難相次ぐ 韓国のニュースサイト「ビューズ・アン...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>744</th>\n",
" <td>0.007116</td>\n",
" <td>0.984996</td>\n",
" <td>0.007888</td>\n",
" <td>data/text/topic-news/topic-news-6864824.txt</td>\n",
" <td>【韓国ニュース】靖国神社でデモを行った韓国人が韓国でも話題に 韓国ユーザーからは怒りの声相次...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>745</th>\n",
" <td>0.972557</td>\n",
" <td>0.013574</td>\n",
" <td>0.013869</td>\n",
" <td>data/text/topic-news/topic-news-6866172.txt</td>\n",
" <td>HKT48、メンバー5人の脱退を発表 18日、秋元康がプロデュースをするアイドルグループで、...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>746</th>\n",
" <td>0.554787</td>\n",
" <td>0.384739</td>\n",
" <td>0.060474</td>\n",
" <td>data/text/topic-news/topic-news-6869775.txt</td>\n",
" <td>さんま、マンUに「日本人は入ってほしくない」と発言し、ひんしゅく買う 18日に放送されたラジ...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>747</th>\n",
" <td>0.011922</td>\n",
" <td>0.976474</td>\n",
" <td>0.011604</td>\n",
" <td>data/text/topic-news/topic-news-6871429.txt</td>\n",
" <td>【韓国ニュース】韓国に“日本人出入禁止”のネットカフェ 19日、韓国のネット掲示板には「ネ...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>748</th>\n",
" <td>0.571286</td>\n",
" <td>0.350414</td>\n",
" <td>0.078300</td>\n",
" <td>data/text/topic-news/topic-news-6873254.txt</td>\n",
" <td>五輪メダリストに無茶な要求をする番組に、ユーザは「中継が見苦しい」 20日、「情報ライブ ミ...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>749</th>\n",
" <td>0.011670</td>\n",
" <td>0.728831</td>\n",
" <td>0.259499</td>\n",
" <td>data/text/topic-news/topic-news-6874561.txt</td>\n",
" <td>【韓国ニュース】韓国のコメディアン、田村淳に「黙れ、おっさん」 20日未明、韓国のコメディア...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>750</th>\n",
" <td>0.013198</td>\n",
" <td>0.229431</td>\n",
" <td>0.757371</td>\n",
" <td>data/text/topic-news/topic-news-6877206.txt</td>\n",
" <td>室伏広治、母親の生活保護受給がネットで物議を醸す 22日、Web版「女性自身」は、ロンドン五...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>751</th>\n",
" <td>0.096281</td>\n",
" <td>0.336996</td>\n",
" <td>0.566723</td>\n",
" <td>data/text/topic-news/topic-news-6877423.txt</td>\n",
" <td>宇多田が渡航者に注意を喚起「犯罪者の目線でものを見るのも大事」 17日、ルーマニアの首都ブカ...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>752</th>\n",
" <td>0.224394</td>\n",
" <td>0.495954</td>\n",
" <td>0.279652</td>\n",
" <td>data/text/topic-news/topic-news-6880928.txt</td>\n",
" <td>逮捕されたソフトバンク・堂上隼人に非難が殺到 23日、ソフトバンクの捕手・堂上隼人が強制わい...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>753</th>\n",
" <td>0.904681</td>\n",
" <td>0.078472</td>\n",
" <td>0.016847</td>\n",
" <td>data/text/topic-news/topic-news-6883210.txt</td>\n",
" <td>北朝鮮が元専属料理人に接触、“身の安全を徹底的に担保する”と訪朝打診 23日放送されたTBS...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>754</th>\n",
" <td>0.974762</td>\n",
" <td>0.010956</td>\n",
" <td>0.014283</td>\n",
" <td>data/text/topic-news/topic-news-6886563.txt</td>\n",
" <td>AKB48出演の「ぷっちょ」新CMがまたもや物議 AKB48メンバーが出演する「ぷっちょ」の...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>755</th>\n",
" <td>0.567471</td>\n",
" <td>0.116738</td>\n",
" <td>0.315791</td>\n",
" <td>data/text/topic-news/topic-news-6886897.txt</td>\n",
" <td>訪朝した藤本氏、「金正恩氏は許してくれたが、藤本殺してやろうというのがいっぱいいる」 24日...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>756</th>\n",
" <td>0.009150</td>\n",
" <td>0.980643</td>\n",
" <td>0.010206</td>\n",
" <td>data/text/topic-news/topic-news-6886968.txt</td>\n",
" <td>英国でも報じられる尖閣問題 反日デモの日本車破壊には疑問の声も 英国紙「デイリー・メール」は...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>757</th>\n",
" <td>0.422467</td>\n",
" <td>0.016307</td>\n",
" <td>0.561227</td>\n",
" <td>data/text/topic-news/topic-news-6893593.txt</td>\n",
" <td>ファーガソン監督のスコットランド訛りに苦戦する香川真司 現地ファンからは同情の声も イギリス...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>758</th>\n",
" <td>0.007269</td>\n",
" <td>0.985457</td>\n",
" <td>0.007274</td>\n",
" <td>data/text/topic-news/topic-news-6895397.txt</td>\n",
" <td>【韓国ニュース】韓国の地方議会に対馬の領有権を主張する決議案 竹島の領有権を巡る日韓の緊張が...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>759</th>\n",
" <td>0.698840</td>\n",
" <td>0.007707</td>\n",
" <td>0.293454</td>\n",
" <td>data/text/topic-news/topic-news-6895782.txt</td>\n",
" <td>有吉弘行が平成ノブシコブシ・吉村崇のブログ炎上に言及 お笑い芸人の有吉弘行が、26日に放送さ...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>760</th>\n",
" <td>0.016180</td>\n",
" <td>0.656395</td>\n",
" <td>0.327425</td>\n",
" <td>data/text/topic-news/topic-news-6897310.txt</td>\n",
" <td>【韓国ニュース】 敗訴の影響か…サムスン「ギャラクシーS3」の販売価格が4分の1に 韓国のニ...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>761</th>\n",
" <td>0.007476</td>\n",
" <td>0.828979</td>\n",
" <td>0.163545</td>\n",
" <td>data/text/topic-news/topic-news-6897478.txt</td>\n",
" <td>英国でも報じられた日韓の関係 ユーザーからは「日本がかわいそうだ」の声も 24日、ロイター通...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>762</th>\n",
" <td>0.020266</td>\n",
" <td>0.018384</td>\n",
" <td>0.961350</td>\n",
" <td>data/text/topic-news/topic-news-6899227.txt</td>\n",
" <td>園山真希絵が経営する料理店を閉店、その経緯に非難の声 29日、料理研究家の園山真希絵が、自身...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>763</th>\n",
" <td>0.895600</td>\n",
" <td>0.006678</td>\n",
" <td>0.097721</td>\n",
" <td>data/text/topic-news/topic-news-6899432.txt</td>\n",
" <td>伊集院光がラジオで「24時間テレビ」について“本音”を語る 27日、伊集院光がラジオ番組「J...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>764</th>\n",
" <td>0.503149</td>\n",
" <td>0.482884</td>\n",
" <td>0.013967</td>\n",
" <td>data/text/topic-news/topic-news-6903121.txt</td>\n",
" <td>吉高由里子の韓国ドラマ出演に疑問の声相次ぐ 30日、女優の吉高由里子が、韓国の連続ドラマに出...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>765</th>\n",
" <td>0.496095</td>\n",
" <td>0.009764</td>\n",
" <td>0.494141</td>\n",
" <td>data/text/topic-news/topic-news-6903190.txt</td>\n",
" <td>爆笑問題・田中裕二も驚く「ひるおび!」での恵俊彰の“天然”ぶり 28日に放送された「JUN...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>766</th>\n",
" <td>0.471810</td>\n",
" <td>0.016679</td>\n",
" <td>0.511511</td>\n",
" <td>data/text/topic-news/topic-news-6907153.txt</td>\n",
" <td>黒田勇樹のDV騒動 ネット掲示板では冷ややかな声も 30日、元俳優の黒田勇樹が、妻の中村瑠衣...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>767</th>\n",
" <td>0.097161</td>\n",
" <td>0.387227</td>\n",
" <td>0.515612</td>\n",
" <td>data/text/topic-news/topic-news-6909425.txt</td>\n",
" <td>サムスンのアンドロイド搭載カメラが韓国で話題に 韓国のIT専門ニュースサイト「ブロター・ネッ...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>768</th>\n",
" <td>0.012722</td>\n",
" <td>0.655921</td>\n",
" <td>0.331357</td>\n",
" <td>data/text/topic-news/topic-news-6909453.txt</td>\n",
" <td>米紙も注目したゲーム「竹島争奪戦」 米紙「ウォール・ストリート・ジャーナル」は29日、「竹島...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>769</th>\n",
" <td>0.952614</td>\n",
" <td>0.024315</td>\n",
" <td>0.023072</td>\n",
" <td>data/text/topic-news/topic-news-6918105.txt</td>\n",
" <td>ジャンプ連載漫画が終了に、ユーザが新たな提案!? 『ONE PIECE』や『NARUTO』、...</td>\n",
" </tr>\n",
" </tbody>\n",
"</table>\n",
"<p>770 rows × 5 columns</p>\n",
"</div>"
],
"text/plain": [
" topic00 topic01 topic02 \\\n",
"0 0.783779 0.048281 0.167940 \n",
"1 0.991185 0.004218 0.004596 \n",
"2 0.697792 0.007239 0.294969 \n",
"3 0.726012 0.075422 0.198567 \n",
"4 0.841284 0.005133 0.153583 \n",
"5 0.019118 0.303659 0.677223 \n",
"6 0.021851 0.956097 0.022052 \n",
"7 0.301523 0.626453 0.072024 \n",
"8 0.125260 0.017644 0.857095 \n",
"9 0.979616 0.008712 0.011671 \n",
"10 0.959785 0.018268 0.021946 \n",
"11 0.013668 0.175755 0.810577 \n",
"12 0.675838 0.072343 0.251819 \n",
"13 0.864931 0.125192 0.009877 \n",
"14 0.978147 0.010085 0.011768 \n",
"15 0.975393 0.012167 0.012441 \n",
"16 0.808134 0.085173 0.106692 \n",
"17 0.046439 0.462378 0.491184 \n",
"18 0.948240 0.024846 0.026914 \n",
"19 0.102666 0.103415 0.793919 \n",
"20 0.724867 0.007789 0.267344 \n",
"21 0.288591 0.009958 0.701451 \n",
"22 0.124518 0.758792 0.116689 \n",
"23 0.361225 0.019461 0.619314 \n",
"24 0.716994 0.242888 0.040118 \n",
"25 0.018010 0.018835 0.963155 \n",
"26 0.248381 0.374934 0.376685 \n",
"27 0.004974 0.802660 0.192365 \n",
"28 0.882995 0.020719 0.096286 \n",
"29 0.977453 0.010051 0.012496 \n",
".. ... ... ... \n",
"740 0.734489 0.250698 0.014813 \n",
"741 0.015324 0.825540 0.159136 \n",
"742 0.008520 0.982225 0.009254 \n",
"743 0.006808 0.777772 0.215420 \n",
"744 0.007116 0.984996 0.007888 \n",
"745 0.972557 0.013574 0.013869 \n",
"746 0.554787 0.384739 0.060474 \n",
"747 0.011922 0.976474 0.011604 \n",
"748 0.571286 0.350414 0.078300 \n",
"749 0.011670 0.728831 0.259499 \n",
"750 0.013198 0.229431 0.757371 \n",
"751 0.096281 0.336996 0.566723 \n",
"752 0.224394 0.495954 0.279652 \n",
"753 0.904681 0.078472 0.016847 \n",
"754 0.974762 0.010956 0.014283 \n",
"755 0.567471 0.116738 0.315791 \n",
"756 0.009150 0.980643 0.010206 \n",
"757 0.422467 0.016307 0.561227 \n",
"758 0.007269 0.985457 0.007274 \n",
"759 0.698840 0.007707 0.293454 \n",
"760 0.016180 0.656395 0.327425 \n",
"761 0.007476 0.828979 0.163545 \n",
"762 0.020266 0.018384 0.961350 \n",
"763 0.895600 0.006678 0.097721 \n",
"764 0.503149 0.482884 0.013967 \n",
"765 0.496095 0.009764 0.494141 \n",
"766 0.471810 0.016679 0.511511 \n",
"767 0.097161 0.387227 0.515612 \n",
"768 0.012722 0.655921 0.331357 \n",
"769 0.952614 0.024315 0.023072 \n",
"\n",
" doc_file \\\n",
"0 data/text/topic-news/topic-news-5903225.txt \n",
"1 data/text/topic-news/topic-news-5903373.txt \n",
"2 data/text/topic-news/topic-news-5907376.txt \n",
"3 data/text/topic-news/topic-news-5908396.txt \n",
"4 data/text/topic-news/topic-news-5910461.txt \n",
"5 data/text/topic-news/topic-news-5910462.txt \n",
"6 data/text/topic-news/topic-news-5911453.txt \n",
"7 data/text/topic-news/topic-news-5913367.txt \n",
"8 data/text/topic-news/topic-news-5913447.txt \n",
"9 data/text/topic-news/topic-news-5914835.txt \n",
"10 data/text/topic-news/topic-news-5918064.txt \n",
"11 data/text/topic-news/topic-news-5921231.txt \n",
"12 data/text/topic-news/topic-news-5927166.txt \n",
"13 data/text/topic-news/topic-news-5927208.txt \n",
"14 data/text/topic-news/topic-news-5927215.txt \n",
"15 data/text/topic-news/topic-news-5927968.txt \n",
"16 data/text/topic-news/topic-news-5928611.txt \n",
"17 data/text/topic-news/topic-news-5930156.txt \n",
"18 data/text/topic-news/topic-news-5930399.txt \n",
"19 data/text/topic-news/topic-news-5931121.txt \n",
"20 data/text/topic-news/topic-news-5931153.txt \n",
"21 data/text/topic-news/topic-news-5931164.txt \n",
"22 data/text/topic-news/topic-news-5931334.txt \n",
"23 data/text/topic-news/topic-news-5931335.txt \n",
"24 data/text/topic-news/topic-news-5933217.txt \n",
"25 data/text/topic-news/topic-news-5933360.txt \n",
"26 data/text/topic-news/topic-news-5934144.txt \n",
"27 data/text/topic-news/topic-news-5934315.txt \n",
"28 data/text/topic-news/topic-news-5934332.txt \n",
"29 data/text/topic-news/topic-news-5934334.txt \n",
".. ... \n",
"740 data/text/topic-news/topic-news-6859857.txt \n",
"741 data/text/topic-news/topic-news-6859873.txt \n",
"742 data/text/topic-news/topic-news-6860367.txt \n",
"743 data/text/topic-news/topic-news-6861303.txt \n",
"744 data/text/topic-news/topic-news-6864824.txt \n",
"745 data/text/topic-news/topic-news-6866172.txt \n",
"746 data/text/topic-news/topic-news-6869775.txt \n",
"747 data/text/topic-news/topic-news-6871429.txt \n",
"748 data/text/topic-news/topic-news-6873254.txt \n",
"749 data/text/topic-news/topic-news-6874561.txt \n",
"750 data/text/topic-news/topic-news-6877206.txt \n",
"751 data/text/topic-news/topic-news-6877423.txt \n",
"752 data/text/topic-news/topic-news-6880928.txt \n",
"753 data/text/topic-news/topic-news-6883210.txt \n",
"754 data/text/topic-news/topic-news-6886563.txt \n",
"755 data/text/topic-news/topic-news-6886897.txt \n",
"756 data/text/topic-news/topic-news-6886968.txt \n",
"757 data/text/topic-news/topic-news-6893593.txt \n",
"758 data/text/topic-news/topic-news-6895397.txt \n",
"759 data/text/topic-news/topic-news-6895782.txt \n",
"760 data/text/topic-news/topic-news-6897310.txt \n",
"761 data/text/topic-news/topic-news-6897478.txt \n",
"762 data/text/topic-news/topic-news-6899227.txt \n",
"763 data/text/topic-news/topic-news-6899432.txt \n",
"764 data/text/topic-news/topic-news-6903121.txt \n",
"765 data/text/topic-news/topic-news-6903190.txt \n",
"766 data/text/topic-news/topic-news-6907153.txt \n",
"767 data/text/topic-news/topic-news-6909425.txt \n",
"768 data/text/topic-news/topic-news-6909453.txt \n",
"769 data/text/topic-news/topic-news-6918105.txt \n",
"\n",
" doc_text \n",
"0 悪評が次から次へと溢れ出る川越シェフ 最近、TVでも人気者の川越シェフ。代官山のおしゃれなイ... \n",
"1 写真が流出し“堕ちていった”アイドルたち アイドルが男性と一緒に写ったプリクラやニャンニャン... \n",
"2 紳助とたけしの明暗を分けたものとは 今年で20回目を迎えたTBSのオールスター感謝祭に、1回... \n",
"3 ガールズバンドSCANDAL、今年着た水着を告白 9月24日から10月2日までの4日間、お台... \n",
"4 読売テレビ広報部長の無礼千万メールにジャーナリスト烏賀陽（うがや）弘道さんが激怒 ジャー... \n",
"5 iPhone5、auに独占供給か 米国版ウォールストリートジャーナルが報じたiPhone5に... \n",
"6 “辛ラーメンにゴキブリ”ネットで話題に 日本でも目にすることが多くなった韓国のインスタントラ... \n",
"7 韓国がハブられたiPhone4S発表会 米アップルが4日に発表したiPhone4S。iPh... \n",
"8 GREEの退会引き止めにユーザーの不満が爆発 グリー株式会社が運営するSNS「GREE」の退... \n",
"9 毎年話題になるベストジーニスト賞の偏り 今年のベストジーニスト一般選出部門に相葉雅紀、黒木メ... \n",
"10 みのもんた引退で変わる芸能界の勢力図 東スポは、林家三平と国分佐智子の披露宴に出席してほろ酔... \n",
"11 チェルノブイリ再来か、福島で恐れていた事態が遂に… 福島第一原発事故から約半年、ついに恐れて... \n",
"12 ゆうこりん、ハワイでの結婚写真を公開 タレントの小倉優子（27）が、ヘアメークアーティスト・... \n",
"13 HEY！HEY！HEY！に寄せられたメッセージがK-POP押しばかり… 10日に放送されたフ... \n",
"14 吉本の“タテ”の実態 ダウンタウンのガキの使いやあらへんで！！”10月9日放送回で、ダウンタ... \n",
"15 安めぐみと結婚報道の東ＭＡＸ、生放送で思わず「結婚したんだよ！」と口走る 安めぐみとの結婚が... \n",
"16 ついに萌えキャラに手を出し始めた野球界 球界のマスコットキャラと言えば中日ドラゴンズの「ド... \n",
"17 米ファンドがすかいらーくを買収 米ファンド、ベインキャピタルがすかいらーく買収で合意したと日... \n",
"18 漫画家の青山景さんが自殺か 講談社イブニングで漫画を連載していた漫画家の青山景さんが自殺した... \n",
"19 横浜で放射性物質ストロンチウムを検出、横浜市内では初 放射性物質のストロンチウムが横浜で検出... \n",
"20 ＡＫＢ大島優子に非難殺到 「性格が悪すぎる」 インターネット掲示板２ちゃんねるで、AKB4... \n",
"21 2ちゃんねるの創設者ひろゆきの発言で波紋 2ちゃんねるの創設者として知られる西村博之氏がtw... \n",
"22 角川グループがメディアファクトリーを買収 リクルート傘下だったメディアファクトリーが角川グル... \n",
"23 ＮＨＫ広報局がTwitterで皮肉タップリ 今やＮＨＫ＝「視聴者の皆様のための優等生」では... \n",
"24 iOS5アップデートで大混乱 日本時間13日未明（米国時間12日）、iOS4を大型アップデ... \n",
"25 メディアに情報操作されるウォール街占拠デモの実態 米ニューヨークのウォール街で始まった**... \n",
"26 千葉県船橋市で毎時5.82マイクロシーベルトを検出 千葉県船橋市にある「ふなばしアンデルセン... \n",
"27 ピザの起源は“韓国”とするCMが話題に ピザの起源を韓国だとする広告動画を韓国のピザ会社「ミ... \n",
"28 たけしが結婚披露宴でタブーに触れる ビートたけしの、林家三平の結婚披露宴での祝辞全文を書き起... \n",
"29 アンジャッシュ渡部の発言に「最低！」の声が続出 10月12日放送「グータンヌーボ」で新企画「... \n",
".. ... \n",
"740 青木裕子アナのハプニング、ネットでは「ギャグかと思うほど見事」「かわいい」 15日に放送され... \n",
"741 竹島まで泳ぐもパニック障害に。ネットでは呆れる声が続々と 15日、韓国人歌手の金章勲（キム・... \n",
"742 韓国政府“野田内閣と対話中断宣言”、日韓通貨スワップ中断は“日本も打撃” 16日、複数の韓... \n",
"743 李明博大統領の“嘘”に韓国ネットユーザーから非難相次ぐ 韓国のニュースサイト「ビューズ・アン... \n",
"744 【韓国ニュース】靖国神社でデモを行った韓国人が韓国でも話題に 韓国ユーザーからは怒りの声相次... \n",
"745 HKT48、メンバー5人の脱退を発表 18日、秋元康がプロデュースをするアイドルグループで、... \n",
"746 さんま、マンUに「日本人は入ってほしくない」と発言し、ひんしゅく買う 18日に放送されたラジ... \n",
"747 【韓国ニュース】韓国に“日本人出入禁止”のネットカフェ 19日、韓国のネット掲示板には「ネ... \n",
"748 五輪メダリストに無茶な要求をする番組に、ユーザは「中継が見苦しい」 20日、「情報ライブ ミ... \n",
"749 【韓国ニュース】韓国のコメディアン、田村淳に「黙れ、おっさん」 20日未明、韓国のコメディア... \n",
"750 室伏広治、母親の生活保護受給がネットで物議を醸す 22日、Web版「女性自身」は、ロンドン五... \n",
"751 宇多田が渡航者に注意を喚起「犯罪者の目線でものを見るのも大事」 17日、ルーマニアの首都ブカ... \n",
"752 逮捕されたソフトバンク・堂上隼人に非難が殺到 23日、ソフトバンクの捕手・堂上隼人が強制わい... \n",
"753 北朝鮮が元専属料理人に接触、“身の安全を徹底的に担保する”と訪朝打診 23日放送されたTBS... \n",
"754 AKB48出演の「ぷっちょ」新CMがまたもや物議 AKB48メンバーが出演する「ぷっちょ」の... \n",
"755 訪朝した藤本氏、「金正恩氏は許してくれたが、藤本殺してやろうというのがいっぱいいる」 24日... \n",
"756 英国でも報じられる尖閣問題 反日デモの日本車破壊には疑問の声も 英国紙「デイリー・メール」は... \n",
"757 ファーガソン監督のスコットランド訛りに苦戦する香川真司 現地ファンからは同情の声も イギリス... \n",
"758 【韓国ニュース】韓国の地方議会に対馬の領有権を主張する決議案 竹島の領有権を巡る日韓の緊張が... \n",
"759 有吉弘行が平成ノブシコブシ・吉村崇のブログ炎上に言及 お笑い芸人の有吉弘行が、26日に放送さ... \n",
"760 【韓国ニュース】 敗訴の影響か…サムスン「ギャラクシーS3」の販売価格が4分の1に 韓国のニ... \n",
"761 英国でも報じられた日韓の関係 ユーザーからは「日本がかわいそうだ」の声も 24日、ロイター通... \n",
"762 園山真希絵が経営する料理店を閉店、その経緯に非難の声 29日、料理研究家の園山真希絵が、自身... \n",
"763 伊集院光がラジオで「24時間テレビ」について“本音”を語る 27日、伊集院光がラジオ番組「J... \n",
"764 吉高由里子の韓国ドラマ出演に疑問の声相次ぐ 30日、女優の吉高由里子が、韓国の連続ドラマに出... \n",
"765 爆笑問題・田中裕二も驚く「ひるおび!」での恵俊彰の“天然”ぶり 28日に放送された「JUN... \n",
"766 黒田勇樹のDV騒動 ネット掲示板では冷ややかな声も 30日、元俳優の黒田勇樹が、妻の中村瑠衣... \n",
"767 サムスンのアンドロイド搭載カメラが韓国で話題に 韓国のIT専門ニュースサイト「ブロター・ネッ... \n",
"768 米紙も注目したゲーム「竹島争奪戦」 米紙「ウォール・ストリート・ジャーナル」は29日、「竹島... \n",
"769 ジャンプ連載漫画が終了に、ユーザが新たな提案!? 『ONE PIECE』や『NARUTO』、... \n",
"\n",
"[770 rows x 5 columns]"
]
},
"execution_count": 6,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"# topic model (LatentDirichletAllocation) のモジュールを読み込む\n",
"from sklearn.decomposition import LatentDirichletAllocation\n",
"\n",
"N_TOPIC = 3\n",
"lda = LatentDirichletAllocation(n_components=N_TOPIC, random_state=0)\n",
"\n",
"# 学習して保存しておく。\n",
"lda.fit(doc_word_matrix)\n",
"file_name = 'data/processed/lda.pickle'\n",
"with open(file_name, 'wb') as f:\n",
" pickle.dump(lda, f)\n",
"\n",
"# 分類された topic\n",
"import pandas as pd\n",
"df_doc_topic = pd.DataFrame(\n",
" lda.transform(doc_word_matrix), \n",
" columns=['topic%02d'%i for i in range(N_TOPIC)]\n",
")\n",
"df_doc_topic['doc_file'] = doc_files\n",
"df_doc_topic['doc_text'] = doc_texts\n",
"\n",
"df_doc_topic"
]
},
{
"cell_type": "code",
"execution_count": 7,
"metadata": {},
"outputs": [],
"source": [
"# df_doc_topic をファイル出力する。\n",
"file_name = 'data/df_doc_topic.csv'\n",
"df_doc_topic.to_csv(file_name, index=False)\n"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"\n",
"# 以上で、オペレーション_01 は終了です\n",
"\n",
"\n",
"# 続いて、オペレーション_02 を行います\n"
]
},
{
"cell_type": "code",
"execution_count": 8,
"metadata": {},
"outputs": [
{
"data": {
"text/html": [
"<div>\n",
"<style scoped>\n",
" .dataframe tbody tr th:only-of-type {\n",
" vertical-align: middle;\n",
" }\n",
"\n",
" .dataframe tbody tr th {\n",
" vertical-align: top;\n",
" }\n",
"\n",
" .dataframe thead th {\n",
" text-align: right;\n",
" }\n",
"</style>\n",
"<table border=\"1\" class=\"dataframe\">\n",
" <thead>\n",
" <tr style=\"text-align: right;\">\n",
" <th></th>\n",
" <th>topic00</th>\n",
" <th>topic01</th>\n",
" <th>topic02</th>\n",
" <th>doc_file</th>\n",
" <th>doc_text</th>\n",
" <th>tag_芸能</th>\n",
" <th>tag_海外</th>\n",
" <th>tag_社会</th>\n",
" <th>tag_政治</th>\n",
" <th>tag_スポーツ</th>\n",
" </tr>\n",
" </thead>\n",
" <tbody>\n",
" <tr>\n",
" <th>0</th>\n",
" <td>0.006954</td>\n",
" <td>0.986436</td>\n",
" <td>0.006611</td>\n",
" <td>data/text/topic-news/topic-news-6843698.txt</td>\n",
" <td>同じホテルに滞在している、日本代表と韓国代表 10日、韓国「ソウル新聞」は、翌11日（日本時...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>1</th>\n",
" <td>0.007343</td>\n",
" <td>0.985629</td>\n",
" <td>0.007028</td>\n",
" <td>data/text/topic-news/topic-news-6841012.txt</td>\n",
" <td>五輪サッカー日韓戦において、韓国が注目する“ある選手”とは？ 日本時間11日午前3時45分よ...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>2</th>\n",
" <td>0.007180</td>\n",
" <td>0.985483</td>\n",
" <td>0.007337</td>\n",
" <td>data/text/topic-news/topic-news-6829539.txt</td>\n",
" <td>女子アーチェリー銅メダリスト早川蓮、 韓国でも話題に 6日、アーチェリー女子銅メダリストの早...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>3</th>\n",
" <td>0.007506</td>\n",
" <td>0.984469</td>\n",
" <td>0.008026</td>\n",
" <td>data/text/topic-news/topic-news-6608684.txt</td>\n",
" <td>五輪逃したタイが「日本の八百長疑惑」を一斉報道 29日、タイでは、女子バレーボール五輪予選で...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>4</th>\n",
" <td>0.007822</td>\n",
" <td>0.984203</td>\n",
" <td>0.007975</td>\n",
" <td>data/text/topic-news/topic-news-6842234.txt</td>\n",
" <td>五輪サッカーで日韓が激突、韓国ユーザは「餌を出して試合させるのは間違っている」 韓国「文化日...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>5</th>\n",
" <td>0.007915</td>\n",
" <td>0.983509</td>\n",
" <td>0.008577</td>\n",
" <td>data/text/topic-news/topic-news-6818120.txt</td>\n",
" <td>女子バドミントン失格に韓国では「なでしこジャパンの引き分け狙いはOKなのになぜ…」の声 ロン...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>6</th>\n",
" <td>0.008171</td>\n",
" <td>0.983338</td>\n",
" <td>0.008491</td>\n",
" <td>data/text/topic-news/topic-news-6636116.txt</td>\n",
" <td>FIFA最新ランキング発表、韓国ユーザが敗北宣言!? 6日、FIFAはサッカーの世界ランキン...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>7</th>\n",
" <td>0.008762</td>\n",
" <td>0.982255</td>\n",
" <td>0.008983</td>\n",
" <td>data/text/topic-news/topic-news-6782959.txt</td>\n",
" <td>【韓国ニュース】WBC日本不参加の報道に「韓国の優勝か!?」 20日、労働組合・日本プロ野球...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>8</th>\n",
" <td>0.008930</td>\n",
" <td>0.981640</td>\n",
" <td>0.009430</td>\n",
" <td>data/text/topic-news/topic-news-6829622.txt</td>\n",
" <td>【五輪サッカー】 韓国に負けたイギリス代表に英ネットユーザーから批判相次ぐ 5日、イギリスの...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>9</th>\n",
" <td>0.009588</td>\n",
" <td>0.980599</td>\n",
" <td>0.009813</td>\n",
" <td>data/text/topic-news/topic-news-6822413.txt</td>\n",
" <td>五輪サッカー 英韓戦を前に韓国では「最悪のシナリオ」の声 2日、韓国のニュースサイト「イデ...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>10</th>\n",
" <td>0.010287</td>\n",
" <td>0.979705</td>\n",
" <td>0.010007</td>\n",
" <td>data/text/topic-news/topic-news-6832659.txt</td>\n",
" <td>勝利後、相手選手を慰めるなでしこジャパン・宮間あやに米国ユーザーから称賛相次ぐ 米国「NBC...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>11</th>\n",
" <td>0.011318</td>\n",
" <td>0.976707</td>\n",
" <td>0.011975</td>\n",
" <td>data/text/topic-news/topic-news-6806327.txt</td>\n",
" <td>五輪柔道 判定覆り勝利した海老沼匡に米国人ユーザーから疑問の声 フランス通信社（AFP）の英...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>12</th>\n",
" <td>0.013042</td>\n",
" <td>0.974346</td>\n",
" <td>0.012612</td>\n",
" <td>data/text/topic-news/topic-news-6822465.txt</td>\n",
" <td>五輪 北朝鮮の躍進に英国で驚きの声 2日、イギリスの「デイリー・メール」は「親愛なる指導者、...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>13</th>\n",
" <td>0.016887</td>\n",
" <td>0.967124</td>\n",
" <td>0.015989</td>\n",
" <td>data/text/topic-news/topic-news-6799124.txt</td>\n",
" <td>【ロンドン五輪】サッカー・イギリス代表 国歌“口元チェック”で論争 W杯にはイングランド、...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>14</th>\n",
" <td>0.004257</td>\n",
" <td>0.990627</td>\n",
" <td>0.005116</td>\n",
" <td>data/text/topic-news/topic-news-6744306.txt</td>\n",
" <td>【韓国ニュース】日本大使館トラック突入事件の容疑者が日本人活動家に“公開提案” 9日、ソウル...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>15</th>\n",
" <td>0.005233</td>\n",
" <td>0.989186</td>\n",
" <td>0.005580</td>\n",
" <td>data/text/topic-news/topic-news-6707019.txt</td>\n",
" <td>【韓国ニュース】韓国ネット掲示板で広まる桜韓国起源説 「花見をする時は韓国に感謝しろ」の声も...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>16</th>\n",
" <td>0.007269</td>\n",
" <td>0.985457</td>\n",
" <td>0.007274</td>\n",
" <td>data/text/topic-news/topic-news-6895397.txt</td>\n",
" <td>【韓国ニュース】韓国の地方議会に対馬の領有権を主張する決議案 竹島の領有権を巡る日韓の緊張が...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>17</th>\n",
" <td>0.007116</td>\n",
" <td>0.984996</td>\n",
" <td>0.007888</td>\n",
" <td>data/text/topic-news/topic-news-6864824.txt</td>\n",
" <td>【韓国ニュース】靖国神社でデモを行った韓国人が韓国でも話題に 韓国ユーザーからは怒りの声相次...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>18</th>\n",
" <td>0.007115</td>\n",
" <td>0.984486</td>\n",
" <td>0.008399</td>\n",
" <td>data/text/topic-news/topic-news-6855184.txt</td>\n",
" <td>【韓国ニュース】李明博大統領の天皇謝罪要求に韓国ネットユーザーも混乱 14日午後、韓国の李明...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>19</th>\n",
" <td>0.007535</td>\n",
" <td>0.984138</td>\n",
" <td>0.008327</td>\n",
" <td>data/text/topic-news/topic-news-6740338.txt</td>\n",
" <td>日本大使館トラック突入事件に韓国ネットユーザー「愛国の志士」 9日、ソウルの日本大使館正門に...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>20</th>\n",
" <td>0.007673</td>\n",
" <td>0.983866</td>\n",
" <td>0.008461</td>\n",
" <td>data/text/topic-news/topic-news-6580716.txt</td>\n",
" <td>韓国の竹島活動家、ヒトラーの言葉を引用し過激な主張を 21日、韓国のニュースサイト「韓国経済...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>21</th>\n",
" <td>0.007478</td>\n",
" <td>0.983816</td>\n",
" <td>0.008705</td>\n",
" <td>data/text/topic-news/topic-news-5965415.txt</td>\n",
" <td>ホワイトハウスで深刻なミス…韓国「受け入れがたい」 13日夕方、ホワイトハウスでオバマ大統領...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>22</th>\n",
" <td>0.007490</td>\n",
" <td>0.983070</td>\n",
" <td>0.009440</td>\n",
" <td>data/text/topic-news/topic-news-6855176.txt</td>\n",
" <td>【韓国ニュース】竹島上陸、韓国内では賛否両論 李明博大統領の支持率にはほとんど影響なし ...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>23</th>\n",
" <td>0.008520</td>\n",
" <td>0.982225</td>\n",
" <td>0.009254</td>\n",
" <td>data/text/topic-news/topic-news-6860367.txt</td>\n",
" <td>韓国政府“野田内閣と対話中断宣言”、日韓通貨スワップ中断は“日本も打撃” 16日、複数の韓...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>24</th>\n",
" <td>0.140529</td>\n",
" <td>0.090961</td>\n",
" <td>0.768510</td>\n",
" <td>data/text/topic-news/topic-news-6360446.txt</td>\n",
" <td>田中防衛大臣の答弁が「酷過ぎる」 \\t 12日、参議院予算委員会質疑における田中直紀防衛大臣...</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>25</th>\n",
" <td>0.010283</td>\n",
" <td>0.011453</td>\n",
" <td>0.978264</td>\n",
" <td>data/text/topic-news/topic-news-6091293.txt</td>\n",
" <td>原発用語の言い換えに「騙されるな！」 福島第一原発の事故に関する記者会見が行われる際、政府や...</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>26</th>\n",
" <td>0.977721</td>\n",
" <td>0.010913</td>\n",
" <td>0.011366</td>\n",
" <td>data/text/topic-news/topic-news-6738631.txt</td>\n",
" <td>「7股中」を謳うアイドルに、西川史子がズバリ核心をつく TBS「サンデー・ジャポン」（8日放...</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>27</th>\n",
" <td>0.010516</td>\n",
" <td>0.010788</td>\n",
" <td>0.978697</td>\n",
" <td>data/text/topic-news/topic-news-6582763.txt</td>\n",
" <td>河本の姉が片山さつき氏に「後で謝ることになる」 ネットで物議 母親の生活保護受給が問題になっ...</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>28</th>\n",
" <td>0.978718</td>\n",
" <td>0.010580</td>\n",
" <td>0.010703</td>\n",
" <td>data/text/topic-news/topic-news-6646286.txt</td>\n",
" <td>ナイナイ岡村、AKB特番の出演依頼を拒否 「ああいうところに出るのは……」 6日に行われた「...</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>29</th>\n",
" <td>0.009577</td>\n",
" <td>0.010248</td>\n",
" <td>0.980175</td>\n",
" <td>data/text/topic-news/topic-news-6771213.txt</td>\n",
" <td>橋下徹大阪市長の女性問題、ネットの声は？ 19日に発売された「週刊文春」（7月26日号）にお...</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>...</th>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>740</th>\n",
" <td>0.855409</td>\n",
" <td>0.007817</td>\n",
" <td>0.136773</td>\n",
" <td>data/text/topic-news/topic-news-6316640.txt</td>\n",
" <td>クイズ☆タレント名鑑の前田敦子に関する問題が「容赦無い」と話題に 26日に放送されたTBS系...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>741</th>\n",
" <td>0.208691</td>\n",
" <td>0.007816</td>\n",
" <td>0.783493</td>\n",
" <td>data/text/topic-news/topic-news-5938333.txt</td>\n",
" <td>au版iPhone4Sの購入者に“仕込み疑惑”が浮上 iPhone4Sが発売となった本日、徹...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>742</th>\n",
" <td>0.724867</td>\n",
" <td>0.007789</td>\n",
" <td>0.267344</td>\n",
" <td>data/text/topic-news/topic-news-5931153.txt</td>\n",
" <td>ＡＫＢ大島優子に非難殺到 「性格が悪すぎる」 インターネット掲示板２ちゃんねるで、AKB4...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>743</th>\n",
" <td>0.746203</td>\n",
" <td>0.007777</td>\n",
" <td>0.246020</td>\n",
" <td>data/text/topic-news/topic-news-6631065.txt</td>\n",
" <td>フジテレビ「家族のうた」など打ち切り相次ぐTV業界に、ネットユーザー「嫌なら見るなとか言って...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>744</th>\n",
" <td>0.698840</td>\n",
" <td>0.007707</td>\n",
" <td>0.293454</td>\n",
" <td>data/text/topic-news/topic-news-6895782.txt</td>\n",
" <td>有吉弘行が平成ノブシコブシ・吉村崇のブログ炎上に言及 お笑い芸人の有吉弘行が、26日に放送さ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>745</th>\n",
" <td>0.630251</td>\n",
" <td>0.007694</td>\n",
" <td>0.362054</td>\n",
" <td>data/text/topic-news/topic-news-6660541.txt</td>\n",
" <td>スギちゃん、本音明かす「ワイルドだけど、嫌われたくないんですよ」 14日、過労でダウンし、イ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>746</th>\n",
" <td>0.983611</td>\n",
" <td>0.007688</td>\n",
" <td>0.008701</td>\n",
" <td>data/text/topic-news/topic-news-6019023.txt</td>\n",
" <td>「マツコ&有吉の怒り新党2」出演者総とっかえの危機 9日放送の「マツコ&有吉の怒り新党」（テ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>747</th>\n",
" <td>0.983836</td>\n",
" <td>0.007641</td>\n",
" <td>0.008524</td>\n",
" <td>data/text/topic-news/topic-news-6780686.txt</td>\n",
" <td>「FNS27時間テレビ」 ローラのリアクションに「放送事故」の声 22日に放送された「FNS...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>748</th>\n",
" <td>0.826461</td>\n",
" <td>0.007585</td>\n",
" <td>0.165955</td>\n",
" <td>data/text/topic-news/topic-news-6302176.txt</td>\n",
" <td>オセロ中島がついに全レギュラー降板、″失業″状態に心配の声 22日、産経ニュースをはじめとし...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>749</th>\n",
" <td>0.898826</td>\n",
" <td>0.007525</td>\n",
" <td>0.093649</td>\n",
" <td>data/text/topic-news/topic-news-6563543.txt</td>\n",
" <td>リンカーンで放送事故、ツイッター騒然 15日に放送されたバラエティ番組「リンカーン」（TBS...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>750</th>\n",
" <td>0.984373</td>\n",
" <td>0.007428</td>\n",
" <td>0.008199</td>\n",
" <td>data/text/topic-news/topic-news-6449971.txt</td>\n",
" <td>テレビ朝日で花見のニュースに津波の映像が流れる放送事故 ネット掲示板は一時騒然 7日、テレビ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>751</th>\n",
" <td>0.909996</td>\n",
" <td>0.007397</td>\n",
" <td>0.082607</td>\n",
" <td>data/text/topic-news/topic-news-6586368.txt</td>\n",
" <td>野球中継が突然の中止、代替番組が用意できず非常事態に 22日に放送されたテレビ愛知の野球中継...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>752</th>\n",
" <td>0.549859</td>\n",
" <td>0.007392</td>\n",
" <td>0.442749</td>\n",
" <td>data/text/topic-news/topic-news-6317274.txt</td>\n",
" <td>漫画家うすた京介さんのパチンコ業界へのTwitter発言がネット掲示板で話題に 27日、漫画...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>753</th>\n",
" <td>0.878630</td>\n",
" <td>0.007364</td>\n",
" <td>0.114006</td>\n",
" <td>data/text/topic-news/topic-news-6450159.txt</td>\n",
" <td>加護亜依が号泣、自殺未遂騒動後初のテレビ出演に「もう芸能界やめたほうがいい」の声 9日、モー...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>754</th>\n",
" <td>0.977388</td>\n",
" <td>0.007242</td>\n",
" <td>0.015369</td>\n",
" <td>data/text/topic-news/topic-news-6406486.txt</td>\n",
" <td>有吉が「しゃべくり007」で暴露した“絡みたくない大物”とは誰か? 26日、日本テレビ系で放...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>755</th>\n",
" <td>0.697792</td>\n",
" <td>0.007239</td>\n",
" <td>0.294969</td>\n",
" <td>data/text/topic-news/topic-news-5907376.txt</td>\n",
" <td>紳助とたけしの明暗を分けたものとは 今年で20回目を迎えたTBSのオールスター感謝祭に、1回...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>756</th>\n",
" <td>0.984013</td>\n",
" <td>0.007222</td>\n",
" <td>0.008764</td>\n",
" <td>data/text/topic-news/topic-news-6668296.txt</td>\n",
" <td>指原莉乃をからかった浅草キッド・玉袋筋太郎に賛否 16日放送の「5時に夢中!」（東京MXテレ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>757</th>\n",
" <td>0.887530</td>\n",
" <td>0.007110</td>\n",
" <td>0.105361</td>\n",
" <td>data/text/topic-news/topic-news-5971115.txt</td>\n",
" <td>“キラキラネーム”でうつになる罪のない子供たち 「キラキラネーム」という言葉をご存知だろうか...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>758</th>\n",
" <td>0.032959</td>\n",
" <td>0.006962</td>\n",
" <td>0.960079</td>\n",
" <td>data/text/topic-news/topic-news-6613650.txt</td>\n",
" <td>生活保護のイメージ悪化に**も、反論の声多数 30日、生活保護問題対策全国会議は、東京・千代...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>759</th>\n",
" <td>0.632465</td>\n",
" <td>0.006928</td>\n",
" <td>0.360607</td>\n",
" <td>data/text/topic-news/topic-news-6301970.txt</td>\n",
" <td>見知らぬ団体が勝手にハロプロのYouTube公式チャンネルを削除、物議に 21日、ハロープロ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>760</th>\n",
" <td>0.626982</td>\n",
" <td>0.006851</td>\n",
" <td>0.366167</td>\n",
" <td>data/text/topic-news/topic-news-6586056.txt</td>\n",
" <td>河本準一、大手企業広告から存在消される事態に 23日、母親の生活保護受給が物議を醸している、...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>761</th>\n",
" <td>0.906056</td>\n",
" <td>0.006742</td>\n",
" <td>0.087202</td>\n",
" <td>data/text/topic-news/topic-news-6154347.txt</td>\n",
" <td>大槻教授、たけしの番組の“やらせ”を暴露 超自然現象や超能力などのオカルト事象を科学的観点か...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>762</th>\n",
" <td>0.895600</td>\n",
" <td>0.006678</td>\n",
" <td>0.097721</td>\n",
" <td>data/text/topic-news/topic-news-6899432.txt</td>\n",
" <td>伊集院光がラジオで「24時間テレビ」について“本音”を語る 27日、伊集院光がラジオ番組「J...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>763</th>\n",
" <td>0.350810</td>\n",
" <td>0.006344</td>\n",
" <td>0.642846</td>\n",
" <td>data/text/topic-news/topic-news-6584186.txt</td>\n",
" <td>神田うのの手のひら返しにネットユーザ騒然 21日、神田うのが自身のブログで二股騒動があった料...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>764</th>\n",
" <td>0.052264</td>\n",
" <td>0.006001</td>\n",
" <td>0.941735</td>\n",
" <td>data/text/topic-news/topic-news-6601493.txt</td>\n",
" <td>河本の生活保護問題で、オリラジ・藤森がツイッターで騒動に 25日、母親の生活保護受給について...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>765</th>\n",
" <td>0.988235</td>\n",
" <td>0.005657</td>\n",
" <td>0.006109</td>\n",
" <td>data/text/topic-news/topic-news-6674453.txt</td>\n",
" <td>AKB指原のスキャンダル。TBS番組は「90％以上のファンが彼女を許した」と説明 今月14日...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>766</th>\n",
" <td>0.330100</td>\n",
" <td>0.005626</td>\n",
" <td>0.664274</td>\n",
" <td>data/text/topic-news/topic-news-6738399.txt</td>\n",
" <td>「世の中そんなに甘くないからね」 スーパーマーケット店員の発言に批判殺到し店舗ブログも大炎上...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>767</th>\n",
" <td>0.841284</td>\n",
" <td>0.005133</td>\n",
" <td>0.153583</td>\n",
" <td>data/text/topic-news/topic-news-5910461.txt</td>\n",
" <td>読売テレビ広報部長の無礼千万メールにジャーナリスト烏賀陽（うがや）弘道さんが激怒 ジャー...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>768</th>\n",
" <td>0.991185</td>\n",
" <td>0.004218</td>\n",
" <td>0.004596</td>\n",
" <td>data/text/topic-news/topic-news-5903373.txt</td>\n",
" <td>写真が流出し“堕ちていった”アイドルたち アイドルが男性と一緒に写ったプリクラやニャンニャン...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>769</th>\n",
" <td>0.788469</td>\n",
" <td>0.003428</td>\n",
" <td>0.208103</td>\n",
" <td>data/text/topic-news/topic-news-6696655.txt</td>\n",
" <td>元AKB指原莉乃、生放送で胸中告白。交際相手のことやネットの書き込みにも言及 今月14日に発...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" </tbody>\n",
"</table>\n",
"<p>770 rows × 10 columns</p>\n",
"</div>"
],
"text/plain": [
" topic00 topic01 topic02 \\\n",
"0 0.006954 0.986436 0.006611 \n",
"1 0.007343 0.985629 0.007028 \n",
"2 0.007180 0.985483 0.007337 \n",
"3 0.007506 0.984469 0.008026 \n",
"4 0.007822 0.984203 0.007975 \n",
"5 0.007915 0.983509 0.008577 \n",
"6 0.008171 0.983338 0.008491 \n",
"7 0.008762 0.982255 0.008983 \n",
"8 0.008930 0.981640 0.009430 \n",
"9 0.009588 0.980599 0.009813 \n",
"10 0.010287 0.979705 0.010007 \n",
"11 0.011318 0.976707 0.011975 \n",
"12 0.013042 0.974346 0.012612 \n",
"13 0.016887 0.967124 0.015989 \n",
"14 0.004257 0.990627 0.005116 \n",
"15 0.005233 0.989186 0.005580 \n",
"16 0.007269 0.985457 0.007274 \n",
"17 0.007116 0.984996 0.007888 \n",
"18 0.007115 0.984486 0.008399 \n",
"19 0.007535 0.984138 0.008327 \n",
"20 0.007673 0.983866 0.008461 \n",
"21 0.007478 0.983816 0.008705 \n",
"22 0.007490 0.983070 0.009440 \n",
"23 0.008520 0.982225 0.009254 \n",
"24 0.140529 0.090961 0.768510 \n",
"25 0.010283 0.011453 0.978264 \n",
"26 0.977721 0.010913 0.011366 \n",
"27 0.010516 0.010788 0.978697 \n",
"28 0.978718 0.010580 0.010703 \n",
"29 0.009577 0.010248 0.980175 \n",
".. ... ... ... \n",
"740 0.855409 0.007817 0.136773 \n",
"741 0.208691 0.007816 0.783493 \n",
"742 0.724867 0.007789 0.267344 \n",
"743 0.746203 0.007777 0.246020 \n",
"744 0.698840 0.007707 0.293454 \n",
"745 0.630251 0.007694 0.362054 \n",
"746 0.983611 0.007688 0.008701 \n",
"747 0.983836 0.007641 0.008524 \n",
"748 0.826461 0.007585 0.165955 \n",
"749 0.898826 0.007525 0.093649 \n",
"750 0.984373 0.007428 0.008199 \n",
"751 0.909996 0.007397 0.082607 \n",
"752 0.549859 0.007392 0.442749 \n",
"753 0.878630 0.007364 0.114006 \n",
"754 0.977388 0.007242 0.015369 \n",
"755 0.697792 0.007239 0.294969 \n",
"756 0.984013 0.007222 0.008764 \n",
"757 0.887530 0.007110 0.105361 \n",
"758 0.032959 0.006962 0.960079 \n",
"759 0.632465 0.006928 0.360607 \n",
"760 0.626982 0.006851 0.366167 \n",
"761 0.906056 0.006742 0.087202 \n",
"762 0.895600 0.006678 0.097721 \n",
"763 0.350810 0.006344 0.642846 \n",
"764 0.052264 0.006001 0.941735 \n",
"765 0.988235 0.005657 0.006109 \n",
"766 0.330100 0.005626 0.664274 \n",
"767 0.841284 0.005133 0.153583 \n",
"768 0.991185 0.004218 0.004596 \n",
"769 0.788469 0.003428 0.208103 \n",
"\n",
" doc_file \\\n",
"0 data/text/topic-news/topic-news-6843698.txt \n",
"1 data/text/topic-news/topic-news-6841012.txt \n",
"2 data/text/topic-news/topic-news-6829539.txt \n",
"3 data/text/topic-news/topic-news-6608684.txt \n",
"4 data/text/topic-news/topic-news-6842234.txt \n",
"5 data/text/topic-news/topic-news-6818120.txt \n",
"6 data/text/topic-news/topic-news-6636116.txt \n",
"7 data/text/topic-news/topic-news-6782959.txt \n",
"8 data/text/topic-news/topic-news-6829622.txt \n",
"9 data/text/topic-news/topic-news-6822413.txt \n",
"10 data/text/topic-news/topic-news-6832659.txt \n",
"11 data/text/topic-news/topic-news-6806327.txt \n",
"12 data/text/topic-news/topic-news-6822465.txt \n",
"13 data/text/topic-news/topic-news-6799124.txt \n",
"14 data/text/topic-news/topic-news-6744306.txt \n",
"15 data/text/topic-news/topic-news-6707019.txt \n",
"16 data/text/topic-news/topic-news-6895397.txt \n",
"17 data/text/topic-news/topic-news-6864824.txt \n",
"18 data/text/topic-news/topic-news-6855184.txt \n",
"19 data/text/topic-news/topic-news-6740338.txt \n",
"20 data/text/topic-news/topic-news-6580716.txt \n",
"21 data/text/topic-news/topic-news-5965415.txt \n",
"22 data/text/topic-news/topic-news-6855176.txt \n",
"23 data/text/topic-news/topic-news-6860367.txt \n",
"24 data/text/topic-news/topic-news-6360446.txt \n",
"25 data/text/topic-news/topic-news-6091293.txt \n",
"26 data/text/topic-news/topic-news-6738631.txt \n",
"27 data/text/topic-news/topic-news-6582763.txt \n",
"28 data/text/topic-news/topic-news-6646286.txt \n",
"29 data/text/topic-news/topic-news-6771213.txt \n",
".. ... \n",
"740 data/text/topic-news/topic-news-6316640.txt \n",
"741 data/text/topic-news/topic-news-5938333.txt \n",
"742 data/text/topic-news/topic-news-5931153.txt \n",
"743 data/text/topic-news/topic-news-6631065.txt \n",
"744 data/text/topic-news/topic-news-6895782.txt \n",
"745 data/text/topic-news/topic-news-6660541.txt \n",
"746 data/text/topic-news/topic-news-6019023.txt \n",
"747 data/text/topic-news/topic-news-6780686.txt \n",
"748 data/text/topic-news/topic-news-6302176.txt \n",
"749 data/text/topic-news/topic-news-6563543.txt \n",
"750 data/text/topic-news/topic-news-6449971.txt \n",
"751 data/text/topic-news/topic-news-6586368.txt \n",
"752 data/text/topic-news/topic-news-6317274.txt \n",
"753 data/text/topic-news/topic-news-6450159.txt \n",
"754 data/text/topic-news/topic-news-6406486.txt \n",
"755 data/text/topic-news/topic-news-5907376.txt \n",
"756 data/text/topic-news/topic-news-6668296.txt \n",
"757 data/text/topic-news/topic-news-5971115.txt \n",
"758 data/text/topic-news/topic-news-6613650.txt \n",
"759 data/text/topic-news/topic-news-6301970.txt \n",
"760 data/text/topic-news/topic-news-6586056.txt \n",
"761 data/text/topic-news/topic-news-6154347.txt \n",
"762 data/text/topic-news/topic-news-6899432.txt \n",
"763 data/text/topic-news/topic-news-6584186.txt \n",
"764 data/text/topic-news/topic-news-6601493.txt \n",
"765 data/text/topic-news/topic-news-6674453.txt \n",
"766 data/text/topic-news/topic-news-6738399.txt \n",
"767 data/text/topic-news/topic-news-5910461.txt \n",
"768 data/text/topic-news/topic-news-5903373.txt \n",
"769 data/text/topic-news/topic-news-6696655.txt \n",
"\n",
" doc_text tag_芸能 tag_海外 \\\n",
"0 同じホテルに滞在している、日本代表と韓国代表 10日、韓国「ソウル新聞」は、翌11日（日本時... 0.0 1.0 \n",
"1 五輪サッカー日韓戦において、韓国が注目する“ある選手”とは？ 日本時間11日午前3時45分よ... 0.0 1.0 \n",
"2 女子アーチェリー銅メダリスト早川蓮、 韓国でも話題に 6日、アーチェリー女子銅メダリストの早... 0.0 1.0 \n",
"3 五輪逃したタイが「日本の八百長疑惑」を一斉報道 29日、タイでは、女子バレーボール五輪予選で... 0.0 1.0 \n",
"4 五輪サッカーで日韓が激突、韓国ユーザは「餌を出して試合させるのは間違っている」 韓国「文化日... 0.0 1.0 \n",
"5 女子バドミントン失格に韓国では「なでしこジャパンの引き分け狙いはOKなのになぜ…」の声 ロン... 0.0 1.0 \n",
"6 FIFA最新ランキング発表、韓国ユーザが敗北宣言!? 6日、FIFAはサッカーの世界ランキン... 0.0 1.0 \n",
"7 【韓国ニュース】WBC日本不参加の報道に「韓国の優勝か!?」 20日、労働組合・日本プロ野球... 0.0 1.0 \n",
"8 【五輪サッカー】 韓国に負けたイギリス代表に英ネットユーザーから批判相次ぐ 5日、イギリスの... 0.0 1.0 \n",
"9 五輪サッカー 英韓戦を前に韓国では「最悪のシナリオ」の声 2日、韓国のニュースサイト「イデ... 0.0 1.0 \n",
"10 勝利後、相手選手を慰めるなでしこジャパン・宮間あやに米国ユーザーから称賛相次ぐ 米国「NBC... 0.0 1.0 \n",
"11 五輪柔道 判定覆り勝利した海老沼匡に米国人ユーザーから疑問の声 フランス通信社（AFP）の英... 0.0 1.0 \n",
"12 五輪 北朝鮮の躍進に英国で驚きの声 2日、イギリスの「デイリー・メール」は「親愛なる指導者、... 0.0 1.0 \n",
"13 【ロンドン五輪】サッカー・イギリス代表 国歌“口元チェック”で論争 W杯にはイングランド、... 0.0 1.0 \n",
"14 【韓国ニュース】日本大使館トラック突入事件の容疑者が日本人活動家に“公開提案” 9日、ソウル... 0.0 1.0 \n",
"15 【韓国ニュース】韓国ネット掲示板で広まる桜韓国起源説 「花見をする時は韓国に感謝しろ」の声も... 0.0 1.0 \n",
"16 【韓国ニュース】韓国の地方議会に対馬の領有権を主張する決議案 竹島の領有権を巡る日韓の緊張が... 0.0 1.0 \n",
"17 【韓国ニュース】靖国神社でデモを行った韓国人が韓国でも話題に 韓国ユーザーからは怒りの声相次... 0.0 1.0 \n",
"18 【韓国ニュース】李明博大統領の天皇謝罪要求に韓国ネットユーザーも混乱 14日午後、韓国の李明... 0.0 1.0 \n",
"19 日本大使館トラック突入事件に韓国ネットユーザー「愛国の志士」 9日、ソウルの日本大使館正門に... 0.0 1.0 \n",
"20 韓国の竹島活動家、ヒトラーの言葉を引用し過激な主張を 21日、韓国のニュースサイト「韓国経済... 0.0 1.0 \n",
"21 ホワイトハウスで深刻なミス…韓国「受け入れがたい」 13日夕方、ホワイトハウスでオバマ大統領... 0.0 1.0 \n",
"22 【韓国ニュース】竹島上陸、韓国内では賛否両論 李明博大統領の支持率にはほとんど影響なし ... 0.0 1.0 \n",
"23 韓国政府“野田内閣と対話中断宣言”、日韓通貨スワップ中断は“日本も打撃” 16日、複数の韓... 0.0 1.0 \n",
"24 田中防衛大臣の答弁が「酷過ぎる」 \\t 12日、参議院予算委員会質疑における田中直紀防衛大臣... 0.0 0.0 \n",
"25 原発用語の言い換えに「騙されるな！」 福島第一原発の事故に関する記者会見が行われる際、政府や... 0.0 0.0 \n",
"26 「7股中」を謳うアイドルに、西川史子がズバリ核心をつく TBS「サンデー・ジャポン」（8日放... 1.0 0.0 \n",
"27 河本の姉が片山さつき氏に「後で謝ることになる」 ネットで物議 母親の生活保護受給が問題になっ... 1.0 0.0 \n",
"28 ナイナイ岡村、AKB特番の出演依頼を拒否 「ああいうところに出るのは……」 6日に行われた「... 1.0 0.0 \n",
"29 橋下徹大阪市長の女性問題、ネットの声は？ 19日に発売された「週刊文春」（7月26日号）にお... 1.0 0.0 \n",
".. ... ... ... \n",
"740 クイズ☆タレント名鑑の前田敦子に関する問題が「容赦無い」と話題に 26日に放送されたTBS系... NaN NaN \n",
"741 au版iPhone4Sの購入者に“仕込み疑惑”が浮上 iPhone4Sが発売となった本日、徹... NaN NaN \n",
"742 ＡＫＢ大島優子に非難殺到 「性格が悪すぎる」 インターネット掲示板２ちゃんねるで、AKB4... NaN NaN \n",
"743 フジテレビ「家族のうた」など打ち切り相次ぐTV業界に、ネットユーザー「嫌なら見るなとか言って... NaN NaN \n",
"744 有吉弘行が平成ノブシコブシ・吉村崇のブログ炎上に言及 お笑い芸人の有吉弘行が、26日に放送さ... NaN NaN \n",
"745 スギちゃん、本音明かす「ワイルドだけど、嫌われたくないんですよ」 14日、過労でダウンし、イ... NaN NaN \n",
"746 「マツコ&有吉の怒り新党2」出演者総とっかえの危機 9日放送の「マツコ&有吉の怒り新党」（テ... NaN NaN \n",
"747 「FNS27時間テレビ」 ローラのリアクションに「放送事故」の声 22日に放送された「FNS... NaN NaN \n",
"748 オセロ中島がついに全レギュラー降板、″失業″状態に心配の声 22日、産経ニュースをはじめとし... NaN NaN \n",
"749 リンカーンで放送事故、ツイッター騒然 15日に放送されたバラエティ番組「リンカーン」（TBS... NaN NaN \n",
"750 テレビ朝日で花見のニュースに津波の映像が流れる放送事故 ネット掲示板は一時騒然 7日、テレビ... NaN NaN \n",
"751 野球中継が突然の中止、代替番組が用意できず非常事態に 22日に放送されたテレビ愛知の野球中継... NaN NaN \n",
"752 漫画家うすた京介さんのパチンコ業界へのTwitter発言がネット掲示板で話題に 27日、漫画... NaN NaN \n",
"753 加護亜依が号泣、自殺未遂騒動後初のテレビ出演に「もう芸能界やめたほうがいい」の声 9日、モー... NaN NaN \n",
"754 有吉が「しゃべくり007」で暴露した“絡みたくない大物”とは誰か? 26日、日本テレビ系で放... NaN NaN \n",
"755 紳助とたけしの明暗を分けたものとは 今年で20回目を迎えたTBSのオールスター感謝祭に、1回... NaN NaN \n",
"756 指原莉乃をからかった浅草キッド・玉袋筋太郎に賛否 16日放送の「5時に夢中!」（東京MXテレ... NaN NaN \n",
"757 “キラキラネーム”でうつになる罪のない子供たち 「キラキラネーム」という言葉をご存知だろうか... NaN NaN \n",
"758 生活保護のイメージ悪化に**も、反論の声多数 30日、生活保護問題対策全国会議は、東京・千代... NaN NaN \n",
"759 見知らぬ団体が勝手にハロプロのYouTube公式チャンネルを削除、物議に 21日、ハロープロ... NaN NaN \n",
"760 河本準一、大手企業広告から存在消される事態に 23日、母親の生活保護受給が物議を醸している、... NaN NaN \n",
"761 大槻教授、たけしの番組の“やらせ”を暴露 超自然現象や超能力などのオカルト事象を科学的観点か... NaN NaN \n",
"762 伊集院光がラジオで「24時間テレビ」について“本音”を語る 27日、伊集院光がラジオ番組「J... NaN NaN \n",
"763 神田うのの手のひら返しにネットユーザ騒然 21日、神田うのが自身のブログで二股騒動があった料... NaN NaN \n",
"764 河本の生活保護問題で、オリラジ・藤森がツイッターで騒動に 25日、母親の生活保護受給について... NaN NaN \n",
"765 AKB指原のスキャンダル。TBS番組は「90％以上のファンが彼女を許した」と説明 今月14日... NaN NaN \n",
"766 「世の中そんなに甘くないからね」 スーパーマーケット店員の発言に批判殺到し店舗ブログも大炎上... NaN NaN \n",
"767 読売テレビ広報部長の無礼千万メールにジャーナリスト烏賀陽（うがや）弘道さんが激怒 ジャー... NaN NaN \n",
"768 写真が流出し“堕ちていった”アイドルたち アイドルが男性と一緒に写ったプリクラやニャンニャン... NaN NaN \n",
"769 元AKB指原莉乃、生放送で胸中告白。交際相手のことやネットの書き込みにも言及 今月14日に発... NaN NaN \n",
"\n",
" tag_社会 tag_政治 tag_スポーツ \n",
"0 0.0 0.0 1.0 \n",
"1 0.0 0.0 1.0 \n",
"2 0.0 0.0 1.0 \n",
"3 0.0 0.0 1.0 \n",
"4 1.0 0.0 1.0 \n",
"5 0.0 0.0 1.0 \n",
"6 0.0 0.0 1.0 \n",
"7 0.0 0.0 1.0 \n",
"8 0.0 0.0 1.0 \n",
"9 0.0 0.0 1.0 \n",
"10 0.0 0.0 1.0 \n",
"11 0.0 0.0 1.0 \n",
"12 0.0 0.0 1.0 \n",
"13 0.0 0.0 1.0 \n",
"14 0.0 0.0 0.0 \n",
"15 0.0 0.0 0.0 \n",
"16 0.0 1.0 0.0 \n",
"17 1.0 0.0 0.0 \n",
"18 0.0 1.0 0.0 \n",
"19 1.0 0.0 0.0 \n",
"20 0.0 1.0 0.0 \n",
"21 0.0 0.0 0.0 \n",
"22 0.0 1.0 0.0 \n",
"23 0.0 1.0 0.0 \n",
"24 0.0 1.0 0.0 \n",
"25 1.0 0.0 0.0 \n",
"26 0.0 0.0 0.0 \n",
"27 1.0 0.0 0.0 \n",
"28 0.0 0.0 0.0 \n",
"29 1.0 1.0 0.0 \n",
".. ... ... ... \n",
"740 NaN NaN NaN \n",
"741 NaN NaN NaN \n",
"742 NaN NaN NaN \n",
"743 NaN NaN NaN \n",
"744 NaN NaN NaN \n",
"745 NaN NaN NaN \n",
"746 NaN NaN NaN \n",
"747 NaN NaN NaN \n",
"748 NaN NaN NaN \n",
"749 NaN NaN NaN \n",
"750 NaN NaN NaN \n",
"751 NaN NaN NaN \n",
"752 NaN NaN NaN \n",
"753 NaN NaN NaN \n",
"754 NaN NaN NaN \n",
"755 NaN NaN NaN \n",
"756 NaN NaN NaN \n",
"757 NaN NaN NaN \n",
"758 NaN NaN NaN \n",
"759 NaN NaN NaN \n",
"760 NaN NaN NaN \n",
"761 NaN NaN NaN \n",
"762 NaN NaN NaN \n",
"763 NaN NaN NaN \n",
"764 NaN NaN NaN \n",
"765 NaN NaN NaN \n",
"766 NaN NaN NaN \n",
"767 NaN NaN NaN \n",
"768 NaN NaN NaN \n",
"769 NaN NaN NaN \n",
"\n",
"[770 rows x 10 columns]"
]
},
"execution_count": 8,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"# 手続き_02で、手動でtagをつける作業を行います。\n",
"# tagをつけたデータを読み込みます。\n",
"# 'data/tag.txt' に手動でタグをつけたデータを読み込みます。\n",
"TAG_FILE = 'data/tag.txt'\n",
"try:\n",
" df_tag = pd.read_csv(TAG_FILE, sep='\\t')\n",
"except:\n",
" df_tag = pd.read_csv(TAG_FILE, sep='\\t', encoding=\"932\")\n",
"\n",
"# このように手動でtagをつけたものです。\n",
"# 全てのtextにtagをつける必要はありません。\n",
"df_tag\n"
]
},
{
"cell_type": "code",
"execution_count": 9,
"metadata": {},
"outputs": [
{
"data": {
"text/html": [
"<div>\n",
"<style scoped>\n",
" .dataframe tbody tr th:only-of-type {\n",
" vertical-align: middle;\n",
" }\n",
"\n",
" .dataframe tbody tr th {\n",
" vertical-align: top;\n",
" }\n",
"\n",
" .dataframe thead th {\n",
" text-align: right;\n",
" }\n",
"</style>\n",
"<table border=\"1\" class=\"dataframe\">\n",
" <thead>\n",
" <tr style=\"text-align: right;\">\n",
" <th></th>\n",
" <th>topic00</th>\n",
" <th>topic01</th>\n",
" <th>topic02</th>\n",
" <th>doc_file</th>\n",
" <th>doc_text</th>\n",
" <th>tag_芸能</th>\n",
" <th>tag_海外</th>\n",
" <th>tag_社会</th>\n",
" <th>tag_政治</th>\n",
" <th>tag_スポーツ</th>\n",
" </tr>\n",
" </thead>\n",
" <tbody>\n",
" <tr>\n",
" <th>100</th>\n",
" <td>0.017635</td>\n",
" <td>0.821989</td>\n",
" <td>0.160377</td>\n",
" <td>data/text/topic-news/topic-news-6017374.txt</td>\n",
" <td>日本の習慣に外国人が激怒 居酒屋で注文せずとも出される“お通し”。日本ではお馴染みの習慣だが...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>101</th>\n",
" <td>0.016988</td>\n",
" <td>0.821360</td>\n",
" <td>0.161651</td>\n",
" <td>data/text/topic-news/topic-news-5966020.txt</td>\n",
" <td>日本スケート連盟のキム・ヨナ締め出しに「当然」の声 「キム・ヨナが日本のアイスショーからは...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>102</th>\n",
" <td>0.010429</td>\n",
" <td>0.818316</td>\n",
" <td>0.171255</td>\n",
" <td>data/text/topic-news/topic-news-6388021.txt</td>\n",
" <td>**警察が女子高生を生きたまま田んぼに遺棄 21日、朝日新聞は、**の警察が倒れている女子高...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>103</th>\n",
" <td>0.014804</td>\n",
" <td>0.816421</td>\n",
" <td>0.168774</td>\n",
" <td>data/text/topic-news/topic-news-6226414.txt</td>\n",
" <td>「日本人が最も食べている漬物はキムチ」に「そんなわけないだろ」 25日、YOMIURI ON...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>104</th>\n",
" <td>0.008732</td>\n",
" <td>0.815220</td>\n",
" <td>0.176047</td>\n",
" <td>data/text/topic-news/topic-news-6395897.txt</td>\n",
" <td>**提案の「南京大虐殺否定罪」に、日本では「幼稚で横暴」だと非難殺到 21日、NEWSポスト...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>105</th>\n",
" <td>0.010536</td>\n",
" <td>0.814796</td>\n",
" <td>0.174668</td>\n",
" <td>data/text/topic-news/topic-news-6705586.txt</td>\n",
" <td>【韓国ニュース】北朝鮮が日韓の軍事協定を批判 韓国ユーザーからは「敵の敵は味方」の声 28...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>106</th>\n",
" <td>0.014255</td>\n",
" <td>0.808532</td>\n",
" <td>0.177213</td>\n",
" <td>data/text/topic-news/topic-news-6349177.txt</td>\n",
" <td>バットの上に長時間正座…プロ野球界の主従関係を非難 7日、プロ野球独立リーグのBCリーグ「福...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>107</th>\n",
" <td>0.031740</td>\n",
" <td>0.807555</td>\n",
" <td>0.160705</td>\n",
" <td>data/text/topic-news/topic-news-6696339.txt</td>\n",
" <td>フィリピンで日本人女性2人に性的暴行を加えた韓国人を逮捕 韓国ネットユーザーからは「日本は昔...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>108</th>\n",
" <td>0.008011</td>\n",
" <td>0.803337</td>\n",
" <td>0.188652</td>\n",
" <td>data/text/topic-news/topic-news-6353761.txt</td>\n",
" <td>「勝手な広告出すな!」韓国への感謝広告に批判殺到 \\t 9日、在韓国日本大使館が各韓国紙に「...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>109</th>\n",
" <td>0.004974</td>\n",
" <td>0.802660</td>\n",
" <td>0.192365</td>\n",
" <td>data/text/topic-news/topic-news-5934315.txt</td>\n",
" <td>ピザの起源は“韓国”とするCMが話題に ピザの起源を韓国だとする広告動画を韓国のピザ会社「ミ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>110</th>\n",
" <td>0.028537</td>\n",
" <td>0.797739</td>\n",
" <td>0.173724</td>\n",
" <td>data/text/topic-news/topic-news-6364323.txt</td>\n",
" <td>五輪マラソン代表の選出基準にネット掲示板で物議 12日に発表されたマラソン五輪代表の選考結果...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>111</th>\n",
" <td>0.013858</td>\n",
" <td>0.795593</td>\n",
" <td>0.190549</td>\n",
" <td>data/text/topic-news/topic-news-5953481.txt</td>\n",
" <td>日韓スワップ協定拡大に批判殺到 野田首相が10月19日、ソウルで行われた李明博（イミョンバ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>112</th>\n",
" <td>0.049260</td>\n",
" <td>0.795543</td>\n",
" <td>0.155197</td>\n",
" <td>data/text/topic-news/topic-news-6608148.txt</td>\n",
" <td>「ほかに開催希望者はないのか」 2020年五輪開催候補地にネットユーザの反応は？ 今月23日...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>113</th>\n",
" <td>0.011444</td>\n",
" <td>0.792846</td>\n",
" <td>0.195710</td>\n",
" <td>data/text/topic-news/topic-news-6361892.txt</td>\n",
" <td>「**に失礼」政府の対応に非難集中 12日、自民党の幹事長代理・世耕弘成氏が、東日本大震災の...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>114</th>\n",
" <td>0.007714</td>\n",
" <td>0.791888</td>\n",
" <td>0.200398</td>\n",
" <td>data/text/topic-news/topic-news-6744410.txt</td>\n",
" <td>【韓国ニュース】「竹島の写真ダメ」に韓国ネットユーザーからは怒りの声 10日、韓国紙「ヘラル...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>115</th>\n",
" <td>0.195250</td>\n",
" <td>0.790722</td>\n",
" <td>0.014029</td>\n",
" <td>data/text/topic-news/topic-news-6790797.txt</td>\n",
" <td>【韓国ニュース】「モテなかったから僧侶になった」 韓国僧侶の発言が話題呼ぶ 韓国では一般的に...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>116</th>\n",
" <td>0.007177</td>\n",
" <td>0.787791</td>\n",
" <td>0.205032</td>\n",
" <td>data/text/topic-news/topic-news-5934833.txt</td>\n",
" <td>「韓国人の顔は何故醜い？」に韓国人激怒 2ちゃんねるに作られたスレッド「韓国人は何故ブサイク...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>117</th>\n",
" <td>0.114864</td>\n",
" <td>0.787027</td>\n",
" <td>0.098109</td>\n",
" <td>data/text/topic-news/topic-news-5943989.txt</td>\n",
" <td>堀江氏、有料メルマガで1億円稼ぐ 株式会社まぐまぐ代表取締役、大川弘一氏がTwitterで、...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>118</th>\n",
" <td>0.008562</td>\n",
" <td>0.786947</td>\n",
" <td>0.204491</td>\n",
" <td>data/text/topic-news/topic-news-6732922.txt</td>\n",
" <td>【韓国ニュース】韓国政府の捕鯨再開宣言に韓国ネット掲示板「日本人の真似する必要ない」「犬も食...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>119</th>\n",
" <td>0.009684</td>\n",
" <td>0.786458</td>\n",
" <td>0.203859</td>\n",
" <td>data/text/topic-news/topic-news-5968673.txt</td>\n",
" <td>**の倫理を問う韓国に批判 8日午後、**で女性が暴漢に性的暴行を加えられ、全裸のまま30分...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>120</th>\n",
" <td>0.203462</td>\n",
" <td>0.784431</td>\n",
" <td>0.012107</td>\n",
" <td>data/text/topic-news/topic-news-6166579.txt</td>\n",
" <td>韓国ネットユーザーが東方神起と嵐の身長差に大喜び 昨年の大晦日に放送された「第62回NHK紅...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>121</th>\n",
" <td>0.006808</td>\n",
" <td>0.777772</td>\n",
" <td>0.215420</td>\n",
" <td>data/text/topic-news/topic-news-6861303.txt</td>\n",
" <td>李明博大統領の“嘘”に韓国ネットユーザーから非難相次ぐ 韓国のニュースサイト「ビューズ・アン...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>122</th>\n",
" <td>0.124518</td>\n",
" <td>0.758792</td>\n",
" <td>0.116689</td>\n",
" <td>data/text/topic-news/topic-news-5931334.txt</td>\n",
" <td>角川グループがメディアファクトリーを買収 リクルート傘下だったメディアファクトリーが角川グル...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>123</th>\n",
" <td>0.235940</td>\n",
" <td>0.744593</td>\n",
" <td>0.019467</td>\n",
" <td>data/text/topic-news/topic-news-6184471.txt</td>\n",
" <td>マツコの発言が海外メディアでも話題に 韓国のポップカルチャーを扱うアメリカのニュースサイト「...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>124</th>\n",
" <td>0.008767</td>\n",
" <td>0.737206</td>\n",
" <td>0.254027</td>\n",
" <td>data/text/topic-news/topic-news-6799292.txt</td>\n",
" <td>【韓国ニュース】韓国旗踏みつけ動画に批判殺到 韓国ユーザー「米国相手にはできないくせに」 ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>125</th>\n",
" <td>0.024057</td>\n",
" <td>0.730043</td>\n",
" <td>0.245900</td>\n",
" <td>data/text/topic-news/topic-news-6696248.txt</td>\n",
" <td>背番号7番を固辞した香川に英国ネットユーザーから賞賛相次ぐ 25日、英国紙「デイリー・メール...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>126</th>\n",
" <td>0.011670</td>\n",
" <td>0.728831</td>\n",
" <td>0.259499</td>\n",
" <td>data/text/topic-news/topic-news-6874561.txt</td>\n",
" <td>【韓国ニュース】韓国のコメディアン、田村淳に「黙れ、おっさん」 20日未明、韓国のコメディア...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>127</th>\n",
" <td>0.007193</td>\n",
" <td>0.728396</td>\n",
" <td>0.264411</td>\n",
" <td>data/text/topic-news/topic-news-6670196.txt</td>\n",
" <td>【韓国ニュース】「Siri」に「独島は韓国領土」と教え込むユーザーが話題に 17日、韓国メデ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>128</th>\n",
" <td>0.256254</td>\n",
" <td>0.725762</td>\n",
" <td>0.017985</td>\n",
" <td>data/text/topic-news/topic-news-6740348.txt</td>\n",
" <td>外国人が日本で友達を作る最も良い方法は？ アメリカのネット掲示板「Reddit」に、「日本...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>129</th>\n",
" <td>0.005541</td>\n",
" <td>0.720970</td>\n",
" <td>0.273490</td>\n",
" <td>data/text/topic-news/topic-news-6310413.txt</td>\n",
" <td>日本を強く非難する韓国歌手、キム・ジャンフン氏に怒りのコメント続出 韓国の歌手であるキム・ジ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>...</th>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>740</th>\n",
" <td>0.855409</td>\n",
" <td>0.007817</td>\n",
" <td>0.136773</td>\n",
" <td>data/text/topic-news/topic-news-6316640.txt</td>\n",
" <td>クイズ☆タレント名鑑の前田敦子に関する問題が「容赦無い」と話題に 26日に放送されたTBS系...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>741</th>\n",
" <td>0.208691</td>\n",
" <td>0.007816</td>\n",
" <td>0.783493</td>\n",
" <td>data/text/topic-news/topic-news-5938333.txt</td>\n",
" <td>au版iPhone4Sの購入者に“仕込み疑惑”が浮上 iPhone4Sが発売となった本日、徹...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>742</th>\n",
" <td>0.724867</td>\n",
" <td>0.007789</td>\n",
" <td>0.267344</td>\n",
" <td>data/text/topic-news/topic-news-5931153.txt</td>\n",
" <td>ＡＫＢ大島優子に非難殺到 「性格が悪すぎる」 インターネット掲示板２ちゃんねるで、AKB4...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>743</th>\n",
" <td>0.746203</td>\n",
" <td>0.007777</td>\n",
" <td>0.246020</td>\n",
" <td>data/text/topic-news/topic-news-6631065.txt</td>\n",
" <td>フジテレビ「家族のうた」など打ち切り相次ぐTV業界に、ネットユーザー「嫌なら見るなとか言って...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>744</th>\n",
" <td>0.698840</td>\n",
" <td>0.007707</td>\n",
" <td>0.293454</td>\n",
" <td>data/text/topic-news/topic-news-6895782.txt</td>\n",
" <td>有吉弘行が平成ノブシコブシ・吉村崇のブログ炎上に言及 お笑い芸人の有吉弘行が、26日に放送さ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>745</th>\n",
" <td>0.630251</td>\n",
" <td>0.007694</td>\n",
" <td>0.362054</td>\n",
" <td>data/text/topic-news/topic-news-6660541.txt</td>\n",
" <td>スギちゃん、本音明かす「ワイルドだけど、嫌われたくないんですよ」 14日、過労でダウンし、イ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>746</th>\n",
" <td>0.983611</td>\n",
" <td>0.007688</td>\n",
" <td>0.008701</td>\n",
" <td>data/text/topic-news/topic-news-6019023.txt</td>\n",
" <td>「マツコ&有吉の怒り新党2」出演者総とっかえの危機 9日放送の「マツコ&有吉の怒り新党」（テ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>747</th>\n",
" <td>0.983836</td>\n",
" <td>0.007641</td>\n",
" <td>0.008524</td>\n",
" <td>data/text/topic-news/topic-news-6780686.txt</td>\n",
" <td>「FNS27時間テレビ」 ローラのリアクションに「放送事故」の声 22日に放送された「FNS...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>748</th>\n",
" <td>0.826461</td>\n",
" <td>0.007585</td>\n",
" <td>0.165955</td>\n",
" <td>data/text/topic-news/topic-news-6302176.txt</td>\n",
" <td>オセロ中島がついに全レギュラー降板、″失業″状態に心配の声 22日、産経ニュースをはじめとし...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>749</th>\n",
" <td>0.898826</td>\n",
" <td>0.007525</td>\n",
" <td>0.093649</td>\n",
" <td>data/text/topic-news/topic-news-6563543.txt</td>\n",
" <td>リンカーンで放送事故、ツイッター騒然 15日に放送されたバラエティ番組「リンカーン」（TBS...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>750</th>\n",
" <td>0.984373</td>\n",
" <td>0.007428</td>\n",
" <td>0.008199</td>\n",
" <td>data/text/topic-news/topic-news-6449971.txt</td>\n",
" <td>テレビ朝日で花見のニュースに津波の映像が流れる放送事故 ネット掲示板は一時騒然 7日、テレビ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>751</th>\n",
" <td>0.909996</td>\n",
" <td>0.007397</td>\n",
" <td>0.082607</td>\n",
" <td>data/text/topic-news/topic-news-6586368.txt</td>\n",
" <td>野球中継が突然の中止、代替番組が用意できず非常事態に 22日に放送されたテレビ愛知の野球中継...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>752</th>\n",
" <td>0.549859</td>\n",
" <td>0.007392</td>\n",
" <td>0.442749</td>\n",
" <td>data/text/topic-news/topic-news-6317274.txt</td>\n",
" <td>漫画家うすた京介さんのパチンコ業界へのTwitter発言がネット掲示板で話題に 27日、漫画...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>753</th>\n",
" <td>0.878630</td>\n",
" <td>0.007364</td>\n",
" <td>0.114006</td>\n",
" <td>data/text/topic-news/topic-news-6450159.txt</td>\n",
" <td>加護亜依が号泣、自殺未遂騒動後初のテレビ出演に「もう芸能界やめたほうがいい」の声 9日、モー...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>754</th>\n",
" <td>0.977388</td>\n",
" <td>0.007242</td>\n",
" <td>0.015369</td>\n",
" <td>data/text/topic-news/topic-news-6406486.txt</td>\n",
" <td>有吉が「しゃべくり007」で暴露した“絡みたくない大物”とは誰か? 26日、日本テレビ系で放...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>755</th>\n",
" <td>0.697792</td>\n",
" <td>0.007239</td>\n",
" <td>0.294969</td>\n",
" <td>data/text/topic-news/topic-news-5907376.txt</td>\n",
" <td>紳助とたけしの明暗を分けたものとは 今年で20回目を迎えたTBSのオールスター感謝祭に、1回...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>756</th>\n",
" <td>0.984013</td>\n",
" <td>0.007222</td>\n",
" <td>0.008764</td>\n",
" <td>data/text/topic-news/topic-news-6668296.txt</td>\n",
" <td>指原莉乃をからかった浅草キッド・玉袋筋太郎に賛否 16日放送の「5時に夢中!」（東京MXテレ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>757</th>\n",
" <td>0.887530</td>\n",
" <td>0.007110</td>\n",
" <td>0.105361</td>\n",
" <td>data/text/topic-news/topic-news-5971115.txt</td>\n",
" <td>“キラキラネーム”でうつになる罪のない子供たち 「キラキラネーム」という言葉をご存知だろうか...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>758</th>\n",
" <td>0.032959</td>\n",
" <td>0.006962</td>\n",
" <td>0.960079</td>\n",
" <td>data/text/topic-news/topic-news-6613650.txt</td>\n",
" <td>生活保護のイメージ悪化に**も、反論の声多数 30日、生活保護問題対策全国会議は、東京・千代...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>759</th>\n",
" <td>0.632465</td>\n",
" <td>0.006928</td>\n",
" <td>0.360607</td>\n",
" <td>data/text/topic-news/topic-news-6301970.txt</td>\n",
" <td>見知らぬ団体が勝手にハロプロのYouTube公式チャンネルを削除、物議に 21日、ハロープロ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>760</th>\n",
" <td>0.626982</td>\n",
" <td>0.006851</td>\n",
" <td>0.366167</td>\n",
" <td>data/text/topic-news/topic-news-6586056.txt</td>\n",
" <td>河本準一、大手企業広告から存在消される事態に 23日、母親の生活保護受給が物議を醸している、...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>761</th>\n",
" <td>0.906056</td>\n",
" <td>0.006742</td>\n",
" <td>0.087202</td>\n",
" <td>data/text/topic-news/topic-news-6154347.txt</td>\n",
" <td>大槻教授、たけしの番組の“やらせ”を暴露 超自然現象や超能力などのオカルト事象を科学的観点か...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>762</th>\n",
" <td>0.895600</td>\n",
" <td>0.006678</td>\n",
" <td>0.097721</td>\n",
" <td>data/text/topic-news/topic-news-6899432.txt</td>\n",
" <td>伊集院光がラジオで「24時間テレビ」について“本音”を語る 27日、伊集院光がラジオ番組「J...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>763</th>\n",
" <td>0.350810</td>\n",
" <td>0.006344</td>\n",
" <td>0.642846</td>\n",
" <td>data/text/topic-news/topic-news-6584186.txt</td>\n",
" <td>神田うのの手のひら返しにネットユーザ騒然 21日、神田うのが自身のブログで二股騒動があった料...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>764</th>\n",
" <td>0.052264</td>\n",
" <td>0.006001</td>\n",
" <td>0.941735</td>\n",
" <td>data/text/topic-news/topic-news-6601493.txt</td>\n",
" <td>河本の生活保護問題で、オリラジ・藤森がツイッターで騒動に 25日、母親の生活保護受給について...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>765</th>\n",
" <td>0.988235</td>\n",
" <td>0.005657</td>\n",
" <td>0.006109</td>\n",
" <td>data/text/topic-news/topic-news-6674453.txt</td>\n",
" <td>AKB指原のスキャンダル。TBS番組は「90％以上のファンが彼女を許した」と説明 今月14日...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>766</th>\n",
" <td>0.330100</td>\n",
" <td>0.005626</td>\n",
" <td>0.664274</td>\n",
" <td>data/text/topic-news/topic-news-6738399.txt</td>\n",
" <td>「世の中そんなに甘くないからね」 スーパーマーケット店員の発言に批判殺到し店舗ブログも大炎上...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>767</th>\n",
" <td>0.841284</td>\n",
" <td>0.005133</td>\n",
" <td>0.153583</td>\n",
" <td>data/text/topic-news/topic-news-5910461.txt</td>\n",
" <td>読売テレビ広報部長の無礼千万メールにジャーナリスト烏賀陽（うがや）弘道さんが激怒 ジャー...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>768</th>\n",
" <td>0.991185</td>\n",
" <td>0.004218</td>\n",
" <td>0.004596</td>\n",
" <td>data/text/topic-news/topic-news-5903373.txt</td>\n",
" <td>写真が流出し“堕ちていった”アイドルたち アイドルが男性と一緒に写ったプリクラやニャンニャン...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" <tr>\n",
" <th>769</th>\n",
" <td>0.788469</td>\n",
" <td>0.003428</td>\n",
" <td>0.208103</td>\n",
" <td>data/text/topic-news/topic-news-6696655.txt</td>\n",
" <td>元AKB指原莉乃、生放送で胸中告白。交際相手のことやネットの書き込みにも言及 今月14日に発...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" </tr>\n",
" </tbody>\n",
"</table>\n",
"<p>670 rows × 10 columns</p>\n",
"</div>"
],
"text/plain": [
" topic00 topic01 topic02 \\\n",
"100 0.017635 0.821989 0.160377 \n",
"101 0.016988 0.821360 0.161651 \n",
"102 0.010429 0.818316 0.171255 \n",
"103 0.014804 0.816421 0.168774 \n",
"104 0.008732 0.815220 0.176047 \n",
"105 0.010536 0.814796 0.174668 \n",
"106 0.014255 0.808532 0.177213 \n",
"107 0.031740 0.807555 0.160705 \n",
"108 0.008011 0.803337 0.188652 \n",
"109 0.004974 0.802660 0.192365 \n",
"110 0.028537 0.797739 0.173724 \n",
"111 0.013858 0.795593 0.190549 \n",
"112 0.049260 0.795543 0.155197 \n",
"113 0.011444 0.792846 0.195710 \n",
"114 0.007714 0.791888 0.200398 \n",
"115 0.195250 0.790722 0.014029 \n",
"116 0.007177 0.787791 0.205032 \n",
"117 0.114864 0.787027 0.098109 \n",
"118 0.008562 0.786947 0.204491 \n",
"119 0.009684 0.786458 0.203859 \n",
"120 0.203462 0.784431 0.012107 \n",
"121 0.006808 0.777772 0.215420 \n",
"122 0.124518 0.758792 0.116689 \n",
"123 0.235940 0.744593 0.019467 \n",
"124 0.008767 0.737206 0.254027 \n",
"125 0.024057 0.730043 0.245900 \n",
"126 0.011670 0.728831 0.259499 \n",
"127 0.007193 0.728396 0.264411 \n",
"128 0.256254 0.725762 0.017985 \n",
"129 0.005541 0.720970 0.273490 \n",
".. ... ... ... \n",
"740 0.855409 0.007817 0.136773 \n",
"741 0.208691 0.007816 0.783493 \n",
"742 0.724867 0.007789 0.267344 \n",
"743 0.746203 0.007777 0.246020 \n",
"744 0.698840 0.007707 0.293454 \n",
"745 0.630251 0.007694 0.362054 \n",
"746 0.983611 0.007688 0.008701 \n",
"747 0.983836 0.007641 0.008524 \n",
"748 0.826461 0.007585 0.165955 \n",
"749 0.898826 0.007525 0.093649 \n",
"750 0.984373 0.007428 0.008199 \n",
"751 0.909996 0.007397 0.082607 \n",
"752 0.549859 0.007392 0.442749 \n",
"753 0.878630 0.007364 0.114006 \n",
"754 0.977388 0.007242 0.015369 \n",
"755 0.697792 0.007239 0.294969 \n",
"756 0.984013 0.007222 0.008764 \n",
"757 0.887530 0.007110 0.105361 \n",
"758 0.032959 0.006962 0.960079 \n",
"759 0.632465 0.006928 0.360607 \n",
"760 0.626982 0.006851 0.366167 \n",
"761 0.906056 0.006742 0.087202 \n",
"762 0.895600 0.006678 0.097721 \n",
"763 0.350810 0.006344 0.642846 \n",
"764 0.052264 0.006001 0.941735 \n",
"765 0.988235 0.005657 0.006109 \n",
"766 0.330100 0.005626 0.664274 \n",
"767 0.841284 0.005133 0.153583 \n",
"768 0.991185 0.004218 0.004596 \n",
"769 0.788469 0.003428 0.208103 \n",
"\n",
" doc_file \\\n",
"100 data/text/topic-news/topic-news-6017374.txt \n",
"101 data/text/topic-news/topic-news-5966020.txt \n",
"102 data/text/topic-news/topic-news-6388021.txt \n",
"103 data/text/topic-news/topic-news-6226414.txt \n",
"104 data/text/topic-news/topic-news-6395897.txt \n",
"105 data/text/topic-news/topic-news-6705586.txt \n",
"106 data/text/topic-news/topic-news-6349177.txt \n",
"107 data/text/topic-news/topic-news-6696339.txt \n",
"108 data/text/topic-news/topic-news-6353761.txt \n",
"109 data/text/topic-news/topic-news-5934315.txt \n",
"110 data/text/topic-news/topic-news-6364323.txt \n",
"111 data/text/topic-news/topic-news-5953481.txt \n",
"112 data/text/topic-news/topic-news-6608148.txt \n",
"113 data/text/topic-news/topic-news-6361892.txt \n",
"114 data/text/topic-news/topic-news-6744410.txt \n",
"115 data/text/topic-news/topic-news-6790797.txt \n",
"116 data/text/topic-news/topic-news-5934833.txt \n",
"117 data/text/topic-news/topic-news-5943989.txt \n",
"118 data/text/topic-news/topic-news-6732922.txt \n",
"119 data/text/topic-news/topic-news-5968673.txt \n",
"120 data/text/topic-news/topic-news-6166579.txt \n",
"121 data/text/topic-news/topic-news-6861303.txt \n",
"122 data/text/topic-news/topic-news-5931334.txt \n",
"123 data/text/topic-news/topic-news-6184471.txt \n",
"124 data/text/topic-news/topic-news-6799292.txt \n",
"125 data/text/topic-news/topic-news-6696248.txt \n",
"126 data/text/topic-news/topic-news-6874561.txt \n",
"127 data/text/topic-news/topic-news-6670196.txt \n",
"128 data/text/topic-news/topic-news-6740348.txt \n",
"129 data/text/topic-news/topic-news-6310413.txt \n",
".. ... \n",
"740 data/text/topic-news/topic-news-6316640.txt \n",
"741 data/text/topic-news/topic-news-5938333.txt \n",
"742 data/text/topic-news/topic-news-5931153.txt \n",
"743 data/text/topic-news/topic-news-6631065.txt \n",
"744 data/text/topic-news/topic-news-6895782.txt \n",
"745 data/text/topic-news/topic-news-6660541.txt \n",
"746 data/text/topic-news/topic-news-6019023.txt \n",
"747 data/text/topic-news/topic-news-6780686.txt \n",
"748 data/text/topic-news/topic-news-6302176.txt \n",
"749 data/text/topic-news/topic-news-6563543.txt \n",
"750 data/text/topic-news/topic-news-6449971.txt \n",
"751 data/text/topic-news/topic-news-6586368.txt \n",
"752 data/text/topic-news/topic-news-6317274.txt \n",
"753 data/text/topic-news/topic-news-6450159.txt \n",
"754 data/text/topic-news/topic-news-6406486.txt \n",
"755 data/text/topic-news/topic-news-5907376.txt \n",
"756 data/text/topic-news/topic-news-6668296.txt \n",
"757 data/text/topic-news/topic-news-5971115.txt \n",
"758 data/text/topic-news/topic-news-6613650.txt \n",
"759 data/text/topic-news/topic-news-6301970.txt \n",
"760 data/text/topic-news/topic-news-6586056.txt \n",
"761 data/text/topic-news/topic-news-6154347.txt \n",
"762 data/text/topic-news/topic-news-6899432.txt \n",
"763 data/text/topic-news/topic-news-6584186.txt \n",
"764 data/text/topic-news/topic-news-6601493.txt \n",
"765 data/text/topic-news/topic-news-6674453.txt \n",
"766 data/text/topic-news/topic-news-6738399.txt \n",
"767 data/text/topic-news/topic-news-5910461.txt \n",
"768 data/text/topic-news/topic-news-5903373.txt \n",
"769 data/text/topic-news/topic-news-6696655.txt \n",
"\n",
" doc_text tag_芸能 tag_海外 \\\n",
"100 日本の習慣に外国人が激怒 居酒屋で注文せずとも出される“お通し”。日本ではお馴染みの習慣だが... NaN NaN \n",
"101 日本スケート連盟のキム・ヨナ締め出しに「当然」の声 「キム・ヨナが日本のアイスショーからは... NaN NaN \n",
"102 **警察が女子高生を生きたまま田んぼに遺棄 21日、朝日新聞は、**の警察が倒れている女子高... NaN NaN \n",
"103 「日本人が最も食べている漬物はキムチ」に「そんなわけないだろ」 25日、YOMIURI ON... NaN NaN \n",
"104 **提案の「南京大虐殺否定罪」に、日本では「幼稚で横暴」だと非難殺到 21日、NEWSポスト... NaN NaN \n",
"105 【韓国ニュース】北朝鮮が日韓の軍事協定を批判 韓国ユーザーからは「敵の敵は味方」の声 28... NaN NaN \n",
"106 バットの上に長時間正座…プロ野球界の主従関係を非難 7日、プロ野球独立リーグのBCリーグ「福... NaN NaN \n",
"107 フィリピンで日本人女性2人に性的暴行を加えた韓国人を逮捕 韓国ネットユーザーからは「日本は昔... NaN NaN \n",
"108 「勝手な広告出すな!」韓国への感謝広告に批判殺到 \\t 9日、在韓国日本大使館が各韓国紙に「... NaN NaN \n",
"109 ピザの起源は“韓国”とするCMが話題に ピザの起源を韓国だとする広告動画を韓国のピザ会社「ミ... NaN NaN \n",
"110 五輪マラソン代表の選出基準にネット掲示板で物議 12日に発表されたマラソン五輪代表の選考結果... NaN NaN \n",
"111 日韓スワップ協定拡大に批判殺到 野田首相が10月19日、ソウルで行われた李明博（イミョンバ... NaN NaN \n",
"112 「ほかに開催希望者はないのか」 2020年五輪開催候補地にネットユーザの反応は？ 今月23日... NaN NaN \n",
"113 「**に失礼」政府の対応に非難集中 12日、自民党の幹事長代理・世耕弘成氏が、東日本大震災の... NaN NaN \n",
"114 【韓国ニュース】「竹島の写真ダメ」に韓国ネットユーザーからは怒りの声 10日、韓国紙「ヘラル... NaN NaN \n",
"115 【韓国ニュース】「モテなかったから僧侶になった」 韓国僧侶の発言が話題呼ぶ 韓国では一般的に... NaN NaN \n",
"116 「韓国人の顔は何故醜い？」に韓国人激怒 2ちゃんねるに作られたスレッド「韓国人は何故ブサイク... NaN NaN \n",
"117 堀江氏、有料メルマガで1億円稼ぐ 株式会社まぐまぐ代表取締役、大川弘一氏がTwitterで、... NaN NaN \n",
"118 【韓国ニュース】韓国政府の捕鯨再開宣言に韓国ネット掲示板「日本人の真似する必要ない」「犬も食... NaN NaN \n",
"119 **の倫理を問う韓国に批判 8日午後、**で女性が暴漢に性的暴行を加えられ、全裸のまま30分... NaN NaN \n",
"120 韓国ネットユーザーが東方神起と嵐の身長差に大喜び 昨年の大晦日に放送された「第62回NHK紅... NaN NaN \n",
"121 李明博大統領の“嘘”に韓国ネットユーザーから非難相次ぐ 韓国のニュースサイト「ビューズ・アン... NaN NaN \n",
"122 角川グループがメディアファクトリーを買収 リクルート傘下だったメディアファクトリーが角川グル... NaN NaN \n",
"123 マツコの発言が海外メディアでも話題に 韓国のポップカルチャーを扱うアメリカのニュースサイト「... NaN NaN \n",
"124 【韓国ニュース】韓国旗踏みつけ動画に批判殺到 韓国ユーザー「米国相手にはできないくせに」 ... NaN NaN \n",
"125 背番号7番を固辞した香川に英国ネットユーザーから賞賛相次ぐ 25日、英国紙「デイリー・メール... NaN NaN \n",
"126 【韓国ニュース】韓国のコメディアン、田村淳に「黙れ、おっさん」 20日未明、韓国のコメディア... NaN NaN \n",
"127 【韓国ニュース】「Siri」に「独島は韓国領土」と教え込むユーザーが話題に 17日、韓国メデ... NaN NaN \n",
"128 外国人が日本で友達を作る最も良い方法は？ アメリカのネット掲示板「Reddit」に、「日本... NaN NaN \n",
"129 日本を強く非難する韓国歌手、キム・ジャンフン氏に怒りのコメント続出 韓国の歌手であるキム・ジ... NaN NaN \n",
".. ... ... ... \n",
"740 クイズ☆タレント名鑑の前田敦子に関する問題が「容赦無い」と話題に 26日に放送されたTBS系... NaN NaN \n",
"741 au版iPhone4Sの購入者に“仕込み疑惑”が浮上 iPhone4Sが発売となった本日、徹... NaN NaN \n",
"742 ＡＫＢ大島優子に非難殺到 「性格が悪すぎる」 インターネット掲示板２ちゃんねるで、AKB4... NaN NaN \n",
"743 フジテレビ「家族のうた」など打ち切り相次ぐTV業界に、ネットユーザー「嫌なら見るなとか言って... NaN NaN \n",
"744 有吉弘行が平成ノブシコブシ・吉村崇のブログ炎上に言及 お笑い芸人の有吉弘行が、26日に放送さ... NaN NaN \n",
"745 スギちゃん、本音明かす「ワイルドだけど、嫌われたくないんですよ」 14日、過労でダウンし、イ... NaN NaN \n",
"746 「マツコ&有吉の怒り新党2」出演者総とっかえの危機 9日放送の「マツコ&有吉の怒り新党」（テ... NaN NaN \n",
"747 「FNS27時間テレビ」 ローラのリアクションに「放送事故」の声 22日に放送された「FNS... NaN NaN \n",
"748 オセロ中島がついに全レギュラー降板、″失業″状態に心配の声 22日、産経ニュースをはじめとし... NaN NaN \n",
"749 リンカーンで放送事故、ツイッター騒然 15日に放送されたバラエティ番組「リンカーン」（TBS... NaN NaN \n",
"750 テレビ朝日で花見のニュースに津波の映像が流れる放送事故 ネット掲示板は一時騒然 7日、テレビ... NaN NaN \n",
"751 野球中継が突然の中止、代替番組が用意できず非常事態に 22日に放送されたテレビ愛知の野球中継... NaN NaN \n",
"752 漫画家うすた京介さんのパチンコ業界へのTwitter発言がネット掲示板で話題に 27日、漫画... NaN NaN \n",
"753 加護亜依が号泣、自殺未遂騒動後初のテレビ出演に「もう芸能界やめたほうがいい」の声 9日、モー... NaN NaN \n",
"754 有吉が「しゃべくり007」で暴露した“絡みたくない大物”とは誰か? 26日、日本テレビ系で放... NaN NaN \n",
"755 紳助とたけしの明暗を分けたものとは 今年で20回目を迎えたTBSのオールスター感謝祭に、1回... NaN NaN \n",
"756 指原莉乃をからかった浅草キッド・玉袋筋太郎に賛否 16日放送の「5時に夢中!」（東京MXテレ... NaN NaN \n",
"757 “キラキラネーム”でうつになる罪のない子供たち 「キラキラネーム」という言葉をご存知だろうか... NaN NaN \n",
"758 生活保護のイメージ悪化に**も、反論の声多数 30日、生活保護問題対策全国会議は、東京・千代... NaN NaN \n",
"759 見知らぬ団体が勝手にハロプロのYouTube公式チャンネルを削除、物議に 21日、ハロープロ... NaN NaN \n",
"760 河本準一、大手企業広告から存在消される事態に 23日、母親の生活保護受給が物議を醸している、... NaN NaN \n",
"761 大槻教授、たけしの番組の“やらせ”を暴露 超自然現象や超能力などのオカルト事象を科学的観点か... NaN NaN \n",
"762 伊集院光がラジオで「24時間テレビ」について“本音”を語る 27日、伊集院光がラジオ番組「J... NaN NaN \n",
"763 神田うのの手のひら返しにネットユーザ騒然 21日、神田うのが自身のブログで二股騒動があった料... NaN NaN \n",
"764 河本の生活保護問題で、オリラジ・藤森がツイッターで騒動に 25日、母親の生活保護受給について... NaN NaN \n",
"765 AKB指原のスキャンダル。TBS番組は「90％以上のファンが彼女を許した」と説明 今月14日... NaN NaN \n",
"766 「世の中そんなに甘くないからね」 スーパーマーケット店員の発言に批判殺到し店舗ブログも大炎上... NaN NaN \n",
"767 読売テレビ広報部長の無礼千万メールにジャーナリスト烏賀陽（うがや）弘道さんが激怒 ジャー... NaN NaN \n",
"768 写真が流出し“堕ちていった”アイドルたち アイドルが男性と一緒に写ったプリクラやニャンニャン... NaN NaN \n",
"769 元AKB指原莉乃、生放送で胸中告白。交際相手のことやネットの書き込みにも言及 今月14日に発... NaN NaN \n",
"\n",
" tag_社会 tag_政治 tag_スポーツ \n",
"100 NaN NaN NaN \n",
"101 NaN NaN NaN \n",
"102 NaN NaN NaN \n",
"103 NaN NaN NaN \n",
"104 NaN NaN NaN \n",
"105 NaN NaN NaN \n",
"106 NaN NaN NaN \n",
"107 NaN NaN NaN \n",
"108 NaN NaN NaN \n",
"109 NaN NaN NaN \n",
"110 NaN NaN NaN \n",
"111 NaN NaN NaN \n",
"112 NaN NaN NaN \n",
"113 NaN NaN NaN \n",
"114 NaN NaN NaN \n",
"115 NaN NaN NaN \n",
"116 NaN NaN NaN \n",
"117 NaN NaN NaN \n",
"118 NaN NaN NaN \n",
"119 NaN NaN NaN \n",
"120 NaN NaN NaN \n",
"121 NaN NaN NaN \n",
"122 NaN NaN NaN \n",
"123 NaN NaN NaN \n",
"124 NaN NaN NaN \n",
"125 NaN NaN NaN \n",
"126 NaN NaN NaN \n",
"127 NaN NaN NaN \n",
"128 NaN NaN NaN \n",
"129 NaN NaN NaN \n",
".. ... ... ... \n",
"740 NaN NaN NaN \n",
"741 NaN NaN NaN \n",
"742 NaN NaN NaN \n",
"743 NaN NaN NaN \n",
"744 NaN NaN NaN \n",
"745 NaN NaN NaN \n",
"746 NaN NaN NaN \n",
"747 NaN NaN NaN \n",
"748 NaN NaN NaN \n",
"749 NaN NaN NaN \n",
"750 NaN NaN NaN \n",
"751 NaN NaN NaN \n",
"752 NaN NaN NaN \n",
"753 NaN NaN NaN \n",
"754 NaN NaN NaN \n",
"755 NaN NaN NaN \n",
"756 NaN NaN NaN \n",
"757 NaN NaN NaN \n",
"758 NaN NaN NaN \n",
"759 NaN NaN NaN \n",
"760 NaN NaN NaN \n",
"761 NaN NaN NaN \n",
"762 NaN NaN NaN \n",
"763 NaN NaN NaN \n",
"764 NaN NaN NaN \n",
"765 NaN NaN NaN \n",
"766 NaN NaN NaN \n",
"767 NaN NaN NaN \n",
"768 NaN NaN NaN \n",
"769 NaN NaN NaN \n",
"\n",
"[670 rows x 10 columns]"
]
},
"execution_count": 9,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"# 後半のほとんどが未記入です。\n",
"df_tag[100:]"
]
},
{
"cell_type": "code",
"execution_count": 10,
"metadata": {},
"outputs": [
{
"data": {
"text/plain": [
"array([0.18183837, 0.17303968, 0.64512195, 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 1. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. , 0. , 0. , 0. , 0. ,\n",
" 0. ])"
]
},
"execution_count": 10,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"# ここで、textからベクトルを生成する関数を定義しておきます。\n",
"\n",
"text = '''\n",
"衆議院の総選挙が開始しました。\n",
"事前の電話調査によれば、与党、野党ともに指示が割れていて予断ができない状態です。\n",
"'''\n",
"\n",
"## テキストをtopicに変換するために必要な学習済みインスタンスを読み込む。\n",
"file_name = 'data/processed/count_vectorizer.pickle'\n",
"with open(file_name, 'rb') as f:\n",
" count_vectorizer = pickle.load(f)\n",
"file_name = 'data/processed/lda.pickle'\n",
"with open(file_name, 'rb') as f:\n",
" lda = pickle.load(f)\n",
"\n",
"## text_vectorize関数を作成し、textをtopicベクトルに変換する手続きを定義する。\n",
"import numpy as np\n",
"def text_vectorize(text):\n",
" _text = text_cleaning(text)\n",
" token = kei.tokenize(_text)\n",
" wakachi = ' '.join([to[2] for to in token])\n",
" count_vec = count_vectorizer.transform([wakachi])[0]\n",
" topic_vec = lda.transform(count_vec)\n",
" # 今回は、topic_vecとcount_vec を変数とする （tf-idfでもよい）\n",
" return np.concatenate([topic_vec, count_vec.toarray()], axis=1)[0]\n",
"\n",
"## このように、入力されたtextをtopicベクトルとして出力することができるようになりました。\n",
"x = text_vectorize(text)\n",
"x\n",
"\n"
]
},
{
"cell_type": "code",
"execution_count": 11,
"metadata": {},
"outputs": [
{
"data": {
"text/plain": [
"{'tag_芸能': GradientBoostingClassifier(criterion='friedman_mse', init=None,\n",
" learning_rate=0.1, loss='deviance', max_depth=3,\n",
" max_features=None, max_leaf_nodes=None,\n",
" min_impurity_decrease=0.0, min_impurity_split=None,\n",
" min_samples_leaf=1, min_samples_split=2,\n",
" min_weight_fraction_leaf=0.0, n_estimators=100,\n",
" n_iter_no_change=None, presort='auto', random_state=None,\n",
" subsample=1.0, tol=0.0001, validation_fraction=0.1,\n",
" verbose=0, warm_start=False),\n",
" 'tag_海外': GradientBoostingClassifier(criterion='friedman_mse', init=None,\n",
" learning_rate=0.1, loss='deviance', max_depth=3,\n",
" max_features=None, max_leaf_nodes=None,\n",
" min_impurity_decrease=0.0, min_impurity_split=None,\n",
" min_samples_leaf=1, min_samples_split=2,\n",
" min_weight_fraction_leaf=0.0, n_estimators=100,\n",
" n_iter_no_change=None, presort='auto', random_state=None,\n",
" subsample=1.0, tol=0.0001, validation_fraction=0.1,\n",
" verbose=0, warm_start=False),\n",
" 'tag_社会': GradientBoostingClassifier(criterion='friedman_mse', init=None,\n",
" learning_rate=0.1, loss='deviance', max_depth=3,\n",
" max_features=None, max_leaf_nodes=None,\n",
" min_impurity_decrease=0.0, min_impurity_split=None,\n",
" min_samples_leaf=1, min_samples_split=2,\n",
" min_weight_fraction_leaf=0.0, n_estimators=100,\n",
" n_iter_no_change=None, presort='auto', random_state=None,\n",
" subsample=1.0, tol=0.0001, validation_fraction=0.1,\n",
" verbose=0, warm_start=False),\n",
" 'tag_政治': GradientBoostingClassifier(criterion='friedman_mse', init=None,\n",
" learning_rate=0.1, loss='deviance', max_depth=3,\n",
" max_features=None, max_leaf_nodes=None,\n",
" min_impurity_decrease=0.0, min_impurity_split=None,\n",
" min_samples_leaf=1, min_samples_split=2,\n",
" min_weight_fraction_leaf=0.0, n_estimators=100,\n",
" n_iter_no_change=None, presort='auto', random_state=None,\n",
" subsample=1.0, tol=0.0001, validation_fraction=0.1,\n",
" verbose=0, warm_start=False),\n",
" 'tag_スポーツ': GradientBoostingClassifier(criterion='friedman_mse', init=None,\n",
" learning_rate=0.1, loss='deviance', max_depth=3,\n",
" max_features=None, max_leaf_nodes=None,\n",
" min_impurity_decrease=0.0, min_impurity_split=None,\n",
" min_samples_leaf=1, min_samples_split=2,\n",
" min_weight_fraction_leaf=0.0, n_estimators=100,\n",
" n_iter_no_change=None, presort='auto', random_state=None,\n",
" subsample=1.0, tol=0.0001, validation_fraction=0.1,\n",
" verbose=0, warm_start=False)}"
]
},
"execution_count": 11,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"# 手動でつけたタグを学習します。\n",
"from sklearn.ensemble import GradientBoostingClassifier\n",
"\n",
"estimater_dict = dict()\n",
"tags = [col for col in df_tag.columns if re.match('^tag_', col)] \n",
"topics = [col for col in df_tag.columns if re.match('^topic', col)] \n",
"for tag in tags:\n",
" # tag を未記入の部分は学習から除外します\n",
" train_index = np.logical_not(np.isnan(df_tag[tag]))\n",
" y = df_tag.loc[train_index, tag]\n",
" # 上記で定義したベクトル化関数を使います。\n",
" X = [text_vectorize(text) for text in df_tag.loc[train_index, 'doc_text']]\n",
" estimator = GradientBoostingClassifier()\n",
" estimator.fit(X, y)\n",
" estimater_dict[tag] = estimator\n",
"\n",
"# タグごとの学習済みセットが出来上がります。\n",
"estimater_dict"
]
},
{
"cell_type": "code",
"execution_count": 12,
"metadata": {},
"outputs": [
{
"data": {
"text/plain": [
"{'tag_芸能': 0.00017465496603007933,\n",
" 'tag_海外': 0.00029488326534318207,\n",
" 'tag_社会': 0.0006311296630511109,\n",
" 'tag_政治': 0.9992325150247189,\n",
" 'tag_スポーツ': 0.00017988462140266926}"
]
},
"execution_count": 12,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"# では新しいtextに対して予測させてみます。\n",
"text = '''\n",
"衆議院の総選挙が開始しました。\n",
"事前の電話調査によれば、与党、野党ともに指示が割れていて予断ができない状態です。\n",
"'''\n",
"def predict(text):\n",
" x = text_vectorize(text)\n",
" predict_result = {}\n",
" for tag, estimator in estimater_dict.items():\n",
" predict_result[tag] = estimator.predict_proba([x])[0][1]\n",
"\n",
" return predict_result\n",
"\n",
"predict(text) # 政治は予測できているようです。"
]
},
{
"cell_type": "code",
"execution_count": 13,
"metadata": {},
"outputs": [
{
"data": {
"text/plain": [
"{'tag_芸能': 0.00017465496603007933,\n",
" 'tag_海外': 0.999705116734657,\n",
" 'tag_社会': 0.0006311296630511109,\n",
" 'tag_政治': 0.00017797109066622262,\n",
" 'tag_スポーツ': 0.00017988462140266926}"
]
},
"execution_count": 13,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"text = '''\n",
"先日、サッカーの世界大会がありました。\n",
"日本代表チームは予選突破し、決勝トーナメントへ駒を進めました。しかし、惜しくも３回戦で敗退しました。\n",
"次は五輪オリンピック予選に向けて、調整に入ります。\n",
"'''\n",
"predict(text) # 海外は予測できているけれど、スポーツはまだ不十分です。"
]
},
{
"cell_type": "code",
"execution_count": 14,
"metadata": {},
"outputs": [
{
"data": {
"text/html": [
"<div>\n",
"<style scoped>\n",
" .dataframe tbody tr th:only-of-type {\n",
" vertical-align: middle;\n",
" }\n",
"\n",
" .dataframe tbody tr th {\n",
" vertical-align: top;\n",
" }\n",
"\n",
" .dataframe thead th {\n",
" text-align: right;\n",
" }\n",
"</style>\n",
"<table border=\"1\" class=\"dataframe\">\n",
" <thead>\n",
" <tr style=\"text-align: right;\">\n",
" <th></th>\n",
" <th>topic00</th>\n",
" <th>topic01</th>\n",
" <th>topic02</th>\n",
" <th>doc_file</th>\n",
" <th>doc_text</th>\n",
" <th>tag_芸能</th>\n",
" <th>tag_海外</th>\n",
" <th>tag_社会</th>\n",
" <th>tag_政治</th>\n",
" <th>tag_スポーツ</th>\n",
" <th>predict_tag_芸能</th>\n",
" <th>predict_tag_海外</th>\n",
" <th>predict_tag_社会</th>\n",
" <th>predict_tag_政治</th>\n",
" <th>predict_tag_スポーツ</th>\n",
" </tr>\n",
" </thead>\n",
" <tbody>\n",
" <tr>\n",
" <th>0</th>\n",
" <td>0.006954</td>\n",
" <td>0.986436</td>\n",
" <td>0.006611</td>\n",
" <td>data/text/topic-news/topic-news-6843698.txt</td>\n",
" <td>同じホテルに滞在している、日本代表と韓国代表 10日、韓国「ソウル新聞」は、翌11日（日本時...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.000631</td>\n",
" <td>0.000178</td>\n",
" <td>0.999698</td>\n",
" </tr>\n",
" <tr>\n",
" <th>1</th>\n",
" <td>0.007343</td>\n",
" <td>0.985629</td>\n",
" <td>0.007028</td>\n",
" <td>data/text/topic-news/topic-news-6841012.txt</td>\n",
" <td>五輪サッカー日韓戦において、韓国が注目する“ある選手”とは？ 日本時間11日午前3時45分よ...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.000631</td>\n",
" <td>0.000178</td>\n",
" <td>0.999698</td>\n",
" </tr>\n",
" <tr>\n",
" <th>2</th>\n",
" <td>0.007180</td>\n",
" <td>0.985483</td>\n",
" <td>0.007337</td>\n",
" <td>data/text/topic-news/topic-news-6829539.txt</td>\n",
" <td>女子アーチェリー銅メダリスト早川蓮、 韓国でも話題に 6日、アーチェリー女子銅メダリストの早...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.001809</td>\n",
" <td>0.000188</td>\n",
" <td>0.999698</td>\n",
" </tr>\n",
" <tr>\n",
" <th>3</th>\n",
" <td>0.007506</td>\n",
" <td>0.984469</td>\n",
" <td>0.008026</td>\n",
" <td>data/text/topic-news/topic-news-6608684.txt</td>\n",
" <td>五輪逃したタイが「日本の八百長疑惑」を一斉報道 29日、タイでは、女子バレーボール五輪予選で...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.001809</td>\n",
" <td>0.000188</td>\n",
" <td>0.999289</td>\n",
" </tr>\n",
" <tr>\n",
" <th>4</th>\n",
" <td>0.007822</td>\n",
" <td>0.984203</td>\n",
" <td>0.007975</td>\n",
" <td>data/text/topic-news/topic-news-6842234.txt</td>\n",
" <td>五輪サッカーで日韓が激突、韓国ユーザは「餌を出して試合させるのは間違っている」 韓国「文化日...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.988512</td>\n",
" <td>0.000178</td>\n",
" <td>0.999698</td>\n",
" </tr>\n",
" <tr>\n",
" <th>5</th>\n",
" <td>0.007915</td>\n",
" <td>0.983509</td>\n",
" <td>0.008577</td>\n",
" <td>data/text/topic-news/topic-news-6818120.txt</td>\n",
" <td>女子バドミントン失格に韓国では「なでしこジャパンの引き分け狙いはOKなのになぜ…」の声 ロン...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.001809</td>\n",
" <td>0.000178</td>\n",
" <td>0.999698</td>\n",
" </tr>\n",
" <tr>\n",
" <th>6</th>\n",
" <td>0.008171</td>\n",
" <td>0.983338</td>\n",
" <td>0.008491</td>\n",
" <td>data/text/topic-news/topic-news-6636116.txt</td>\n",
" <td>FIFA最新ランキング発表、韓国ユーザが敗北宣言!? 6日、FIFAはサッカーの世界ランキン...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.000631</td>\n",
" <td>0.000178</td>\n",
" <td>0.999168</td>\n",
" </tr>\n",
" <tr>\n",
" <th>7</th>\n",
" <td>0.008762</td>\n",
" <td>0.982255</td>\n",
" <td>0.008983</td>\n",
" <td>data/text/topic-news/topic-news-6782959.txt</td>\n",
" <td>【韓国ニュース】WBC日本不参加の報道に「韓国の優勝か!?」 20日、労働組合・日本プロ野球...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.001809</td>\n",
" <td>0.000235</td>\n",
" <td>0.999168</td>\n",
" </tr>\n",
" <tr>\n",
" <th>8</th>\n",
" <td>0.008930</td>\n",
" <td>0.981640</td>\n",
" <td>0.009430</td>\n",
" <td>data/text/topic-news/topic-news-6829622.txt</td>\n",
" <td>【五輪サッカー】 韓国に負けたイギリス代表に英ネットユーザーから批判相次ぐ 5日、イギリスの...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.002167</td>\n",
" <td>0.000178</td>\n",
" <td>0.999698</td>\n",
" </tr>\n",
" <tr>\n",
" <th>9</th>\n",
" <td>0.009588</td>\n",
" <td>0.980599</td>\n",
" <td>0.009813</td>\n",
" <td>data/text/topic-news/topic-news-6822413.txt</td>\n",
" <td>五輪サッカー 英韓戦を前に韓国では「最悪のシナリオ」の声 2日、韓国のニュースサイト「イデ...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.000631</td>\n",
" <td>0.000188</td>\n",
" <td>0.999289</td>\n",
" </tr>\n",
" <tr>\n",
" <th>10</th>\n",
" <td>0.010287</td>\n",
" <td>0.979705</td>\n",
" <td>0.010007</td>\n",
" <td>data/text/topic-news/topic-news-6832659.txt</td>\n",
" <td>勝利後、相手選手を慰めるなでしこジャパン・宮間あやに米国ユーザーから称賛相次ぐ 米国「NBC...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.000631</td>\n",
" <td>0.000188</td>\n",
" <td>0.999698</td>\n",
" </tr>\n",
" <tr>\n",
" <th>11</th>\n",
" <td>0.011318</td>\n",
" <td>0.976707</td>\n",
" <td>0.011975</td>\n",
" <td>data/text/topic-news/topic-news-6806327.txt</td>\n",
" <td>五輪柔道 判定覆り勝利した海老沼匡に米国人ユーザーから疑問の声 フランス通信社（AFP）の英...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.001809</td>\n",
" <td>0.000178</td>\n",
" <td>0.999698</td>\n",
" </tr>\n",
" <tr>\n",
" <th>12</th>\n",
" <td>0.013042</td>\n",
" <td>0.974346</td>\n",
" <td>0.012612</td>\n",
" <td>data/text/topic-news/topic-news-6822465.txt</td>\n",
" <td>五輪 北朝鮮の躍進に英国で驚きの声 2日、イギリスの「デイリー・メール」は「親愛なる指導者、...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.000631</td>\n",
" <td>0.000178</td>\n",
" <td>0.999698</td>\n",
" </tr>\n",
" <tr>\n",
" <th>13</th>\n",
" <td>0.016887</td>\n",
" <td>0.967124</td>\n",
" <td>0.015989</td>\n",
" <td>data/text/topic-news/topic-news-6799124.txt</td>\n",
" <td>【ロンドン五輪】サッカー・イギリス代表 国歌“口元チェック”で論争 W杯にはイングランド、...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.000631</td>\n",
" <td>0.000178</td>\n",
" <td>0.999698</td>\n",
" </tr>\n",
" <tr>\n",
" <th>14</th>\n",
" <td>0.004257</td>\n",
" <td>0.990627</td>\n",
" <td>0.005116</td>\n",
" <td>data/text/topic-news/topic-news-6744306.txt</td>\n",
" <td>【韓国ニュース】日本大使館トラック突入事件の容疑者が日本人活動家に“公開提案” 9日、ソウル...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.002319</td>\n",
" <td>0.000188</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>15</th>\n",
" <td>0.005233</td>\n",
" <td>0.989186</td>\n",
" <td>0.005580</td>\n",
" <td>data/text/topic-news/topic-news-6707019.txt</td>\n",
" <td>【韓国ニュース】韓国ネット掲示板で広まる桜韓国起源説 「花見をする時は韓国に感謝しろ」の声も...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.000631</td>\n",
" <td>0.000194</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>16</th>\n",
" <td>0.007269</td>\n",
" <td>0.985457</td>\n",
" <td>0.007274</td>\n",
" <td>data/text/topic-news/topic-news-6895397.txt</td>\n",
" <td>【韓国ニュース】韓国の地方議会に対馬の領有権を主張する決議案 竹島の領有権を巡る日韓の緊張が...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.000631</td>\n",
" <td>0.999598</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>17</th>\n",
" <td>0.007116</td>\n",
" <td>0.984996</td>\n",
" <td>0.007888</td>\n",
" <td>data/text/topic-news/topic-news-6864824.txt</td>\n",
" <td>【韓国ニュース】靖国神社でデモを行った韓国人が韓国でも話題に 韓国ユーザーからは怒りの声相次...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.992961</td>\n",
" <td>0.000236</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>18</th>\n",
" <td>0.007115</td>\n",
" <td>0.984486</td>\n",
" <td>0.008399</td>\n",
" <td>data/text/topic-news/topic-news-6855184.txt</td>\n",
" <td>【韓国ニュース】李明博大統領の天皇謝罪要求に韓国ネットユーザーも混乱 14日午後、韓国の李明...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.000631</td>\n",
" <td>0.999414</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>19</th>\n",
" <td>0.007535</td>\n",
" <td>0.984138</td>\n",
" <td>0.008327</td>\n",
" <td>data/text/topic-news/topic-news-6740338.txt</td>\n",
" <td>日本大使館トラック突入事件に韓国ネットユーザー「愛国の志士」 9日、ソウルの日本大使館正門に...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.993121</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>20</th>\n",
" <td>0.007673</td>\n",
" <td>0.983866</td>\n",
" <td>0.008461</td>\n",
" <td>data/text/topic-news/topic-news-6580716.txt</td>\n",
" <td>韓国の竹島活動家、ヒトラーの言葉を引用し過激な主張を 21日、韓国のニュースサイト「韓国経済...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.001709</td>\n",
" <td>0.999365</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>21</th>\n",
" <td>0.007478</td>\n",
" <td>0.983816</td>\n",
" <td>0.008705</td>\n",
" <td>data/text/topic-news/topic-news-5965415.txt</td>\n",
" <td>ホワイトハウスで深刻なミス…韓国「受け入れがたい」 13日夕方、ホワイトハウスでオバマ大統領...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.000631</td>\n",
" <td>0.000188</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>22</th>\n",
" <td>0.007490</td>\n",
" <td>0.983070</td>\n",
" <td>0.009440</td>\n",
" <td>data/text/topic-news/topic-news-6855176.txt</td>\n",
" <td>【韓国ニュース】竹島上陸、韓国内では賛否両論 李明博大統領の支持率にはほとんど影響なし ...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.000631</td>\n",
" <td>0.999398</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>23</th>\n",
" <td>0.008520</td>\n",
" <td>0.982225</td>\n",
" <td>0.009254</td>\n",
" <td>data/text/topic-news/topic-news-6860367.txt</td>\n",
" <td>韓国政府“野田内閣と対話中断宣言”、日韓通貨スワップ中断は“日本も打撃” 16日、複数の韓...</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.002279</td>\n",
" <td>0.999187</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>24</th>\n",
" <td>0.140529</td>\n",
" <td>0.090961</td>\n",
" <td>0.768510</td>\n",
" <td>data/text/topic-news/topic-news-6360446.txt</td>\n",
" <td>田中防衛大臣の答弁が「酷過ぎる」 \\t 12日、参議院予算委員会質疑における田中直紀防衛大臣...</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.000175</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.999493</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>25</th>\n",
" <td>0.010283</td>\n",
" <td>0.011453</td>\n",
" <td>0.978264</td>\n",
" <td>data/text/topic-news/topic-news-6091293.txt</td>\n",
" <td>原発用語の言い換えに「騙されるな！」 福島第一原発の事故に関する記者会見が行われる際、政府や...</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.000175</td>\n",
" <td>0.000295</td>\n",
" <td>0.993297</td>\n",
" <td>0.000289</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>26</th>\n",
" <td>0.977721</td>\n",
" <td>0.010913</td>\n",
" <td>0.011366</td>\n",
" <td>data/text/topic-news/topic-news-6738631.txt</td>\n",
" <td>「7股中」を謳うアイドルに、西川史子がズバリ核心をつく TBS「サンデー・ジャポン」（8日放...</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>27</th>\n",
" <td>0.010516</td>\n",
" <td>0.010788</td>\n",
" <td>0.978697</td>\n",
" <td>data/text/topic-news/topic-news-6582763.txt</td>\n",
" <td>河本の姉が片山さつき氏に「後で謝ることになる」 ネットで物議 母親の生活保護受給が問題になっ...</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.999248</td>\n",
" <td>0.000295</td>\n",
" <td>0.996597</td>\n",
" <td>0.000263</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>28</th>\n",
" <td>0.978718</td>\n",
" <td>0.010580</td>\n",
" <td>0.010703</td>\n",
" <td>data/text/topic-news/topic-news-6646286.txt</td>\n",
" <td>ナイナイ岡村、AKB特番の出演依頼を拒否 「ああいうところに出るのは……」 6日に行われた「...</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>29</th>\n",
" <td>0.009577</td>\n",
" <td>0.010248</td>\n",
" <td>0.980175</td>\n",
" <td>data/text/topic-news/topic-news-6771213.txt</td>\n",
" <td>橋下徹大阪市長の女性問題、ネットの声は？ 19日に発売された「週刊文春」（7月26日号）にお...</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.999248</td>\n",
" <td>0.000295</td>\n",
" <td>0.994020</td>\n",
" <td>0.999525</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>...</th>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>740</th>\n",
" <td>0.855409</td>\n",
" <td>0.007817</td>\n",
" <td>0.136773</td>\n",
" <td>data/text/topic-news/topic-news-6316640.txt</td>\n",
" <td>クイズ☆タレント名鑑の前田敦子に関する問題が「容赦無い」と話題に 26日に放送されたTBS系...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.967480</td>\n",
" <td>0.000188</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>741</th>\n",
" <td>0.208691</td>\n",
" <td>0.007816</td>\n",
" <td>0.783493</td>\n",
" <td>data/text/topic-news/topic-news-5938333.txt</td>\n",
" <td>au版iPhone4Sの購入者に“仕込み疑惑”が浮上 iPhone4Sが発売となった本日、徹...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.963972</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.055152</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>742</th>\n",
" <td>0.724867</td>\n",
" <td>0.007789</td>\n",
" <td>0.267344</td>\n",
" <td>data/text/topic-news/topic-news-5931153.txt</td>\n",
" <td>ＡＫＢ大島優子に非難殺到 「性格が悪すぎる」 インターネット掲示板２ちゃんねるで、AKB4...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999541</td>\n",
" <td>0.000295</td>\n",
" <td>0.005327</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>743</th>\n",
" <td>0.746203</td>\n",
" <td>0.007777</td>\n",
" <td>0.246020</td>\n",
" <td>data/text/topic-news/topic-news-6631065.txt</td>\n",
" <td>フジテレビ「家族のうた」など打ち切り相次ぐTV業界に、ネットユーザー「嫌なら見るなとか言って...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.000188</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>744</th>\n",
" <td>0.698840</td>\n",
" <td>0.007707</td>\n",
" <td>0.293454</td>\n",
" <td>data/text/topic-news/topic-news-6895782.txt</td>\n",
" <td>有吉弘行が平成ノブシコブシ・吉村崇のブログ炎上に言及 お笑い芸人の有吉弘行が、26日に放送さ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.000207</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>745</th>\n",
" <td>0.630251</td>\n",
" <td>0.007694</td>\n",
" <td>0.362054</td>\n",
" <td>data/text/topic-news/topic-news-6660541.txt</td>\n",
" <td>スギちゃん、本音明かす「ワイルドだけど、嫌われたくないんですよ」 14日、過労でダウンし、イ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000257</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.995182</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>746</th>\n",
" <td>0.983611</td>\n",
" <td>0.007688</td>\n",
" <td>0.008701</td>\n",
" <td>data/text/topic-news/topic-news-6019023.txt</td>\n",
" <td>「マツコ&有吉の怒り新党2」出演者総とっかえの危機 9日放送の「マツコ&有吉の怒り新党」（テ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>747</th>\n",
" <td>0.983836</td>\n",
" <td>0.007641</td>\n",
" <td>0.008524</td>\n",
" <td>data/text/topic-news/topic-news-6780686.txt</td>\n",
" <td>「FNS27時間テレビ」 ローラのリアクションに「放送事故」の声 22日に放送された「FNS...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>748</th>\n",
" <td>0.826461</td>\n",
" <td>0.007585</td>\n",
" <td>0.165955</td>\n",
" <td>data/text/topic-news/topic-news-6302176.txt</td>\n",
" <td>オセロ中島がついに全レギュラー降板、″失業″状態に心配の声 22日、産経ニュースをはじめとし...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.004777</td>\n",
" <td>0.000235</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>749</th>\n",
" <td>0.898826</td>\n",
" <td>0.007525</td>\n",
" <td>0.093649</td>\n",
" <td>data/text/topic-news/topic-news-6563543.txt</td>\n",
" <td>リンカーンで放送事故、ツイッター騒然 15日に放送されたバラエティ番組「リンカーン」（TBS...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.002928</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>750</th>\n",
" <td>0.984373</td>\n",
" <td>0.007428</td>\n",
" <td>0.008199</td>\n",
" <td>data/text/topic-news/topic-news-6449971.txt</td>\n",
" <td>テレビ朝日で花見のニュースに津波の映像が流れる放送事故 ネット掲示板は一時騒然 7日、テレビ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.000235</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>751</th>\n",
" <td>0.909996</td>\n",
" <td>0.007397</td>\n",
" <td>0.082607</td>\n",
" <td>data/text/topic-news/topic-news-6586368.txt</td>\n",
" <td>野球中継が突然の中止、代替番組が用意できず非常事態に 22日に放送されたテレビ愛知の野球中継...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.002155</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>752</th>\n",
" <td>0.549859</td>\n",
" <td>0.007392</td>\n",
" <td>0.442749</td>\n",
" <td>data/text/topic-news/topic-news-6317274.txt</td>\n",
" <td>漫画家うすた京介さんのパチンコ業界へのTwitter発言がネット掲示板で話題に 27日、漫画...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000257</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.999339</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>753</th>\n",
" <td>0.878630</td>\n",
" <td>0.007364</td>\n",
" <td>0.114006</td>\n",
" <td>data/text/topic-news/topic-news-6450159.txt</td>\n",
" <td>加護亜依が号泣、自殺未遂騒動後初のテレビ出演に「もう芸能界やめたほうがいい」の声 9日、モー...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.001709</td>\n",
" <td>0.015909</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>754</th>\n",
" <td>0.977388</td>\n",
" <td>0.007242</td>\n",
" <td>0.015369</td>\n",
" <td>data/text/topic-news/topic-news-6406486.txt</td>\n",
" <td>有吉が「しゃべくり007」で暴露した“絡みたくない大物”とは誰か? 26日、日本テレビ系で放...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.014417</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>755</th>\n",
" <td>0.697792</td>\n",
" <td>0.007239</td>\n",
" <td>0.294969</td>\n",
" <td>data/text/topic-news/topic-news-5907376.txt</td>\n",
" <td>紳助とたけしの明暗を分けたものとは 今年で20回目を迎えたTBSのオールスター感謝祭に、1回...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.001653</td>\n",
" <td>0.010447</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>756</th>\n",
" <td>0.984013</td>\n",
" <td>0.007222</td>\n",
" <td>0.008764</td>\n",
" <td>data/text/topic-news/topic-news-6668296.txt</td>\n",
" <td>指原莉乃をからかった浅草キッド・玉袋筋太郎に賛否 16日放送の「5時に夢中!」（東京MXテレ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.001809</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>757</th>\n",
" <td>0.887530</td>\n",
" <td>0.007110</td>\n",
" <td>0.105361</td>\n",
" <td>data/text/topic-news/topic-news-5971115.txt</td>\n",
" <td>“キラキラネーム”でうつになる罪のない子供たち 「キラキラネーム」という言葉をご存知だろうか...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.005327</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>758</th>\n",
" <td>0.032959</td>\n",
" <td>0.006962</td>\n",
" <td>0.960079</td>\n",
" <td>data/text/topic-news/topic-news-6613650.txt</td>\n",
" <td>生活保護のイメージ悪化に**も、反論の声多数 30日、生活保護問題対策全国会議は、東京・千代...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000257</td>\n",
" <td>0.000295</td>\n",
" <td>0.040283</td>\n",
" <td>0.240241</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>759</th>\n",
" <td>0.632465</td>\n",
" <td>0.006928</td>\n",
" <td>0.360607</td>\n",
" <td>data/text/topic-news/topic-news-6301970.txt</td>\n",
" <td>見知らぬ団体が勝手にハロプロのYouTube公式チャンネルを削除、物議に 21日、ハロープロ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000257</td>\n",
" <td>0.000295</td>\n",
" <td>0.005327</td>\n",
" <td>0.999191</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>760</th>\n",
" <td>0.626982</td>\n",
" <td>0.006851</td>\n",
" <td>0.366167</td>\n",
" <td>data/text/topic-news/topic-news-6586056.txt</td>\n",
" <td>河本準一、大手企業広告から存在消される事態に 23日、母親の生活保護受給が物議を醸している、...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000257</td>\n",
" <td>0.000295</td>\n",
" <td>0.005327</td>\n",
" <td>0.000279</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>761</th>\n",
" <td>0.906056</td>\n",
" <td>0.006742</td>\n",
" <td>0.087202</td>\n",
" <td>data/text/topic-news/topic-news-6154347.txt</td>\n",
" <td>大槻教授、たけしの番組の“やらせ”を暴露 超自然現象や超能力などのオカルト事象を科学的観点か...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>762</th>\n",
" <td>0.895600</td>\n",
" <td>0.006678</td>\n",
" <td>0.097721</td>\n",
" <td>data/text/topic-news/topic-news-6899432.txt</td>\n",
" <td>伊集院光がラジオで「24時間テレビ」について“本音”を語る 27日、伊集院光がラジオ番組「J...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>763</th>\n",
" <td>0.350810</td>\n",
" <td>0.006344</td>\n",
" <td>0.642846</td>\n",
" <td>data/text/topic-news/topic-news-6584186.txt</td>\n",
" <td>神田うのの手のひら返しにネットユーザ騒然 21日、神田うのが自身のブログで二股騒動があった料...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000191</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.999493</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>764</th>\n",
" <td>0.052264</td>\n",
" <td>0.006001</td>\n",
" <td>0.941735</td>\n",
" <td>data/text/topic-news/topic-news-6601493.txt</td>\n",
" <td>河本の生活保護問題で、オリラジ・藤森がツイッターで騒動に 25日、母親の生活保護受給について...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000191</td>\n",
" <td>0.000295</td>\n",
" <td>0.968722</td>\n",
" <td>0.000859</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>765</th>\n",
" <td>0.988235</td>\n",
" <td>0.005657</td>\n",
" <td>0.006109</td>\n",
" <td>data/text/topic-news/topic-news-6674453.txt</td>\n",
" <td>AKB指原のスキャンダル。TBS番組は「90％以上のファンが彼女を許した」と説明 今月14日...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.002155</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>766</th>\n",
" <td>0.330100</td>\n",
" <td>0.005626</td>\n",
" <td>0.664274</td>\n",
" <td>data/text/topic-news/topic-news-6738399.txt</td>\n",
" <td>「世の中そんなに甘くないからね」 スーパーマーケット店員の発言に批判殺到し店舗ブログも大炎上...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000191</td>\n",
" <td>0.000295</td>\n",
" <td>0.001603</td>\n",
" <td>0.996365</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>767</th>\n",
" <td>0.841284</td>\n",
" <td>0.005133</td>\n",
" <td>0.153583</td>\n",
" <td>data/text/topic-news/topic-news-5910461.txt</td>\n",
" <td>読売テレビ広報部長の無礼千万メールにジャーナリスト烏賀陽（うがや）弘道さんが激怒 ジャー...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.029341</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>768</th>\n",
" <td>0.991185</td>\n",
" <td>0.004218</td>\n",
" <td>0.004596</td>\n",
" <td>data/text/topic-news/topic-news-5903373.txt</td>\n",
" <td>写真が流出し“堕ちていった”アイドルたち アイドルが男性と一緒に写ったプリクラやニャンニャン...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.037480</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>769</th>\n",
" <td>0.788469</td>\n",
" <td>0.003428</td>\n",
" <td>0.208103</td>\n",
" <td>data/text/topic-news/topic-news-6696655.txt</td>\n",
" <td>元AKB指原莉乃、生放送で胸中告白。交際相手のことやネットの書き込みにも言及 今月14日に発...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999541</td>\n",
" <td>0.000295</td>\n",
" <td>0.004894</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" </tbody>\n",
"</table>\n",
"<p>770 rows × 15 columns</p>\n",
"</div>"
],
"text/plain": [
" topic00 topic01 topic02 \\\n",
"0 0.006954 0.986436 0.006611 \n",
"1 0.007343 0.985629 0.007028 \n",
"2 0.007180 0.985483 0.007337 \n",
"3 0.007506 0.984469 0.008026 \n",
"4 0.007822 0.984203 0.007975 \n",
"5 0.007915 0.983509 0.008577 \n",
"6 0.008171 0.983338 0.008491 \n",
"7 0.008762 0.982255 0.008983 \n",
"8 0.008930 0.981640 0.009430 \n",
"9 0.009588 0.980599 0.009813 \n",
"10 0.010287 0.979705 0.010007 \n",
"11 0.011318 0.976707 0.011975 \n",
"12 0.013042 0.974346 0.012612 \n",
"13 0.016887 0.967124 0.015989 \n",
"14 0.004257 0.990627 0.005116 \n",
"15 0.005233 0.989186 0.005580 \n",
"16 0.007269 0.985457 0.007274 \n",
"17 0.007116 0.984996 0.007888 \n",
"18 0.007115 0.984486 0.008399 \n",
"19 0.007535 0.984138 0.008327 \n",
"20 0.007673 0.983866 0.008461 \n",
"21 0.007478 0.983816 0.008705 \n",
"22 0.007490 0.983070 0.009440 \n",
"23 0.008520 0.982225 0.009254 \n",
"24 0.140529 0.090961 0.768510 \n",
"25 0.010283 0.011453 0.978264 \n",
"26 0.977721 0.010913 0.011366 \n",
"27 0.010516 0.010788 0.978697 \n",
"28 0.978718 0.010580 0.010703 \n",
"29 0.009577 0.010248 0.980175 \n",
".. ... ... ... \n",
"740 0.855409 0.007817 0.136773 \n",
"741 0.208691 0.007816 0.783493 \n",
"742 0.724867 0.007789 0.267344 \n",
"743 0.746203 0.007777 0.246020 \n",
"744 0.698840 0.007707 0.293454 \n",
"745 0.630251 0.007694 0.362054 \n",
"746 0.983611 0.007688 0.008701 \n",
"747 0.983836 0.007641 0.008524 \n",
"748 0.826461 0.007585 0.165955 \n",
"749 0.898826 0.007525 0.093649 \n",
"750 0.984373 0.007428 0.008199 \n",
"751 0.909996 0.007397 0.082607 \n",
"752 0.549859 0.007392 0.442749 \n",
"753 0.878630 0.007364 0.114006 \n",
"754 0.977388 0.007242 0.015369 \n",
"755 0.697792 0.007239 0.294969 \n",
"756 0.984013 0.007222 0.008764 \n",
"757 0.887530 0.007110 0.105361 \n",
"758 0.032959 0.006962 0.960079 \n",
"759 0.632465 0.006928 0.360607 \n",
"760 0.626982 0.006851 0.366167 \n",
"761 0.906056 0.006742 0.087202 \n",
"762 0.895600 0.006678 0.097721 \n",
"763 0.350810 0.006344 0.642846 \n",
"764 0.052264 0.006001 0.941735 \n",
"765 0.988235 0.005657 0.006109 \n",
"766 0.330100 0.005626 0.664274 \n",
"767 0.841284 0.005133 0.153583 \n",
"768 0.991185 0.004218 0.004596 \n",
"769 0.788469 0.003428 0.208103 \n",
"\n",
" doc_file \\\n",
"0 data/text/topic-news/topic-news-6843698.txt \n",
"1 data/text/topic-news/topic-news-6841012.txt \n",
"2 data/text/topic-news/topic-news-6829539.txt \n",
"3 data/text/topic-news/topic-news-6608684.txt \n",
"4 data/text/topic-news/topic-news-6842234.txt \n",
"5 data/text/topic-news/topic-news-6818120.txt \n",
"6 data/text/topic-news/topic-news-6636116.txt \n",
"7 data/text/topic-news/topic-news-6782959.txt \n",
"8 data/text/topic-news/topic-news-6829622.txt \n",
"9 data/text/topic-news/topic-news-6822413.txt \n",
"10 data/text/topic-news/topic-news-6832659.txt \n",
"11 data/text/topic-news/topic-news-6806327.txt \n",
"12 data/text/topic-news/topic-news-6822465.txt \n",
"13 data/text/topic-news/topic-news-6799124.txt \n",
"14 data/text/topic-news/topic-news-6744306.txt \n",
"15 data/text/topic-news/topic-news-6707019.txt \n",
"16 data/text/topic-news/topic-news-6895397.txt \n",
"17 data/text/topic-news/topic-news-6864824.txt \n",
"18 data/text/topic-news/topic-news-6855184.txt \n",
"19 data/text/topic-news/topic-news-6740338.txt \n",
"20 data/text/topic-news/topic-news-6580716.txt \n",
"21 data/text/topic-news/topic-news-5965415.txt \n",
"22 data/text/topic-news/topic-news-6855176.txt \n",
"23 data/text/topic-news/topic-news-6860367.txt \n",
"24 data/text/topic-news/topic-news-6360446.txt \n",
"25 data/text/topic-news/topic-news-6091293.txt \n",
"26 data/text/topic-news/topic-news-6738631.txt \n",
"27 data/text/topic-news/topic-news-6582763.txt \n",
"28 data/text/topic-news/topic-news-6646286.txt \n",
"29 data/text/topic-news/topic-news-6771213.txt \n",
".. ... \n",
"740 data/text/topic-news/topic-news-6316640.txt \n",
"741 data/text/topic-news/topic-news-5938333.txt \n",
"742 data/text/topic-news/topic-news-5931153.txt \n",
"743 data/text/topic-news/topic-news-6631065.txt \n",
"744 data/text/topic-news/topic-news-6895782.txt \n",
"745 data/text/topic-news/topic-news-6660541.txt \n",
"746 data/text/topic-news/topic-news-6019023.txt \n",
"747 data/text/topic-news/topic-news-6780686.txt \n",
"748 data/text/topic-news/topic-news-6302176.txt \n",
"749 data/text/topic-news/topic-news-6563543.txt \n",
"750 data/text/topic-news/topic-news-6449971.txt \n",
"751 data/text/topic-news/topic-news-6586368.txt \n",
"752 data/text/topic-news/topic-news-6317274.txt \n",
"753 data/text/topic-news/topic-news-6450159.txt \n",
"754 data/text/topic-news/topic-news-6406486.txt \n",
"755 data/text/topic-news/topic-news-5907376.txt \n",
"756 data/text/topic-news/topic-news-6668296.txt \n",
"757 data/text/topic-news/topic-news-5971115.txt \n",
"758 data/text/topic-news/topic-news-6613650.txt \n",
"759 data/text/topic-news/topic-news-6301970.txt \n",
"760 data/text/topic-news/topic-news-6586056.txt \n",
"761 data/text/topic-news/topic-news-6154347.txt \n",
"762 data/text/topic-news/topic-news-6899432.txt \n",
"763 data/text/topic-news/topic-news-6584186.txt \n",
"764 data/text/topic-news/topic-news-6601493.txt \n",
"765 data/text/topic-news/topic-news-6674453.txt \n",
"766 data/text/topic-news/topic-news-6738399.txt \n",
"767 data/text/topic-news/topic-news-5910461.txt \n",
"768 data/text/topic-news/topic-news-5903373.txt \n",
"769 data/text/topic-news/topic-news-6696655.txt \n",
"\n",
" doc_text tag_芸能 tag_海外 \\\n",
"0 同じホテルに滞在している、日本代表と韓国代表 10日、韓国「ソウル新聞」は、翌11日（日本時... 0.0 1.0 \n",
"1 五輪サッカー日韓戦において、韓国が注目する“ある選手”とは？ 日本時間11日午前3時45分よ... 0.0 1.0 \n",
"2 女子アーチェリー銅メダリスト早川蓮、 韓国でも話題に 6日、アーチェリー女子銅メダリストの早... 0.0 1.0 \n",
"3 五輪逃したタイが「日本の八百長疑惑」を一斉報道 29日、タイでは、女子バレーボール五輪予選で... 0.0 1.0 \n",
"4 五輪サッカーで日韓が激突、韓国ユーザは「餌を出して試合させるのは間違っている」 韓国「文化日... 0.0 1.0 \n",
"5 女子バドミントン失格に韓国では「なでしこジャパンの引き分け狙いはOKなのになぜ…」の声 ロン... 0.0 1.0 \n",
"6 FIFA最新ランキング発表、韓国ユーザが敗北宣言!? 6日、FIFAはサッカーの世界ランキン... 0.0 1.0 \n",
"7 【韓国ニュース】WBC日本不参加の報道に「韓国の優勝か!?」 20日、労働組合・日本プロ野球... 0.0 1.0 \n",
"8 【五輪サッカー】 韓国に負けたイギリス代表に英ネットユーザーから批判相次ぐ 5日、イギリスの... 0.0 1.0 \n",
"9 五輪サッカー 英韓戦を前に韓国では「最悪のシナリオ」の声 2日、韓国のニュースサイト「イデ... 0.0 1.0 \n",
"10 勝利後、相手選手を慰めるなでしこジャパン・宮間あやに米国ユーザーから称賛相次ぐ 米国「NBC... 0.0 1.0 \n",
"11 五輪柔道 判定覆り勝利した海老沼匡に米国人ユーザーから疑問の声 フランス通信社（AFP）の英... 0.0 1.0 \n",
"12 五輪 北朝鮮の躍進に英国で驚きの声 2日、イギリスの「デイリー・メール」は「親愛なる指導者、... 0.0 1.0 \n",
"13 【ロンドン五輪】サッカー・イギリス代表 国歌“口元チェック”で論争 W杯にはイングランド、... 0.0 1.0 \n",
"14 【韓国ニュース】日本大使館トラック突入事件の容疑者が日本人活動家に“公開提案” 9日、ソウル... 0.0 1.0 \n",
"15 【韓国ニュース】韓国ネット掲示板で広まる桜韓国起源説 「花見をする時は韓国に感謝しろ」の声も... 0.0 1.0 \n",
"16 【韓国ニュース】韓国の地方議会に対馬の領有権を主張する決議案 竹島の領有権を巡る日韓の緊張が... 0.0 1.0 \n",
"17 【韓国ニュース】靖国神社でデモを行った韓国人が韓国でも話題に 韓国ユーザーからは怒りの声相次... 0.0 1.0 \n",
"18 【韓国ニュース】李明博大統領の天皇謝罪要求に韓国ネットユーザーも混乱 14日午後、韓国の李明... 0.0 1.0 \n",
"19 日本大使館トラック突入事件に韓国ネットユーザー「愛国の志士」 9日、ソウルの日本大使館正門に... 0.0 1.0 \n",
"20 韓国の竹島活動家、ヒトラーの言葉を引用し過激な主張を 21日、韓国のニュースサイト「韓国経済... 0.0 1.0 \n",
"21 ホワイトハウスで深刻なミス…韓国「受け入れがたい」 13日夕方、ホワイトハウスでオバマ大統領... 0.0 1.0 \n",
"22 【韓国ニュース】竹島上陸、韓国内では賛否両論 李明博大統領の支持率にはほとんど影響なし ... 0.0 1.0 \n",
"23 韓国政府“野田内閣と対話中断宣言”、日韓通貨スワップ中断は“日本も打撃” 16日、複数の韓... 0.0 1.0 \n",
"24 田中防衛大臣の答弁が「酷過ぎる」 \\t 12日、参議院予算委員会質疑における田中直紀防衛大臣... 0.0 0.0 \n",
"25 原発用語の言い換えに「騙されるな！」 福島第一原発の事故に関する記者会見が行われる際、政府や... 0.0 0.0 \n",
"26 「7股中」を謳うアイドルに、西川史子がズバリ核心をつく TBS「サンデー・ジャポン」（8日放... 1.0 0.0 \n",
"27 河本の姉が片山さつき氏に「後で謝ることになる」 ネットで物議 母親の生活保護受給が問題になっ... 1.0 0.0 \n",
"28 ナイナイ岡村、AKB特番の出演依頼を拒否 「ああいうところに出るのは……」 6日に行われた「... 1.0 0.0 \n",
"29 橋下徹大阪市長の女性問題、ネットの声は？ 19日に発売された「週刊文春」（7月26日号）にお... 1.0 0.0 \n",
".. ... ... ... \n",
"740 クイズ☆タレント名鑑の前田敦子に関する問題が「容赦無い」と話題に 26日に放送されたTBS系... NaN NaN \n",
"741 au版iPhone4Sの購入者に“仕込み疑惑”が浮上 iPhone4Sが発売となった本日、徹... NaN NaN \n",
"742 ＡＫＢ大島優子に非難殺到 「性格が悪すぎる」 インターネット掲示板２ちゃんねるで、AKB4... NaN NaN \n",
"743 フジテレビ「家族のうた」など打ち切り相次ぐTV業界に、ネットユーザー「嫌なら見るなとか言って... NaN NaN \n",
"744 有吉弘行が平成ノブシコブシ・吉村崇のブログ炎上に言及 お笑い芸人の有吉弘行が、26日に放送さ... NaN NaN \n",
"745 スギちゃん、本音明かす「ワイルドだけど、嫌われたくないんですよ」 14日、過労でダウンし、イ... NaN NaN \n",
"746 「マツコ&有吉の怒り新党2」出演者総とっかえの危機 9日放送の「マツコ&有吉の怒り新党」（テ... NaN NaN \n",
"747 「FNS27時間テレビ」 ローラのリアクションに「放送事故」の声 22日に放送された「FNS... NaN NaN \n",
"748 オセロ中島がついに全レギュラー降板、″失業″状態に心配の声 22日、産経ニュースをはじめとし... NaN NaN \n",
"749 リンカーンで放送事故、ツイッター騒然 15日に放送されたバラエティ番組「リンカーン」（TBS... NaN NaN \n",
"750 テレビ朝日で花見のニュースに津波の映像が流れる放送事故 ネット掲示板は一時騒然 7日、テレビ... NaN NaN \n",
"751 野球中継が突然の中止、代替番組が用意できず非常事態に 22日に放送されたテレビ愛知の野球中継... NaN NaN \n",
"752 漫画家うすた京介さんのパチンコ業界へのTwitter発言がネット掲示板で話題に 27日、漫画... NaN NaN \n",
"753 加護亜依が号泣、自殺未遂騒動後初のテレビ出演に「もう芸能界やめたほうがいい」の声 9日、モー... NaN NaN \n",
"754 有吉が「しゃべくり007」で暴露した“絡みたくない大物”とは誰か? 26日、日本テレビ系で放... NaN NaN \n",
"755 紳助とたけしの明暗を分けたものとは 今年で20回目を迎えたTBSのオールスター感謝祭に、1回... NaN NaN \n",
"756 指原莉乃をからかった浅草キッド・玉袋筋太郎に賛否 16日放送の「5時に夢中!」（東京MXテレ... NaN NaN \n",
"757 “キラキラネーム”でうつになる罪のない子供たち 「キラキラネーム」という言葉をご存知だろうか... NaN NaN \n",
"758 生活保護のイメージ悪化に**も、反論の声多数 30日、生活保護問題対策全国会議は、東京・千代... NaN NaN \n",
"759 見知らぬ団体が勝手にハロプロのYouTube公式チャンネルを削除、物議に 21日、ハロープロ... NaN NaN \n",
"760 河本準一、大手企業広告から存在消される事態に 23日、母親の生活保護受給が物議を醸している、... NaN NaN \n",
"761 大槻教授、たけしの番組の“やらせ”を暴露 超自然現象や超能力などのオカルト事象を科学的観点か... NaN NaN \n",
"762 伊集院光がラジオで「24時間テレビ」について“本音”を語る 27日、伊集院光がラジオ番組「J... NaN NaN \n",
"763 神田うのの手のひら返しにネットユーザ騒然 21日、神田うのが自身のブログで二股騒動があった料... NaN NaN \n",
"764 河本の生活保護問題で、オリラジ・藤森がツイッターで騒動に 25日、母親の生活保護受給について... NaN NaN \n",
"765 AKB指原のスキャンダル。TBS番組は「90％以上のファンが彼女を許した」と説明 今月14日... NaN NaN \n",
"766 「世の中そんなに甘くないからね」 スーパーマーケット店員の発言に批判殺到し店舗ブログも大炎上... NaN NaN \n",
"767 読売テレビ広報部長の無礼千万メールにジャーナリスト烏賀陽（うがや）弘道さんが激怒 ジャー... NaN NaN \n",
"768 写真が流出し“堕ちていった”アイドルたち アイドルが男性と一緒に写ったプリクラやニャンニャン... NaN NaN \n",
"769 元AKB指原莉乃、生放送で胸中告白。交際相手のことやネットの書き込みにも言及 今月14日に発... NaN NaN \n",
"\n",
" tag_社会 tag_政治 tag_スポーツ predict_tag_芸能 predict_tag_海外 predict_tag_社会 \\\n",
"0 0.0 0.0 1.0 0.000175 0.999705 0.000631 \n",
"1 0.0 0.0 1.0 0.000175 0.999705 0.000631 \n",
"2 0.0 0.0 1.0 0.000175 0.999705 0.001809 \n",
"3 0.0 0.0 1.0 0.000175 0.999705 0.001809 \n",
"4 1.0 0.0 1.0 0.000175 0.999705 0.988512 \n",
"5 0.0 0.0 1.0 0.000175 0.999705 0.001809 \n",
"6 0.0 0.0 1.0 0.000175 0.999705 0.000631 \n",
"7 0.0 0.0 1.0 0.000175 0.999705 0.001809 \n",
"8 0.0 0.0 1.0 0.000175 0.999705 0.002167 \n",
"9 0.0 0.0 1.0 0.000175 0.999705 0.000631 \n",
"10 0.0 0.0 1.0 0.000175 0.999705 0.000631 \n",
"11 0.0 0.0 1.0 0.000175 0.999705 0.001809 \n",
"12 0.0 0.0 1.0 0.000175 0.999705 0.000631 \n",
"13 0.0 0.0 1.0 0.000175 0.999705 0.000631 \n",
"14 0.0 0.0 0.0 0.000175 0.999705 0.002319 \n",
"15 0.0 0.0 0.0 0.000175 0.999705 0.000631 \n",
"16 0.0 1.0 0.0 0.000175 0.999705 0.000631 \n",
"17 1.0 0.0 0.0 0.000175 0.999705 0.992961 \n",
"18 0.0 1.0 0.0 0.000175 0.999705 0.000631 \n",
"19 1.0 0.0 0.0 0.000175 0.999705 0.993121 \n",
"20 0.0 1.0 0.0 0.000175 0.999705 0.001709 \n",
"21 0.0 0.0 0.0 0.000175 0.999705 0.000631 \n",
"22 0.0 1.0 0.0 0.000175 0.999705 0.000631 \n",
"23 0.0 1.0 0.0 0.000175 0.999705 0.002279 \n",
"24 0.0 1.0 0.0 0.000175 0.000295 0.000631 \n",
"25 1.0 0.0 0.0 0.000175 0.000295 0.993297 \n",
"26 0.0 0.0 0.0 0.999659 0.000295 0.000631 \n",
"27 1.0 0.0 0.0 0.999248 0.000295 0.996597 \n",
"28 0.0 0.0 0.0 0.999659 0.000295 0.000631 \n",
"29 1.0 1.0 0.0 0.999248 0.000295 0.994020 \n",
".. ... ... ... ... ... ... \n",
"740 NaN NaN NaN 0.999659 0.000295 0.967480 \n",
"741 NaN NaN NaN 0.963972 0.000295 0.000631 \n",
"742 NaN NaN NaN 0.999541 0.000295 0.005327 \n",
"743 NaN NaN NaN 0.999659 0.000295 0.000631 \n",
"744 NaN NaN NaN 0.999659 0.000295 0.000631 \n",
"745 NaN NaN NaN 0.000257 0.000295 0.000631 \n",
"746 NaN NaN NaN 0.999659 0.000295 0.000631 \n",
"747 NaN NaN NaN 0.999659 0.000295 0.000631 \n",
"748 NaN NaN NaN 0.999659 0.000295 0.004777 \n",
"749 NaN NaN NaN 0.999659 0.000295 0.002928 \n",
"750 NaN NaN NaN 0.999659 0.000295 0.000631 \n",
"751 NaN NaN NaN 0.999659 0.000295 0.002155 \n",
"752 NaN NaN NaN 0.000257 0.000295 0.000631 \n",
"753 NaN NaN NaN 0.999659 0.000295 0.001709 \n",
"754 NaN NaN NaN 0.999659 0.000295 0.014417 \n",
"755 NaN NaN NaN 0.999659 0.000295 0.001653 \n",
"756 NaN NaN NaN 0.999659 0.000295 0.001809 \n",
"757 NaN NaN NaN 0.999659 0.000295 0.005327 \n",
"758 NaN NaN NaN 0.000257 0.000295 0.040283 \n",
"759 NaN NaN NaN 0.000257 0.000295 0.005327 \n",
"760 NaN NaN NaN 0.000257 0.000295 0.005327 \n",
"761 NaN NaN NaN 0.999659 0.000295 0.000631 \n",
"762 NaN NaN NaN 0.999659 0.000295 0.000631 \n",
"763 NaN NaN NaN 0.000191 0.000295 0.000631 \n",
"764 NaN NaN NaN 0.000191 0.000295 0.968722 \n",
"765 NaN NaN NaN 0.999659 0.000295 0.002155 \n",
"766 NaN NaN NaN 0.000191 0.000295 0.001603 \n",
"767 NaN NaN NaN 0.999659 0.000295 0.000631 \n",
"768 NaN NaN NaN 0.999659 0.000295 0.037480 \n",
"769 NaN NaN NaN 0.999541 0.000295 0.004894 \n",
"\n",
" predict_tag_政治 predict_tag_スポーツ \n",
"0 0.000178 0.999698 \n",
"1 0.000178 0.999698 \n",
"2 0.000188 0.999698 \n",
"3 0.000188 0.999289 \n",
"4 0.000178 0.999698 \n",
"5 0.000178 0.999698 \n",
"6 0.000178 0.999168 \n",
"7 0.000235 0.999168 \n",
"8 0.000178 0.999698 \n",
"9 0.000188 0.999289 \n",
"10 0.000188 0.999698 \n",
"11 0.000178 0.999698 \n",
"12 0.000178 0.999698 \n",
"13 0.000178 0.999698 \n",
"14 0.000188 0.000180 \n",
"15 0.000194 0.000180 \n",
"16 0.999598 0.000180 \n",
"17 0.000236 0.000180 \n",
"18 0.999414 0.000180 \n",
"19 0.000178 0.000180 \n",
"20 0.999365 0.000180 \n",
"21 0.000188 0.000180 \n",
"22 0.999398 0.000180 \n",
"23 0.999187 0.000180 \n",
"24 0.999493 0.000180 \n",
"25 0.000289 0.000180 \n",
"26 0.000178 0.000180 \n",
"27 0.000263 0.000180 \n",
"28 0.000178 0.000180 \n",
"29 0.999525 0.000180 \n",
".. ... ... \n",
"740 0.000188 0.000180 \n",
"741 0.055152 0.000180 \n",
"742 0.000178 0.000180 \n",
"743 0.000188 0.000180 \n",
"744 0.000207 0.000180 \n",
"745 0.995182 0.000180 \n",
"746 0.000178 0.000180 \n",
"747 0.000178 0.000180 \n",
"748 0.000235 0.000180 \n",
"749 0.000178 0.000180 \n",
"750 0.000235 0.000180 \n",
"751 0.000178 0.000180 \n",
"752 0.999339 0.000180 \n",
"753 0.015909 0.000180 \n",
"754 0.000178 0.000180 \n",
"755 0.010447 0.000180 \n",
"756 0.000178 0.000180 \n",
"757 0.000178 0.000180 \n",
"758 0.240241 0.000180 \n",
"759 0.999191 0.000180 \n",
"760 0.000279 0.000180 \n",
"761 0.000178 0.000180 \n",
"762 0.000178 0.000180 \n",
"763 0.999493 0.000180 \n",
"764 0.000859 0.000180 \n",
"765 0.000178 0.000180 \n",
"766 0.996365 0.000180 \n",
"767 0.029341 0.000180 \n",
"768 0.000178 0.000180 \n",
"769 0.000178 0.000180 \n",
"\n",
"[770 rows x 15 columns]"
]
},
"execution_count": 14,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"# より予測精度を上げるためには、1)モデルの改善、2)データの改善を行います。\n",
"# ここではデータの改善に取り組んでみます。 モデルはいつでも変更できますが、tagつきデータはどこにもありません。\n",
"\n",
"# まずは、現状の予測 数値を df_tag に追加します。\n",
"for index, row in df_tag.iterrows():\n",
" predicted_dict = predict(row['doc_text'])\n",
" for tag, val in predicted_dict.items():\n",
" df_tag.loc[index, 'predict_'+tag] = val\n",
"\n",
"df_tag"
]
},
{
"cell_type": "code",
"execution_count": 15,
"metadata": {},
"outputs": [
{
"data": {
"text/html": [
"<div>\n",
"<style scoped>\n",
" .dataframe tbody tr th:only-of-type {\n",
" vertical-align: middle;\n",
" }\n",
"\n",
" .dataframe tbody tr th {\n",
" vertical-align: top;\n",
" }\n",
"\n",
" .dataframe thead th {\n",
" text-align: right;\n",
" }\n",
"</style>\n",
"<table border=\"1\" class=\"dataframe\">\n",
" <thead>\n",
" <tr style=\"text-align: right;\">\n",
" <th></th>\n",
" <th>topic00</th>\n",
" <th>topic01</th>\n",
" <th>topic02</th>\n",
" <th>doc_file</th>\n",
" <th>doc_text</th>\n",
" <th>tag_芸能</th>\n",
" <th>tag_海外</th>\n",
" <th>tag_社会</th>\n",
" <th>tag_政治</th>\n",
" <th>tag_スポーツ</th>\n",
" <th>predict_tag_芸能</th>\n",
" <th>predict_tag_海外</th>\n",
" <th>predict_tag_社会</th>\n",
" <th>predict_tag_政治</th>\n",
" <th>predict_tag_スポーツ</th>\n",
" </tr>\n",
" </thead>\n",
" <tbody>\n",
" <tr>\n",
" <th>100</th>\n",
" <td>0.017635</td>\n",
" <td>0.821989</td>\n",
" <td>0.160377</td>\n",
" <td>data/text/topic-news/topic-news-6017374.txt</td>\n",
" <td>日本の習慣に外国人が激怒 居酒屋で注文せずとも出される“お通し”。日本ではお馴染みの習慣だが...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.005327</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>101</th>\n",
" <td>0.016988</td>\n",
" <td>0.821360</td>\n",
" <td>0.161651</td>\n",
" <td>data/text/topic-news/topic-news-5966020.txt</td>\n",
" <td>日本スケート連盟のキム・ヨナ締め出しに「当然」の声 「キム・ヨナが日本のアイスショーからは...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.001653</td>\n",
" <td>0.000178</td>\n",
" <td>0.999168</td>\n",
" </tr>\n",
" <tr>\n",
" <th>102</th>\n",
" <td>0.010429</td>\n",
" <td>0.818316</td>\n",
" <td>0.171255</td>\n",
" <td>data/text/topic-news/topic-news-6388021.txt</td>\n",
" <td>**警察が女子高生を生きたまま田んぼに遺棄 21日、朝日新聞は、**の警察が倒れている女子高...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.264500</td>\n",
" <td>0.999207</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>103</th>\n",
" <td>0.014804</td>\n",
" <td>0.816421</td>\n",
" <td>0.168774</td>\n",
" <td>data/text/topic-news/topic-news-6226414.txt</td>\n",
" <td>「日本人が最も食べている漬物はキムチ」に「そんなわけないだろ」 25日、YOMIURI ON...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.000631</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>104</th>\n",
" <td>0.008732</td>\n",
" <td>0.815220</td>\n",
" <td>0.176047</td>\n",
" <td>data/text/topic-news/topic-news-6395897.txt</td>\n",
" <td>**提案の「南京大虐殺否定罪」に、日本では「幼稚で横暴」だと非難殺到 21日、NEWSポスト...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.010239</td>\n",
" <td>0.999187</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>105</th>\n",
" <td>0.010536</td>\n",
" <td>0.814796</td>\n",
" <td>0.174668</td>\n",
" <td>data/text/topic-news/topic-news-6705586.txt</td>\n",
" <td>【韓国ニュース】北朝鮮が日韓の軍事協定を批判 韓国ユーザーからは「敵の敵は味方」の声 28...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.001809</td>\n",
" <td>0.000300</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>106</th>\n",
" <td>0.014255</td>\n",
" <td>0.808532</td>\n",
" <td>0.177213</td>\n",
" <td>data/text/topic-news/topic-news-6349177.txt</td>\n",
" <td>バットの上に長時間正座…プロ野球界の主従関係を非難 7日、プロ野球独立リーグのBCリーグ「福...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.001051</td>\n",
" <td>0.010447</td>\n",
" <td>0.999168</td>\n",
" </tr>\n",
" <tr>\n",
" <th>107</th>\n",
" <td>0.031740</td>\n",
" <td>0.807555</td>\n",
" <td>0.160705</td>\n",
" <td>data/text/topic-news/topic-news-6696339.txt</td>\n",
" <td>フィリピンで日本人女性2人に性的暴行を加えた韓国人を逮捕 韓国ネットユーザーからは「日本は昔...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.300861</td>\n",
" <td>0.000235</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>108</th>\n",
" <td>0.008011</td>\n",
" <td>0.803337</td>\n",
" <td>0.188652</td>\n",
" <td>data/text/topic-news/topic-news-6353761.txt</td>\n",
" <td>「勝手な広告出すな!」韓国への感謝広告に批判殺到 \\t 9日、在韓国日本大使館が各韓国紙に「...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.035103</td>\n",
" <td>0.999207</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>109</th>\n",
" <td>0.004974</td>\n",
" <td>0.802660</td>\n",
" <td>0.192365</td>\n",
" <td>data/text/topic-news/topic-news-5934315.txt</td>\n",
" <td>ピザの起源は“韓国”とするCMが話題に ピザの起源を韓国だとする広告動画を韓国のピザ会社「ミ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.003605</td>\n",
" <td>0.000194</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>110</th>\n",
" <td>0.028537</td>\n",
" <td>0.797739</td>\n",
" <td>0.173724</td>\n",
" <td>data/text/topic-news/topic-news-6364323.txt</td>\n",
" <td>五輪マラソン代表の選出基準にネット掲示板で物議 12日に発表されたマラソン五輪代表の選考結果...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.001809</td>\n",
" <td>0.000178</td>\n",
" <td>0.999698</td>\n",
" </tr>\n",
" <tr>\n",
" <th>111</th>\n",
" <td>0.013858</td>\n",
" <td>0.795593</td>\n",
" <td>0.190549</td>\n",
" <td>data/text/topic-news/topic-news-5953481.txt</td>\n",
" <td>日韓スワップ協定拡大に批判殺到 野田首相が10月19日、ソウルで行われた李明博（イミョンバ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.001809</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>112</th>\n",
" <td>0.049260</td>\n",
" <td>0.795543</td>\n",
" <td>0.155197</td>\n",
" <td>data/text/topic-news/topic-news-6608148.txt</td>\n",
" <td>「ほかに開催希望者はないのか」 2020年五輪開催候補地にネットユーザの反応は？ 今月23日...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.010265</td>\n",
" <td>0.990878</td>\n",
" <td>0.999289</td>\n",
" </tr>\n",
" <tr>\n",
" <th>113</th>\n",
" <td>0.011444</td>\n",
" <td>0.792846</td>\n",
" <td>0.195710</td>\n",
" <td>data/text/topic-news/topic-news-6361892.txt</td>\n",
" <td>「**に失礼」政府の対応に非難集中 12日、自民党の幹事長代理・世耕弘成氏が、東日本大震災の...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.039105</td>\n",
" <td>0.996204</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>114</th>\n",
" <td>0.007714</td>\n",
" <td>0.791888</td>\n",
" <td>0.200398</td>\n",
" <td>data/text/topic-news/topic-news-6744410.txt</td>\n",
" <td>【韓国ニュース】「竹島の写真ダメ」に韓国ネットユーザーからは怒りの声 10日、韓国紙「ヘラル...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.034275</td>\n",
" <td>0.999705</td>\n",
" <td>0.000631</td>\n",
" <td>0.012821</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>115</th>\n",
" <td>0.195250</td>\n",
" <td>0.790722</td>\n",
" <td>0.014029</td>\n",
" <td>data/text/topic-news/topic-news-6790797.txt</td>\n",
" <td>【韓国ニュース】「モテなかったから僧侶になった」 韓国僧侶の発言が話題呼ぶ 韓国では一般的に...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.000631</td>\n",
" <td>0.000235</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>116</th>\n",
" <td>0.007177</td>\n",
" <td>0.787791</td>\n",
" <td>0.205032</td>\n",
" <td>data/text/topic-news/topic-news-5934833.txt</td>\n",
" <td>「韓国人の顔は何故醜い？」に韓国人激怒 2ちゃんねるに作られたスレッド「韓国人は何故ブサイク...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.000631</td>\n",
" <td>0.010447</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>117</th>\n",
" <td>0.114864</td>\n",
" <td>0.787027</td>\n",
" <td>0.098109</td>\n",
" <td>data/text/topic-news/topic-news-5943989.txt</td>\n",
" <td>堀江氏、有料メルマガで1億円稼ぐ 株式会社まぐまぐ代表取締役、大川弘一氏がTwitterで、...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.000631</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>118</th>\n",
" <td>0.008562</td>\n",
" <td>0.786947</td>\n",
" <td>0.204491</td>\n",
" <td>data/text/topic-news/topic-news-6732922.txt</td>\n",
" <td>【韓国ニュース】韓国政府の捕鯨再開宣言に韓国ネット掲示板「日本人の真似する必要ない」「犬も食...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.048798</td>\n",
" <td>0.986236</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>119</th>\n",
" <td>0.009684</td>\n",
" <td>0.786458</td>\n",
" <td>0.203859</td>\n",
" <td>data/text/topic-news/topic-news-5968673.txt</td>\n",
" <td>**の倫理を問う韓国に批判 8日午後、**で女性が暴漢に性的暴行を加えられ、全裸のまま30分...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.006714</td>\n",
" <td>0.006557</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>120</th>\n",
" <td>0.203462</td>\n",
" <td>0.784431</td>\n",
" <td>0.012107</td>\n",
" <td>data/text/topic-news/topic-news-6166579.txt</td>\n",
" <td>韓国ネットユーザーが東方神起と嵐の身長差に大喜び 昨年の大晦日に放送された「第62回NHK紅...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.000631</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>121</th>\n",
" <td>0.006808</td>\n",
" <td>0.777772</td>\n",
" <td>0.215420</td>\n",
" <td>data/text/topic-news/topic-news-6861303.txt</td>\n",
" <td>李明博大統領の“嘘”に韓国ネットユーザーから非難相次ぐ 韓国のニュースサイト「ビューズ・アン...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.023494</td>\n",
" <td>0.998988</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>122</th>\n",
" <td>0.124518</td>\n",
" <td>0.758792</td>\n",
" <td>0.116689</td>\n",
" <td>data/text/topic-news/topic-news-5931334.txt</td>\n",
" <td>角川グループがメディアファクトリーを買収 リクルート傘下だったメディアファクトリーが角川グル...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.000631</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>123</th>\n",
" <td>0.235940</td>\n",
" <td>0.744593</td>\n",
" <td>0.019467</td>\n",
" <td>data/text/topic-news/topic-news-6184471.txt</td>\n",
" <td>マツコの発言が海外メディアでも話題に 韓国のポップカルチャーを扱うアメリカのニュースサイト「...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.000631</td>\n",
" <td>0.005274</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>124</th>\n",
" <td>0.008767</td>\n",
" <td>0.737206</td>\n",
" <td>0.254027</td>\n",
" <td>data/text/topic-news/topic-news-6799292.txt</td>\n",
" <td>【韓国ニュース】韓国旗踏みつけ動画に批判殺到 韓国ユーザー「米国相手にはできないくせに」 ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.006714</td>\n",
" <td>0.000255</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>125</th>\n",
" <td>0.024057</td>\n",
" <td>0.730043</td>\n",
" <td>0.245900</td>\n",
" <td>data/text/topic-news/topic-news-6696248.txt</td>\n",
" <td>背番号7番を固辞した香川に英国ネットユーザーから賞賛相次ぐ 25日、英国紙「デイリー・メール...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.000631</td>\n",
" <td>0.000178</td>\n",
" <td>0.999168</td>\n",
" </tr>\n",
" <tr>\n",
" <th>126</th>\n",
" <td>0.011670</td>\n",
" <td>0.728831</td>\n",
" <td>0.259499</td>\n",
" <td>data/text/topic-news/topic-news-6874561.txt</td>\n",
" <td>【韓国ニュース】韓国のコメディアン、田村淳に「黙れ、おっさん」 20日未明、韓国のコメディア...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.000631</td>\n",
" <td>0.000235</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>127</th>\n",
" <td>0.007193</td>\n",
" <td>0.728396</td>\n",
" <td>0.264411</td>\n",
" <td>data/text/topic-news/topic-news-6670196.txt</td>\n",
" <td>【韓国ニュース】「Siri」に「独島は韓国領土」と教え込むユーザーが話題に 17日、韓国メデ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.000631</td>\n",
" <td>0.000219</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>128</th>\n",
" <td>0.256254</td>\n",
" <td>0.725762</td>\n",
" <td>0.017985</td>\n",
" <td>data/text/topic-news/topic-news-6740348.txt</td>\n",
" <td>外国人が日本で友達を作る最も良い方法は？ アメリカのネット掲示板「Reddit」に、「日本...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.000631</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>129</th>\n",
" <td>0.005541</td>\n",
" <td>0.720970</td>\n",
" <td>0.273490</td>\n",
" <td>data/text/topic-news/topic-news-6310413.txt</td>\n",
" <td>日本を強く非難する韓国歌手、キム・ジャンフン氏に怒りのコメント続出 韓国の歌手であるキム・ジ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000175</td>\n",
" <td>0.999705</td>\n",
" <td>0.001709</td>\n",
" <td>0.000265</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>...</th>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" <td>...</td>\n",
" </tr>\n",
" <tr>\n",
" <th>740</th>\n",
" <td>0.855409</td>\n",
" <td>0.007817</td>\n",
" <td>0.136773</td>\n",
" <td>data/text/topic-news/topic-news-6316640.txt</td>\n",
" <td>クイズ☆タレント名鑑の前田敦子に関する問題が「容赦無い」と話題に 26日に放送されたTBS系...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.967480</td>\n",
" <td>0.000188</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>741</th>\n",
" <td>0.208691</td>\n",
" <td>0.007816</td>\n",
" <td>0.783493</td>\n",
" <td>data/text/topic-news/topic-news-5938333.txt</td>\n",
" <td>au版iPhone4Sの購入者に“仕込み疑惑”が浮上 iPhone4Sが発売となった本日、徹...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.963972</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.055152</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>742</th>\n",
" <td>0.724867</td>\n",
" <td>0.007789</td>\n",
" <td>0.267344</td>\n",
" <td>data/text/topic-news/topic-news-5931153.txt</td>\n",
" <td>ＡＫＢ大島優子に非難殺到 「性格が悪すぎる」 インターネット掲示板２ちゃんねるで、AKB4...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999541</td>\n",
" <td>0.000295</td>\n",
" <td>0.005327</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>743</th>\n",
" <td>0.746203</td>\n",
" <td>0.007777</td>\n",
" <td>0.246020</td>\n",
" <td>data/text/topic-news/topic-news-6631065.txt</td>\n",
" <td>フジテレビ「家族のうた」など打ち切り相次ぐTV業界に、ネットユーザー「嫌なら見るなとか言って...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.000188</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>744</th>\n",
" <td>0.698840</td>\n",
" <td>0.007707</td>\n",
" <td>0.293454</td>\n",
" <td>data/text/topic-news/topic-news-6895782.txt</td>\n",
" <td>有吉弘行が平成ノブシコブシ・吉村崇のブログ炎上に言及 お笑い芸人の有吉弘行が、26日に放送さ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.000207</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>745</th>\n",
" <td>0.630251</td>\n",
" <td>0.007694</td>\n",
" <td>0.362054</td>\n",
" <td>data/text/topic-news/topic-news-6660541.txt</td>\n",
" <td>スギちゃん、本音明かす「ワイルドだけど、嫌われたくないんですよ」 14日、過労でダウンし、イ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000257</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.995182</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>746</th>\n",
" <td>0.983611</td>\n",
" <td>0.007688</td>\n",
" <td>0.008701</td>\n",
" <td>data/text/topic-news/topic-news-6019023.txt</td>\n",
" <td>「マツコ&有吉の怒り新党2」出演者総とっかえの危機 9日放送の「マツコ&有吉の怒り新党」（テ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>747</th>\n",
" <td>0.983836</td>\n",
" <td>0.007641</td>\n",
" <td>0.008524</td>\n",
" <td>data/text/topic-news/topic-news-6780686.txt</td>\n",
" <td>「FNS27時間テレビ」 ローラのリアクションに「放送事故」の声 22日に放送された「FNS...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>748</th>\n",
" <td>0.826461</td>\n",
" <td>0.007585</td>\n",
" <td>0.165955</td>\n",
" <td>data/text/topic-news/topic-news-6302176.txt</td>\n",
" <td>オセロ中島がついに全レギュラー降板、″失業″状態に心配の声 22日、産経ニュースをはじめとし...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.004777</td>\n",
" <td>0.000235</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>749</th>\n",
" <td>0.898826</td>\n",
" <td>0.007525</td>\n",
" <td>0.093649</td>\n",
" <td>data/text/topic-news/topic-news-6563543.txt</td>\n",
" <td>リンカーンで放送事故、ツイッター騒然 15日に放送されたバラエティ番組「リンカーン」（TBS...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.002928</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>750</th>\n",
" <td>0.984373</td>\n",
" <td>0.007428</td>\n",
" <td>0.008199</td>\n",
" <td>data/text/topic-news/topic-news-6449971.txt</td>\n",
" <td>テレビ朝日で花見のニュースに津波の映像が流れる放送事故 ネット掲示板は一時騒然 7日、テレビ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.000235</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>751</th>\n",
" <td>0.909996</td>\n",
" <td>0.007397</td>\n",
" <td>0.082607</td>\n",
" <td>data/text/topic-news/topic-news-6586368.txt</td>\n",
" <td>野球中継が突然の中止、代替番組が用意できず非常事態に 22日に放送されたテレビ愛知の野球中継...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.002155</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>752</th>\n",
" <td>0.549859</td>\n",
" <td>0.007392</td>\n",
" <td>0.442749</td>\n",
" <td>data/text/topic-news/topic-news-6317274.txt</td>\n",
" <td>漫画家うすた京介さんのパチンコ業界へのTwitter発言がネット掲示板で話題に 27日、漫画...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000257</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.999339</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>753</th>\n",
" <td>0.878630</td>\n",
" <td>0.007364</td>\n",
" <td>0.114006</td>\n",
" <td>data/text/topic-news/topic-news-6450159.txt</td>\n",
" <td>加護亜依が号泣、自殺未遂騒動後初のテレビ出演に「もう芸能界やめたほうがいい」の声 9日、モー...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.001709</td>\n",
" <td>0.015909</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>754</th>\n",
" <td>0.977388</td>\n",
" <td>0.007242</td>\n",
" <td>0.015369</td>\n",
" <td>data/text/topic-news/topic-news-6406486.txt</td>\n",
" <td>有吉が「しゃべくり007」で暴露した“絡みたくない大物”とは誰か? 26日、日本テレビ系で放...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.014417</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>755</th>\n",
" <td>0.697792</td>\n",
" <td>0.007239</td>\n",
" <td>0.294969</td>\n",
" <td>data/text/topic-news/topic-news-5907376.txt</td>\n",
" <td>紳助とたけしの明暗を分けたものとは 今年で20回目を迎えたTBSのオールスター感謝祭に、1回...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.001653</td>\n",
" <td>0.010447</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>756</th>\n",
" <td>0.984013</td>\n",
" <td>0.007222</td>\n",
" <td>0.008764</td>\n",
" <td>data/text/topic-news/topic-news-6668296.txt</td>\n",
" <td>指原莉乃をからかった浅草キッド・玉袋筋太郎に賛否 16日放送の「5時に夢中!」（東京MXテレ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.001809</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>757</th>\n",
" <td>0.887530</td>\n",
" <td>0.007110</td>\n",
" <td>0.105361</td>\n",
" <td>data/text/topic-news/topic-news-5971115.txt</td>\n",
" <td>“キラキラネーム”でうつになる罪のない子供たち 「キラキラネーム」という言葉をご存知だろうか...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.005327</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>758</th>\n",
" <td>0.032959</td>\n",
" <td>0.006962</td>\n",
" <td>0.960079</td>\n",
" <td>data/text/topic-news/topic-news-6613650.txt</td>\n",
" <td>生活保護のイメージ悪化に**も、反論の声多数 30日、生活保護問題対策全国会議は、東京・千代...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000257</td>\n",
" <td>0.000295</td>\n",
" <td>0.040283</td>\n",
" <td>0.240241</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>759</th>\n",
" <td>0.632465</td>\n",
" <td>0.006928</td>\n",
" <td>0.360607</td>\n",
" <td>data/text/topic-news/topic-news-6301970.txt</td>\n",
" <td>見知らぬ団体が勝手にハロプロのYouTube公式チャンネルを削除、物議に 21日、ハロープロ...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000257</td>\n",
" <td>0.000295</td>\n",
" <td>0.005327</td>\n",
" <td>0.999191</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>760</th>\n",
" <td>0.626982</td>\n",
" <td>0.006851</td>\n",
" <td>0.366167</td>\n",
" <td>data/text/topic-news/topic-news-6586056.txt</td>\n",
" <td>河本準一、大手企業広告から存在消される事態に 23日、母親の生活保護受給が物議を醸している、...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000257</td>\n",
" <td>0.000295</td>\n",
" <td>0.005327</td>\n",
" <td>0.000279</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>761</th>\n",
" <td>0.906056</td>\n",
" <td>0.006742</td>\n",
" <td>0.087202</td>\n",
" <td>data/text/topic-news/topic-news-6154347.txt</td>\n",
" <td>大槻教授、たけしの番組の“やらせ”を暴露 超自然現象や超能力などのオカルト事象を科学的観点か...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>762</th>\n",
" <td>0.895600</td>\n",
" <td>0.006678</td>\n",
" <td>0.097721</td>\n",
" <td>data/text/topic-news/topic-news-6899432.txt</td>\n",
" <td>伊集院光がラジオで「24時間テレビ」について“本音”を語る 27日、伊集院光がラジオ番組「J...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>763</th>\n",
" <td>0.350810</td>\n",
" <td>0.006344</td>\n",
" <td>0.642846</td>\n",
" <td>data/text/topic-news/topic-news-6584186.txt</td>\n",
" <td>神田うのの手のひら返しにネットユーザ騒然 21日、神田うのが自身のブログで二股騒動があった料...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000191</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.999493</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>764</th>\n",
" <td>0.052264</td>\n",
" <td>0.006001</td>\n",
" <td>0.941735</td>\n",
" <td>data/text/topic-news/topic-news-6601493.txt</td>\n",
" <td>河本の生活保護問題で、オリラジ・藤森がツイッターで騒動に 25日、母親の生活保護受給について...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000191</td>\n",
" <td>0.000295</td>\n",
" <td>0.968722</td>\n",
" <td>0.000859</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>765</th>\n",
" <td>0.988235</td>\n",
" <td>0.005657</td>\n",
" <td>0.006109</td>\n",
" <td>data/text/topic-news/topic-news-6674453.txt</td>\n",
" <td>AKB指原のスキャンダル。TBS番組は「90％以上のファンが彼女を許した」と説明 今月14日...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.002155</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>766</th>\n",
" <td>0.330100</td>\n",
" <td>0.005626</td>\n",
" <td>0.664274</td>\n",
" <td>data/text/topic-news/topic-news-6738399.txt</td>\n",
" <td>「世の中そんなに甘くないからね」 スーパーマーケット店員の発言に批判殺到し店舗ブログも大炎上...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.000191</td>\n",
" <td>0.000295</td>\n",
" <td>0.001603</td>\n",
" <td>0.996365</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>767</th>\n",
" <td>0.841284</td>\n",
" <td>0.005133</td>\n",
" <td>0.153583</td>\n",
" <td>data/text/topic-news/topic-news-5910461.txt</td>\n",
" <td>読売テレビ広報部長の無礼千万メールにジャーナリスト烏賀陽（うがや）弘道さんが激怒 ジャー...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.000631</td>\n",
" <td>0.029341</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>768</th>\n",
" <td>0.991185</td>\n",
" <td>0.004218</td>\n",
" <td>0.004596</td>\n",
" <td>data/text/topic-news/topic-news-5903373.txt</td>\n",
" <td>写真が流出し“堕ちていった”アイドルたち アイドルが男性と一緒に写ったプリクラやニャンニャン...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999659</td>\n",
" <td>0.000295</td>\n",
" <td>0.037480</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" <tr>\n",
" <th>769</th>\n",
" <td>0.788469</td>\n",
" <td>0.003428</td>\n",
" <td>0.208103</td>\n",
" <td>data/text/topic-news/topic-news-6696655.txt</td>\n",
" <td>元AKB指原莉乃、生放送で胸中告白。交際相手のことやネットの書き込みにも言及 今月14日に発...</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>NaN</td>\n",
" <td>0.999541</td>\n",
" <td>0.000295</td>\n",
" <td>0.004894</td>\n",
" <td>0.000178</td>\n",
" <td>0.000180</td>\n",
" </tr>\n",
" </tbody>\n",
"</table>\n",
"<p>670 rows × 15 columns</p>\n",
"</div>"
],
"text/plain": [
" topic00 topic01 topic02 \\\n",
"100 0.017635 0.821989 0.160377 \n",
"101 0.016988 0.821360 0.161651 \n",
"102 0.010429 0.818316 0.171255 \n",
"103 0.014804 0.816421 0.168774 \n",
"104 0.008732 0.815220 0.176047 \n",
"105 0.010536 0.814796 0.174668 \n",
"106 0.014255 0.808532 0.177213 \n",
"107 0.031740 0.807555 0.160705 \n",
"108 0.008011 0.803337 0.188652 \n",
"109 0.004974 0.802660 0.192365 \n",
"110 0.028537 0.797739 0.173724 \n",
"111 0.013858 0.795593 0.190549 \n",
"112 0.049260 0.795543 0.155197 \n",
"113 0.011444 0.792846 0.195710 \n",
"114 0.007714 0.791888 0.200398 \n",
"115 0.195250 0.790722 0.014029 \n",
"116 0.007177 0.787791 0.205032 \n",
"117 0.114864 0.787027 0.098109 \n",
"118 0.008562 0.786947 0.204491 \n",
"119 0.009684 0.786458 0.203859 \n",
"120 0.203462 0.784431 0.012107 \n",
"121 0.006808 0.777772 0.215420 \n",
"122 0.124518 0.758792 0.116689 \n",
"123 0.235940 0.744593 0.019467 \n",
"124 0.008767 0.737206 0.254027 \n",
"125 0.024057 0.730043 0.245900 \n",
"126 0.011670 0.728831 0.259499 \n",
"127 0.007193 0.728396 0.264411 \n",
"128 0.256254 0.725762 0.017985 \n",
"129 0.005541 0.720970 0.273490 \n",
".. ... ... ... \n",
"740 0.855409 0.007817 0.136773 \n",
"741 0.208691 0.007816 0.783493 \n",
"742 0.724867 0.007789 0.267344 \n",
"743 0.746203 0.007777 0.246020 \n",
"744 0.698840 0.007707 0.293454 \n",
"745 0.630251 0.007694 0.362054 \n",
"746 0.983611 0.007688 0.008701 \n",
"747 0.983836 0.007641 0.008524 \n",
"748 0.826461 0.007585 0.165955 \n",
"749 0.898826 0.007525 0.093649 \n",
"750 0.984373 0.007428 0.008199 \n",
"751 0.909996 0.007397 0.082607 \n",
"752 0.549859 0.007392 0.442749 \n",
"753 0.878630 0.007364 0.114006 \n",
"754 0.977388 0.007242 0.015369 \n",
"755 0.697792 0.007239 0.294969 \n",
"756 0.984013 0.007222 0.008764 \n",
"757 0.887530 0.007110 0.105361 \n",
"758 0.032959 0.006962 0.960079 \n",
"759 0.632465 0.006928 0.360607 \n",
"760 0.626982 0.006851 0.366167 \n",
"761 0.906056 0.006742 0.087202 \n",
"762 0.895600 0.006678 0.097721 \n",
"763 0.350810 0.006344 0.642846 \n",
"764 0.052264 0.006001 0.941735 \n",
"765 0.988235 0.005657 0.006109 \n",
"766 0.330100 0.005626 0.664274 \n",
"767 0.841284 0.005133 0.153583 \n",
"768 0.991185 0.004218 0.004596 \n",
"769 0.788469 0.003428 0.208103 \n",
"\n",
" doc_file \\\n",
"100 data/text/topic-news/topic-news-6017374.txt \n",
"101 data/text/topic-news/topic-news-5966020.txt \n",
"102 data/text/topic-news/topic-news-6388021.txt \n",
"103 data/text/topic-news/topic-news-6226414.txt \n",
"104 data/text/topic-news/topic-news-6395897.txt \n",
"105 data/text/topic-news/topic-news-6705586.txt \n",
"106 data/text/topic-news/topic-news-6349177.txt \n",
"107 data/text/topic-news/topic-news-6696339.txt \n",
"108 data/text/topic-news/topic-news-6353761.txt \n",
"109 data/text/topic-news/topic-news-5934315.txt \n",
"110 data/text/topic-news/topic-news-6364323.txt \n",
"111 data/text/topic-news/topic-news-5953481.txt \n",
"112 data/text/topic-news/topic-news-6608148.txt \n",
"113 data/text/topic-news/topic-news-6361892.txt \n",
"114 data/text/topic-news/topic-news-6744410.txt \n",
"115 data/text/topic-news/topic-news-6790797.txt \n",
"116 data/text/topic-news/topic-news-5934833.txt \n",
"117 data/text/topic-news/topic-news-5943989.txt \n",
"118 data/text/topic-news/topic-news-6732922.txt \n",
"119 data/text/topic-news/topic-news-5968673.txt \n",
"120 data/text/topic-news/topic-news-6166579.txt \n",
"121 data/text/topic-news/topic-news-6861303.txt \n",
"122 data/text/topic-news/topic-news-5931334.txt \n",
"123 data/text/topic-news/topic-news-6184471.txt \n",
"124 data/text/topic-news/topic-news-6799292.txt \n",
"125 data/text/topic-news/topic-news-6696248.txt \n",
"126 data/text/topic-news/topic-news-6874561.txt \n",
"127 data/text/topic-news/topic-news-6670196.txt \n",
"128 data/text/topic-news/topic-news-6740348.txt \n",
"129 data/text/topic-news/topic-news-6310413.txt \n",
".. ... \n",
"740 data/text/topic-news/topic-news-6316640.txt \n",
"741 data/text/topic-news/topic-news-5938333.txt \n",
"742 data/text/topic-news/topic-news-5931153.txt \n",
"743 data/text/topic-news/topic-news-6631065.txt \n",
"744 data/text/topic-news/topic-news-6895782.txt \n",
"745 data/text/topic-news/topic-news-6660541.txt \n",
"746 data/text/topic-news/topic-news-6019023.txt \n",
"747 data/text/topic-news/topic-news-6780686.txt \n",
"748 data/text/topic-news/topic-news-6302176.txt \n",
"749 data/text/topic-news/topic-news-6563543.txt \n",
"750 data/text/topic-news/topic-news-6449971.txt \n",
"751 data/text/topic-news/topic-news-6586368.txt \n",
"752 data/text/topic-news/topic-news-6317274.txt \n",
"753 data/text/topic-news/topic-news-6450159.txt \n",
"754 data/text/topic-news/topic-news-6406486.txt \n",
"755 data/text/topic-news/topic-news-5907376.txt \n",
"756 data/text/topic-news/topic-news-6668296.txt \n",
"757 data/text/topic-news/topic-news-5971115.txt \n",
"758 data/text/topic-news/topic-news-6613650.txt \n",
"759 data/text/topic-news/topic-news-6301970.txt \n",
"760 data/text/topic-news/topic-news-6586056.txt \n",
"761 data/text/topic-news/topic-news-6154347.txt \n",
"762 data/text/topic-news/topic-news-6899432.txt \n",
"763 data/text/topic-news/topic-news-6584186.txt \n",
"764 data/text/topic-news/topic-news-6601493.txt \n",
"765 data/text/topic-news/topic-news-6674453.txt \n",
"766 data/text/topic-news/topic-news-6738399.txt \n",
"767 data/text/topic-news/topic-news-5910461.txt \n",
"768 data/text/topic-news/topic-news-5903373.txt \n",
"769 data/text/topic-news/topic-news-6696655.txt \n",
"\n",
" doc_text tag_芸能 tag_海外 \\\n",
"100 日本の習慣に外国人が激怒 居酒屋で注文せずとも出される“お通し”。日本ではお馴染みの習慣だが... NaN NaN \n",
"101 日本スケート連盟のキム・ヨナ締め出しに「当然」の声 「キム・ヨナが日本のアイスショーからは... NaN NaN \n",
"102 **警察が女子高生を生きたまま田んぼに遺棄 21日、朝日新聞は、**の警察が倒れている女子高... NaN NaN \n",
"103 「日本人が最も食べている漬物はキムチ」に「そんなわけないだろ」 25日、YOMIURI ON... NaN NaN \n",
"104 **提案の「南京大虐殺否定罪」に、日本では「幼稚で横暴」だと非難殺到 21日、NEWSポスト... NaN NaN \n",
"105 【韓国ニュース】北朝鮮が日韓の軍事協定を批判 韓国ユーザーからは「敵の敵は味方」の声 28... NaN NaN \n",
"106 バットの上に長時間正座…プロ野球界の主従関係を非難 7日、プロ野球独立リーグのBCリーグ「福... NaN NaN \n",
"107 フィリピンで日本人女性2人に性的暴行を加えた韓国人を逮捕 韓国ネットユーザーからは「日本は昔... NaN NaN \n",
"108 「勝手な広告出すな!」韓国への感謝広告に批判殺到 \\t 9日、在韓国日本大使館が各韓国紙に「... NaN NaN \n",
"109 ピザの起源は“韓国”とするCMが話題に ピザの起源を韓国だとする広告動画を韓国のピザ会社「ミ... NaN NaN \n",
"110 五輪マラソン代表の選出基準にネット掲示板で物議 12日に発表されたマラソン五輪代表の選考結果... NaN NaN \n",
"111 日韓スワップ協定拡大に批判殺到 野田首相が10月19日、ソウルで行われた李明博（イミョンバ... NaN NaN \n",
"112 「ほかに開催希望者はないのか」 2020年五輪開催候補地にネットユーザの反応は？ 今月23日... NaN NaN \n",
"113 「**に失礼」政府の対応に非難集中 12日、自民党の幹事長代理・世耕弘成氏が、東日本大震災の... NaN NaN \n",
"114 【韓国ニュース】「竹島の写真ダメ」に韓国ネットユーザーからは怒りの声 10日、韓国紙「ヘラル... NaN NaN \n",
"115 【韓国ニュース】「モテなかったから僧侶になった」 韓国僧侶の発言が話題呼ぶ 韓国では一般的に... NaN NaN \n",
"116 「韓国人の顔は何故醜い？」に韓国人激怒 2ちゃんねるに作られたスレッド「韓国人は何故ブサイク... NaN NaN \n",
"117 堀江氏、有料メルマガで1億円稼ぐ 株式会社まぐまぐ代表取締役、大川弘一氏がTwitterで、... NaN NaN \n",
"118 【韓国ニュース】韓国政府の捕鯨再開宣言に韓国ネット掲示板「日本人の真似する必要ない」「犬も食... NaN NaN \n",
"119 **の倫理を問う韓国に批判 8日午後、**で女性が暴漢に性的暴行を加えられ、全裸のまま30分... NaN NaN \n",
"120 韓国ネットユーザーが東方神起と嵐の身長差に大喜び 昨年の大晦日に放送された「第62回NHK紅... NaN NaN \n",
"121 李明博大統領の“嘘”に韓国ネットユーザーから非難相次ぐ 韓国のニュースサイト「ビューズ・アン... NaN NaN \n",
"122 角川グループがメディアファクトリーを買収 リクルート傘下だったメディアファクトリーが角川グル... NaN NaN \n",
"123 マツコの発言が海外メディアでも話題に 韓国のポップカルチャーを扱うアメリカのニュースサイト「... NaN NaN \n",
"124 【韓国ニュース】韓国旗踏みつけ動画に批判殺到 韓国ユーザー「米国相手にはできないくせに」 ... NaN NaN \n",
"125 背番号7番を固辞した香川に英国ネットユーザーから賞賛相次ぐ 25日、英国紙「デイリー・メール... NaN NaN \n",
"126 【韓国ニュース】韓国のコメディアン、田村淳に「黙れ、おっさん」 20日未明、韓国のコメディア... NaN NaN \n",
"127 【韓国ニュース】「Siri」に「独島は韓国領土」と教え込むユーザーが話題に 17日、韓国メデ... NaN NaN \n",
"128 外国人が日本で友達を作る最も良い方法は？ アメリカのネット掲示板「Reddit」に、「日本... NaN NaN \n",
"129 日本を強く非難する韓国歌手、キム・ジャンフン氏に怒りのコメント続出 韓国の歌手であるキム・ジ... NaN NaN \n",
".. ... ... ... \n",
"740 クイズ☆タレント名鑑の前田敦子に関する問題が「容赦無い」と話題に 26日に放送されたTBS系... NaN NaN \n",
"741 au版iPhone4Sの購入者に“仕込み疑惑”が浮上 iPhone4Sが発売となった本日、徹... NaN NaN \n",
"742 ＡＫＢ大島優子に非難殺到 「性格が悪すぎる」 インターネット掲示板２ちゃんねるで、AKB4... NaN NaN \n",
"743 フジテレビ「家族のうた」など打ち切り相次ぐTV業界に、ネットユーザー「嫌なら見るなとか言って... NaN NaN \n",
"744 有吉弘行が平成ノブシコブシ・吉村崇のブログ炎上に言及 お笑い芸人の有吉弘行が、26日に放送さ... NaN NaN \n",
"745 スギちゃん、本音明かす「ワイルドだけど、嫌われたくないんですよ」 14日、過労でダウンし、イ... NaN NaN \n",
"746 「マツコ&有吉の怒り新党2」出演者総とっかえの危機 9日放送の「マツコ&有吉の怒り新党」（テ... NaN NaN \n",
"747 「FNS27時間テレビ」 ローラのリアクションに「放送事故」の声 22日に放送された「FNS... NaN NaN \n",
"748 オセロ中島がついに全レギュラー降板、″失業″状態に心配の声 22日、産経ニュースをはじめとし... NaN NaN \n",
"749 リンカーンで放送事故、ツイッター騒然 15日に放送されたバラエティ番組「リンカーン」（TBS... NaN NaN \n",
"750 テレビ朝日で花見のニュースに津波の映像が流れる放送事故 ネット掲示板は一時騒然 7日、テレビ... NaN NaN \n",
"751 野球中継が突然の中止、代替番組が用意できず非常事態に 22日に放送されたテレビ愛知の野球中継... NaN NaN \n",
"752 漫画家うすた京介さんのパチンコ業界へのTwitter発言がネット掲示板で話題に 27日、漫画... NaN NaN \n",
"753 加護亜依が号泣、自殺未遂騒動後初のテレビ出演に「もう芸能界やめたほうがいい」の声 9日、モー... NaN NaN \n",
"754 有吉が「しゃべくり007」で暴露した“絡みたくない大物”とは誰か? 26日、日本テレビ系で放... NaN NaN \n",
"755 紳助とたけしの明暗を分けたものとは 今年で20回目を迎えたTBSのオールスター感謝祭に、1回... NaN NaN \n",
"756 指原莉乃をからかった浅草キッド・玉袋筋太郎に賛否 16日放送の「5時に夢中!」（東京MXテレ... NaN NaN \n",
"757 “キラキラネーム”でうつになる罪のない子供たち 「キラキラネーム」という言葉をご存知だろうか... NaN NaN \n",
"758 生活保護のイメージ悪化に**も、反論の声多数 30日、生活保護問題対策全国会議は、東京・千代... NaN NaN \n",
"759 見知らぬ団体が勝手にハロプロのYouTube公式チャンネルを削除、物議に 21日、ハロープロ... NaN NaN \n",
"760 河本準一、大手企業広告から存在消される事態に 23日、母親の生活保護受給が物議を醸している、... NaN NaN \n",
"761 大槻教授、たけしの番組の“やらせ”を暴露 超自然現象や超能力などのオカルト事象を科学的観点か... NaN NaN \n",
"762 伊集院光がラジオで「24時間テレビ」について“本音”を語る 27日、伊集院光がラジオ番組「J... NaN NaN \n",
"763 神田うのの手のひら返しにネットユーザ騒然 21日、神田うのが自身のブログで二股騒動があった料... NaN NaN \n",
"764 河本の生活保護問題で、オリラジ・藤森がツイッターで騒動に 25日、母親の生活保護受給について... NaN NaN \n",
"765 AKB指原のスキャンダル。TBS番組は「90％以上のファンが彼女を許した」と説明 今月14日... NaN NaN \n",
"766 「世の中そんなに甘くないからね」 スーパーマーケット店員の発言に批判殺到し店舗ブログも大炎上... NaN NaN \n",
"767 読売テレビ広報部長の無礼千万メールにジャーナリスト烏賀陽（うがや）弘道さんが激怒 ジャー... NaN NaN \n",
"768 写真が流出し“堕ちていった”アイドルたち アイドルが男性と一緒に写ったプリクラやニャンニャン... NaN NaN \n",
"769 元AKB指原莉乃、生放送で胸中告白。交際相手のことやネットの書き込みにも言及 今月14日に発... NaN NaN \n",
"\n",
" tag_社会 tag_政治 tag_スポーツ predict_tag_芸能 predict_tag_海外 predict_tag_社会 \\\n",
"100 NaN NaN NaN 0.000175 0.999705 0.005327 \n",
"101 NaN NaN NaN 0.000175 0.999705 0.001653 \n",
"102 NaN NaN NaN 0.000175 0.999705 0.264500 \n",
"103 NaN NaN NaN 0.000175 0.999705 0.000631 \n",
"104 NaN NaN NaN 0.000175 0.999705 0.010239 \n",
"105 NaN NaN NaN 0.000175 0.999705 0.001809 \n",
"106 NaN NaN NaN 0.000175 0.999705 0.001051 \n",
"107 NaN NaN NaN 0.000175 0.999705 0.300861 \n",
"108 NaN NaN NaN 0.000175 0.999705 0.035103 \n",
"109 NaN NaN NaN 0.000175 0.999705 0.003605 \n",
"110 NaN NaN NaN 0.000175 0.999705 0.001809 \n",
"111 NaN NaN NaN 0.000175 0.999705 0.001809 \n",
"112 NaN NaN NaN 0.000175 0.999705 0.010265 \n",
"113 NaN NaN NaN 0.000175 0.999705 0.039105 \n",
"114 NaN NaN NaN 0.034275 0.999705 0.000631 \n",
"115 NaN NaN NaN 0.000175 0.999705 0.000631 \n",
"116 NaN NaN NaN 0.000175 0.999705 0.000631 \n",
"117 NaN NaN NaN 0.000175 0.999705 0.000631 \n",
"118 NaN NaN NaN 0.000175 0.999705 0.048798 \n",
"119 NaN NaN NaN 0.000175 0.999705 0.006714 \n",
"120 NaN NaN NaN 0.000175 0.999705 0.000631 \n",
"121 NaN NaN NaN 0.000175 0.999705 0.023494 \n",
"122 NaN NaN NaN 0.000175 0.999705 0.000631 \n",
"123 NaN NaN NaN 0.000175 0.999705 0.000631 \n",
"124 NaN NaN NaN 0.000175 0.999705 0.006714 \n",
"125 NaN NaN NaN 0.000175 0.999705 0.000631 \n",
"126 NaN NaN NaN 0.000175 0.999705 0.000631 \n",
"127 NaN NaN NaN 0.000175 0.999705 0.000631 \n",
"128 NaN NaN NaN 0.000175 0.999705 0.000631 \n",
"129 NaN NaN NaN 0.000175 0.999705 0.001709 \n",
".. ... ... ... ... ... ... \n",
"740 NaN NaN NaN 0.999659 0.000295 0.967480 \n",
"741 NaN NaN NaN 0.963972 0.000295 0.000631 \n",
"742 NaN NaN NaN 0.999541 0.000295 0.005327 \n",
"743 NaN NaN NaN 0.999659 0.000295 0.000631 \n",
"744 NaN NaN NaN 0.999659 0.000295 0.000631 \n",
"745 NaN NaN NaN 0.000257 0.000295 0.000631 \n",
"746 NaN NaN NaN 0.999659 0.000295 0.000631 \n",
"747 NaN NaN NaN 0.999659 0.000295 0.000631 \n",
"748 NaN NaN NaN 0.999659 0.000295 0.004777 \n",
"749 NaN NaN NaN 0.999659 0.000295 0.002928 \n",
"750 NaN NaN NaN 0.999659 0.000295 0.000631 \n",
"751 NaN NaN NaN 0.999659 0.000295 0.002155 \n",
"752 NaN NaN NaN 0.000257 0.000295 0.000631 \n",
"753 NaN NaN NaN 0.999659 0.000295 0.001709 \n",
"754 NaN NaN NaN 0.999659 0.000295 0.014417 \n",
"755 NaN NaN NaN 0.999659 0.000295 0.001653 \n",
"756 NaN NaN NaN 0.999659 0.000295 0.001809 \n",
"757 NaN NaN NaN 0.999659 0.000295 0.005327 \n",
"758 NaN NaN NaN 0.000257 0.000295 0.040283 \n",
"759 NaN NaN NaN 0.000257 0.000295 0.005327 \n",
"760 NaN NaN NaN 0.000257 0.000295 0.005327 \n",
"761 NaN NaN NaN 0.999659 0.000295 0.000631 \n",
"762 NaN NaN NaN 0.999659 0.000295 0.000631 \n",
"763 NaN NaN NaN 0.000191 0.000295 0.000631 \n",
"764 NaN NaN NaN 0.000191 0.000295 0.968722 \n",
"765 NaN NaN NaN 0.999659 0.000295 0.002155 \n",
"766 NaN NaN NaN 0.000191 0.000295 0.001603 \n",
"767 NaN NaN NaN 0.999659 0.000295 0.000631 \n",
"768 NaN NaN NaN 0.999659 0.000295 0.037480 \n",
"769 NaN NaN NaN 0.999541 0.000295 0.004894 \n",
"\n",
" predict_tag_政治 predict_tag_スポーツ \n",
"100 0.000178 0.000180 \n",
"101 0.000178 0.999168 \n",
"102 0.999207 0.000180 \n",
"103 0.000178 0.000180 \n",
"104 0.999187 0.000180 \n",
"105 0.000300 0.000180 \n",
"106 0.010447 0.999168 \n",
"107 0.000235 0.000180 \n",
"108 0.999207 0.000180 \n",
"109 0.000194 0.000180 \n",
"110 0.000178 0.999698 \n",
"111 0.000178 0.000180 \n",
"112 0.990878 0.999289 \n",
"113 0.996204 0.000180 \n",
"114 0.012821 0.000180 \n",
"115 0.000235 0.000180 \n",
"116 0.010447 0.000180 \n",
"117 0.000178 0.000180 \n",
"118 0.986236 0.000180 \n",
"119 0.006557 0.000180 \n",
"120 0.000178 0.000180 \n",
"121 0.998988 0.000180 \n",
"122 0.000178 0.000180 \n",
"123 0.005274 0.000180 \n",
"124 0.000255 0.000180 \n",
"125 0.000178 0.999168 \n",
"126 0.000235 0.000180 \n",
"127 0.000219 0.000180 \n",
"128 0.000178 0.000180 \n",
"129 0.000265 0.000180 \n",
".. ... ... \n",
"740 0.000188 0.000180 \n",
"741 0.055152 0.000180 \n",
"742 0.000178 0.000180 \n",
"743 0.000188 0.000180 \n",
"744 0.000207 0.000180 \n",
"745 0.995182 0.000180 \n",
"746 0.000178 0.000180 \n",
"747 0.000178 0.000180 \n",
"748 0.000235 0.000180 \n",
"749 0.000178 0.000180 \n",
"750 0.000235 0.000180 \n",
"751 0.000178 0.000180 \n",
"752 0.999339 0.000180 \n",
"753 0.015909 0.000180 \n",
"754 0.000178 0.000180 \n",
"755 0.010447 0.000180 \n",
"756 0.000178 0.000180 \n",
"757 0.000178 0.000180 \n",
"758 0.240241 0.000180 \n",
"759 0.999191 0.000180 \n",
"760 0.000279 0.000180 \n",
"761 0.000178 0.000180 \n",
"762 0.000178 0.000180 \n",
"763 0.999493 0.000180 \n",
"764 0.000859 0.000180 \n",
"765 0.000178 0.000180 \n",
"766 0.996365 0.000180 \n",
"767 0.029341 0.000180 \n",
"768 0.000178 0.000180 \n",
"769 0.000178 0.000180 \n",
"\n",
"[670 rows x 15 columns]"
]
},
"execution_count": 15,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"# 予測は、 tag づけしていないデータにもつきます。\n",
"df_tag[100:]"
]
},
{
"cell_type": "code",
"execution_count": 16,
"metadata": {
"collapsed": true
},
"outputs": [],
"source": [
"# ファイルとして出力します。\n",
"file_name = 'data/tag_predict.csv'\n",
"df_tag.to_csv(file_name, index=False)\n"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"# 後は、、、\n",
"\n",
"上記で出力された data/tag_predict.csv を目視で確認して、予測が間違っている部分の tag を手動で入力し直しましょう。\n",
"\n",
"（予測が正しい場合を、再入力してもよいですが、あまり効果はありません。現状の学習の強化になるだけです）\n",
"\n",
"入力し直したデータを、 data/tag_predict.txt に上書きします。\n",
"\n",
"そして、また再学習することで精度が強化されていきます。\n",
"\n",
"こうして、「正しいデータを、効率的に増やしていきます」\n",
"\n",
"後は、学習モデルをより高度なものに変更してみてもよいでしょう。\n",
"\n",
"RNNでもBERTなど、自然言語の判別アルゴリズムは2019年の現在では頻繁にアップデートされています。\n",
"\n",
"それらは、tagづけされたデータが出来上がってから改めて再学習することができます。"
]
}
],
"metadata": {
"kernelspec": {
"display_name": "Python 3",
"language": "python",
"name": "python3"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.6.8"
}
},
"nbformat": 4,
"nbformat_minor": 2
}