Passive Aggressive

This python script visualizes the process of Online Passive-Aggressive (PA) algorithm and PA-Ⅰ algorithm.

PA algorithm is a margin based online learning algorithm[Crammer et al.] for binary classification.
Unlike PA algorithm, which is a hard-margin based method, PA-I algorithm is a soft margin based method and robuster to noise.

"Koby Crammer, Ofer Dekel, Joseph Keshet, Shai Shalev-Shwartz, Yoram Singer, "Online Passive-Aggressive Algorithms" Journal of Machine Learning Research 7 (2006) 551–585."

日本語解説ページ (Qiita)

オンライン機械学習の弱点って？？：Passive Aggressiveのプロセスを実装＆可視化

Example

Show online learning process:

python passive_aggressive_ex.py

If you want to record the result:

python passive_aggresive_ex.py --record 1

The result is saved as "results.mp4"

References

オンライン機械学習 (機械学習プロフェッショナルシリーズ)
統計の素人だけどPythonで機械学習モデルを実装したい、そんな人のための第一歩
実装して理解するオンライン学習器(1) - PassiveAggresive
AtsushiSakai/matplotrecorder

License

MIT License, Seita Kayukawa (Wotipati)