/machine_learning

Basic Machine Learning Introductory Documents

Primary LanguagePythonMIT LicenseMIT

Introduction

This project implement classic machine learning algorithms(ML). Motivations for this project includes:

  • Helping machine learning freshman have a better and deeper understanding of the basic algorithms and models in this field.
  • Providing the real-life and commercial executing methods in ML filed.
  • Keeping my Mathematics Theory and Coding ability fresh due to such cases.

Overview

1.FM

1.1 fastfm

Show how to use the package of fast_fm to classify the training data directly.

1.2 Fsfm

@bolg：FM解析

We rewrite fm by ourselves and focus helping people get deeper insights about FM.So we upload it to the pypi named Fsfm,you can downlode it if you're interested in it.

2.N-gram

An interview problem in 'Nlp' solved by n-gram instead of Naive Bayes.

3.Svd

@bolg：SVD解析

3.1 Matrix decomposition in linalg

3.2 Matrix decomposition with RSVD

4.Collaborative Filtering Recommendation System

@bolg：协同推荐解析

4.1 Base of Item

4.2 Base of User

5.Semantic recognition

@bolg：评价文本判断用户流失倾向

5.1 Jieba Process

5.2 Tf-Idf

5.3 Bp Neural Network

5.4 SVM process

5.5 Naive Bayes

5.6 RandomForest

6.Gradient_descent

7.Smote

@bolg：SMOTE解析

7.1 Mean of the weight

7.2 Random scale in connected Vector

8.Frcwp

@bolg：风控方法解析

It means fast risk control with python.It's a lightweight tool that automatic recognize the outliers from a large data pool.

9.Ensemble

@bolg:Kaggle&TianChi分类问题相关算法快速实现

@bolg:Kaggle&TianChi分类问题相关纯算法理论剖析

9.1 Data preprocessing before ensemble

9.2 Case showed by stacking xgboost and logistic regression

9.3 Case showed by stacking gbdt and logistic regression

9.4 Case showed by bagging xgboots or gbdts

9.5 How to use the trained stacking model during the online module

10.Tsnewp

T-distributed stochastic neighbor embedding(t-SNE) rewrite with Python by ourselves, it's a good dimensionality reduction method. Add many explanation among the code.

Package download address.

More test data.

11.Knowledge Summary

Some questions for the new hand to estimate their level of the ML、DL. What's more ,it also contains the key point which i think during my study with Andrew Ng's machine learning lessons（to be continued）.

Also, I write some words to the new hand. Read it 写给想转行机器学习深度学习的同学 if you're interested in it .

12.Youtube

Following the paper 'Deep Neural Networks for YouTube Recommendations' , finished with Python.

@bolg：利用DNN做推荐的实现过程中的总结

@bolg：关于'Deep Neural Networks for YouTube Recommendations'的一些思考和实现

13.FFM

See More From:

@bolg：基于Tensorflow实现FFM

More you may follow with interest ：FM部分||deepFM部分

14.GolVe_Classification

See More From:

@bolg：GolVe向量化做文本分类

More you may follow with interest ：Youtube构造skn Vector||N-Grams

15.YMMNlpUtils

Phone number analytical tools, design for get out the true phone number from digital mixed with dialect、chinese、special symbols

pip install YMMNlpUtils supported

DEMO:

from YMMNlpUtils import YMMNlpUtils
obj = YMMNlpUtils(strict =True)
obj.get_all_phone_number('买车，看到请联系178#洞拐洞事您您两3\～')
Out[3]: '买车看到请联系17807040023'
obj.get_all_phone_number('买车，我有姗姗的电话，家住东洞门口，看到请联系178#洞拐姗姗您您两3\～')
Out[4]: '买车我有姗姗的电话家住东洞门口看到请联系17807330023'

Requirements

Python Environment. More details getting from single project requirement.

More

If you find some incorrect content, i'm so sorry about that. PLS contact me by the following way: