/CRF

Conditional Random Field

Primary LanguagePythonMIT LicenseMIT

Conditional Random Field

结构

.
├── bigdata
│   ├── dev.conll
│   ├── test.conll
│   └── train.conll
├── data
│   ├── dev.conll
│   └── train.conll
├── results
│   ├── acrf.txt
│   ├── bacrf.txt
│   ├── bcrf.txt
│   ├── boacrf.txt
│   ├── bocrf.txt
│   ├── crf.txt
│   ├── oacrf.txt
│   └── ocrf.txt
├── config.py
├── crf.py
├── ocrf.py
├── README.md
└── run.py

用法

$ python run.py -h
usage: run.py [-h] [--bigdata] [--anneal] [--optimize] [--regularize]
              [--seed SEED] [--file FILE]

Create Conditional Random Field(CRF) for POS Tagging.

optional arguments:
  -h, --help            show this help message and exit
  --bigdata, -b         use big data
  --anneal, -a          use simulated annealing
  --optimize, -o        use feature extracion optimization
  --regularize, -r      use L2 regularization
  --seed SEED, -s SEED  set the seed for generating random numbers
  --file FILE, -f FILE  set where to store the model
# e.g. 特征提取优化+模拟退火
$ python run.py -b --optimize --anneal

结果

大数据集 特征提取优化 模拟退火 迭代次数 dev/P test/P mT(s)
× × × 12/18 88.6405% * 0:00:52.687575
× × √ 10/16 88.6504% * 0:00:52.967660
× √ × 10/16 88.9425% * 0:00:16.543064
× √ √ 12/18 88.9247% * 0:00:17.004330
√ × × 14/25 93.8587% 93.7054% 0:57:13.132850
√ × √ 37/48 94.2190% 93.9665% 0:56:30.033807
√ √ × 15/26 93.9705% 93.8537% 0:13:33.869449
√ √ √ 13/24 94.2107% 94.0425% 0:13:25.669687