Skip to content

WhiteGive-Boy/CWS-Hmm_BiLSTM-CRF

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

22 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

CWS Chinese word segmentation 中文分词

实现算法:HMM BiLSTM BiLSTM+CRF

数据集:人民日报 训练:测试=4:1
数据处理:

cd data
python data_u.py

HMM:

cd HMM
python hmm_model.py

LSTM:

cd LSTM
python train.py

BiLSTM+CRF:

cd BiLSTM-CRF
python train.py

我运行的结果:

BiLSTM+CRF
embedding_dim=100 hidden_dim=200 epoch=1 lr=0.005
precision:0.96975528
recall:   0.96779571
fscore:   0.96877451
LSTM:
precision:0.94323622
recall:   0.89368218
fscore:   0.91779080
HMM:
precision:0.87980196
recall:   0.84381022
fscore:   0.86143031

BiLSTM+CRF pytorch实现 参考 ChineseNER
Hmm实现 参考 HMM

About

CWS中文分词 HMM BiLSTM+CRF pytorch 细致实现

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages