http://www.cslt.org/mediawiki/index.php?action=history&feed=atom&title=Dongxu_Zhang_14-11-03Dongxu Zhang 14-11-03 - 版本历史2026-04-04T01:02:18Z本wiki的该页面的版本历史MediaWiki 1.23.3http://www.cslt.org/mediawiki/index.php?title=Dongxu_Zhang_14-11-03&diff=12238&oldid=prevZhangdx：以“=== Accomplished this week === * Create 100k,200k,150576 vocabulary. And use 150576 to build baiduhi, baiduzhidao language model(still running, preprocess). * Use 1...”为内容创建页面2014-11-02T16:52:38Z<p>以“=== Accomplished this week === * Create 100k,200k,150576 vocabulary. And use 150576 to build baiduhi, baiduzhidao language model(still running, preprocess). * Use 1...”为内容创建页面</p>
<p><b>新页面</b></p><div>=== Accomplished this week ===<br />
* Create 100k,200k,150576 vocabulary. And use 150576 to build baiduhi, baiduzhidao language model(still running, preprocess). <br />
* Use 166k vocabulary to train lm on baiduhi, baiduzhidao seperately,(still running ,pruning)<br />
* Extract sentences which contains English and numbers from weibo corpus.<br />
* Running BPTT using rwthlm. Still not normal. High ppl, low wer. But it seems that using rwthlm itself, lstm is indeed better than standard bptt.<br />
* Found a tool called Shenlan which can parse Sogou cell vocabulary. Using its code with a crawler, we can update our vocabulary with new words.<br />
<br />
=== Planned for next week ===<br />
* Working on building lm and comparing vocabulary.<br />
* Working on rwthlm.</div>Zhangdx