cslt Wiki - 用户贡献 [zh-cn]

Schedule

2016-12-29T08:38:01Z

Xiaopl：/* Daily Report */

=NLP Schedule=

==Members==

===Current Members===

* Yang Feng (冯洋)
* Jiyuan Zhang （张记袁）
* Aodong Li (李傲冬)
* Andi Zhang (张安迪)
* Shiyue Zhang (张诗悦)
* Li Gu (古丽)
* Peilun Xiao (肖培伦)

===Former Members===
* '''Chao Xing (邢超)''' : FreeNeb
* '''Rong Liu (刘荣)''' : 优酷
* '''Xiaoxi Wang (王晓曦)''' : 图灵机器人
* '''Xi Ma (马习)''' : 清华大学研究生
* '''Tianyi Luo (骆天一)''' ： phd candidate in University of California Santa Cruz
* '''Qixin Wang (王琪鑫)''' : MA candidate in University of California
* '''DongXu Zhang (张东旭)''': --
* '''Yiqiao Pan (潘一桥)''' ： MA candidate in University of Sydney
* '''Shiyao Li （李诗瑶）''' : BUPT
* '''Aiting Liu (刘艾婷)''' : BUPT

==Work Progress==
===Daily Report===

{|class="wikitable"
! Date !! Person !! start!! leave !! hours ||status
|-
| rowspan="3"|2016/12/1
|Andy Zhang|| 9:30||18:30 ||8 ||
*read source code
*thought about ways to store encoder output
|-
|Shiyue Zhang || 9:10 || 19:00|| 8+ ||
* draw tsne pictures
|-
|Guli ||9:10 ||9:50 ||12+ ||
*prepare data and run code
*prepare for Thesis Report
|-
| rowspan="4"|2016/12/2
|Andy Zhang|| 9:30|| 18:30|| 8||
*finish the code to output encoder output but have not tested yet
*prepared a small data set for testing
|-
|Shiyue Zhang || || || ||
|-
|Guli ||9:05 ||18:05 ||8 ||
*read code and check data
*think about how to improve bleu score
|-
|Peilun Xiao ||10:00||12:30|| 2+||
*learn basic things of work
|-
| rowspan="4"|2016/12/5
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*group meeting
*prepare the same data set as in Theano for Tensorflow
|-
|Shiyue Zhang || 9:30 || 19:00 || 8+||
* discuss with teachers about the tsne pictures
* group meeting
|-
|Guli ||9:00 ||22:35 ||13+ ||
*install moses
*weekly report
|-
|Peilun Xiao ||9:30||18:30 ||8||
*learn how to use weka
|-
| rowspan="4"|2016/12/6
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*run fr-en (single encoder)
*prepare paraphrase data set, enumerate them, excluding 呀啊哈, etc.
|-
|Shiyue Zhang || || || ||
|-
|Guli ||9:05 ||22;30 ||12+ ||
*run moses
*write Thesis Report
|-
|Peilun Xiao ||9:40||18:30|| 8||
*read a paper
*use weka
|-
| rowspan="4"|2016/12/7
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*prepare paraphrase data set, enumerate them, excluding 呀啊哈, etc.
*met with some problems, used too much memory, had to restrict enumerate nums to 15000
|-
|Shiyue Zhang || 9:30 || 19:00 || 8+||
* change mem to 28-dim states
* retry previous experiments
|-
|Guli ||9:15||22;00||12+ ||
*run moses
*write Thesis Report
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/8
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*finished preparing the data set
*start working on bidirectional model
|-
|Shiyue Zhang || 9:30 || 19:00 || 8+||
* try more experiments, but all are not good, always converge to baseline
* draw the tsne picture of test data
* discuss with Teacher Wang
|-
|Guli ||9:15||21;15||12 ||
*run moses
*write Thesis Report
|-
|Peilun Xiao ||9:30||17:30|| 7||
*learn GibbsLda++
|-
| rowspan="4"|2016/12/9
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*finished coding, added masks for encoder inputs
*had a some breakthrough with Jiyuan's help, but still meet nan problem
|-
|Shiyue Zhang ||9:30 || 19:00 || 8+||
* return to 384-dim mem, which has 0.07 improvement than baseline
* replace cos with a one-layer neural network, which is also slightly better than baseline
* discuss with teachers, and find the problem of scale
|-
|Guli ||9:15||21;30||12 +||
*prepared Thesis Report
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/12
|Andy Zhang|| || || ||
|-
|Shiyue Zhang || || || ||
|-
|Guli ||10:00||19;00|| 9||
*read paper to solve oov
|-
|Peilun Xiao ||9:30||19:00||8+||
*use lda to generate document vector
|-
| rowspan="4"|2016/12/13
|Andy Zhang|| 9:30 || 18:30 || 8 ||
*tried to modify the wrong softmax
|-
|Shiyue Zhang || 9:30 || 19:00 || 8+ ||
* change mem scale to (0, -10000.0...)
* try previous experiments
|-
|Guli ||09:30||21;00||11+||
*read papers
|-
|Peilun Xiao ||9:50 ||19:00 || 8 ||
*use lda to generate document vector
|-
| rowspan="4"|2016/12/14
|Andy Zhang|| 9:30 || 18:30 || 8 ||
*tried to modify the wrong softmax
*decided to abandon it for now
|-
|Shiyue Zhang || || || ||
|-
|Guli ||09:20||20;30||11+||
*read papers
*writing a survey
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/15
|Andy Zhang|| 9:30 || 18:30 || 8 ||
*tried to add bleu scoring into the code, but met with out of memory problem
|-
|Shiyue Zhang || 9:30 || 19:00|| 8+||
* changed scale didn't lead to better results
* try 1-dim gate, but converge to baseline
|-
|Guli ||09:20||20;30||11+||
*read papers
*writing a survey
|-
|Peilun Xiao ||13:30||19:00||5+||
*use lda to generate document vector
|-
| rowspan="4"|2016/12/16
|Andy Zhang|| 9:20 || 18:20 || 8 ||
*finished adding bleu scoring into the code
|-
|Shiyue Zhang || 14:00 || 19:00|| 5||
* try to only train gate
* try model similar to attention
|-
|Guli ||09:30||20;30||11||
*Check the data, modify the error
*writing a survey
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/19
|Andy Zhang|| 9:30 || 18:30 || 8 ||
*group meeting
*made some revises on bleu scoring
|-
|Shiyue Zhang || 9:00 || 19:00|| 9||
* review last week work
* write the report and talk with teachers
* decide what to do next and meeting
* try to train gate with true action info
|-
|Guli ||9：15||20：00||10+||
*weekly meeting
*conduct comparative test
|-
|Peilun Xiao ||9：30 ||19：00 || 8+ ||
*weekly meeting
*code on tf-idf
|-
| rowspan="4"|2016/12/20
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*dealt with some bugs on bidirectional model
*coding on getting encoder outputs
|-
|Shiyue Zhang || 9:30 ||19:00|| 8+||
* try to train gate with true actions, which gets the results better than no true action, but still not very good.
* try to change cos to inner product, which gets better performance than cos.
|-
|Guli ||9：00||21：50||12+||
*voice tagging
*write survey
|-
|Peilun Xiao ||9:50||18:30 ||8 ||
*debug the code
*prepare a small test set
|-
| rowspan="4"|2016/12/21
|Andy Zhang||9:20 || 18:30 || 8+ ||
*finishing testing on getting encoder outputs
*coded to output corresponding source and target sentences, but have not tested yet
|-
|Shiyue Zhang || || || ||

|-
|Guli ||9：10||21：10 ||12 ||
*voice tagging
*write survey
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/22
|Andy Zhang||9:20 || 18:30 || 8+ ||
*decided to make some revises on bleu scoring part

|-
|Shiyue Zhang || 9:30 || 19:00|| 8+||
* try to change the scales of one-hot vec, and find >=-5000 is good
|-
|Guli ||9：20 ||21:10 ||11+ ||
*voice tagging
*write survey
|-
|Peilun Xiao ||9:20 || 19:00|| 9 ||
*read paper
*try to solve the bug
|-
| rowspan="4"|2016/12/23
|Andy Zhang||9:30 || 18:10 || 7+ ||
*finished bleu scoring part
*made it process by batches & testing several checkpoints and save the best one
|-
|Shiyue Zhang || 14:30 || 19:00|| 5.5 ||
* review the work of the whole week and discuss with teachers
* try joint training
|-
|Guli ||9：20|| 21:30 ||12+ ||
*voice tagging
*write survey
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/26
|Andy Zhang|| || || ||

|-
|Shiyue Zhang || 14:30 || 19:00|| 5.5 ||
*
|-
|Guli ||9:10 || 21:30 ||12+ ||
* weekly report
* read pepar
|-
|Peilun Xiao || 9:20 ||19:00 ||8+ ||
* debug code
* read sklearn source code
|-
| rowspan="4"|2016/12/27
|Andy Zhang||9:30 || 18:30 || 8 ||
*modified the BLEU script to compare translation result with original sentences
|-
|Shiyue Zhang || 14:30 || 19:00|| 5.5 ||
*
|-
|Guli ||9：05||18:40 ||7+ ||
* read paper
* prepare data
|-
|Peilun Xiao ||9:20||19:00 ||9 ||
* debug code
* write a code about elm
|-
| rowspan="4"|2016/12/28
|Andy Zhang||9:30 || 18:30 || 8 ||
*modified BLEU script, now it is auto called while training
|-
|Shiyue Zhang || || || ||
|-
|Guli |||| || ||

|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/29
|Andy Zhang||9:30 || 18:30 || 8 ||

|-
|Shiyue Zhang || || || ||

|-
|Guli |||| || ||

|-
|Peilun Xiao ||9:30 ||18:00 ||7+||
* prepare data
* run data
|-
|}

===Time Off Table===

{| class="wikitable"
! Date !! Yang Feng !! Jiyuan Zhang
|-
|}

==Past progress==

[[nlp-progress 2016/11]]

[[nlp-progress 2016/10]]

[[nlp-progress 2016/09]]

[[nlp-progress 2016/08]]

[[nlp-progress 2016/05/01 -- 08/16 | nlp-progress 2016/05-07]]

[[nlp-progress 2016/04]]

Schedule

2016-12-29T08:33:15Z

Xiaopl：/* Daily Report */

=NLP Schedule=

==Members==

===Current Members===

* Yang Feng (冯洋)
* Jiyuan Zhang （张记袁）
* Aodong Li (李傲冬)
* Andi Zhang (张安迪)
* Shiyue Zhang (张诗悦)
* Li Gu (古丽)
* Peilun Xiao (肖培伦)

===Former Members===
* '''Chao Xing (邢超)''' : FreeNeb
* '''Rong Liu (刘荣)''' : 优酷
* '''Xiaoxi Wang (王晓曦)''' : 图灵机器人
* '''Xi Ma (马习)''' : 清华大学研究生
* '''Tianyi Luo (骆天一)''' ： phd candidate in University of California Santa Cruz
* '''Qixin Wang (王琪鑫)''' : MA candidate in University of California
* '''DongXu Zhang (张东旭)''': --
* '''Yiqiao Pan (潘一桥)''' ： MA candidate in University of Sydney
* '''Shiyao Li （李诗瑶）''' : BUPT
* '''Aiting Liu (刘艾婷)''' : BUPT

==Work Progress==
===Daily Report===

{|class="wikitable"
! Date !! Person !! start!! leave !! hours ||status
|-
| rowspan="3"|2016/12/1
|Andy Zhang|| 9:30||18:30 ||8 ||
*read source code
*thought about ways to store encoder output
|-
|Shiyue Zhang || 9:10 || 19:00|| 8+ ||
* draw tsne pictures
|-
|Guli ||9:10 ||9:50 ||12+ ||
*prepare data and run code
*prepare for Thesis Report
|-
| rowspan="4"|2016/12/2
|Andy Zhang|| 9:30|| 18:30|| 8||
*finish the code to output encoder output but have not tested yet
*prepared a small data set for testing
|-
|Shiyue Zhang || || || ||
|-
|Guli ||9:05 ||18:05 ||8 ||
*read code and check data
*think about how to improve bleu score
|-
|Peilun Xiao ||10:00||12:30|| 2+||
*learn basic things of work
|-
| rowspan="4"|2016/12/5
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*group meeting
*prepare the same data set as in Theano for Tensorflow
|-
|Shiyue Zhang || 9:30 || 19:00 || 8+||
* discuss with teachers about the tsne pictures
* group meeting
|-
|Guli ||9:00 ||22:35 ||13+ ||
*install moses
*weekly report
|-
|Peilun Xiao ||9:30||18:30 ||8||
*learn how to use weka
|-
| rowspan="4"|2016/12/6
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*run fr-en (single encoder)
*prepare paraphrase data set, enumerate them, excluding 呀啊哈, etc.
|-
|Shiyue Zhang || || || ||
|-
|Guli ||9:05 ||22;30 ||12+ ||
*run moses
*write Thesis Report
|-
|Peilun Xiao ||9:40||18:30|| 8||
*read a paper
*use weka
|-
| rowspan="4"|2016/12/7
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*prepare paraphrase data set, enumerate them, excluding 呀啊哈, etc.
*met with some problems, used too much memory, had to restrict enumerate nums to 15000
|-
|Shiyue Zhang || 9:30 || 19:00 || 8+||
* change mem to 28-dim states
* retry previous experiments
|-
|Guli ||9:15||22;00||12+ ||
*run moses
*write Thesis Report
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/8
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*finished preparing the data set
*start working on bidirectional model
|-
|Shiyue Zhang || 9:30 || 19:00 || 8+||
* try more experiments, but all are not good, always converge to baseline
* draw the tsne picture of test data
* discuss with Teacher Wang
|-
|Guli ||9:15||21;15||12 ||
*run moses
*write Thesis Report
|-
|Peilun Xiao ||9:30||17:30|| 7||
*learn GibbsLda++
|-
| rowspan="4"|2016/12/9
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*finished coding, added masks for encoder inputs
*had a some breakthrough with Jiyuan's help, but still meet nan problem
|-
|Shiyue Zhang ||9:30 || 19:00 || 8+||
* return to 384-dim mem, which has 0.07 improvement than baseline
* replace cos with a one-layer neural network, which is also slightly better than baseline
* discuss with teachers, and find the problem of scale
|-
|Guli ||9:15||21;30||12 +||
*prepared Thesis Report
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/12
|Andy Zhang|| || || ||
|-
|Shiyue Zhang || || || ||
|-
|Guli ||10:00||19;00|| 9||
*read paper to solve oov
|-
|Peilun Xiao ||9:30||19:00||8+||
*use lda to generate document vector
|-
| rowspan="4"|2016/12/13
|Andy Zhang|| 9:30 || 18:30 || 8 ||
*tried to modify the wrong softmax
|-
|Shiyue Zhang || 9:30 || 19:00 || 8+ ||
* change mem scale to (0, -10000.0...)
* try previous experiments
|-
|Guli ||09:30||21;00||11+||
*read papers
|-
|Peilun Xiao ||9:50 ||19:00 || 8 ||
*use lda to generate document vector
|-
| rowspan="4"|2016/12/14
|Andy Zhang|| 9:30 || 18:30 || 8 ||
*tried to modify the wrong softmax
*decided to abandon it for now
|-
|Shiyue Zhang || || || ||
|-
|Guli ||09:20||20;30||11+||
*read papers
*writing a survey
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/15
|Andy Zhang|| 9:30 || 18:30 || 8 ||
*tried to add bleu scoring into the code, but met with out of memory problem
|-
|Shiyue Zhang || 9:30 || 19:00|| 8+||
* changed scale didn't lead to better results
* try 1-dim gate, but converge to baseline
|-
|Guli ||09:20||20;30||11+||
*read papers
*writing a survey
|-
|Peilun Xiao ||13:30||19:00||5+||
*use lda to generate document vector
|-
| rowspan="4"|2016/12/16
|Andy Zhang|| 9:20 || 18:20 || 8 ||
*finished adding bleu scoring into the code
|-
|Shiyue Zhang || 14:00 || 19:00|| 5||
* try to only train gate
* try model similar to attention
|-
|Guli ||09:30||20;30||11||
*Check the data, modify the error
*writing a survey
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/19
|Andy Zhang|| 9:30 || 18:30 || 8 ||
*group meeting
*made some revises on bleu scoring
|-
|Shiyue Zhang || 9:00 || 19:00|| 9||
* review last week work
* write the report and talk with teachers
* decide what to do next and meeting
* try to train gate with true action info
|-
|Guli ||9：15||20：00||10+||
*weekly meeting
*conduct comparative test
|-
|Peilun Xiao ||9：30 ||19：00 || 9+ ||
*weekly meeting
*code on tf-idf
|-
| rowspan="4"|2016/12/20
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*dealt with some bugs on bidirectional model
*coding on getting encoder outputs
|-
|Shiyue Zhang || 9:30 ||19:00|| 8+||
* try to train gate with true actions, which gets the results better than no true action, but still not very good.
* try to change cos to inner product, which gets better performance than cos.
|-
|Guli ||9：00||21：50||12+||
*voice tagging
*write survey
|-
|Peilun Xiao ||9:50||18:30 ||8 ||
*debug the code
*prepare a small test set
|-
| rowspan="4"|2016/12/21
|Andy Zhang||9:20 || 18:30 || 8+ ||
*finishing testing on getting encoder outputs
*coded to output corresponding source and target sentences, but have not tested yet
|-
|Shiyue Zhang || || || ||

|-
|Guli ||9：10||21：10 ||12 ||
*voice tagging
*write survey
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/22
|Andy Zhang||9:20 || 18:30 || 8+ ||
*decided to make some revises on bleu scoring part

|-
|Shiyue Zhang || 9:30 || 19:00|| 8+||
* try to change the scales of one-hot vec, and find >=-5000 is good
|-
|Guli ||9：20 ||21:10 ||11+ ||
*voice tagging
*write survey
|-
|Peilun Xiao ||9:20 || 19:00|| 9 ||
*read paper
*try to solve the bug
|-
| rowspan="4"|2016/12/23
|Andy Zhang||9:30 || 18:10 || 7+ ||
*finished bleu scoring part
*made it process by batches & testing several checkpoints and save the best one
|-
|Shiyue Zhang || 14:30 || 19:00|| 5.5 ||
* review the work of the whole week and discuss with teachers
* try joint training
|-
|Guli ||9：20|| 21:30 ||12+ ||
*voice tagging
*write survey
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/26
|Andy Zhang|| || || ||

|-
|Shiyue Zhang || 14:30 || 19:00|| 5.5 ||
*
|-
|Guli ||9:10 || 21:30 ||12+ ||
* weekly report
* read pepar
|-
|Peilun Xiao || 9:20 ||19:00 ||9 ||
* debug code
* read sklearn source code
|-
| rowspan="4"|2016/12/27
|Andy Zhang||9:30 || 18:30 || 8 ||
*modified the BLEU script to compare translation result with original sentences
|-
|Shiyue Zhang || 14:30 || 19:00|| 5.5 ||
*
|-
|Guli ||9：05||18:40 ||7+ ||
* read paper
* prepare data
|-
|Peilun Xiao ||9:20||19:00 ||9 ||
* debug code
* write a code about elm
|-
| rowspan="4"|2016/12/28
|Andy Zhang||9:30 || 18:30 || 8 ||
*modified BLEU script, now it is auto called while training
|-
|Shiyue Zhang || || || ||
|-
|Guli |||| || ||

|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/29
|Andy Zhang||9:30 || 18:30 || 8 ||

|-
|Shiyue Zhang || || || ||

|-
|Guli |||| || ||

|-
|Peilun Xiao ||9:30 ||18:00 ||7+||
* prepare data
* run data
|-
|}

===Time Off Table===

{| class="wikitable"
! Date !! Yang Feng !! Jiyuan Zhang
|-
|}

==Past progress==

[[nlp-progress 2016/11]]

[[nlp-progress 2016/10]]

[[nlp-progress 2016/09]]

[[nlp-progress 2016/08]]

[[nlp-progress 2016/05/01 -- 08/16 | nlp-progress 2016/05-07]]

[[nlp-progress 2016/04]]

Schedule

2016-12-29T08:29:34Z

Xiaopl：/* Work Progress */

=NLP Schedule=

==Members==

===Current Members===

* Yang Feng (冯洋)
* Jiyuan Zhang （张记袁）
* Aodong Li (李傲冬)
* Andi Zhang (张安迪)
* Shiyue Zhang (张诗悦)
* Li Gu (古丽)
* Peilun Xiao (肖培伦)

===Former Members===
* '''Chao Xing (邢超)''' : FreeNeb
* '''Rong Liu (刘荣)''' : 优酷
* '''Xiaoxi Wang (王晓曦)''' : 图灵机器人
* '''Xi Ma (马习)''' : 清华大学研究生
* '''Tianyi Luo (骆天一)''' ： phd candidate in University of California Santa Cruz
* '''Qixin Wang (王琪鑫)''' : MA candidate in University of California
* '''DongXu Zhang (张东旭)''': --
* '''Yiqiao Pan (潘一桥)''' ： MA candidate in University of Sydney
* '''Shiyao Li （李诗瑶）''' : BUPT
* '''Aiting Liu (刘艾婷)''' : BUPT

==Work Progress==
===Daily Report===

{|class="wikitable"
! Date !! Person !! start!! leave !! hours ||status
|-
| rowspan="3"|2016/12/1
|Andy Zhang|| 9:30||18:30 ||8 ||
*read source code
*thought about ways to store encoder output
|-
|Shiyue Zhang || 9:10 || 19:00|| 8+ ||
* draw tsne pictures
|-
|Guli ||9:10 ||9:50 ||12+ ||
*prepare data and run code
*prepare for Thesis Report
|-
| rowspan="4"|2016/12/2
|Andy Zhang|| 9:30|| 18:30|| 8||
*finish the code to output encoder output but have not tested yet
*prepared a small data set for testing
|-
|Shiyue Zhang || || || ||
|-
|Guli ||9:05 ||18:05 ||8 ||
*read code and check data
*think about how to improve bleu score
|-
|Peilun Xiao ||10:00||12:30|| 2+||
*learn basic things of work
|-
| rowspan="4"|2016/12/5
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*group meeting
*prepare the same data set as in Theano for Tensorflow
|-
|Shiyue Zhang || 9:30 || 19:00 || 8+||
* discuss with teachers about the tsne pictures
* group meeting
|-
|Guli ||9:00 ||22:35 ||13+ ||
*install moses
*weekly report
|-
|Peilun Xiao ||9:30||18:30 ||8||
*learn how to use weka
|-
| rowspan="4"|2016/12/6
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*run fr-en (single encoder)
*prepare paraphrase data set, enumerate them, excluding 呀啊哈, etc.
|-
|Shiyue Zhang || || || ||
|-
|Guli ||9:05 ||22;30 ||12+ ||
*run moses
*write Thesis Report
|-
|Peilun Xiao ||9:40||18:30|| 8||
*read a paper
*use weka
|-
| rowspan="4"|2016/12/7
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*prepare paraphrase data set, enumerate them, excluding 呀啊哈, etc.
*met with some problems, used too much memory, had to restrict enumerate nums to 15000
|-
|Shiyue Zhang || 9:30 || 19:00 || 8+||
* change mem to 28-dim states
* retry previous experiments
|-
|Guli ||9:15||22;00||12+ ||
*run moses
*write Thesis Report
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/8
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*finished preparing the data set
*start working on bidirectional model
|-
|Shiyue Zhang || 9:30 || 19:00 || 8+||
* try more experiments, but all are not good, always converge to baseline
* draw the tsne picture of test data
* discuss with Teacher Wang
|-
|Guli ||9:15||21;15||12 ||
*run moses
*write Thesis Report
|-
|Peilun Xiao ||9:30||17:30|| 7||
*learn GibbsLda++
|-
| rowspan="4"|2016/12/9
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*finished coding, added masks for encoder inputs
*had a some breakthrough with Jiyuan's help, but still meet nan problem
|-
|Shiyue Zhang ||9:30 || 19:00 || 8+||
* return to 384-dim mem, which has 0.07 improvement than baseline
* replace cos with a one-layer neural network, which is also slightly better than baseline
* discuss with teachers, and find the problem of scale
|-
|Guli ||9:15||21;30||12 +||
*prepared Thesis Report
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/12
|Andy Zhang|| || || ||
|-
|Shiyue Zhang || || || ||
|-
|Guli ||10:00||19;00|| 9||
*read paper to solve oov
|-
|Peilun Xiao ||9:30||19:00||8+||
*use lda to generate document vector
|-
| rowspan="4"|2016/12/13
|Andy Zhang|| 9:30 || 18:30 || 8 ||
*tried to modify the wrong softmax
|-
|Shiyue Zhang || 9:30 || 19:00 || 8+ ||
* change mem scale to (0, -10000.0...)
* try previous experiments
|-
|Guli ||09:30||21;00||11+||
*read papers
|-
|Peilun Xiao ||9:50 ||19:00 || 9 ||
*use lda to generate document vector
|-
| rowspan="4"|2016/12/14
|Andy Zhang|| 9:30 || 18:30 || 8 ||
*tried to modify the wrong softmax
*decided to abandon it for now
|-
|Shiyue Zhang || || || ||
|-
|Guli ||09:20||20;30||11+||
*read papers
*writing a survey
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/15
|Andy Zhang|| 9:30 || 18:30 || 8 ||
*tried to add bleu scoring into the code, but met with out of memory problem
|-
|Shiyue Zhang || 9:30 || 19:00|| 8+||
* changed scale didn't lead to better results
* try 1-dim gate, but converge to baseline
|-
|Guli ||09:20||20;30||11+||
*read papers
*writing a survey
|-
|Peilun Xiao ||13:30||19:00||5+||
*use lda to generate document vector
|-
| rowspan="4"|2016/12/16
|Andy Zhang|| 9:20 || 18:20 || 8 ||
*finished adding bleu scoring into the code
|-
|Shiyue Zhang || 14:00 || 19:00|| 5||
* try to only train gate
* try model similar to attention
|-
|Guli ||09:30||20;30||11||
*Check the data, modify the error
*writing a survey
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/19
|Andy Zhang|| 9:30 || 18:30 || 8 ||
*group meeting
*made some revises on bleu scoring
|-
|Shiyue Zhang || 9:00 || 19:00|| 9||
* review last week work
* write the report and talk with teachers
* decide what to do next and meeting
* try to train gate with true action info
|-
|Guli ||9：15||20：00||10+||
*weekly meeting
*conduct comparative test
|-
|Peilun Xiao ||9：30 ||19：00 || 9+ ||
*weekly meeting
*code on tf-idf
|-
| rowspan="4"|2016/12/20
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*dealt with some bugs on bidirectional model
*coding on getting encoder outputs
|-
|Shiyue Zhang || 9:30 ||19:00|| 8+||
* try to train gate with true actions, which gets the results better than no true action, but still not very good.
* try to change cos to inner product, which gets better performance than cos.
|-
|Guli ||9：00||21：50||12+||
*voice tagging
*write survey
|-
|Peilun Xiao ||9:50||18:30 ||8 ||
*debug the code
*prepare a small test set
|-
| rowspan="4"|2016/12/21
|Andy Zhang||9:20 || 18:30 || 8+ ||
*finishing testing on getting encoder outputs
*coded to output corresponding source and target sentences, but have not tested yet
|-
|Shiyue Zhang || || || ||

|-
|Guli ||9：10||21：10 ||12 ||
*voice tagging
*write survey
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/22
|Andy Zhang||9:20 || 18:30 || 8+ ||
*decided to make some revises on bleu scoring part

|-
|Shiyue Zhang || 9:30 || 19:00|| 8+||
* try to change the scales of one-hot vec, and find >=-5000 is good
|-
|Guli ||9：20 ||21:10 ||11+ ||
*voice tagging
*write survey
|-
|Peilun Xiao ||9:20 || 19:00|| 9 ||
*read paper
*try to solve the bug
|-
| rowspan="4"|2016/12/23
|Andy Zhang||9:30 || 18:10 || 7+ ||
*finished bleu scoring part
*made it process by batches & testing several checkpoints and save the best one
|-
|Shiyue Zhang || 14:30 || 19:00|| 5.5 ||
* review the work of the whole week and discuss with teachers
* try joint training
|-
|Guli ||9：20|| 21:30 ||12+ ||
*voice tagging
*write survey
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/26
|Andy Zhang|| || || ||

|-
|Shiyue Zhang || 14:30 || 19:00|| 5.5 ||
*
|-
|Guli ||9:10 || 21:30 ||12+ ||
* weekly report
* read pepar
|-
|Peilun Xiao || 9:20 ||19:00 ||9 ||
* debug code
* read sklearn source code
|-
| rowspan="4"|2016/12/27
|Andy Zhang||9:30 || 18:30 || 8 ||
*modified the BLEU script to compare translation result with original sentences
|-
|Shiyue Zhang || 14:30 || 19:00|| 5.5 ||
*
|-
|Guli ||9：05||18:40 ||7+ ||
* read paper
* prepare data
|-
|Peilun Xiao ||9:20||19:00 ||9 ||
* debug code
* write a code about elm
|-
| rowspan="4"|2016/12/28
|Andy Zhang||9:30 || 18:30 || 8 ||
*modified BLEU script, now it is auto called while training
|-
|Shiyue Zhang || || || ||
|-
|Guli |||| || ||

|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/29
|Andy Zhang||9:30 || 18:30 || 8 ||

|-
|Shiyue Zhang || || || ||

|-
|Guli |||| || ||

|-
|Peilun Xiao ||9:30 ||18:00 ||7+||
* prepare data
* run data
|-
|}

===Time Off Table===

{| class="wikitable"
! Date !! Yang Feng !! Jiyuan Zhang
|-
|}

==Past progress==

[[nlp-progress 2016/11]]

[[nlp-progress 2016/10]]

[[nlp-progress 2016/09]]

[[nlp-progress 2016/08]]

[[nlp-progress 2016/05/01 -- 08/16 | nlp-progress 2016/05-07]]

[[nlp-progress 2016/04]]

Schedule

2016-12-29T08:27:43Z

Xiaopl：/* Daily Report */

=NLP Schedule=

==Members==

===Current Members===

* Yang Feng (冯洋)
* Jiyuan Zhang （张记袁）
* Aodong Li (李傲冬)
* Andi Zhang (张安迪)
* Shiyue Zhang (张诗悦)
* Li Gu (古丽)
* Peilun Xiao (肖培伦)

===Former Members===
* '''Chao Xing (邢超)''' : FreeNeb
* '''Rong Liu (刘荣)''' : 优酷
* '''Xiaoxi Wang (王晓曦)''' : 图灵机器人
* '''Xi Ma (马习)''' : 清华大学研究生
* '''Tianyi Luo (骆天一)''' ： phd candidate in University of California Santa Cruz
* '''Qixin Wang (王琪鑫)''' : MA candidate in University of California
* '''DongXu Zhang (张东旭)''': --
* '''Yiqiao Pan (潘一桥)''' ： MA candidate in University of Sydney
* '''Shiyao Li （李诗瑶）''' : BUPT
* '''Aiting Liu (刘艾婷)''' : BUPT

==Work Progress==
===Daily Report===

{|class="wikitable"
! Date !! Person !! start!! leave !! hours ||status
|-
| rowspan="3"|2016/12/1
|Andy Zhang|| 9:30||18:30 ||8 ||
*read source code
*thought about ways to store encoder output
|-
|Shiyue Zhang || 9:10 || 19:00|| 8+ ||
* draw tsne pictures
|-
|Guli ||9:10 ||9:50 ||12+ ||
*prepare data and run code
*prepare for Thesis Report
|-
| rowspan="4"|2016/12/2
|Andy Zhang|| 9:30|| 18:30|| 8||
*finish the code to output encoder output but have not tested yet
*prepared a small data set for testing
|-
|Shiyue Zhang || || || ||
|-
|Guli ||9:05 ||18:05 ||8 ||
*read code and check data
*think about how to improve bleu score
|-
|Peilun Xiao ||10:00||12:30|| 2+||
*learn basic things of work
|-
| rowspan="4"|2016/12/5
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*group meeting
*prepare the same data set as in Theano for Tensorflow
|-
|Shiyue Zhang || 9:30 || 19:00 || 8+||
* discuss with teachers about the tsne pictures
* group meeting
|-
|Guli ||9:00 ||22:35 ||13+ ||
*install moses
*weekly report
|-
|Peilun Xiao ||9:30||18:30 ||8||
*learn how to use weka
|-
| rowspan="4"|2016/12/6
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*run fr-en (single encoder)
*prepare paraphrase data set, enumerate them, excluding 呀啊哈, etc.
|-
|Shiyue Zhang || || || ||
|-
|Guli ||9:05 ||22;30 ||12+ ||
*run moses
*write Thesis Report
|-
|Peilun Xiao ||9:40||18:30|| 8||
*read a paper
*use weka
|-
| rowspan="4"|2016/12/7
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*prepare paraphrase data set, enumerate them, excluding 呀啊哈, etc.
*met with some problems, used too much memory, had to restrict enumerate nums to 15000
|-
|Shiyue Zhang || 9:30 || 19:00 || 8+||
* change mem to 28-dim states
* retry previous experiments
|-
|Guli ||9:15||22;00||12+ ||
*run moses
*write Thesis Report
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/8
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*finished preparing the data set
*start working on bidirectional model
|-
|Shiyue Zhang || 9:30 || 19:00 || 8+||
* try more experiments, but all are not good, always converge to baseline
* draw the tsne picture of test data
* discuss with Teacher Wang
|-
|Guli ||9:15||21;15||12 ||
*run moses
*write Thesis Report
|-
|Peilun Xiao ||9:30||17:30|| 7||
*learn GibbsLda++
|-
| rowspan="4"|2016/12/9
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*finished coding, added masks for encoder inputs
*had a some breakthrough with Jiyuan's help, but still meet nan problem
|-
|Shiyue Zhang ||9:30 || 19:00 || 8+||
* return to 384-dim mem, which has 0.07 improvement than baseline
* replace cos with a one-layer neural network, which is also slightly better than baseline
* discuss with teachers, and find the problem of scale
|-
|Guli ||9:15||21;30||12 +||
*prepared Thesis Report
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/12
|Andy Zhang|| || || ||
|-
|Shiyue Zhang || || || ||
|-
|Guli ||10:00||19;00|| 9||
*read paper to solve oov
|-
|Peilun Xiao ||9:30||19:00||9+||
*use lda to generate document vector
|-
| rowspan="4"|2016/12/13
|Andy Zhang|| 9:30 || 18:30 || 8 ||
*tried to modify the wrong softmax
|-
|Shiyue Zhang || 9:30 || 19:00 || 8+ ||
* change mem scale to (0, -10000.0...)
* try previous experiments
|-
|Guli ||09:30||21;00||11+||
*read papers
|-
|Peilun Xiao ||9:50 ||19:00 || 9 ||
*use lda to generate document vector
|-
| rowspan="4"|2016/12/14
|Andy Zhang|| 9:30 || 18:30 || 8 ||
*tried to modify the wrong softmax
*decided to abandon it for now
|-
|Shiyue Zhang || || || ||
|-
|Guli ||09:20||20;30||11+||
*read papers
*writing a survey
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/15
|Andy Zhang|| 9:30 || 18:30 || 8 ||
*tried to add bleu scoring into the code, but met with out of memory problem
|-
|Shiyue Zhang || 9:30 || 19:00|| 8+||
* changed scale didn't lead to better results
* try 1-dim gate, but converge to baseline
|-
|Guli ||09:20||20;30||11+||
*read papers
*writing a survey
|-
|Peilun Xiao ||13:30||19:00||5+||
*use lda to generate document vector
|-
| rowspan="4"|2016/12/16
|Andy Zhang|| 9:20 || 18:20 || 8 ||
*finished adding bleu scoring into the code
|-
|Shiyue Zhang || 14:00 || 19:00|| 5||
* try to only train gate
* try model similar to attention
|-
|Guli ||09:30||20;30||11||
*Check the data, modify the error
*writing a survey
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/19
|Andy Zhang|| 9:30 || 18:30 || 8 ||
*group meeting
*made some revises on bleu scoring
|-
|Shiyue Zhang || 9:00 || 19:00|| 9||
* review last week work
* write the report and talk with teachers
* decide what to do next and meeting
* try to train gate with true action info
|-
|Guli ||9：15||20：00||10+||
*weekly meeting
*conduct comparative test
|-
|Peilun Xiao ||9：30 ||19：00 || 9+ ||
*weekly meeting
*code on tf-idf
|-
| rowspan="4"|2016/12/20
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*dealt with some bugs on bidirectional model
*coding on getting encoder outputs
|-
|Shiyue Zhang || 9:30 ||19:00|| 8+||
* try to train gate with true actions, which gets the results better than no true action, but still not very good.
* try to change cos to inner product, which gets better performance than cos.
|-
|Guli ||9：00||21：50||12+||
*voice tagging
*write survey
|-
|Peilun Xiao ||9:50||18:30 ||8 ||
*debug the code
*prepare a small test set
|-
| rowspan="4"|2016/12/21
|Andy Zhang||9:20 || 18:30 || 8+ ||
*finishing testing on getting encoder outputs
*coded to output corresponding source and target sentences, but have not tested yet
|-
|Shiyue Zhang || || || ||

|-
|Guli ||9：10||21：10 ||12 ||
*voice tagging
*write survey
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/22
|Andy Zhang||9:20 || 18:30 || 8+ ||
*decided to make some revises on bleu scoring part

|-
|Shiyue Zhang || 9:30 || 19:00|| 8+||
* try to change the scales of one-hot vec, and find >=-5000 is good
|-
|Guli ||9：20 ||21:10 ||11+ ||
*voice tagging
*write survey
|-
|Peilun Xiao ||9:20 || 19:00|| 9 ||
*read paper
*try to solve the bug
|-
| rowspan="4"|2016/12/23
|Andy Zhang||9:30 || 18:10 || 7+ ||
*finished bleu scoring part
*made it process by batches & testing several checkpoints and save the best one
|-
|Shiyue Zhang || 14:30 || 19:00|| 5.5 ||
* review the work of the whole week and discuss with teachers
* try joint training
|-
|Guli ||9：20|| 21:30 ||12+ ||
*voice tagging
*write survey
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/26
|Andy Zhang|| || || ||

|-
|Shiyue Zhang || 14:30 || 19:00|| 5.5 ||
*
|-
|Guli ||9:10 || 21:30 ||12+ ||
* weekly report
* read pepar
|-
|Peilun Xiao || 9:20 ||19:00 ||9 ||
* debug code
* read sklearn source code
|-
| rowspan="4"|2016/12/27
|Andy Zhang||9:30 || 18:30 || 8 ||
*modified the BLEU script to compare translation result with original sentences
|-
|Shiyue Zhang || 14:30 || 19:00|| 5.5 ||
*
|-
|Guli ||9：05||18:40 ||7+ ||
* read paper
* prepare data
|-
|Peilun Xiao ||9:20||19:00 ||9 ||
* debug code
* write a code about elm
|-
| rowspan="4"|2016/12/28
|Andy Zhang||9:30 || 18:30 || 8 ||
*modified BLEU script, now it is auto called while training
|-
|Shiyue Zhang || || || ||
|-
|Guli |||| || ||

|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/29
|Andy Zhang||9:30 || 18:30 || 8 ||

|-
|Shiyue Zhang || || || ||

|-
|Guli |||| || ||

|-
|Peilun Xiao ||9:30 ||18:00 ||7+||
* prepare data
* run data
|-
|}

===Time Off Table===

{| class="wikitable"
! Date !! Yang Feng !! Jiyuan Zhang
|-
|}

==Past progress==

[[nlp-progress 2016/11]]

[[nlp-progress 2016/10]]

[[nlp-progress 2016/09]]

[[nlp-progress 2016/08]]

[[nlp-progress 2016/05/01 -- 08/16 | nlp-progress 2016/05-07]]

[[nlp-progress 2016/04]]

NLP Status Report 2016-12-26

2016-12-26T02:21:56Z

Xiaopl：

{| class="wikitable"
!Date !! People !! Last Week !! This Week
|-
| rowspan="6"|2016/12/26
|Yang Feng ||
*[[s2smn:]] wrote the manual of s2s with tensorflow [[http://cslt.riit.tsinghua.edu.cn/mediawiki/images/5/51/Nmt-tensorflow-mannua-yfeng.pdf nmt-manual]]
*wrote part of the code of mn.
*wrote the manual of Moses [[http://cslt.riit.tsinghua.edu.cn/mediawiki/images/9/92/Moses%E6%93%8D%E4%BD%9C%E6%89%8B%E5%86%8C--%E5%86%AF%E6%B4%8B.pdf moses-manual]]
*[[Huilan:]] fixed the problem of syntax-based translation.
*sort out the system and corresponding documents.
||
*[[s2smn:]] finish the code of adding mn.
*[[Huilan:]] handover.
|-
|Jiyuan Zhang ||
*coded tone_model,but had some trouble
*run global_attention_model that decodes four sentences, [http://cslt.riit.tsinghua.edu.cn/mediawiki/images/d/d5/Four_local_atten.pdf four][http://cslt.riit.tsinghua.edu.cn/mediawiki/images/0/05/Five_local_attention.pdf five]generated by local_attention model
||
*improve poem model
|-
|Andi Zhang ||
*coded to output encoder outputs and correspoding source & target sentences(ids in dictionaries)
*coded a script for bleu scoring, which tests the five checkpoints auto created by training process and save the one with best performance
||
*extract encoder outputs
|-
|Shiyue Zhang ||
* tried to add true action info when training gate, which got better results than no true actions, but still not very good.
* tried different scale vectors, and found setting >=-5000 is good
* tried to change cos to only inner product, and inner product is better than cos.
* [[http://cslt.riit.tsinghua.edu.cn/mediawiki/images/9/9f/RNNG%2Bmm_experiment_report.pdf report]]
* read a paper [[http://cslt.riit.tsinghua.edu.cn/mediawiki/images/9/92/DEEP_BIAFFINE_ATTENTION_FOR_NEURAL_DEPENDENCY_PARSING.pdf]]
* trying the joint training, which got a problem of optimization.
||
* try the joint training
* read more papers [[http://cslt.riit.tsinghua.edu.cn/mediawiki/images/a/aa/Simple_and_Accurate_Dependency_Parsing_Using_Bidirectional_LSTM_Feature_Representations.pdf]] [[http://cslt.riit.tsinghua.edu.cn/mediawiki/images/f/fb/Bi-directional_Attention_with_Agreement_for_Dependency_Parsing.pdf]]
|-
|Guli ||
*read papers about Transfer learning and solving OOV
*conducted comparative test
*writing survey
||
* complete the first draft of the survey
|-
|Peilun Xiao ||
*learned tf-idf algorithm
*coded tf-idf alogrithm in python,but found it not worked well
*tried to use small dataset to test the program
||
*use sklearn tfidf to test the dataset
|}

Schedule

2016-12-26T01:03:39Z

Xiaopl：/* Daily Report */

=NLP Schedule=

==Members==

===Current Members===

* Yang Feng (冯洋)
* Jiyuan Zhang （张记袁）
* Aodong Li (李傲冬)
* Andi Zhang (张安迪)
* Shiyue Zhang (张诗悦)
* Li Gu (古丽)
* Peilun Xiao (肖培伦)

===Former Members===
* '''Chao Xing (邢超)''' : FreeNeb
* '''Rong Liu (刘荣)''' : 优酷
* '''Xiaoxi Wang (王晓曦)''' : 图灵机器人
* '''Xi Ma (马习)''' : 清华大学研究生
* '''Tianyi Luo (骆天一)''' ： phd candidate in University of California Santa Cruz
* '''Qixin Wang (王琪鑫)''' : MA candidate in University of California
* '''DongXu Zhang (张东旭)''': --
* '''Yiqiao Pan (潘一桥)''' ： MA candidate in University of Sydney
* '''Shiyao Li （李诗瑶）''' : BUPT
* '''Aiting Liu (刘艾婷)''' : BUPT

==Work Progress==
===Daily Report===

{|class="wikitable"
! Date !! Person !! start!! leave !! hours ||status
|-
| rowspan="3"|2016/12/1
|Andy Zhang|| 9:30||18:30 ||8 ||
*read source code
*thought about ways to store encoder output
|-
|Shiyue Zhang || 9:10 || 19:00|| 8+ ||
* draw tsne pictures
|-
|Guli ||9:10 ||9:50 ||12+ ||
*prepare data and run code
*prepare for Thesis Report
|-
| rowspan="4"|2016/12/2
|Andy Zhang|| 9:30|| 18:30|| 8||
*finish the code to output encoder output but have not tested yet
*prepared a small data set for testing
|-
|Shiyue Zhang || || || ||
|-
|Guli ||9:05 ||18:05 ||8 ||
*read code and check data
*think about how to improve bleu score
|-
|Peilun Xiao ||10:00||12:30|| 2+||
*learn basic things of work
|-
| rowspan="4"|2016/12/5
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*group meeting
*prepare the same data set as in Theano for Tensorflow
|-
|Shiyue Zhang || 9:30 || 19:00 || 8+||
* discuss with teachers about the tsne pictures
* group meeting
|-
|Guli ||9:00 ||22:35 ||13+ ||
*install moses
*weekly report
|-
|Peilun Xiao ||9:30||18:30 ||8||
*learn how to use weka
|-
| rowspan="4"|2016/12/6
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*run fr-en (single encoder)
*prepare paraphrase data set, enumerate them, excluding 呀啊哈, etc.
|-
|Shiyue Zhang || || || ||
|-
|Guli ||9:05 ||22;30 ||12+ ||
*run moses
*write Thesis Report
|-
|Peilun Xiao ||9:40||18:30|| 8||
*read a paper
*use weka
|-
| rowspan="4"|2016/12/7
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*prepare paraphrase data set, enumerate them, excluding 呀啊哈, etc.
*met with some problems, used too much memory, had to restrict enumerate nums to 15000
|-
|Shiyue Zhang || 9:30 || 19:00 || 8+||
* change mem to 28-dim states
* retry previous experiments
|-
|Guli ||9:15||22;00||12+ ||
*run moses
*write Thesis Report
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/8
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*finished preparing the data set
*start working on bidirectional model
|-
|Shiyue Zhang || 9:30 || 19:00 || 8+||
* try more experiments, but all are not good, always converge to baseline
* draw the tsne picture of test data
* discuss with Teacher Wang
|-
|Guli ||9:15||21;15||12 ||
*run moses
*write Thesis Report
|-
|Peilun Xiao ||9:30||17:30|| 7||
*learn GibbsLda++
|-
| rowspan="4"|2016/12/9
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*finished coding, added masks for encoder inputs
*had a some breakthrough with Jiyuan's help, but still meet nan problem
|-
|Shiyue Zhang ||9:30 || 19:00 || 8+||
* return to 384-dim mem, which has 0.07 improvement than baseline
* replace cos with a one-layer neural network, which is also slightly better than baseline
* discuss with teachers, and find the problem of scale
|-
|Guli ||9:15||21;30||12 +||
*prepared Thesis Report
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/12
|Andy Zhang|| || || ||
|-
|Shiyue Zhang || || || ||
|-
|Guli ||10:00||19;00|| 9||
*read paper to solve oov
|-
|Peilun Xiao ||9:30||19:00||9+||
*use lda to generate document vector
|-
| rowspan="4"|2016/12/13
|Andy Zhang|| 9:30 || 18:30 || 8 ||
*tried to modify the wrong softmax
|-
|Shiyue Zhang || 9:30 || 19:00 || 8+ ||
* change mem scale to (0, -10000.0...)
* try previous experiments
|-
|Guli ||09:30||21;00||11+||
*read papers
|-
|Peilun Xiao ||9:50 ||19:00 || 9 ||
*use lda to generate document vector
|-
| rowspan="4"|2016/12/14
|Andy Zhang|| 9:30 || 18:30 || 8 ||
*tried to modify the wrong softmax
*decided to abandon it for now
|-
|Shiyue Zhang || || || ||
|-
|Guli ||09:20||20;30||11+||
*read papers
*writing a survey
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/15
|Andy Zhang|| 9:30 || 18:30 || 8 ||
*tried to add bleu scoring into the code, but met with out of memory problem
|-
|Shiyue Zhang || 9:30 || 19:00|| 8+||
* changed scale didn't lead to better results
* try 1-dim gate, but converge to baseline
|-
|Guli ||09:20||20;30||11+||
*read papers
*writing a survey
|-
|Peilun Xiao ||13:30||19:00||5+||
*use lda to generate document vector
|-
| rowspan="4"|2016/12/16
|Andy Zhang|| 9:20 || 18:20 || 8 ||
*finished adding bleu scoring into the code
|-
|Shiyue Zhang || 14:00 || 19:00|| 5||
* try to only train gate
* try model similar to attention
|-
|Guli ||09:30||20;30||11||
*Check the data, modify the error
*writing a survey
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/19
|Andy Zhang|| 9:30 || 18:30 || 8 ||
*group meeting
*made some revises on bleu scoring
|-
|Shiyue Zhang || 9:00 || 19:00|| 9||
* review last week work
* write the report and talk with teachers
* decide what to do next and meeting
* try to train gate with true action info
|-
|Guli ||9：15||20：00||10+||
*weekly meeting
*conduct comparative test
|-
|Peilun Xiao ||9：30 ||19：00 || 9+ ||
*weekly meeting
*code on tf-idf
|-
| rowspan="4"|2016/12/20
|Andy Zhang|| 9:30 || 19:00 || 8+ ||
*dealt with some bugs on bidirectional model
*coding on getting encoder outputs
|-
|Shiyue Zhang || |||| ||

|-
|Guli ||9：00||21：50||12+||
*voice tagging
*write survey
|-
|Peilun Xiao ||9:50||18:30 ||8 ||
*debug the code
*prepare a small test set
|-
| rowspan="4"|2016/12/21
|Andy Zhang||9:20 || 18:30 || 8+ ||
*finishing testing on getting encoder outputs
*coded to output corresponding source and target sentences, but have not tested yet
|-
|Shiyue Zhang || || || ||
|-
|Guli ||9：10||21：10 ||12 ||
*voice tagging
*write survey
|-
|Peilun Xiao || || || ||
|-
| rowspan="4"|2016/12/22
|Andy Zhang||9:20 || 18:30 || 8+ ||
*decided to make some revises on bleu scoring part

|-
|Shiyue Zhang || || || ||
|-
|Guli ||9：20 ||21:10 ||11+ ||
*voice tagging
*write survey
|-
|Peilun Xiao ||9:20 || 19:00|| 9 ||
*read paper
*try to solve the bug
|-
| rowspan="4"|2016/12/23
|Andy Zhang||9:30 || 18:10 || 7+ ||
*finished bleu scoring part
*made it process by batches & testing several checkpoints and save the best one
|-
|Shiyue Zhang || || || ||
|-
|Guli ||9：20|| 21:30 ||12+ ||
*voice tagging
*write survey
|-
|Peilun Xiao || || || ||
|-
|}

===Time Off Table===

{| class="wikitable"
! Date !! Yang Feng !! Jiyuan Zhang
|-
|}

==Past progress==

[[nlp-progress 2016/11]]

[[nlp-progress 2016/10]]

[[nlp-progress 2016/09]]

[[nlp-progress 2016/08]]

[[nlp-progress 2016/05/01 -- 08/16 | nlp-progress 2016/05-07]]

[[nlp-progress 2016/04]]

NLP Status Report 2016-12-19

2016-12-20T05:21:11Z

Xiaopl：

{| class="wikitable"
!Date !! People !! Last Week !! This Week
|-
| rowspan="6"|2016/12/19
|Yang Feng ||
*[[s2smn:]] wrote the manual of s2s with tensorflow [[http://cslt.riit.tsinghua.edu.cn/mediawiki/images/5/51/Nmt-tensorflow-mannua-yfeng.pdf nmt-manual]]
*wrote part of the code of mn.
*wrote the manual of Moses [[http://cslt.riit.tsinghua.edu.cn/mediawiki/images/9/92/Moses%E6%93%8D%E4%BD%9C%E6%89%8B%E5%86%8C--%E5%86%AF%E6%B4%8B.pdf moses-manual]]
*[[Huilan:]] fixed the problem of syntax-based translation.
*sort out the system and corresponding documents.
||
*[[s2smn:]] finish the code of adding mn.
*[[Huilan:]] handover.
|-
|Jiyuan Zhang ||
*coded tone_model,but had some trouble
*run global_attention_model that decodes four sentences, [http://cslt.riit.tsinghua.edu.cn/mediawiki/images/d/d5/Four_local_atten.pdf four][http://cslt.riit.tsinghua.edu.cn/mediawiki/images/0/05/Five_local_attention.pdf five]generated by local_attention model
||
*improve poem model
|-
|Andi Zhang ||
*tried to modify the wrong softmax, but abandoned at last
*added bleu scoring part
||
*extract encoder outputs
|-
|Shiyue Zhang ||
* changed the one-hot vector to (0, -inf, -inf...), and retied the experiments. But no improvement showed.
* tried 1-dim gate, but converged to baseline
* tried to only train gate, but the best is taking all instance as "right"
* trying a model similar to attention
* [[http://cslt.riit.tsinghua.edu.cn/mediawiki/images/9/9f/RNNG%2Bmm_experiment_report.pdf report]]
||
* try to add true action info when training gate
* try different scale vectors
* try to change cos to only inner product
|-
|Guli ||
*read papers about Transfer learning and solving OOV
*conducted comparative test
*writing survey
||
* complete the first draft of the survey
|-
|Peilun Xiao ||
*use LDA to generate 10-500 dimension document vector in the rest datasets
*write a python code about a new algorithm about tf-idf
||
*debug the code
|}

NLP Status Report 2016-12-19

2016-12-20T05:20:30Z

Xiaopl：

{| class="wikitable"
!Date !! People !! Last Week !! This Week
|-
| rowspan="6"|2016/12/19
|Yang Feng ||
*[[s2smn:]] wrote the manual of s2s with tensorflow [[http://cslt.riit.tsinghua.edu.cn/mediawiki/images/5/51/Nmt-tensorflow-mannua-yfeng.pdf nmt-manual]]
*wrote part of the code of mn.
*wrote the manual of Moses [[http://cslt.riit.tsinghua.edu.cn/mediawiki/images/9/92/Moses%E6%93%8D%E4%BD%9C%E6%89%8B%E5%86%8C--%E5%86%AF%E6%B4%8B.pdf moses-manual]]
*[[Huilan:]] fixed the problem of syntax-based translation.
*sort out the system and corresponding documents.
||
*[[s2smn:]] finish the code of adding mn.
*[[Huilan:]] handover.
|-
|Jiyuan Zhang ||
*coded tone_model,but had some trouble
*run global_attention_model that decodes four sentences, [http://cslt.riit.tsinghua.edu.cn/mediawiki/images/d/d5/Four_local_atten.pdf four][http://cslt.riit.tsinghua.edu.cn/mediawiki/images/0/05/Five_local_attention.pdf five]generated by local_attention model
||
*improve poem model
|-
|Andi Zhang ||
*tried to modify the wrong softmax, but abandoned at last
*added bleu scoring part
||
*extract encoder outputs
|-
|Shiyue Zhang ||
* changed the one-hot vector to (0, -inf, -inf...), and retied the experiments. But no improvement showed.
* tried 1-dim gate, but converged to baseline
* tried to only train gate, but the best is taking all instance as "right"
* trying a model similar to attention
* [[http://cslt.riit.tsinghua.edu.cn/mediawiki/images/9/9f/RNNG%2Bmm_experiment_report.pdf report]]
||
* try to add true action info when training gate
* try different scale vectors
* try to change cos to only inner product
|-
|Guli ||
*read papers about Transfer learning and solving OOV
*conducted comparative test
*writing survey
||
* complete the first draft of the survey
|-
|Peilun Xiao ||
*Use LDA to generate 10-500 dimension document vector in the rest datasets
*Write a python code about a new algorithm about tf-idf
||
*Debug the code
|}

Schedule

2016-12-17T05:03:11Z

Xiaopl：/* Daily Report */

NLP Status Report 2016-12-12

2016-12-17T04:57:46Z

Xiaopl：

{| class="wikitable"
!Date !! People !! Last Week !! This Week
|-
| rowspan="6"|2016/12/12
|Yang Feng ||
*[[s2smn:]] installed tensorflow and ran a toy example (solved problems: version conflict and memory exhausted)
*wrote the code of the memory network part
*[[Huilan:]] prepared for periodical report and system submission.
||
*[[s2smn:]] finish the code of mn
*[[poemgen:]] experiment design
*[[Huilan:]] system submission
|-
|Jiyuan Zhang ||
*attempted to use memory model to improve the atten model of bad effect
*With the vernacular as the input，generated poem by local atten model[http://cslt.riit.tsinghua.edu.cn/mediawiki/images/2/2f/Local_atten_resluts.pdf]
*Modified working mechanism of memory model(top1 to average)
*help andi
||
*improve poem model
|-
|Andi Zhang ||
*prepared a paraphrase data set that is enumerated from a previous one (ignoring words like "啊呀哈")
*worked on coding bidirectional model under tensorflow, met with NAN problem
||
*ignore NAN problem for now, run it on the same data set used in Theano
|-
|Shiyue Zhang ||
* finished tsne pictures, and discussed with teachers
* tried experiments with 28-dim mem, but found almost all of them converged to baseline
* returned to 384-dim mem, which is still slightly better than basline.
* found the problem of action mem, one-hot vector is not proper.
* [[http://cslt.riit.tsinghua.edu.cn/mediawiki/images/2/2f/RNNG%2Bmm%E5%AE%9E%E9%AA%8C%E6%8A%A5%E5%91%8A.pdf report]]
||
* change one-hot vector to (0, -10000.0, -10000.0...)
* try 1-dim gate
* try max cos
|-
|Guli ||
*install and run moses
*prepare thesis report
||
*read papers about Transfer learning and solving OOV
|-
|Peilun Xiao ||
*Read a paper about document classification wiht GMM distributions of word vecotrs and try to code it in python
*Use LDA to reduce the dimension of the text in r52、r8 and contrast the performance of classification
||
*Use LDA to reduce the dimension of the text in 20news and webkb
|}

Schedule

2016-12-12T09:37:07Z

Xiaopl：/* Daily Report */

Schedule

2016-12-12T09:32:40Z

Xiaopl：/* Daily Report */

NLP Status Report 2016-12-12

2016-12-12T09:24:40Z

Xiaopl：清空页面

NLP Status Report 2016-12-12

2016-12-12T06:27:49Z

Xiaopl：以“1.Read a paper about document classification wiht GMM distributions of word vecotrs and try to code it in python 2.Use GibbsLDA++ to reduce the dimension of the text...”为内容创建页面

1.Read a paper about document classification wiht GMM distributions of word vecotrs and try to code it in python
2.Use GibbsLDA++ to reduce the dimension of the text in 20news、r52、r8、webkb and contrast the performance of classification