A Corpus Worker`s Toolkit：语料库工具箱-0908 更新
- 主题发起人 动态语法
- 时间
回复：Announcing A Corpus Worker"s Toolkit
In order to prevent this fro m happening, the following steps must be followed.
4) Copy the following files to C:\Perl\bin: kwic.pl, kwic_e.pl, segment.pl, wordlist.txt.
5) Copy segmenter.pl to C:\Perl\lib.
If you have followed these steps and still got that error, then we have a problem.
In order to prevent this fro m happening, the following steps must be followed.
4) Copy the following files to C:\Perl\bin: kwic.pl, kwic_e.pl, segment.pl, wordlist.txt.
5) Copy segmenter.pl to C:\Perl\lib.
If you have followed these steps and still got that error, then we have a problem.
以下是引用 xiaoz 在 2005-8-17 19:38:52 的发言：
Shoud prove a very handy tool! Many thanks.
Any idea of what's happing in the following screen dump?
回复：Announcing A Corpus Worker"s Toolkit
With this release, I am still not comfortable with a number of
things. Among them,
1) T-Score, which has been confusing to
me when I read the literature. So don't write a dissertation based
on the T-Score results produced here!
2) XML. I hope the sample tags are not too far off, even though they
are relatively consistent.
With this release, I am still not comfortable with a number of
things. Among them,
1) T-Score, which has been confusing to
me when I read the literature. So don't write a dissertation based
on the T-Score results produced here!
2) XML. I hope the sample tags are not too far off, even though they
are relatively consistent.
回复：Announcing A Corpus Worker"s Toolkit
To facilitate downloading of the screen captures, I am putting down
two batches of image files below.
http://www.corpus4u.org/upload/forum/2005081800101598.rar
http://www.corpus4u.org/upload/forum/2005081800112636.rar
To facilitate downloading of the screen captures, I am putting down
two batches of image files below.
http://www.corpus4u.org/upload/forum/2005081800101598.rar
http://www.corpus4u.org/upload/forum/2005081800112636.rar
回复：Announcing A Corpus Worker"s Toolkit
[转贴] 关于T-Score 和 Mutual Information 的好文章
http://www.corpus4u.org/showthread.php?t=58
T-SCORE AND MUTUAL INFORMATION SCORE
http://www.corpus4u.org/showthread.php?t=26
[转贴] 关于T-Score 和 Mutual Information 的好文章
http://www.corpus4u.org/showthread.php?t=58
T-SCORE AND MUTUAL INFORMATION SCORE
http://www.corpus4u.org/showthread.php?t=26
回复：Announcing A Corpus Worker"s Toolkit
J. Clear says that:
the null hypothesis,
(f(post) * span ) * relative_freq(the)
which is
(2579 * 8) * (1 / 20) = 20632 / 20 = 1031
And in calculating both MI/T-Score, the notion of span is used as a
variable. My question (and confusion) is, why choosing 8, why not
other numbers? is there an optimal number to use?
Ultimately people can choose any # for the span, but
in many cases I have found that they just use 1 as the window size,
hence the XY method (i.e. XY are immediately next to each other). I
believe this has been the case for many people, but I also believe that
people can do it differently (i.e. choosing different numbers).
J. Clear says that:
the null hypothesis,
(f(post) * span ) * relative_freq(the)
which is
(2579 * 8) * (1 / 20) = 20632 / 20 = 1031
And in calculating both MI/T-Score, the notion of span is used as a
variable. My question (and confusion) is, why choosing 8, why not
other numbers? is there an optimal number to use?
Ultimately people can choose any # for the span, but
in many cases I have found that they just use 1 as the window size,
hence the XY method (i.e. XY are immediately next to each other). I
believe this has been the case for many people, but I also believe that
people can do it differently (i.e. choosing different numbers).
回复：Announcing A Corpus Worker"s Toolkit
There was also a paper that was posted here a while ago:
汉语搭配定量分析初探
孙茂松黄昌宁方捷
清华大学计算机科学与技术系
http://www.corpus4u.org/showthread.php?t=56
where they provide some different perspectives on collocations in Chinese.
There was also a paper that was posted here a while ago:
汉语搭配定量分析初探
孙茂松黄昌宁方捷
清华大学计算机科学与技术系
http://www.corpus4u.org/showthread.php?t=56
where they provide some different perspectives on collocations in Chinese.
