有哪位想建应用语料库的吗?
- 主题发起人 happyw
- 时间
回复: 有哪位想建应用语料库的吗?
我朋友很想参加你们的中国英语语料库建设计划。
他们现在主要针对中文语料的处理和统计分析工作，也有一定的成果。
已经利用语料的处理开发了很多产品，以及一个在线词典（多形式的）——中文助手
可以参看他们的网站：
www.languagetech.cn
可否e-mail详谈？
我朋友很想参加你们的中国英语语料库建设计划。
他们现在主要针对中文语料的处理和统计分析工作，也有一定的成果。
已经利用语料的处理开发了很多产品，以及一个在线词典（多形式的）——中文助手
可以参看他们的网站：
www.languagetech.cn
可否e-mail详谈？
回复: 有哪位想建应用语料库的吗?
小女子接触语料库是这学期的事情，因为研究兴趣是词汇，导师建议我使用语料库作为一个有效的研究手段，导师去英国了，临行之前留给我一个自建语料库，其中包含了非英语专业研究生用英语写的学术论文，看到这张贴的时候突然想起了一直在想的问题，我们的语料库到底有多少典型性。我们都在做自己的语料库，但是谁也不知道用这样的小规模自建语料库检索的信息到底有多少可信度，是时候开始一个系统的语料库建设工程了。我们也应该有一个中国的BNC了，中国的英语学习者需要全面地了解自己的英语使用状况。
小女子接触语料库是这学期的事情，因为研究兴趣是词汇，导师建议我使用语料库作为一个有效的研究手段，导师去英国了，临行之前留给我一个自建语料库，其中包含了非英语专业研究生用英语写的学术论文，看到这张贴的时候突然想起了一直在想的问题，我们的语料库到底有多少典型性。我们都在做自己的语料库，但是谁也不知道用这样的小规模自建语料库检索的信息到底有多少可信度，是时候开始一个系统的语料库建设工程了。我们也应该有一个中国的BNC了，中国的英语学习者需要全面地了解自己的英语使用状况。
oscar3
高级会员
回复: 有哪位想建应用语料库的吗?
说得很不错。但是，语料库的建设不是一件很容易的事情，尤其是创建一个规模够大，又是质量上乘的语料库。即便如此，由于研究的目的不同，小规模的语料库仍然有其存在的价值。至于小规模的语料库到底有多少典型性这就只有研究者自己才清楚。用的一个学校的语料，干吗一定要说这是这就代表了所有中国英语学习者的状况呢？但是，这不等于说，基于个别学校的语料就没有价值，只是要注意结论的普遍性。
说得很不错。但是，语料库的建设不是一件很容易的事情，尤其是创建一个规模够大，又是质量上乘的语料库。即便如此，由于研究的目的不同，小规模的语料库仍然有其存在的价值。至于小规模的语料库到底有多少典型性这就只有研究者自己才清楚。用的一个学校的语料，干吗一定要说这是这就代表了所有中国英语学习者的状况呢？但是，这不等于说，基于个别学校的语料就没有价值，只是要注意结论的普遍性。
回复: 有哪位想建应用语料库的吗?
这里人人在用语料库，想自建语料库的也不少。不过，干什么都需要钱，要花钱就得先预算好。转发一个关于建语料库的预算的讨论：
------------------------------------------------------------------------
Kutz Arrieta asked:
>
> Dear list members,
> I'm trying to calculate what the cost of building annotated corpora for a
> language with no pre-existing annotated data with enough quality and volume
> to be used in initial versions of MT and translation memory would be.
> Any suggestions would be appreciated.
>
> KA
> karrieta@vicomtech.org
>
------------------------------------------------------------------------
Martin Wynne answered:
Dear Arrieta,
It's an interesting question, and I'm afraid that I don't know of any work that has been done on this. I don't think anyone will really be able to help you in terms of amounts of money, as there are too many variables, most importantly the cost of labour and overheads in your country.
However, to start the discussion on this topic, I would suggest that you need to work out the costs of the following:
- planning the project
- allocating or hiring staff, getting rooms, buying computers, arranging all the infrastructure; or paying for the costs of these things to your institution, or arranging permission to use them
- setting up a computing infrastructure for your project data and communications (text storage, version control system, intranet, wiki, etc)
- obtaining the texts (selection, obtaining permissions, downloading/digitising, collecting and marking up metadata, quality control)
- transforming the texts to a common format appropriate for further processing and annotation
- devising an annotation model
- training annotators
- manually annotating the corpus
- checking the corpus: size, sampling, text integrity, markup errors, annotation accuracy and consistency
- documenting the corpus and annotation
- making the corpus available, and continuing support for its storage, use and licensing
- long-term archiving and preservation
And when you've worked out the man-hours involved, double them for a realistic estimate.
So, for some projects, the biggest cost will be the digitisation of the materials. For others, it will be paying for permission to use them. For some, it will be to construct a schema for annotation. For many it will be to do the annotation, etc.
I welcome suggestions for the things that I've overlooked in the list above!
Martin Wynne
Oxford Text Archive: http://www.ota.ox.ac.uk/
Oxford e-Research Centre: http://www.oerc.ox.ac.uk/
CLARIN: http://www.clarin.eu/
Oxford University Computing Services
13 Banbury Road
Oxford
UK - OX2 6NN
Tel: +44 1865 283299
Fax: +44 1865 273275
martin.wynne@oucs.ox.ac.uk
这里人人在用语料库，想自建语料库的也不少。不过，干什么都需要钱，要花钱就得先预算好。转发一个关于建语料库的预算的讨论：
------------------------------------------------------------------------
Kutz Arrieta asked:
>
> Dear list members,
> I'm trying to calculate what the cost of building annotated corpora for a
> language with no pre-existing annotated data with enough quality and volume
> to be used in initial versions of MT and translation memory would be.
> Any suggestions would be appreciated.
>
> KA
> karrieta@vicomtech.org
>
------------------------------------------------------------------------
Martin Wynne answered:
Dear Arrieta,
It's an interesting question, and I'm afraid that I don't know of any work that has been done on this. I don't think anyone will really be able to help you in terms of amounts of money, as there are too many variables, most importantly the cost of labour and overheads in your country.
However, to start the discussion on this topic, I would suggest that you need to work out the costs of the following:
- planning the project
- allocating or hiring staff, getting rooms, buying computers, arranging all the infrastructure; or paying for the costs of these things to your institution, or arranging permission to use them
- setting up a computing infrastructure for your project data and communications (text storage, version control system, intranet, wiki, etc)
- obtaining the texts (selection, obtaining permissions, downloading/digitising, collecting and marking up metadata, quality control)
- transforming the texts to a common format appropriate for further processing and annotation
- devising an annotation model
- training annotators
- manually annotating the corpus
- checking the corpus: size, sampling, text integrity, markup errors, annotation accuracy and consistency
- documenting the corpus and annotation
- making the corpus available, and continuing support for its storage, use and licensing
- long-term archiving and preservation
And when you've worked out the man-hours involved, double them for a realistic estimate.
So, for some projects, the biggest cost will be the digitisation of the materials. For others, it will be paying for permission to use them. For some, it will be to construct a schema for annotation. For many it will be to do the annotation, etc.
I welcome suggestions for the things that I've overlooked in the list above!
Martin Wynne
Oxford Text Archive: http://www.ota.ox.ac.uk/
Oxford e-Research Centre: http://www.oerc.ox.ac.uk/
CLARIN: http://www.clarin.eu/
Oxford University Computing Services
13 Banbury Road
Oxford
UK - OX2 6NN
Tel: +44 1865 283299
Fax: +44 1865 273275
martin.wynne@oucs.ox.ac.uk
回复: 有哪位想建应用语料库的吗?
我有浓厚的兴趣，但是，目前只有兴趣。
我有浓厚的兴趣，但是，目前只有兴趣。