求助：如何在学习者语料库中提取同一个题目的作文并将其存为独立的文本
- 主题发起人 april426
- 时间
回复: 求助：如何在学习者语料库中提取同一个题目的作文并将其存为独立的文本
wordsmith5.0 有个Splitter的功能你可以试试, 但要求语料标记规范,每个小的文章要有结束标记标记. Utilities-->file Utilities-->Splitter. 自己好好琢磨一下应该能解决问题的.
我用它把CEM的单个文件里的作文分成了四千多个小文件. 不过可能要辅以少量的手工劳动.
wordsmith5.0 有个Splitter的功能你可以试试, 但要求语料标记规范,每个小的文章要有结束标记标记. Utilities-->file Utilities-->Splitter. 自己好好琢磨一下应该能解决问题的.
我用它把CEM的单个文件里的作文分成了四千多个小文件. 不过可能要辅以少量的手工劳动.
回复: 求助：如何在学习者语料库中提取同一个题目的作文并将其存为独立的文本
没有结尾标记你就把下一篇的开头标记作为本篇结尾也可以. 例如下面这些你可以把<ST 2> 作为结尾标记.
<ST 2> <SEX ?><Y ?> <SCH GDWYWMDXFSWYXX> <AGE ?> <WAY ?><DIC ?> <TYP 2>
A Healthy Diet
A healthy diet is very important for people. It contains some fat, some fibre, a little salt and so on. The Chinese diet is considered to be the healthies [fm1,-] in the world. It contains a lot of fruit and vegetables. It is rich in fibre and low in sugar and fat. As a result, a lot of Chinese have healthy white teeth. So I am very happy to be Chinses [fm1,-]. People in west eat too much fat and sugar. They like to eat butter, cream, chocolate, sweet and so on, which contain a lot of sugar. As a result, they put on weight easily. Many of them become very fat and some have bad teeth. The worset [fm1,-] thing is that many westerners die in an early age from the heart illness. So I thought [vp6,s-] [vp1,2-2] eat more fruit and vegetables, not to ear [wd3,1-2] too much sugar and fat is a real healthy diet. [sn8,s]
<ST 2> <SEX ?><Y ?> <SCH GDWYWMDXFSWYXX> <AGE ?> <WAY ?><DIC ?> <TYP 2>
Healthy Diet
What's a healthy diet? Many people can not answer this question exactly. But if they want to be healthy, they should have a healthy diet at first. People should have more cereal and grain, that's very helpful. According to a file of the American Health Research, cereals contain more vitamins, proteins, fibre & less fat, sugar than any other foods of the world. They're the basicest [aj3,1-] food in our life. Next, people should have more green vegetables & fruits[np5], they're a part of a healthy diet. People should have fewer [wd3,1-] food which contains a lot of fat, sugar, western diets are always quite unhealthy, we should ear [wd7,1-]less.
<ST 2> <SEX ?><Y ?> <SCH GDWYWMDXFSWYXX> <AGE ?> <WAY ?><DIC ?> <TYP 2>
What is a healthy diet?
What is a healthy diet? The foods [sn9,1-] which contain some fat, some fibre, a little salt and so on is a healthy diet [vp3,s-]. Such as the Chinese diet that is considered to be the healthiest in the world. It's high in fibre and low in sugar and fat. As a result, scores of people in China have healthy white teeth. On the other hand, the westerners eat a lot of fat in the form of crisps, potato chips, butter, cream and chocolate. Because of this, they die at an early age from heart illnesses. Besides, many of them have weight problems. However, a new hamburgar [fm1,-] restaurant in Beijing was quite popular. A doctor advised people not to have hamburgar [fm1,-] for it's not a good diet. Neither is the Coca Cola. So we should think we're lucky to have the healthy Chinese diet.
没有结尾标记你就把下一篇的开头标记作为本篇结尾也可以. 例如下面这些你可以把<ST 2> 作为结尾标记.
<ST 2> <SEX ?><Y ?> <SCH GDWYWMDXFSWYXX> <AGE ?> <WAY ?><DIC ?> <TYP 2>
A Healthy Diet
A healthy diet is very important for people. It contains some fat, some fibre, a little salt and so on. The Chinese diet is considered to be the healthies [fm1,-] in the world. It contains a lot of fruit and vegetables. It is rich in fibre and low in sugar and fat. As a result, a lot of Chinese have healthy white teeth. So I am very happy to be Chinses [fm1,-]. People in west eat too much fat and sugar. They like to eat butter, cream, chocolate, sweet and so on, which contain a lot of sugar. As a result, they put on weight easily. Many of them become very fat and some have bad teeth. The worset [fm1,-] thing is that many westerners die in an early age from the heart illness. So I thought [vp6,s-] [vp1,2-2] eat more fruit and vegetables, not to ear [wd3,1-2] too much sugar and fat is a real healthy diet. [sn8,s]
<ST 2> <SEX ?><Y ?> <SCH GDWYWMDXFSWYXX> <AGE ?> <WAY ?><DIC ?> <TYP 2>
Healthy Diet
What's a healthy diet? Many people can not answer this question exactly. But if they want to be healthy, they should have a healthy diet at first. People should have more cereal and grain, that's very helpful. According to a file of the American Health Research, cereals contain more vitamins, proteins, fibre & less fat, sugar than any other foods of the world. They're the basicest [aj3,1-] food in our life. Next, people should have more green vegetables & fruits[np5], they're a part of a healthy diet. People should have fewer [wd3,1-] food which contains a lot of fat, sugar, western diets are always quite unhealthy, we should ear [wd7,1-]less.
<ST 2> <SEX ?><Y ?> <SCH GDWYWMDXFSWYXX> <AGE ?> <WAY ?><DIC ?> <TYP 2>
What is a healthy diet?
What is a healthy diet? The foods [sn9,1-] which contain some fat, some fibre, a little salt and so on is a healthy diet [vp3,s-]. Such as the Chinese diet that is considered to be the healthiest in the world. It's high in fibre and low in sugar and fat. As a result, scores of people in China have healthy white teeth. On the other hand, the westerners eat a lot of fat in the form of crisps, potato chips, butter, cream and chocolate. Because of this, they die at an early age from heart illnesses. Besides, many of them have weight problems. However, a new hamburgar [fm1,-] restaurant in Beijing was quite popular. A doctor advised people not to have hamburgar [fm1,-] for it's not a good diet. Neither is the Coca Cola. So we should think we're lucky to have the healthy Chinese diet.