Hongyin and I are pleased to announce a brand new corpus of written Chinese -
The UCLA Chinese corpus
The UCLA Chinese Corpus is designed as a Chinese counterpart for the FLOB and Frown corpora of British and American English for contrastive research, as well as a recent update of the Lancaster Corpus of Mandarin Chinese (LCMC) for diachronic studies of possible changes in written Chinese over the past decade. Since this period is of special significance because of the impact of the Internet on language, especially on Chinese, the corpus is an excellent complement to LCMC.
The samples in the corpus are all collected from written modern Chinese available from the internet, during the period of 2000-2005, though some texts may have been converted from paper-based publications in earlier years. File types are matched as closely as possible to the Brown corpus model, with some variations (e.g. adventure fictions) to accommodate Chinese characteristics, while the proportions for different text categories may vary from the English counterparts and LCMC. Presently the genres covered and their sample sizes are shown as in the table below. Our target size is one million tokens.
The corpus is Unicode and XML-compliant. Each corpus file is composed of a corpus header and a text body. The header gives general information of a corpus file. In the body part, paragraphs, sentences and tokens are marked up, with each sentence numbered and each token annotated for part of speech.
The UCLA Chinese Corpus is a product of the joint effort of Professor Hongyin Tao (University of California Los Angeles) and Dr. Richard Xiao (UCREL of Lancaster University). Funding for this project was provided to Hongyin Tao by the UCLA Academic Senate during the academic years 2003-2005, while Richard Xiao was supported by the UK Economic and Social Research Council (Award Reference RES-000-23-0553). We are also obliged to Iris Li, Haiyong Liu, and Hui Zhang for their assistance in data collection.
The corpus is distributed free of charge for use in non-profit-making research. For licensing information, please refer to the LCMC licence. You are welcome to access the corpus using our web-based concordancer. Click here to have a look at the POS tagset.
The UCLA Chinese Corpus can be cited as: Tao, Hongyin and Richard Xiao (2007) The UCLA Chinese Corpus. UCREL, Lancaster.
Disclaimer: We give no warranties that the UCLA corpus will be suitable for any particular purpose and accept no responsibility for any technical limitations of the corpus or software.
The UCLA Chinese corpus
The UCLA Chinese Corpus is designed as a Chinese counterpart for the FLOB and Frown corpora of British and American English for contrastive research, as well as a recent update of the Lancaster Corpus of Mandarin Chinese (LCMC) for diachronic studies of possible changes in written Chinese over the past decade. Since this period is of special significance because of the impact of the Internet on language, especially on Chinese, the corpus is an excellent complement to LCMC.
The samples in the corpus are all collected from written modern Chinese available from the internet, during the period of 2000-2005, though some texts may have been converted from paper-based publications in earlier years. File types are matched as closely as possible to the Brown corpus model, with some variations (e.g. adventure fictions) to accommodate Chinese characteristics, while the proportions for different text categories may vary from the English counterparts and LCMC. Presently the genres covered and their sample sizes are shown as in the table below. Our target size is one million tokens.
The corpus is Unicode and XML-compliant. Each corpus file is composed of a corpus header and a text body. The header gives general information of a corpus file. In the body part, paragraphs, sentences and tokens are marked up, with each sentence numbered and each token annotated for part of speech.
The UCLA Chinese Corpus is a product of the joint effort of Professor Hongyin Tao (University of California Los Angeles) and Dr. Richard Xiao (UCREL of Lancaster University). Funding for this project was provided to Hongyin Tao by the UCLA Academic Senate during the academic years 2003-2005, while Richard Xiao was supported by the UK Economic and Social Research Council (Award Reference RES-000-23-0553). We are also obliged to Iris Li, Haiyong Liu, and Hui Zhang for their assistance in data collection.
The corpus is distributed free of charge for use in non-profit-making research. For licensing information, please refer to the LCMC licence. You are welcome to access the corpus using our web-based concordancer. Click here to have a look at the POS tagset.
The UCLA Chinese Corpus can be cited as: Tao, Hongyin and Richard Xiao (2007) The UCLA Chinese Corpus. UCREL, Lancaster.
Disclaimer: We give no warranties that the UCLA corpus will be suitable for any particular purpose and accept no responsibility for any technical limitations of the corpus or software.
