Christoph Ringlstetter, Klaus U. Schulz and Stoyan Mihov. 2006. Orthographic Errors in Web Pages - Towards Cleaner Web Corpora . Computational Linguistics, September 2006, Vol. 32(3), pp. 295-340.
Abstract:
Since the Web by far represents the largest public repository of natural language texts, recent experiments, methods, and tools in the area of corpus linguistics often use the Web as a corpus. For applications where high accuracy is crucial, the problem has to be faced that a non-negligible number of orthographic and grammatical errors occur in Web documents. In this article we investigate the distribution of orthographic errors of various types in Web pages. As a by-product, methods are developed for efficiently detecting erroneous pages and for marking orthographic errors in acceptableWeb documents, reducing thus the number of errors in corpora and linguistic knowledge bases automatically retrieved from the Web.
Full paper for downloading...
(unfortunately failed several times to upload the attachment. Pls download it from Corpus4U gmail account!)
Abstract:
Since the Web by far represents the largest public repository of natural language texts, recent experiments, methods, and tools in the area of corpus linguistics often use the Web as a corpus. For applications where high accuracy is crucial, the problem has to be faced that a non-negligible number of orthographic and grammatical errors occur in Web documents. In this article we investigate the distribution of orthographic errors of various types in Web pages. As a by-product, methods are developed for efficiently detecting erroneous pages and for marking orthographic errors in acceptableWeb documents, reducing thus the number of errors in corpora and linguistic knowledge bases automatically retrieved from the Web.
Full paper for downloading...
(unfortunately failed several times to upload the attachment. Pls download it from Corpus4U gmail account!)
Last edited:
