Spelling errors and keywords in born-digital data: a case study using the Teenage Health Freak Corpus

Catherine Smith, Svenja Adolphs, Kevin Harvey, Louise Mullany

Research output: Contribution to journalArticlepeer-review

4 Citations (Scopus)
188 Downloads (Pure)

Abstract

The abundance of language data that is now available in digital form, and the rise of distinct language varieties that are used for digital communication, means that issues of non-standard spellings and spelling errors are, in future, likely to become more prominent for compilers of corpora. This paper examines the effect of spelling variation on keywords in a born-digital corpus in order to explore the extent and impact of this variation for future corpus studies. The corpus used in this study consists of e-mails about health concerns that were sent to a health website by adolescents. Keywords are generated using the original version of the corpus and a version with spelling errors corrected, and the British National Corpus (BNC) acts as the reference corpus. The ranks of the keywords are shown to be very similar and, therefore, suggest that, depending on the research goals, keywords could be generated reliably without any need for spelling correction.
Original languageEnglish
Pages (from-to)137-154
JournalCorpora
Volume9
Issue number2
DOIs
Publication statusPublished - 1 Nov 2014

Fingerprint

Dive into the research topics of 'Spelling errors and keywords in born-digital data: a case study using the Teenage Health Freak Corpus'. Together they form a unique fingerprint.

Cite this