File(s) not publicly available
Student Translations of Natural Language into Logic: The Grade Grinder Corpus Release 1.0.
presentationposted on 2023-06-07, 19:37 authored by David Barker-Plummer, Richard Cox, Robert Dale
Students find logic hard. In particular, they seem to find it hard to translate natural language sentences into their corresponding representations in logic. As an enabling step towards determining why this is the case, this paper presents the public release of a corpus of over 4.5 million translations of natural language (nl) sentences into first-order logic (fol), provided by 55,000 students from almost 50 countries over a period of 10 years. The translations, provided by the students as fol renderings of a collection of 275 nl sentences, were automatically graded by an online assessment tool, the Grade Grinder. More than 604,000 are in error, exemplifying a wide range of misunderstandings and confusions that students struggle with. The corpus thus provides a rich source of data for discovering how students learn logical concepts and for correlating error patterns with linguistic features. We describe the structure and content of the corpus in some detail, and discuss a range of potentially fruitful lines of enquiry. Our hope is that educational data mining of the corpus will lead to improved logic curricula and teaching practice.
Event nameEducational Data Mining 2011
Event locationEindhoven, Netherlands
Event date6-8 July, 2011.
Department affiliated with
- Informatics Publications
Full text available