Acuity : Journal of English Language Pedagogy, Literature and Culture
Vol. 7 No. 1 (2022): Acuity: Journal of English Language Pedagogy, Literature & Culture

Sentiment and Sentence Similarity as Predictors of Integrated and Independent L2 Writing Performance

Uzun, Kutay (Unknown)
Ulum, Ömer Gökhan (Unknown)



Article Info

Publish Date
28 Jun 2021

Abstract

This study aimed to utilize sentiment and sentence similarity analyses, two Natural Language Processing techniques, to see if and how well they could predict L2 Writing Performance in integrated and independent task conditions. The data sources were an integrated L2 writing corpus of 185 literary analysis essays and an independent L2 writing corpus of 500 argumentative essays, both of which were compiled in higher education contexts. Both essay groups were scored between 0 and 100. Two Python libraries, TextBlob and SpaCy, were used to generate sentiment and sentence similarity data. Using sentiment (polarity and subjectivity) and sentence similarity variables, regression models were built and 95% prediction intervals were compared for integrated and independent corpora. The results showed that integrated L2 writing performance could be predicted by subjectivity and sentence similarity. However, only subjectivity predicted independent L2 writing performance. The prediction interval of subjectivity for independent writing model was found to be narrower than the same interval for integrated writing. The results show that the sentiment and sentence similarity analysis algorithms can be used to generate complementary data to improve more complex multivariate L2 writing performance prediction models.

Copyrights © 2022






Journal Info

Abbrev

acuity

Publisher

Subject

Education Languange, Linguistic, Communication & Media

Description

Journal of English Language Pedagogy, Literature and Culture (Jelpedlic) is the research journal for the Teaching of English, Literature & Culture. It publishes research-based articles, reviews and poems, which reflect on every aspect of English teaching. The journal also considers new developments ...