TEKNIK INFORMATIKA
Vol. 19 No. 2: JURNAL TEKNIK INFORMATIKA

Interpretable Machine Learning for Narrative Framing Classification: A TF-IDF-Based Study of Frankenstein

Luthfiana Dwi Rakhmawati (English Literature, Faculty of Adab and Humanities, UIN Syarif Hidayatullah Jakarta, Indonesia)
Rusdi Aulia Romadhon (Informatics Engineering, Faculty of Science and Technology, UIN Syarif Hidayatullah Jakarta, Indonesia)
Kiki Adnan Muzaki (Religious Studies Department, University of California, Riverside, USA)
Anna Nurawalia (English Language Department, Politeknik Bau-Bau, Indonesia)
Dewi Aprilia Ningrum (Centre for Planners'
Development, Education, and Training (Pusbindiklatren), Ministry of National Development Planning/Bappenas)



Article Info

Publish Date
30 Oct 2026

Abstract

This study evaluates interpretable supervised machine learning for three-class narrative framing classification of literary text, using Mary Shelley's Frankenstein (1818) as a case study; narrative framing is the evaluative position a passage assigns to the Creature: Threat, Victim, or Ambivalent. The methodology comprised five stages: (1) extraction of passages narrated by Victor Frankenstein, the Creature, and Robert Walton from the 1818 Project Gutenberg text; (2) annotation of 195 passages, with a blinded second annotator re-labeling 68 passages (Cohen's κ = 0.6926); (3) sublinear TF-IDF unigram and bigram representation; (4) classification with Multinomial Naive Bayes, Linear SVM, and Logistic Regression against Majority and VADER baselines under stratified 5-fold cross-validation; and (5) a designation-masking ablation and coefficient analysis. The results show that Logistic Regression obtained the highest mean scores (66.67% accuracy; 47.75% Macro-F1), although its margin over Linear SVM (46.18%) and VADER (44.85%) lies within fold-level variability. Pooled F1 reached 69.0% for Threat and 74.3% for Victim, whereas none of the 29 Ambivalent passages was correctly identified. Masking explicit designations reduced Macro-F1 only to 45.20%, indicating partial robustness to this procedure rather than discourse-level modeling. It is concluded that interpretable classical classifiers can separate Threat from Victim framing using transparent lexical evidence but cannot yet detect ambiguous framing; given the single-novel, small, and imbalanced dataset, the findings are a preliminary proof of concept. Future work should enlarge and balance the corpus, apply group-based and repeated cross-validation, and compare context-aware models, including large language models, on the Ambivalent class.

Copyrights © 2026






Journal Info

Abbrev

ti

Publisher

Subject

Computer Science & IT

Description

Jurnal Teknik Informatika merupakan wadah bagi insan peneliti, dosen, praktisi, mahasiswa dan masyarakat ilmiah lainnya untuk mempublikasikan artikel hasil penelitian, rekayasa dan kajian di bidang Teknologi Informasi. Jurnal Teknik Informatika diterbitkan 2 (dua) kali dalam ...