Scientia Psychiatrica
Vol. 7 No. 2 (2026): Scientia Psychiatrica

Temporal Transportability of an Ordinal Suicide-Risk Semantic Axis on Reddit, 2018–2020: An Open-Data Reanalysis

Danila Adi Sanjaya (Department of Literature Science, CMHC Research Center, Palembang, Indonesia)
Amir Serikova (Department of Cultural and Heritage Preservation, Emeritus Research Center, Skopje, North Macedonia)
Arya Ganendra (Department of Literacy, Emerald Language Institute, Balikpapan, Indonesia)



Article Info

Publish Date
30 Apr 2026

Abstract

Background. Language models applied to online mental-health communities meet shifting vocabulary and social context. Temporal transportability matters for population research but is often conflated with clinical validation. Objective. To develop and internally validate a Columbia-Suicide Severity Rating Scale-informed semantic axis and examine aggregate transport across matched r/SuicideWatch windows, 2018–2020. Methods. This secondary open-data study used 500 anonymous Reddit users labeled Supportive, Indicator, Ideation, Behavior or Attempt and 46,203 deduplicated r/SuicideWatch posts from matched January–April windows in 2018–2020. A two-stage model (Supportive versus risk-related content, then three cumulative thresholds) used term frequency-inverse document frequency (TF-IDF) unigrams and bigrams. Nested repeated cross-validation selected regularization; the locked model was applied to the temporal corpus. Drift was measured by cosine distance and Jensen-Shannon divergence. Calendar-matched 2020-minus-2019 differences were bootstrapped by day, and 2020 daily means underwent exploratory interrupted-time-series (ITS) analysis. Results. Internal validation gave an area under the receiver operating characteristic curve (AUC) of 0.841 (95% confidence interval [CI] 0.799–0.876), Spearman rho 0.568 (0.503–0.624), weighted kappa 0.464 (0.392–0.527) and macro-F1 0.292 (0.257–0.326). Attempt recall was 0%. Mean projected scores were 1.969, 1.923 and 1.928 in 2018, 2019 and 2020; matched 2020-minus-2019 difference was 0.0053 (−0.0020 to 0.0128). Exploratory ITS level change was −0.01976 (−0.04062 to 0.00110). Vocabulary drift was measurable, whereas probability-composition divergence remained small. Conclusion. The axis captured moderate ordinal structure, yet no Attempt-labeled user had Attempt as the highest-probability class. Stable aggregate outputs are not evidence of individual clinical validity. The model supports aggregate transport research, not screening, diagnosis or intervention.

Copyrights © 2026






Journal Info

Abbrev

SciPsy

Publisher

Subject

Health Professions Medicine & Pharmacology Neuroscience Public Health

Description

Scientia Psychiatrica covers the latest developments in various fields of psychiatric : biological psychiatry, neuropsychiatry, child psychiatry, psychiatry of community, psychotherapy, drugs-related mental illness, psychiatry of geriatric, psychosomatics medicine, psychology, cultural psychiatry, ...