Management and Economics Journal (MEC-J)
Vol 10, No 2 (2026)

LLM-Based Strategic Risk Q & A over SEC Filings for Top Management Decision Support: A Reproducible Evaluastion on the SecQue Benchmark

Qi Xin (Management Information Systems, University of Pittsburgh, PA, USA)



Article Info

Publish Date
31 Aug 2026

Abstract

This paper studies strategic question answering over SEC filings for top-management decision support through a comprehensive evaluation on the SecQue benchmark, encompassing expert-written comparison, ratio, risk, and analysis tasks. The study operationalizes a board-facing retrieval-control stack with four integrated components: evidence retrieval, answer composition, refusal control, and explanation tracing. The benchmark contains 565 expert-written questions distributed across 220 comparison questions, 188 ratio questions, 85 risk questions, and 72 analysis questions. Empirical results demonstrate that metadata-aware retrieval significantly outperforms conventional lexical baselines, while specialized synthesis models achieve superior textual alignment and numerical fidelity. Furthermore, negative-testing and explanation diagnostics confirm robust cross-company refusal mechanisms and complete metadata provenance tracing. By filtering ungrounded assertions and highlighting precise metadata provenance, these automated control layers significantly reduce cognitive overload for corporate directors evaluating dense filings under tight time constraints. Ultimately, grounding board-level synthesis in auditable, trace-backed financial evidence mitigates informational asymmetry between executive teams and non-executive board members

Copyrights © 2026






Journal Info

Abbrev

mec

Publisher

Subject

Decision Sciences, Operations Research & Management Economics, Econometrics & Finance Social Sciences

Description

Management and Economics Journal (MEC-J) is a peer-reviewed and open access journal that focuses on management and economics fields. This journal publishes original articles, reviews, and also interesting case reports. Letters and commentaries of our published articles are welcome. Subjects suitable ...