Bulletin of Electrical Engineering and Informatics
Vol 14, No 6: December 2025

The extraction of a brief summary from scientific documents using machine learning methods

Murzabekova, Gulden (Unknown)
Mukhamedrakhimova, Galiya (Unknown)
Taszhurekova, Zhazira (Unknown)
Yerbayev, Yerbol (Unknown)
Doumcharieva, Zhanagul (Unknown)
Makhatova, Valentina (Unknown)
Tolganbaeva, Moldir (Unknown)
Serikbayeva, Sandugash (Unknown)



Article Info

Publish Date
01 Dec 2025

Abstract

This study proposes a machine learning-based approach for automatic summarization of scientific documents using a fine-tuned DistilBART model a lightweight and efficient version of the bidirectional and auto-regressive transformers (BART) architecture. The model was trained on a large corpus of 12,540 scientific articles (2015–2023) collected from the arXiv repository, enabling it to effectively capture domain-specific terminology and structural patterns. The proposed pipeline integrates advanced text preprocessing techniques, including tokenization, stopword removal, and stemming, to enhance the quality of semantic representation. Experimental evaluation demonstrates that the fine-tuned DistilBART achieves high summarization performance, with ROUGE-2=0.472 and ROUGE-L=0.602, outperforming baseline transformer-based models. Unlike conventional approaches, the method shows strong applicability beyond academic research, including automated indexing of technical documentation, metadata extraction in digital libraries, and real-time text processing in embedded natural language processing (NLP) systems. The results highlight the potential of transformer-based summarization to accelerate scientific knowledge discovery and improve the efficiency of information retrieval across various domains.

Copyrights © 2025






Journal Info

Abbrev

EEI

Publisher

Subject

Electrical & Electronics Engineering

Description

Bulletin of Electrical Engineering and Informatics (Buletin Teknik Elektro dan Informatika) ISSN: 2089-3191, e-ISSN: 2302-9285 is open to submission from scholars and experts in the wide areas of electrical, electronics, instrumentation, control, telecommunication and computer engineering from the ...