Control Systems and Optimization Letters
Vol 4, No 2 (2026)

Understanding Large Language Models: A Review

Wulandari, Annastasya Nabila Elsa (Unknown)
Purwono, Purwono (Unknown)
Ma’arif, Alfian (Unknown)
Basil, Noorulden (Unknown)
Marhoon, Hamzah M. (Unknown)



Article Info

Publish Date
07 May 2026

Abstract

Large Language Models (LLMs) have experienced rapid development and have been established as the dominant paradigm in modern Natural Language Processing (NLP), with high performance demonstrated across various language understanding and generation tasks. Increasing architectural complexity has led to the need for a structured conceptual framework to explain how architectural design, training paradigms, and inference mechanisms are collectively associated with model behavior. A conceptual and analytical review of LLMs is presented in this article through an examination of the relationship between Transformer-based architectures, multi-stage training processes, and the resulting capabilities and limitations. Encoder-only, decoder-only, and encoder–decoder architectural variants are examined in relation to structural characteristics and functional implications. The roles of pretraining, supervised fine-tuning, and instruction tuning are analyzed to clarify how output characteristics are shaped during model development. This study emphasizes how architectural and training strategies causally influence generative capabilities and inherent limitations. Fundamental issues, including hallucination, bias, data dependency, computational cost, and evaluation challenges, are critically examined as consequences of the probabilistic modeling paradigm adopted in LLMs. This review contributes a structured analytical perspective for evaluating LLMs design choices and their operational consequences, supporting more informed development and deployment practices.

Copyrights © 2026






Journal Info

Abbrev

csol

Publisher

Subject

Aerospace Engineering Automotive Engineering Computer Science & IT Control & Systems Engineering Electrical & Electronics Engineering Engineering

Description

Control Systems and Optimization Letters is an open-access journal offering authors the opportunity to publish in all fundamental and interdisciplinary areas of control and optimization, rapidly enabling a safe and sustainable interconnected human society. Control Systems and Optimization Letters ...