Jurnal Ilmiah Informatika dan Komputer
Vol. 2 No. 1 (2025): June 2025

Linear Algebra for Modern Statistics: Efficiency and Interpretability Challenges in Regression and PCA

Khoerul Rahman (Unknown)
Diny Syarifah Sany (Unknown)



Article Info

Publish Date
01 Jun 2025

Abstract

The development of modern statistics faces the challenge of high-dimensional data complexity, which requires an efficient yet interpretable approach. Linear algebra offers a solution through matrix representation, but its limitations in non-linear contexts and high-dimensional interpretation need to be examined in greater depth. This study analyzes algebraic methods through case studies of linear regression (normal equation solutions) and PCA (eigen decomposition), tested on synthetic datasets and MNIST. The results show: (1) a 40% computational acceleration in matrix-based regression, (2) PCA successfully reduces the MNIST dimension to 3 main components (retaining 85% of the variance), but a survey reveals that 73% of practitioners have difficulty interpreting high-dimensional components. Despite its efficiency advantages, algebraic methods require further development through hybrid approaches (kernel PCA) and interpretable techniques to address limitations in linearity and high-dimensional complexity.

Copyrights © 2025






Journal Info

Abbrev

informatech

Publisher

Subject

Computer Science & IT

Description

INFORMATECH : Jurnal Ilmiah Informatika dan Komputer (E-ISSN : 3047-4752) merupakan Jurnal nasional dengan akses terbuka yang menerbitkan artikel hasil penelitian di bidang Teknik Informatika dan Ilmu Komputer. Ruang Lingkup Jurnal meliputi Kecerdasan Buatan (Artificial Intellegence), Sistem ...