Journal of Applied Data Sciences
Vol 7, No 4: December 2026

Trade-Offs in Statistical and Machine-Learning-Based Imputation for Algal Time-Series: A Multi-Criteria Evaluation on Optical Density Data Without Ground Truth

Erickson James (Universiti Malaysia Sabah)
Ervin Gubin Moung (Universiti Malaysia Sabah)
Mohd Shahazureen Ikwan Bin Abdul Rahman (Universiti Malaysia Sabah)
Valentino Liaw (Universiti Malaysia Sabah)
Lucky Goh Poh Wah (Universiti Malaysia Sabah)
Ahmad Asnawi Bin Mus (Universiti Malaysia Sabah)
Ali Farzamnia (University of Huddersfield)



Article Info

Publish Date
15 Oct 2026

Abstract

Missing values are pervasive in algal cultivation monitoring, where instrument failure and transmission loss remove whole runs of consecutive observations, and the repair method chosen silently shapes every downstream analysis. This study asks which repair method should be used, and on what evidence, when no complete reference series exists. Twelve methods are compared on optical density and ten covariates recorded across 30 open-pond production cycles at five geographically distinct sites: four interpolation schemes, a propagation scheme, two nearest-neighbour schemes, three chained-equation variants, a random-forest ensemble and a mechanistic growth-curve fit. The principal contribution is a validation framework organised in two clearly separate tiers. The first tier needs no ground truth and applies to the naturally missing values, comparing central tendency, dispersion, distributional shape, autocorrelation structure and coverage between observed and repaired series. The second tier withholds values that were in fact recorded and rebuilds them, so reconstruction error can be measured directly; it is replicated over ten random seeds, three masking proportions and four contiguous outage lengths, giving 25,200 paired evaluations in which every method sees an identical pattern of withhold cells. Key findings found that no method dominates. Ensemble and chained-equation learners rebuild individual values most accurately, with a normalised error of 0.1927 against 0.2645 for linear interpolation, but they compress dispersion and distort distributional shape, whereas shape-preserving interpolation and propagation protect those properties and rebuild less accurately. Gap structure matters: interpolation loses accuracy when gaps are contiguous rather than scattered, while multivariate learners gain. Regularising the chained equations removes a convergence failure that left one pond unrepaired. An aggregated decision analysis turns these trade-offs into a weight-dependent selection rule, giving practitioners an auditable basis for matching method to analytical objective instead of a single universal default.

Copyrights © 2026






Journal Info

Abbrev

JADS

Publisher

Subject

Computer Science & IT Control & Systems Engineering Decision Sciences, Operations Research & Management

Description

One of the current hot topics in science is data: how can datasets be used in scientific and scholarly research in a more reliable, citable and accountable way? Data is of paramount importance to scientific progress, yet most research data remains private. Enhancing the transparency of the processes ...