Claim Missing Document
Check
Articles

Found 12 Documents
Search

Hybrid Cloud Architecture for Efficient and Cost-Effective Large Language Model Deployment Qi Xin
Journal of Information System and Informatics Vol 7 No 3 (2025): September
Publisher : Asosiasi Doktor Sistem Informasi Indonesia

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.51519/journalisi.v7i3.1170

Abstract

Large Language Models (LLMs) have achieved remarkable success across natural language tasks, but their enormous computational requirements pose challenges for practical deployment. This paper proposes a hybrid cloud–edge architecture to deploy LLMs in a cost-effective and efficient manner. The proposed system employs a lightweight on-premise LLM to handle the bulk of user requests, and dynamically offloads complex queries to a powerful cloud-hosted LLM only when necessary. We implement a confidence-based routing mechanism to decide when to invoke the cloud model. Experiments on a question-answering use case demonstrate that our hybrid approach can match the accuracy of a state-of-the-art LLM while reducing cloud API usage by over 60%, resulting in significant cost savings and a ~40% reduction in average latency. We also discuss how the hybrid strategy enhances data privacy by keeping sensitive queries on-premise. These results highlight a promising direction for organizations to leverage advanced LLM capabilities without prohibitive expense or risk, by intelligently combining local and cloud resources.
Correlation-Driven Root Cause Analysis from Multi-Service Logs via Template-Aware Graph Inference: An Empirical Study on LogHub Hadoop and RCAEval Sock Shop Qi Xin
JEECS (Journal of Electrical Engineering and Computer Sciences) Vol. 11 No. 2 (2026): December
Publisher : Fakultas Teknik Universitas Bhayangkara

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.54732/jeecs.v11i2.3

Abstract

Root cause analysis (RCA) has become urgent in AIOps because modern incidents rarely stay inside one component: failures propagate across services and operators must identify the initiating service, not only the loudest symptom. Prior log analytics studies have mainly emphasized parsing and anomaly detection, while recent microservice RCA benchmarks have focused on service localization with multimodal telemetry. This paper studies a narrower and practical question: how far can correlation-driven RCA go when only multi-service logs and their event templates are used? We present a template-aware correlation-graph framework that converts raw logs into service-template events, learns directed lagged edges, and ranks root-cause candidates using direct anomaly evidence, one-step edge attribution, and reverse personalized PageRank. Experiments are conducted on the complete LogHub Hadoop logs and the RCAEval RE2-SS Sock Shop data. The Hadoop corpus contains 394,310 raw log lines, 55 applications, and 44 labeled abnormal applications. RE2-SS contains 90 fault cases, five root services, six fault types, and 7,566,220 log rows. On RE2-SS, the proposed HybridRCA reaches 0.267 Top-1, 0.456 Top-3, and 0.435 MRR for service-level root localization, improving Top-1 and MRR over frequency-only ranking. A metric-only reference reaches 0.578 Top-1, showing that log-only RCA remains limited for resource faults whose strongest symptoms appear in metrics rather than logs. The results support correlation graphs as useful diagnostic evidence while clarifying the unresolved weakness of log-only RCA in multimodal microservice incidents.