Claim Missing Document
Check
Articles

Found 2 Documents
Search

Privacy-Preserving Federated Query Processing Across Distributed Cloud Data Platforms Shankar das Boddu
International Journal of Engineering, Science and Information Technology Vol 6, No 2 (2026)
Publisher : Malikussaleh University, Aceh, Indonesia

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.52088/ijesty.v6i2.1844

Abstract

The rapid adoption of multi-cloud data platforms has enabled organizations to perform large-scale distributed analytics while complying with regional data governance requirements. However, existing federated query processing frameworks often prioritize performance and interoperability without providing rigorous privacy guarantees or enforcing regulatory compliance across multiple jurisdictions. This study presents PrivFed, a privacy-preserving federated query processing framework designed for distributed cloud data platforms operating under heterogeneous legal and regulatory constraints. PrivFed integrates differential privacy (DP), secure aggregation (SA), and a region-aware multi-objective query optimizer to support compliant, low-latency analytics over geographically partitioned datasets without exposing sensitive information. The proposed framework formalizes the federated query compliance problem by jointly optimizing query execution cost, privacy preservation, and data residency requirements. Formal analysis establishes -DP guarantees under adaptive composition and proves the security of the aggregation protocol in the semi-honest adversarial model. A comprehensive prototype was implemented across AWS Redshift, Azure Synapse, and Google BigQuery spanning three regulatory regions to evaluate scalability, efficiency, and privacy performance. Experimental results demonstrate that PrivFed achieves a median query latency only 1.4× higher than conventional non-private federated query systems, substantially outperforming homomorphic encryption-based approaches that incur 18–340× latency overhead. Furthermore, privacy-aware predicate pushdown reduces inter-region data transfer by 62%, while maintaining a cumulative privacy budget of ? ? 1.0 across 10,000 simulated adaptive queries. Comparative evaluation against Presto, Trino, and BigQuery Omni indicates that PrivFed is the only framework capable of simultaneously satisfying three critical objectives: strict data residency compliance, mathematically provable privacy protection, and practical query execution with less than 2× performance overhead. These findings demonstrate that PrivFed provides a practical and scalable foundation for secure federated analytics in modern multi-cloud environments.
A Unified Observability Framework for Cloud-Native Machine Learning Systems: Architectural Primitives, Lineage Correlation, and Cross-Stage Reliability Objectives Shankar das Boddu
International Journal of Engineering, Science and Information Technology Vol 6, No 1 (2026)
Publisher : Malikussaleh University, Aceh, Indonesia

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.52088/ijesty.v6i1.1824

Abstract

The observability gap in modern cloud-native organizations reflects a fundamental disconnect between data engineering teams, which focus on pipeline throughput and data freshness, and machine learning teams, which monitor inference latency and prediction drift. This separation is largely caused by telemetry systems that lack a unified identity model capable of linking datasets, features, model versions, and production environments across the machine learning lifecycle. To address this challenge, this paper proposes a unified observability framework that integrates telemetry primitives, lineage-aware correlation, and end-to-end reliability objectives connecting data quality and freshness with model performance outcomes. The framework introduces a minimal set of universal telemetry tags, including environment, workload identifier, dataset/feature/model version, and execution run identifier, enabling consistent cross-lifecycle correlation and incident analysis. A comparative evaluation is conducted against existing observability solutions, including MLflow integrated with OpenTelemetry, Monte Carlo data observability, and WhyLogs. The results indicate that the proposed framework offers superior capabilities for cross-stage incident attribution by linking failures occurring across data pipelines, feature engineering processes, model training, and inference services. Concept validation is performed using the Alibaba Cluster Trace Dataset and Evidently AI Drift Detection Dataset, demonstrating the practicality and applicability of the proposed telemetry primitives in real-world scenarios. The study further shows that lineage-aware correlation can reveal operational dependencies and failure propagation patterns that remain undetected by conventional component-level monitoring approaches. In addition, the framework defines a tool-agnostic event format and supports machine learning–based incident classification for common cross-stage failure modes, including training-serving skew and prediction degradation caused by data freshness issues. An incremental adoption strategy is proposed to facilitate implementation, beginning with high-impact production models and expanding according to demonstrated operational value.