Article Per Year (5 Year)
p-Index From 2021 - 2026
2.957
P-Index
This Author published in this journals
All Journal Jupiter CESS (Journal of Computer Engineering, System and Science) Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi) IT JOURNAL RESEARCH AND DEVELOPMENT Jurnal Cendikia Jurnal Teknologi Informatika dan Komputer Informanika Jurnal Pengembangan Sistem Informasi dan Informatika Jurnal Pengabdian kepada Masyarakat Bina Darma Jurnal Abdi Masyarakat Indonesia Jurnal Ilmiah Sistem Informasi dan Teknik Informatika (JISTI) KOMMAS: Jurnal Pengabdian Kepada Masyarakat Jurnal Pengabdian Masyarakat Information Technology (JPM ITech) Indonesia Berdampak: Jurnal Pengabdian Kepada Masyarakat Jurnal Pengabdian Kepada Masyarakat Indonesia Jurnal Informatika Dan Tekonologi Komputer
M. Soekarno Putra
Universitas Bina Darma
Agriculture, Biological Sciences & Forestry Humanities Civil Engineering, Building, Construction & Architecture Computer Science & IT Control & Systems Engineering Decision Sciences, Operations Research & Management Economics, Econometrics & Finance Education Electrical & Electronics Engineering Engineering Environmental Science Industrial & Manufacturing Engineering Languange, Linguistic, Communication & Media Library & Information Science Public Health Social Sciences Other

Published : 21 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 21 Documents
Search

 1   2   3 
Implementasi Proses Extract, Transform, dan Load (ETL) Menggunakan Luigi untuk Pengolahan Data Berita Terkait Pupuk, Pupuk Subsidi, dan Pupuk Langka Linda Herawati; M. Soekarno Putra
Jurnal Pengabdian kepada Masyarakat Indonesia (JPKMI) Vol. 6 No. 2 (2026): Agustus: Jurnal Pengabdian Kepada Masyarakat Indonesia (JPKMI)
Publisher : AMIK Veteran Purwokerto

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.55606/jpkmi.v6i2.12311

Abstract

The increasing amount of online news related to the fertilizer industry requires an automated data processing mechanism to produce structured and reliable information. Manual collection of news data from multiple news portals is inefficient, time-consuming, and prone to errors due to differences in website structures and continuously updated content. This study aims to implement an Extract, Transform, and Load (ETL) process using the Luigi workflow orchestration framework to automate the processing of news data related to fertilizer, subsidized fertilizer, and fertilizer scarcity. The ETL pipeline was developed using Python by collecting news data through web scraping from three national news portals, namely ANTARA, Detik, and Republika. The extracted data were merged, article contents were retrieved, cleaned, normalized, filtered based on publication years 2025–2026, and finally stored in a MySQL database. Luigi was utilized to manage task dependencies and execute the workflow automatically through a structured pipeline. The implementation results show that the developed ETL pipeline successfully automated the entire data processing workflow, improved processing efficiency, reduced manual intervention, and produced structured data ready for further utilization. The application of Luigi also simplified workflow monitoring and maintenance through its scheduler, making the ETL process more reliable and easier to manage for future data engineering developments.
Co-Authors Aldi Saputra Alek Wijaya Andre Satriawan DINNY KOMALASARI Doli Lyanda Edy Irawansyah endah fitriani Fatoni Firamon Syakti Hamim Tezar Rizandi Imam Solikin Kgs. M.Fijai Fahlevi Kiki Krisdayanti kiky rizky nova wardani Kurniati Kurniati Linda Herawati M Bronly Mangku Pandita M. Denny Tri Lisandi M. Komroni Makmur M. Rizki Julianto Merrieayu Puspita Hannah Misinem Muhammad Ade Syaifudin Muhammad Faiz Muhammad Nasir Normaliaty Fithri Nurul Adha Oktarini Saputri Nurul Huda R.M. Nasrul Halim Rahmat Maulana Olanda Rasmila Rindi Rama Saputra6 Rio Fernando Rizki Arya Pratama Septa Hardini Syahril Rizal Tabi In Athyam Madani Wydyanto Wydyanto