Indonesian Journal of Statistics and Its Applications
Vol 5 No 2 (2021)

Development of Automated Environmental Data Collection System and Environment Statistics Dashboard

Dede Yoga Paramartha (Directorate of Analysis and Statistics Development, BPS Statistics Indonesia, Jakarta, 10710, Indonesia)
Ana Lailatul Fitriyani (Directorate of Analysis and Statistics Development, BPS Statistics Indonesia, Jakarta, 10710, Indonesia)
Setia Pramana (Politeknik Statistika STIS, Jakarta, 13330, Indonesia)



Article Info

Publish Date
30 Jun 2021

Abstract

Environmental data such as pollutants, temperature, and humidity are data that have a role in the agricultural sector in predicting rainfall conditions. In fact, pollutant data is common to be used as a proxy to see the density of industry and transportation. With this need, it is necessary to have automated data from outside websites that are able to provide data faster than satellite confirmation. Data sourced from IQair, can be used as a benchmark or confirmative data for weather and environmental statistics in Indonesia. Data is taken by scraping method on the website. Scraping is done on the API available on the website. Scraping is divided into 2 stages, the first is to determine the location in Indonesia, the second is to collect statistics such as temperature, humidity, and pollutant data (AQI). The module used in python is the scrapy module, where the crawling is effective starting from May 2020. The data is recorded every three hours for all regions of Indonesia and directly displayed by the Power BI-based dashboard. We also illustrated that AQI data can be used as a proxy for socio-economic activity and also as an indicator in monitoring green growth in Indonesia.

Copyrights © 2021






Journal Info

Abbrev

ijsa

Publisher

Subject

Computer Science & IT Mathematics Other

Description

Indonesian Journal of Statistics and Its Applications (eISSN:2599-0802) (formerly named Forum Statistika dan Komputasi), established since 2017, publishes scientific papers in the area of statistical science and the applications. The published papers should be research papers with, but not limited ...