Journal of Applied Engineering and Technological Science (JAETS)
Vol. 4 No. 2 (2023): Journal of Applied Engineering and Technological Science (JAETS)

Twitter Data Analysis and Text Normalization in Collecting Standard Word

Arif Ridho Lubis (Politeknik Negeri Medan)
Mahyuddin K M Nasution (Universitas Sumatera Utara)



Article Info

Publish Date
05 Jun 2023

Abstract

is one of the most important data sources in social data analysis. However, the text contained on Twitter is often unstructured, resulting in difficulties in collecting standard words. Therefore, in this research, we analyze Twitter data and normalize text to produce standard words that can be used in social data analysis. The purpose of this research is to improve the quality of data collection on standard words on social media from Twitter and facilitate the analysis of social data that is more accurate and valid. The method used is natural language processing techniques using classification algorithms and text normalization techniques. The result of this study is a set of standard words that can be used for social data analysis with a total of 11430 words, then 4075 words with structural or formal words and 7355 informal words. Informal words are corrected by trusted sources to create a corpus of formal and informal words obtained from social media tweet data @fullSenyum. The contribution to this research is that the method developed can improve the quality of social data collection from Twitter by ensuring the words used are standard and accurate and the text normalization method used in this study can be used as a reference for text normalization in other social data, thus facilitating collection. and better-quality social data analysis. This research can assist researchers or practitioners in understanding natural language processing techniques and their application in social data analysis. This research is expected to assist in collecting social data more effectively and efficiently.

Copyrights © 2023






Journal Info

Abbrev

jaets

Publisher

Subject

Civil Engineering, Building, Construction & Architecture Computer Science & IT Decision Sciences, Operations Research & Management Electrical & Electronics Engineering Industrial & Manufacturing Engineering

Description

Journal of Applied Engineering and Technological Science (JAETS) is published by Yayasan Pendidikan Riset dan Pengembangan Intelektual (YRPI), Pekanbaru, Indonesia. It is academic, online, open access, peer reviewed international journal. It aims to publish original, theoretical and practical ...