Jurnal Penelitian Pendidikan IPA (JPPIPA)
Vol 9 No 9 (2023): September

Transformers in Machine Learning: Literature Review

T, Thoyyibah (Unknown)
Haryono, Wasis (Unknown)
Zailani, Achmad Udin (Unknown)
Djaksana, Yan Mitha (Unknown)
Rosmawarni, Neny (Unknown)
Arianti, Nunik Destria (Unknown)



Article Info

Publish Date
25 Sep 2023

Abstract

In this study, the researcher presents an approach regarding methods in Transformer Machine Learning. Initially, transformers are neural network architectures that are considered as inputs. Transformers are widely used in various studies with various objects. The transformer is one of the deep learning architectures that can be modified. Transformers are also mechanisms that study contextual relationships between words. Transformers are used for text compression in readings. Transformers are used to recognize chemical images with an accuracy rate of 96%. Transformers are used to detect a person's emotions. Transformer to detect emotions in social media conversations, for example, on Facebook with happy, sad, and angry categories. Figure 1 illustrates the encoder and decoder process through the input process and produces output. the purpose of this study is to only review literature from various journals that discuss transformers. This explanation is also done by presenting the subject or dataset, data analysis method, year, and accuracy achieved. By using the methods presented, researchers can conclude results in search of the highest accuracy and opportunities for further research.

Copyrights © 2023






Journal Info

Abbrev

jppipa

Publisher

Subject

Agriculture, Biological Sciences & Forestry Biochemistry, Genetics & Molecular Biology Chemical Engineering, Chemistry & Bioengineering Chemistry Education Materials Science & Nanotechnology Physics

Description

Science Educational Research Journal is international open access, published by Science Master Program of Science Education Graduate Program University of Mataram, contains scientific articles both in the form of research results and literature review that includes science, technology and teaching ...