Article Per Year (5 Year)
p-Index From 2021 - 2026
0.626
P-Index
This Author published in this journals
All Journal TELKOMNIKA (Telecommunication Computing Electronics and Control)
Asmae Briouya
Ibn Tofail University
Computer Science & IT

Published : 2 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 2 Documents
Search

 1 
Overview of the progression of state-of-the-art language models Asmae Briouya; Hasnae Briouya; Ali Choukri
TELKOMNIKA (Telecommunication Computing Electronics and Control) Vol 22, No 4: August 2024
Publisher : Universitas Ahmad Dahlan

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.12928/telkomnika.v22i4.25936

Abstract

This review provides a concise overview of key transformer-based language models, including bidirectional encoder representations from transformers (BERT), generative pre-trained transformer 3 (GPT-3), robustly optimized BERT pretraining approach (RoBERTa), a lite BERT (ALBERT), text-to-text transfer transformer (T5), generative pre-trained transformer 4 (GPT-4), and extra large neural network (XLNet). These models have significantly advanced natural language processing (NLP) capabilities, each bringing unique contributions to the field. We delve into BERT’s bidirectional context understanding, GPT-3’s versatility with 175 billion parameters, and RoBERTa’s optimization of BERT. ALBERT emphasizes model efficiency, T5 introduces a text-to-text framework, and GPT-4, with 170 trillion parameters, excels in multimodal tasks. Safety considerations are highlighted, especially in GPT-4. Additionally, XL-Net’s permutation-based training achieves bidirectional context understanding. The motivations, advancements, and challenges of these models are explored, offering insights into the evolving landscape of large-scale language models.
Exploration of image and 3D data segmentation methods: an exhaustive survey Hasnae Briouya; Asmae Briouya; Ali Choukri
TELKOMNIKA (Telecommunication Computing Electronics and Control) Vol 22, No 2: April 2024
Publisher : Universitas Ahmad Dahlan

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.12928/telkomnika.v22i2.25740

Abstract

The field of image and 3-dimensional (3D) data segmentation is growing fast and has many uses, like in medicine, and robotics. In this article, we explain how computers understand and divide images and 3D data. We compare different ways of doing this in 2D and 3D, and look at the computer methods used. We also discuss recent work and what they discovered. This article gives a broad overview of what’s happening in this area of computer science. It explains the goals of the research, how they do it, and what they’ve found out. It’s a useful guide for researchers to understand what’s happening now and what challenges they might face in the future.
Co-Authors Ali Choukri Hasnae Briouya