p-Index From 2021 - 2026
9.638
P-Index
This Author published in this journals
All Journal IAES International Journal of Artificial Intelligence (IJ-AI) Bulletin of Electrical Engineering and Informatics Jurnal Informatika Jurnal Teknologi Informasi dan Ilmu Komputer Jurnal Edukasi dan Penelitian Informatika (JEPIN) Sistemasi: Jurnal Sistem Informasi Jurnal ELTIKOM : Jurnal Teknik Elektro, Teknologi Informasi dan Komputer JOIV : International Journal on Informatics Visualization Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi) Jurnal Pendidikan UNIGA Jurnal Ilmiah Universitas Batanghari Jambi INOVTEK Polbeng - Seri Informatika IJIS - Indonesian Journal On Information System Sebatik ILKOM Jurnal Ilmiah INTECOMS: Journal of Information Technology and Computer Science Jiko (Jurnal Informatika dan komputer) IJISTECH (International Journal Of Information System & Technology) JIPI (Jurnal Ilmiah Penelitian dan Pembelajaran Informatika) EDUMATIC: Jurnal Pendidikan Informatika METIK JURNAL Jurnal Manajemen Informatika dan Sistem Informasi Journal of Information Systems and Informatics JATI (Jurnal Mahasiswa Teknik Informatika) PRAJA: Jurnal Ilmiah Pemerintahan Indonesian Journal of Electrical Engineering and Computer Science JTIULM (Jurnal Teknologi Informasi Universitas Lambung Mangkurat) Jurnal Informa: Jurnal Penelitian dan Pengabdian Masyarakat Pilar Teknologi : Jurnal Penelitian Ilmu-ilmu Teknik JiTEKH (Jurnal Ilmiah Teknologi Harapan) Journal of Electrical Engineering and Computer (JEECOM) IJISTECH Jurnal FASILKOM (teknologi inFormASi dan ILmu KOMputer) Jurnal Computer Science and Information Technology (CoSciTech) Buletin Poltanesa International Research on Big-data and Computer Technology (IRobot) Bulletin of Computer Science Research Journal of Applied Sciences, Management and Engineering Technology (JASMET) Journal of Information Technology (JIfoTech) Jurnal Informatika Teknologi dan Sains (Jinteks) JAIA - Journal of Artificial Intelligence and Applications Nusantara of Engineering (NOE) Jurnal Bangkit Indonesia Jikom: Jurnal Informatika dan Komputer Journal of Informatics, Electrical and Electronics Engineering SmartComp Jurnal Informatika Polinema (JIP) TECHNOVATAR Intechno Journal : Information Technology Journal Bridge: Jurnal Publikasi Sistem Informasi dan Telekomunikasi Teknologi : Jurnal Ilmiah Sistem Informasi
Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : Journal of Informatics, Electrical and Electronics Engineering

Efektivitas Pelatihan Awal Berbasis Domain Spesifik Legal-BERT Untuk Natural Language Processing Hukum: Replikasi Dan Perluasan Studi Casehold Zakiri, Hasani; Alva Hendi Muhammad; Asro Nasiri
Journal of Informatics, Electrical and Electronics Engineering Vol. 5 No. 1 (2025): September 2025
Publisher : Forum Kerjasama Pendidikan Tinggi (FKPT)

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.47065/jieee.v5i1.2610

Abstract

Abstract?The emergence of domain-specific language models has demonstrated significant potential across various specialized fields. However, their effectiveness in legal natural language processing (NLP) remains underexplored, particularly given the unique challenges posed by legal text complexity and specialized terminology. Legal NLP has practical applications such as automated legal precedent search and court decision analysis that can accelerate legal research from weeks to hours. This study evaluates the CaseHOLD dataset to provide comprehensive empirical validation of domain-specific pretraining benefits for legal NLP tasks with focus on data efficiency and context complexity analysis. We conducted systematic experiments using the CaseHOLD dataset containing 53,000 legal multiple-choice questions. We compared four models: BiLSTM, BERT-base, Legal-BERT, and RoBERTa across varying data volumes (1%, 10%, 50%, 100%) and context complexity levels. Paired t-tests with 10-fold cross-validation and Bonferroni correction ensure robust methodology that guarantees finding reliability. Legal-BERT achieved the highest macro-F1 score of 69.5% (95% CI: [68.0, 71.0]), demonstrating a statistically significant improvement of 7.2 percentage points over BERT-base (62.3%, p < 0.001, Cohen's d= 1.23). RoBERTa showed competitive performance at 68.9%, nearly matching Legal-BERT. The most substantial improvements occurred under limited data conditions with 16.6% improvement at 1% training data. Context complexity analysis revealed an inverted-U pattern with optimal performance on 41-60 word texts. The introduced Domain Specificity Score (DS-score) showed strong positive correlation (r = 0.73, p < 0.001) with pretraining effectiveness, explaining 53.3% of performance improvement variance. These findings provide empirical evidence that domain-specific pretraining offers significant advantages for legal NLP tasks, particularly under data-constrained conditions and moderate-high context complexity. The key distinction of this research is the development of a predictive DS-score framework enabling benefit estimation before implementation, unlike previous studies that only evaluated post-hoc performance. The results have practical implications for developing legal NLP systems in resource-limited environments and provide optimal implementation guidance for Legal-BERT.
Co-Authors Abdul latif Adhien Kenya Estetikha Aditama, Galih Agung Harimurti, Agung Agus Purwanto Ahmad Yusuf Alif Syaiful Huda Ananda Fikri Akbar Andi Sunyoto Anggit Dwi Hartanto Anggrainy, Shynta Eza Annisa Hestiningtyas Apriadi, Frans Nilwan Arief Rahman Hakim Arif Baktiar Ariningsih, Puji Arsad Arta Perdana, Bagus Gede Asro Nasiri Asro Nasiri A’yuni, Ashlih Qurota Baiq Yulia Fitriyani Bambang Soedijono Bambang Soedijono W.A Bambang Soedijono W.A Bambang Soedijono, Bambang Bernadhed, Bernadhed Chaedar Fatach, Muhamad Reza Danu Prawira Utama Dhani Ariatmanto DHANI ARIATMANTO Diamanta, David Eka Sakti, Putra Utama Eko Pramono Ema Utami Fauzi, Moch Farid Fitriyani, Baiq Yulia Hanafi Hanafi Hanafi Hanafi Harahap, Muhammad Sya'ban Haris, Ruby Hasan, Nurul Rahmawati Hasibuan, M. Rivai Hery Priandoko Hewen, Maria Beliti Ilham Setya Budi Irawan, Hafizhan Irawan, Ridwan Dwi Irwan Oyong Jangkung Tri Nygroho Jeki Kuswanto Joko Dwi Santoso Juslan, Wulandari kurniawan, Ade Kurniawan Kusnawi Kusnawi Kusrini Kusrini Kusrini Kusrini Kusrini, K Kusrini, Kusrini Leo, Donatus Lubna Lubna Malik, Husni Hidayat Maradona, Maradona Muh Adha Muhamad Rodi Muhammad Husein Budiraharjo Muhammad Imam Munandar Muhartini, Sitti Muktafin, Elik Hari Nadya Chitayae Nasiri, Asro Novel Adil Dwijaksana Nugroho, Hanantyo Sri Nur Aini Nur Aziz Nugroho Prasetya, Bismar Rifki wahyu Prasetya, Rendra Prima Giri Pamungkas Raynold, Raynold Razaq, Thata Authar Richki Hardi Rifqi Anugrah Robert Marco, Robert Rosady, Melinne Maldini Saputra, Mahmuda Setiajid, Bayu Simanjuntak, Nurcahaya Sofian Dwi Hadiwinata Suparyati Suparyati Suseno, Hari Budhi Taryoko, Taryoko TONNY HIDAYAT Ula, M. Izul Verawati, Ike Wahyunia Ningsih Syam Widodo, Cynthia Wiwi Widayani, Wiwi Yana Hendriana Yossy Ariyanto Zakiri, Hasani Zitnaa Dhiaaul Kusnaa Washilatul Arba&#039;ah Zitnaa Dhiaaul KWA Zubaedi, Umam Faqih