NuminaMath 7B: Revolutionizing Math Solving with Integrated Reasoning Advanced Generative AI Tools and Python REPL

Adi Jufriansah (Faculty of Mathematics and Natural Sciences, Universitas Gadjah Mada)
Irwan Akib (Faculty of Teacher Training and Education, Universitas Muhammadiyah Makassar)
Naufal Ishartono (Faculty of Teacher Training and Education, Universitas Muhammadiyah Surakarta)
Azmi Khusnani (Faculty of Mathematics and Natural Sciences, Universitas Gadjah Mada)
Tanti Diyah Rahmawati (Department of Ship Machinery Engineering Technology, Politeknik Pelayaran Surabaya)
Edwin Ariesto Umbu Malahina (Department of Informatics, STIKOM Uyelindo Kupang)
Osniman Paulina Maure (Faculty of Mathematics and Natural Sciences, Universitas San Pedro)
Nova Tri Romadloni (Faculty of Science, Technology and Animal Husbandry, Universitas Muhammadiyah Karanganyar)

Jurnal Penelitian Sains Teknologi
Vol. 2, No. 1, March 2026

The efficacy of NuminaMath 7B, an AI model that was created to address mathematical challenges, is assessed in this investigation. We evaluated the model's accuracy and efficiency against conventional methods through experiments that produced quantitative data. Qualitative data were collected through surveys and interviews with users to gain insight into their experiences and pinpoint areas for improvement. The survey results indicated that users found NuminaMath 7B to be pertinent, effective, and user-friendly, as evidenced by the exceptionally high average scores in user experience (95), perception of features and interface (90), and additional feedback (85). NuminaMath 7B was able to offer mathematical solutions with logical and detailed explanations as a result of the model's development through two phases of adjustments, which were conducted using the Chain of Thought (CoT) methodology and inspiration from the Tool-Integrated Reasoning Agent (ToRA) framework. Testing demonstrated that the model achieved a score of 29 out of 50 in the AI Math Olympiad competition, despite encountering difficulties in resolving more intricate problems. This study underscores the significance and urgency of AI technology, particularly in the field of mathematics, as well as the significant potential of AI models to facilitate a more comprehensive comprehension of mathematical concepts.