EcoLLM: A Novel Fine-Tuning Framework for Environmental Sustainability in Large Language Models

Gagandeep Singh
Jaskaran Singh
Gourav Arora

Elementaria: Journal of Educational Research
Vol. 2 No. 2 (2024): Transformative Learning Approaches

The increasing reliance on artificial intelligence (AI) models, such as Large Language Models (LLMs), poses a unique challenge regarding environmental sustainability. Current LLMs prioritize performance and versatility, often neglecting the ecological impact of the solutions they generate. This paper presents a novel approach to fine-tuning LLMs to embed environmental considerations in their responses. By adjusting their training datasets and models, we enhance the likelihood of producing environmentally friendly outcomes. We observed that responses factoring in sustainability increased from 5% to over 75% post-optimization. This paper discusses our methodology, the challenges faced, and the implications for AI’s role in supporting global sustainability goals