OPERATING SYSTEMSOS Linux

Advancing Responsible AI: Unveiling the Software Carbon Efficiency Rat… – Chris Xie & Tereze Gaile

Advancing Responsible AI: Unveiling the Software Carbon Efficiency Rating (SCER) for LLMs – Chris Xie, Futurewei & Tereze Gaile, Salesforce

In this talk, we’ll present the SCER (Software Carbon Efficiency Rating) for LLMs initiative by the Green Software Foundation. We will share our work on a standardized approach to measure and improve the carbon efficiency of Large Language Models (LLMs), crucial for responsible AI development. We’ve conducted comprehensive analyses on LLMs’ energy use and CO2 emissions, advocating for CO2e metrics over kWh to reflect the true environmental impact. This effort aims to drive the adoption of renewable energy in AI, advocating sustainability as part of the AI life-cycle rather than the after-fact. Join us to explore the SCER framework’s potential to foster greener AI technologies.

source

by The Linux Foundation

linux foundation