Offer Energy Ratings for Each Model
under review
S
Scott Morgan
I'd like to be able to choose models based on energy efficiency as one of my biggest concerns with AI is environmental impact. It'd be great if I could see the scoring next to each model. This could be a nice feature addition based on the below example from Hugging Face. https://huggingface.co/spaces/AIEnergyScore/Leaderboard
V
Vijay Bharadwaj
That's an interesting idea, Scott, so thank you for posting this!
Our only concern is the model picker UI is already cramped for space, and adding an energy rating might confuse users. Moreover, the link you've provided only has numbers for open-source models.
A rule of thumb for you while trying to choose what model to use: cheaper (low query cost) and newer models are usually more energy efficient.
We've compiled an approximate ranking to help you with this for the time being :)
V
Vijay Bharadwaj
under review