Show environmental impact in LLM selection window

freijon

I really love the new hover menu next to the LLMs showing the cost, quality and speed of the given model. The only thing missing in my point of view is the environmental impact of the model. Here a little mockup:
{Model information including environment with leaves}

I don't know how difficult / realistic it is to get this information reliably. But I'd really like to know the environmental impact of my requests, it would for sure be a factor in the decision which LLM to use.

Thibaultmol

It's quite difficult to get these stats and have them be reliable unfortainly. You can basically only trust the providers' own data which.... could be heavily biased or manipulated.

for open source models it's quite easy to get energy estimations and then you atleast have that. you stil don't know about the exact hoster of said models, how their footprint is. But yeah, comparing that to non-open source models is impossible