"The more information we have about the energy cost of AI, the better we can all assess the cost of this technology. All of which makes a recent announcement from Google that much more interesting. This document includes information on the energy usage of a text query sent to Google's AI systems. The result, as Google's Amin Vahdat and Jeff Dean explain, might be lower than you'd expect: "The per-prompt energy impact is equivalent to watching TV for less than nine seconds.""
"They point to one 12-month-long period during which time "the energy and total carbon footprint of the median Gemini Apps text prompt dropped by 33x and 44x." They went on to argue that Google's method of calculating the energy use of AI queries takes into account more factors than other methods, including monitoring idle servers and factoring in data centers' water use."
Requests to AI systems require data center processing and consume energy, creating environmental concerns. Google published data estimating the energy footprint of a text query to its AI systems. The company reported the per‑prompt energy impact is equivalent to watching television for less than nine seconds. Google reported a 12‑month period in which the energy and total carbon footprint of the median Gemini Apps text prompt dropped by 33x and 44x. Google's calculations account for idle servers and data center water use. The company stated it is investing to reduce power provisioning costs and water required per prompt. Transparency aims to improve assessment and reductions.
Read at InsideHook
Unable to calculate read time
Collection
[
|
...
]