"On mobile devices, a standard LLM session uses on average 5.4 times less energy than a classic ad-supported web search session, highlighting the efficiency of LLMs in this context."
"Programmatic advertising alone accounts for up to 41% of device battery drain per session, indicating a significant impact on energy consumption during mobile searches."
"The advantage of LLM sessions disappears on fixed Wi-Fi or fiber connections and reverses for reasoning models, suggesting context-dependent energy efficiency."
A parametric model of mobile search sessions reveals that standard LLM sessions use 5.4 times less energy than traditional ad-supported web searches. The model accounts for various factors, including 4G/5G radio energy, rendering costs, and network transmission. Programmatic advertising contributes to 41% of battery drain during these sessions. However, the advantage of LLMs diminishes on fixed Wi-Fi and reverses for reasoning models. The findings are based on a Monte Carlo simulation and are documented in a working paper, pending peer review.
Read at Ycombinator
Unable to calculate read time
Collection
[
|
...
]