#parameter-heterogeneity

[ follow ]
Scala
fromHackernoon
1 month ago

The Hidden Power of "Cherry" Parameters in Large Language Models | HackerNoon

Parameter heterogeneity in LLMs shows that a small number of parameters greatly influence performance, leading to the development of the CherryQ quantization method.
[ Load more ]