top | item 45401341

(no title)

snats | 5 months ago

I also did a couple of experiments with pruning LLMs[1] using genetic algorithms and you can just keep removing a surprising amount of layers in big models before they start to have a stroke.

[1]https://snats.xyz/pages/articles/pruningg.html

discuss

order

kridsdale1|5 months ago

I suspect this applies to human beings as well.

TeMPOraL|5 months ago

There's https://en.wikipedia.org/wiki/Hydrocephalus# and there are cases of people living normal lives, not realizing they're missing most of their brains, until this gets discovered on some unrelated medical test. Or people who survived an unplanned brain surgery by rebar or bullet. Etc.

littlestymaar|5 months ago

Well, humans don't have “layers” in the first place…