top | item 42094237

(no title)

sixfiveotwo | 1 year ago

> I spend much longer trying to figure out how to get 1-trit training to work and I never could.

What did you try? What were the research directions at the time?

discuss

order

llm_trw|1 year ago

This is a big question that needs a research paper worth of explanation. Feel free to email me if you care enough to have a more in-depth discussion.

sixfiveotwo|1 year ago

Sorry, I understand it was a bit intrusively direct. To bring some context, I toyed a little with neural networks a few years ago and wondered myself about this topic of training a so called quantized network (I wanted to write a small multilayer perceptron based library parameterized by the coefficient type - floating point or integer of different precision), but didn't implement it. Since you mentioned your own work in that area, it picked my interest, but I don't want to waste your time unnecessarily.