top | item 45807224 (no title) computably | 3 months ago 1024 bits for a hash is pretty roomy. The embedding "just" has to be well-distributed across enough of the dimensions. discuss order hn newest ImPostingOnHN|3 months ago Yeah, that's what I was thinking: Did we think 32 bits across each of the 1024 dimensions would be necessary? Maybe 32768 bits is adding unnecessary precision to what is ~1024 bits of information in the first place. FuckButtons|3 months ago That’s a much more interesting question, I wonder if there is a way to put a lower bound on the number of bits you could use?
ImPostingOnHN|3 months ago Yeah, that's what I was thinking: Did we think 32 bits across each of the 1024 dimensions would be necessary? Maybe 32768 bits is adding unnecessary precision to what is ~1024 bits of information in the first place. FuckButtons|3 months ago That’s a much more interesting question, I wonder if there is a way to put a lower bound on the number of bits you could use?
FuckButtons|3 months ago That’s a much more interesting question, I wonder if there is a way to put a lower bound on the number of bits you could use?
ImPostingOnHN|3 months ago
FuckButtons|3 months ago