I do sometimes wonder if we will get "detailed enough" vector embeddings in LLMs to bring the grain of resolution down below human perception - like having enough bits to fully capture what's on tape in audio world. Maybe this is never possible, and (I hope) some details are unresolvable, but it will be interesting to see.
pixl97|1 month ago
Simply put anything that can be encoded is a language, so you just need sensors to capture and classify the incoming data and build that into a model. The real question is post training the model to behave correctly as these places are far less explored than things at the human scale. RLHF may be a poor choice because the models may see actual behaviors that humans don't and humans will discount it as being incorrect.
storystarling|1 month ago
bobson381|1 month ago
>When I was a child I used to ask my mother—of course—all sorts of ridiculous questions that every child asks, and when she got bored with my questions she would say, “Darling, there are just some things we’re just not meant to know.” I said, “Will we ever know?” She said, “Yes, of course, when we die and go to heaven, God will make everything plain.” So I used to imagine on wet afternoons in heaven, we’d all sit around the throne of grace and say to God, “Well, now, why did you do this?” and “How did you do that?” and he would explain it to us. “Heavenly father, why are the leaves green?” And he would say, “Because of the chlorophyll.” And we’d say, “Oh.”
1:00:09
But in he Hindu universe, you would say to God, “How did you make the mountains?” And he would say: well, I just did it. Because what you’re (Text sourced from https://www.organism.earth/library/document/out-of-your-mind...) asking me for—when you ask me how did I make the mountains, you’re asking me to describe in words how I made the mountains, and there are no words which can do this. Words cannot tell you how I made the mountains any more than I can drink the ocean with a fork. A fork may be useful for sticking into a piece of something and eating it, but it’s of no use for imbibing the ocean. It would take millions of years. So it would take millions of years, and you would be bored with my description long before I got through it, if I put it to you in words. Because I didn’t create the mountains with words, I just did it. Like you open and close your hand. You know how to do this, but can you describe in words how you do it? But you do it. You are conscious, aren’t you? Don’t you know how you manage to be conscious? Do you know how you beat your heart? Can you say in words, explain correctly, how this is done? You do it, but you can’t put it into words! Because words are too clumsy, and yet you manage this expertly for as long as you’re able to do it.[1]
[1]:https://www.organism.earth/library/document/out-of-your-mind...