top | item 40636902

(no title)

menacingly | 1 year ago

if the servers are so private, why is on-device such a win? here are some irrelevant distractions:

- the cpu arch of the servers

- mentioning that you have to trust vendors not to keep your data, then announcing a cloud architecture where you have to trust them not to keep your data

- pushing the verifiability of the phone image, when all we ever cared about was what they sent to servers

- only "relevant" data is sent, which over time is everything, and since they never give anyone fine-grained control over anything, the llm will quietly determine what's relevant

- the mention that the data is encrypted, which of course it isn't, since they couldn't inference. They mean in flight, which hopefully _everything_ is, so it's irrelevant

discuss

order

menacingly|1 year ago

it will defer to the server a _lot_, if you just consider the capability they can fit on that phone