top | item 43649226

(no title)

wgd | 10 months ago

How charitable of you to assume those examples work reliably.

discuss

order

jskarpet|10 months ago

Bemyeyes app already work quite reliability to describe scenes to the blind

lynx97|10 months ago

Haha, did you evaluate this personally?

I did a BeMyEyes test recently, trying to sort about 40 cans according to the existance of a deposit logo. After 90 minutes of submitting photos, and a second round to make sure it doesn't lie too much, I had 16 cans which according to BeMyEyes (OpenAI) had a deposit logo. Then, I went to the shop to bring them back. Turns out, only 4 cans had a logo. So after a second round to eliminate hallucinations, the success rate was only 25%.

Do you call that reliable?

jryle70|10 months ago

Are you willing to bet that it wouldn't work reliably in a year, 2 years, 5 years?

pfg_|10 months ago

If you're releasing something today, should you talk about what it can do now or what it might be able to do in two years?