top | item 39313080

(no title)

_hzw | 2 years ago

Tangent. Yesterday I tried Gemini Ultra with a Django template question (HTML + Bootstrap v5 related), and here's its totally unrelated answer:

> Elections are a complex topic with fast-changing information. To make sure you have the latest and most accurate information, try Google Search.

I know how to do it myself, I just want to see if Gemini can solve it. And it did (or didn't?) disappoint me.

Links: https://g.co/gemini/share/fe710b6dfc95

And ChatGPT's: https://chat.openai.com/share/e8f6d571-127d-46e7-9826-015ec3...

discuss

order

MallocVoidstar|2 years ago

I've seen multiple people get that exact denial response on prompts that don't mention elections in any way. I think they tried to make it avoid ever answering a question about a current election and were so aggressive it bled into everything.

londons_explore|2 years ago

They probably have a basic "election detector" which might just be a keyword matcher, and if it matches either the query or the response they give back this canned string.

For example, maybe it looks for the word "vote", yet the response contained "There are many ways to do this, but I'd vote to use django directly".

Me1000|2 years ago

I'm pretty certain that there is a layer before the LLM that just checks to see if the embedding of the query is near "election", because I was getting this canned response to several queries that were not about elections, but I could imagine them being close in embedding space. And it was always the same canned response. I could follow up saying it has nothing to do with the election and the LLM would respond correctly.

I'm guessing Google really just want to keep Gemini away from any kind of election information for PR reasons. Not hard to imagine how it could be a PR headache.

Gregam3|2 years ago

Asking it to write code for a react notes project and it's giving me the same response, bizarre and embarrassing.

thepasswordis|2 years ago

It gave me this response when I simply asked who a current US congressman was.

jacquesm|2 years ago

> try Google Search.

Anti-trust issue right there.

falcor84|2 years ago

It's only the other way around, no? Abusing your monopoly position in one area to advance your product in another is wrong, but I don't see a clear issue on the other direction.