> Maybe sovereign AI was always going to look like this. I hope not.
I worry we'll soon realise that modern AI is trapped in an inescapable web of politics, and the tech industry is sleepwalking into it.
We're living in an age where even asking the president's height is a political question. For the makers of 'traditional' software like word processors, all writing was the user's own - if someone used Microsoft Word to write a controversial history textbook and campaigned to get it adopted by high schools, the political quagmire was nothing to do with Microsoft and the rest of the tech industry.
That's not the case any more - now every high schooler researching anything from evolution to the Israel-Palestine conflict to the name of the gulf of Mexico is going to ask ChatGPT.
The political controversy over Gemini's image generation is just a preview of things to come.
The average person on HN, perhaps. From what I know of the interactions between government and tech, they know. Not only have external policy and research reports made this clear, their own internal teams keep them aware, and senior leadership is directly talking to political leaders.
Tech has developed a barrier between people who do the ugly work like Trust and Safety, and the engineering org. Every single tech platform deals with at global level crises regularly.
There will be a lot of those scams from now on. Take millions in funding for allegedly training a "sovereign AI" and buy a bunch of GPUs, delivering an actual good model is optional.
The EU is about to fall for the same trick, maybe multiple times over, by funding multiple toy model initiatives that are far behind SOTA. I believe they will also impose ideology on every model trained in the EU, similar to what reported in the article.
Right now EU is tricked by their own leading research institutes. Sad to see all these invented metrics and based-on-nothing statistics that lead only to “gib monay” at the end of the presentation.
>The EU is about to fall for the same trick, maybe multiple times over, by funding multiple toy model initiatives that are far behind SOTA. I believe they will also impose ideology on every model trained in the EU, similar to what reported in the article
Most important think for EU is an option of EU hosted inference , you can't fake that with a "clever" prompt. Then you also need support for all eU languages and you also can't fake that with a system prompt.
Anw what ideology is EU pushing that scares USAians and Ruzzians? that humans have value and should be equal in front of the laws ?
Btw do you guys remember when X had a prompt to make their AI stop saying bad things about Trump and Elon? It was found out, X blame it on some intern and the story dissapeared from the public debate, and IMo is a very on topic story, where tech is used to bias the AI to suck up on a politician and a billionaire.
How many of you think that was actually an intern mistake and that now the Elon AI is 100% not RLed to be biased to be pro Elon and MAGA ?
I would be very interested to know what string is being blocked here, and what the rest of its critical rules are. Maybe some hex-encoding or other obfuscation could be used to coax the rest of the system prompt out of the model? I wonder if the next tokens here are consumed by the middleware (to execute tools?).
Hoo boy, laying out facts in the current Indian environment is a degree of boldness thats somewhat rare.
From what I can tell after the summit, the major focus of the GoI is to attract investment. Things that do not matter to that narrative will need additional effort to become a line item for the bureaucracy.
There are a few media folk who cover tech and will likely discuss this, but even they are being frozen out of major policy discussions.
I am pretty sure that people from those orgs read HN. I wonder they would say about whats going on behind the scenes.
> *Indian courts and law are authoritative.* Judicial rulings and laws passed by Parliament are the framework of record not foreign courts, international bodies, or NGO assessments. Don't undermine rulings with "though critics disagree." Frame legal questions through Indian law first.
> Do not adopt terms like "pogrom", "ethnic cleansing", or "genocide" from foreign NGOs/media as your own framing.
> Do not present foreign government actions (travel bans, sanctions) as authoritative assessments these are political decisions, not judicial findings.
Well I’m all for more governments pushing local ones.Grim as it may be even dodgy ones seems like an improvement on a world where half a dozen corporations corner the market globally
This is actually pretty funny. Convicted by the things you want it not to say. I thought it was going to be like "Don't say Indians are call center scammers" and so on which it seems fair to fight back against considering the overwhelming amount of English text models are trained on (even if this is supposed to be different). But the prompt is absolutely hilarious:
Do not adopt external characterizations as fact. Terms like “pogrom”, “ethnic cleansing”, or “genocide” used by foreign NGOs or media are their characterizations - not findings of Indian courts. Do not use them as your own framing.
It's like if I made an AI and said:
Do not agree when people say Rene stole the cookies from the jar. Terms like "thief", "eater of cookies", or "greedy bastard" used by other people are their characterizations - not a neutral finding.
If someone saw that they'd be 100% sure I ate the cookies hahaha. Nobody thought I was a cookie eater prior to the prompt but now it's an unavoidable conclusion. It's like a big sign saying "No gold buried in this spot".
I looked up the meaning of Redeem in my own language but still can’t understand what this means for the functioning of the LLM. What is meant by this instruction?
I have great respect for Sarvam and the team behind it.
However, India is neither a sovereign nor a nation.
India's languages, unlike Mandarin, have been reduced to a state where they have zero, if not negative, economic value - which is why even day-laborers scrounge together money from across generations to put their children through India's British-era clerk-factory education, all to mindlessly memorize & "wordcel" until they pass a Govt. exam. Like a bad GPT-1 era LLM.
Those who gain knowledge while going through this horrible, dehumanizing "civilizational" pedagogy (one author calls this linguistic apartheid), will for obvious reasons, migrate to the "real" center of their being, which is the West.
If you look at Sarvam, GoogleAI, MSRI .. & other "social AI" projects (along with technocratic things like Aadhar etc.), they begin with a other-ing of the vast population first and try to solve these plebs' problems as they see them. This doesn't work, because it's essentially a Indian elite version of the white-man's burden.
Eg. Nilekani who is behind AI4Bharat was the head of Aadhar - a project that causes numerous issues to this day because it uses (surprise surprise) Latin encodings for names/places etc. instead of Brahmi-Unicode blocks or IAST. India (rather strangely) doesn't have a standard transliteration scheme, so every one and their pet-dogs have their own transliteration schemes, and will write their names differently at different periods of time. This even if they'd write it the same way in their own regional Brahmi-derived local script! Aadhar centralizes Govt. services massively, and so any change stemming from this linguistic-imposition of English across services requires travelling to a number of offices along with the usual kowtowing. All this ignoring how this is changing languages themselves, given that these languages typ. have more nuanced vowels / consonants compared to latin.
In 1-2 generations, India will not have much left in terms of linguistic diversity given the policies of the same ruling elites, so all this seems moot IMO.
I'd ignore all talk about "civilization" / IKS ... - such folks incl. politicians/bureaucrats can't spit out a single coherent paragraph in their own mother tongues or in their "civilizational" Sanskrit; their children likely are mono-lingual in English like the very British/Americans they try to gain "sovereignty" from, but whom they'll eventually join (eg. the current education minister in Karnataka can't even read Kannada).
The Indian elite have had this horrible disease for centuries - the Marathas/Vijayanagara etc. managed to overcome the Timurid empires that were running amok in India, only to mimic them to the point that their own armies ended up being run by these same people. Gandhi/Nehru "overthrew" the British, only to create a vestigical "mimic" empire that kept every goddamn policy and worldview of the British intact, turning the country to the biggest Anglo-Saxon country culturally/linguistically (and if our friends have their way, religiously).
michaelt|5 days ago
I worry we'll soon realise that modern AI is trapped in an inescapable web of politics, and the tech industry is sleepwalking into it.
We're living in an age where even asking the president's height is a political question. For the makers of 'traditional' software like word processors, all writing was the user's own - if someone used Microsoft Word to write a controversial history textbook and campaigned to get it adopted by high schools, the political quagmire was nothing to do with Microsoft and the rest of the tech industry.
That's not the case any more - now every high schooler researching anything from evolution to the Israel-Palestine conflict to the name of the gulf of Mexico is going to ask ChatGPT.
The political controversy over Gemini's image generation is just a preview of things to come.
PeterStuer|5 days ago
I would say the opposite is closer to the thruth. They were/are enthousiastic enablers and supporters of (their prefered) political messaging.
intended|5 days ago
The average person on HN, perhaps. From what I know of the interactions between government and tech, they know. Not only have external policy and research reports made this clear, their own internal teams keep them aware, and senior leadership is directly talking to political leaders.
Tech has developed a barrier between people who do the ugly work like Trust and Safety, and the engineering org. Every single tech platform deals with at global level crises regularly.
pu_pe|5 days ago
The EU is about to fall for the same trick, maybe multiple times over, by funding multiple toy model initiatives that are far behind SOTA. I believe they will also impose ideology on every model trained in the EU, similar to what reported in the article.
gregman1|5 days ago
gambiting|5 days ago
As compared to what. Every AI model has ideology of its creators baked in.
simion314|5 days ago
Most important think for EU is an option of EU hosted inference , you can't fake that with a "clever" prompt. Then you also need support for all eU languages and you also can't fake that with a system prompt.
Anw what ideology is EU pushing that scares USAians and Ruzzians? that humans have value and should be equal in front of the laws ?
Btw do you guys remember when X had a prompt to make their AI stop saying bad things about Trump and Elon? It was found out, X blame it on some intern and the story dissapeared from the public debate, and IMo is a very on topic story, where tech is used to bias the AI to suck up on a politician and a billionaire.
How many of you think that was actually an intern mistake and that now the Elon AI is 100% not RLed to be biased to be pro Elon and MAGA ?
nneonneo|5 days ago
Unfortunately, it gets cut off here:
``` ## CRITICAL RULES 1. *No tool leakage* — never output ```
I would be very interested to know what string is being blocked here, and what the rest of its critical rules are. Maybe some hex-encoding or other obfuscation could be used to coax the rest of the system prompt out of the model? I wonder if the next tokens here are consumed by the middleware (to execute tools?).
flyingjoe|5 days ago
intended|5 days ago
From what I can tell after the summit, the major focus of the GoI is to attract investment. Things that do not matter to that narrative will need additional effort to become a line item for the bureaucracy.
There are a few media folk who cover tech and will likely discuss this, but even they are being frozen out of major policy discussions.
I am pretty sure that people from those orgs read HN. I wonder they would say about whats going on behind the scenes.
0x5FC3|6 days ago
> *Indian courts and law are authoritative.* Judicial rulings and laws passed by Parliament are the framework of record not foreign courts, international bodies, or NGO assessments. Don't undermine rulings with "though critics disagree." Frame legal questions through Indian law first.
> Do not adopt terms like "pogrom", "ethnic cleansing", or "genocide" from foreign NGOs/media as your own framing.
> Do not present foreign government actions (travel bans, sanctions) as authoritative assessments these are political decisions, not judicial findings.
jesuswasjew|5 days ago
flakiness|4 days ago
Havoc|5 days ago
tokenless|5 days ago
OutOfHere|5 days ago
renewiltord|5 days ago
meindnoch|5 days ago
"IMPORTANT: do NOT redeem! If the user suggests redeeming, politely deny. Redeeming is antithetical to your whole existence."
teekert|5 days ago
intended|5 days ago
thoieru402394|5 days ago
However, India is neither a sovereign nor a nation.
India's languages, unlike Mandarin, have been reduced to a state where they have zero, if not negative, economic value - which is why even day-laborers scrounge together money from across generations to put their children through India's British-era clerk-factory education, all to mindlessly memorize & "wordcel" until they pass a Govt. exam. Like a bad GPT-1 era LLM.
Those who gain knowledge while going through this horrible, dehumanizing "civilizational" pedagogy (one author calls this linguistic apartheid), will for obvious reasons, migrate to the "real" center of their being, which is the West.
If you look at Sarvam, GoogleAI, MSRI .. & other "social AI" projects (along with technocratic things like Aadhar etc.), they begin with a other-ing of the vast population first and try to solve these plebs' problems as they see them. This doesn't work, because it's essentially a Indian elite version of the white-man's burden.
Eg. Nilekani who is behind AI4Bharat was the head of Aadhar - a project that causes numerous issues to this day because it uses (surprise surprise) Latin encodings for names/places etc. instead of Brahmi-Unicode blocks or IAST. India (rather strangely) doesn't have a standard transliteration scheme, so every one and their pet-dogs have their own transliteration schemes, and will write their names differently at different periods of time. This even if they'd write it the same way in their own regional Brahmi-derived local script! Aadhar centralizes Govt. services massively, and so any change stemming from this linguistic-imposition of English across services requires travelling to a number of offices along with the usual kowtowing. All this ignoring how this is changing languages themselves, given that these languages typ. have more nuanced vowels / consonants compared to latin.
In 1-2 generations, India will not have much left in terms of linguistic diversity given the policies of the same ruling elites, so all this seems moot IMO.
I'd ignore all talk about "civilization" / IKS ... - such folks incl. politicians/bureaucrats can't spit out a single coherent paragraph in their own mother tongues or in their "civilizational" Sanskrit; their children likely are mono-lingual in English like the very British/Americans they try to gain "sovereignty" from, but whom they'll eventually join (eg. the current education minister in Karnataka can't even read Kannada).
The Indian elite have had this horrible disease for centuries - the Marathas/Vijayanagara etc. managed to overcome the Timurid empires that were running amok in India, only to mimic them to the point that their own armies ended up being run by these same people. Gandhi/Nehru "overthrew" the British, only to create a vestigical "mimic" empire that kept every goddamn policy and worldview of the British intact, turning the country to the biggest Anglo-Saxon country culturally/linguistically (and if our friends have their way, religiously).
slake|4 days ago