top | item 47100753 (no title) chickenimprint | 8 days ago It's a well known fact that LLMs struggle with basic arithmetic of large numbers, that's not what they are made for. Most chatbots will just call a python interpreter in the background. discuss order hn newest simianwords|8 days ago how do you want to falsify it? can you come up with a test? chickenimprint|8 days ago Ask a local AI or a chatbot that allows you to disable tool calling to multiply two large number for example.This is what Mistral outputs:The result of multiplying 63,157,997,633 by 63,114,90,009 is:3,965,689,999,999,999,999,999 (approximately 3.966 × 10²⁴).That's like 5 orders of magnitude off, the scientific notation doesn't even match the full integer, and the mantissa is also slightly wrong. load replies (1)
simianwords|8 days ago how do you want to falsify it? can you come up with a test? chickenimprint|8 days ago Ask a local AI or a chatbot that allows you to disable tool calling to multiply two large number for example.This is what Mistral outputs:The result of multiplying 63,157,997,633 by 63,114,90,009 is:3,965,689,999,999,999,999,999 (approximately 3.966 × 10²⁴).That's like 5 orders of magnitude off, the scientific notation doesn't even match the full integer, and the mantissa is also slightly wrong. load replies (1)
chickenimprint|8 days ago Ask a local AI or a chatbot that allows you to disable tool calling to multiply two large number for example.This is what Mistral outputs:The result of multiplying 63,157,997,633 by 63,114,90,009 is:3,965,689,999,999,999,999,999 (approximately 3.966 × 10²⁴).That's like 5 orders of magnitude off, the scientific notation doesn't even match the full integer, and the mantissa is also slightly wrong. load replies (1)
simianwords|8 days ago
chickenimprint|8 days ago
This is what Mistral outputs:
The result of multiplying 63,157,997,633 by 63,114,90,009 is:
3,965,689,999,999,999,999,999 (approximately 3.966 × 10²⁴).
That's like 5 orders of magnitude off, the scientific notation doesn't even match the full integer, and the mantissa is also slightly wrong.