Auntie PDF – an open source app built using Mistral OCR

[sbarre]

I find it challenging to accept something that talks about "OCR" but then I upload a PDF with text in images, and when I query the document after upload, I get a message that says "I can't interpret images"..

Then are you actually doing OCR, or are you just extracting embedded text?

[0x62]

I’d imagine their capabilities mirror that of Mistral OCR [1]. Mistral outputs markdown, the image would have to be convertible to a reasonably useful markdown structure (charts, tables etc).

[1] https://mistral.ai/en/news/mistral-ocr

[tmpz22]

Same vein - YouTube most (all?) llm integrations just scrape the transcript. I -think- google's aistudio does more but I'm unsure.

I mean I get it bulk video processing would be crazy expensive, but at least mention you're only analyzing the transcript especially if you're a paid product.

[setnone]

Sweet branding! Grandma told me she's not happy with lack of privacy policy.

[bilater]

Its open source.

[simonw]

I built a CLI tool for experimenting with Mistral OCR here: https://simonwillison.net/2025/Mar/7/mistral-ocr/

Honestly, the vibes aren't great. Gemini is a lot more flexible for handling PDFs - you can prompt it to do a bunch of other things - and Mistral OCR appears to hallucinate if it can't correctly read handwriting, a common problem with vision LLM based OCR tools.

The way Mistral OCR handles images within the text is disappointing - it doesn't attempt to interpret them, just extracts them out as binary blobs. A vision LLM can usually do a great job of describing an image, but with Mistral OCR you have to manually run that as a separate step.

[brianjking]

Knowing that you have to do that as a separate step adds a whole additional level of complexity too.

For example, if some content has the images and some don't, you need to add whole additional steps to your processing and potentially add hallucinations in.

What are you using for document extraction lately, Simon?

[bilater]

Agreed - I am surprised they did are not using Pixtral to read images as well.

[bilater]

OK I've been critical of Mistral AI but credit where credit is due. Mistral OCR seems cool.

So cool in fact, I got distracted and ended up building an open source PDF parser and chat app!

Presenting Auntie PDF - your all-knowing guide that unpacks every PDF into clear, actionable insights.

You can upload a pdf or point to a public link, parse it, and then ask questions. All open source and free.

[onebitwise]

Lovely idea.

Not working for me on a file like this: https://files.catbox.moe/gii0pu.pdf It says that is larger than 10MB (it's 7MB), or failed on url.

[pogue]

That's pretty impressive for a project just released yesterday. I wish I had the energy and wherewithal to put stuff together that fast.

[jbaudanza]

I have a question about Mistral OCR. If I give the model a PDF that is 90% text, is it actually performing OCR on an image representation of the text? Or is it smart enough to extract the text directly and only use OCR on images?

[foundzen]

Love the creativity in the branding but it did not work in my case either. Gibberish raw content and error in answering any question.

[t-3]

What are people using these OCR programs for? Are there really that many PDFs being made without embedded text these days?

[qingcharles]

I have a million+ scanned PDF documents going back 300 years that are mostly just images of text.

[elanning]

It looks great, nice work. I’m impressed at the quick development too.

[bilater]

thanks!

[JoelJacobson]

Thanks for creating, really useful!

Would be nice with a [Download Combined Rendered] button to download a self-contained .html web page of the rendered combined page.

[bilater]

Added!

[shnpln]

I would like it if my chat session did not clear if go to Document Content and back to chat. Or I wish I could see my document when chatting.

[daft_pink]

Is there a way to use mistral ocr on us servers so your data never leaves our borders?

[mjyoon]

Unfortunate that Mistral OCR can't tell me details presented in charts and graphs.

[yannis]

Pretty impressive and did a good job for an academic pdf I uploaded. Nice UI also.

[bilater]

thanks!

[ab_testing]

This is amazing. Could you share the prompts that were used for this product ?

[bilater]

its not something you build with just a prompt. at least not yet.

[triyambakam]

The coolest thing about this is the short and easy to pronounce .com

[bilater]

haha yes I was very happy to get the domain

[n8m8]

im on mobile and don’t have a pdf to test it with, but I love your styling and text copy.

[bilater]

thanks!

[throwaway81348]

what about privacy?

[eastoeast]

Awesome UI!

[bilater]

thanks!