Show HN: Web Ingest – Convert websites to LLM-friendly text

[chrisnolet]

I really love Git Ingest, but I needed something more general. So I built this!

It crawls websites and converts each page to Markdown.

It’s great for developer documentation.

And it’s free. I built it over the excellent Jina Reader. I hope you get some use out of it!

[lord-squirrel]

Is it open source?

[chrisnolet]

Thanks for trying it! It's not open source, but it is a single-page app. You could download the source and run it locally.

The web app is calling Jina Reader under the hood. If you needed something a little different, it wouldn't be too hard to write a CLI tool to call Jina and achieve similar results.

It's cheap to host, so I'll be leaving this up for the foreseeable future.