bartdegoede's comments

bartdegoede | 1 month ago | on: Modernizing my "150-line" Python search engine

A few years ago I wrote a post about implementing tf-idf in 150 lines of python. The data source it relied on was removed (turns out Yahoo! isn't as relevant anymore).

bartdegoede | 5 months ago | on: The Loyal Wingman

Adventures with writing a novel with LLMs

bartdegoede | 5 years ago | on: Building a full-text search engine in 150 lines of Python code

Added an MIT license. Have fun :-)

bartdegoede | 5 years ago | on: Building a full-text search engine in 150 lines of Python code

The idea was to illustrate the concepts of an inverted index and tf-idf :-) I've built some stuff like this for a smaller project written in Python because it was Easier™ than spinning up an Elasticsearch cluster (ie it definitely didn't need to scale :-D)

bartdegoede | 5 years ago | on: Building a full-text search engine in 150 lines of Python code

Author here: you may want to check out something like Whoosh https://whoosh.readthedocs.io/en/latest/intro.html (it's like a clone of Lucene but in pure Python). I've used this to build some basic search for a small Python website and it was more than fast enough for my purposes :-)

bartdegoede | 8 years ago | on: Free SSL on Github Pages with a custom domain: Part 2 – Let's Encrypt

Mailinabox (https://mailinabox.email/guide.html#admin) uses it to get SSL certificates too; you can see it in action here https://github.com/mail-in-a-box/mailinabox/blob/master/mana...

bartdegoede | 8 years ago | on: Searching your Hugo site with Lunr.js

It will contain all content for pages that are live (in my case that's only 2 so far: http://bart.degoe.de/js/search/index.json), so your user will download all the content you want to have available for search on your site on page load, and then, depending on your index configuration, load more data in memory.

Lunr has an analysis pipeline that will generate a bunch of tokens for queries to match on, and you can do pretty much anything there.

It won't scale to thousands of pages, but I don't have thousands of them anyway :-)