[n8m8]

+1, I have a c4ai docker container + brave search MCP (2000 queries/mo free!) running on my laptop so I can ask claude code to do research similar to GPT deep research, but I config to ignore robots.txt since it's a one-off instance collecting data on my personal behalf, not a service (At least that's how I justify it)

[bhy]

What is c4ai? Crawl4ai?

[n8m8]

Yes~