top | item 46443256 (no title) 7moritz7 | 2 months ago The scale. How many tools do you know that can query the content of all arxiv papers. discuss order hn newest eamag|2 months ago Doesn't look like the scale is there, even for HN:> Currently have embedded: posts: 1.4M / 4.6M comments: 15.6M / 38M That's with Voyage-3.5-lite Xyra|2 months ago The scale is there. I'm scraping, cleaning, token efficientizing dozens of sources every single hour. The lack of monies for embedding everything was a temporary problem.
eamag|2 months ago Doesn't look like the scale is there, even for HN:> Currently have embedded: posts: 1.4M / 4.6M comments: 15.6M / 38M That's with Voyage-3.5-lite Xyra|2 months ago The scale is there. I'm scraping, cleaning, token efficientizing dozens of sources every single hour. The lack of monies for embedding everything was a temporary problem.
Xyra|2 months ago The scale is there. I'm scraping, cleaning, token efficientizing dozens of sources every single hour. The lack of monies for embedding everything was a temporary problem.
eamag|2 months ago
> Currently have embedded: posts: 1.4M / 4.6M comments: 15.6M / 38M That's with Voyage-3.5-lite
Xyra|2 months ago