WingNews logo WingNews
top | item 45938397

(no title)

hhthrowaway1230 | 3 months ago

Good like these small tools. I'd like to opt for more strategies too like doclings HierarchicalChunker.

discuss

order

messkan|3 months ago

Thanks, glad you like the tool! That's exactly the plan. The goal for v0.1 was to build the evaluation harness first (the scoring part). Now that it's in place, adding more strategies like HierarchicalChunker to the 'test bench' is the perfect next step. I've added it to the roadmap!

hhthrowaway1230|3 months ago

A good thing is to incorporate some old school observability and benchmarking, MLFLOW has been around for some time. You could push some some parameters to that to track your scores, and you could use Meta's AX optimisation framework to finetuning the settings (hyperparameters)