top | item 40896469

(no title)

gixco | 1 year ago

I didn't just look at the implementation, I tried it as well. I was hoping it would work, but the aggregating model mostly either failed to properly synthesize a new response (merely dumping out the previous responses as separate functions) or erratically took bits from each without properly gluing them together. In every case, simply picking the best out of the four responses myself yielded better results.

discuss

order

ianbutler|1 year ago

Interesting, I've seen live demos working fairly well. I've also implemented something adjacent to the work and it works quite well too. I'm not sure why you had a hard time with it.

I am however working in a domain where verification isn't subjective so I know a good response from a bad response fairly easily. Things like this depend quite heavily on the model being used too in my experience.

ericjmorey|1 year ago

Use the fifth model to suggest which of the 4 outputs is the best and sell the idea for $10 billion.