[karfly]

IMO all RLHF stuff is mainly about aligning model not to reply with offensive and inappropriate answers, but NOT about making model's answers better.

[xg15]

Ah, that makes sense. Thanks!