Don't think it adds a lot of value. One, the instruction-following models do not create high quality q&a pairs, chats do it by default. Two, at the time the usage was very low compared to ChatGPT. I am fairly confident, one month of people trying all sorts of things w ChatGPT gave them a lot more data - both in quantity and range - compared to API usage previously. Third, they always maintained they do not train on API inputs, and I think it's fair to assume that. They do not get feedback whether the output was any good, so it's always dicey to feed that directly to a model without those signals.
ankit219|2 years ago
weird-eye-issue|2 years ago
BonoboIO|2 years ago