I can definitely write better code with copilot due to faster iterations and much better code coverage. I believe we are a paper away before this can start improve of existing code itcluding the code of itself.
How would it know what a better version of itself were? Seems like that's a particularly human instinct. It requires a certain level of introspection and purpose, coupled with desire, ambition, a goal etc.
> Create a list of test cases by which you can benchmark yourself against
> Create an architecture for an LLM that passes 99%+ of those test cases
Then use an evolutionary algorithm based on those <1% of cases to create the next batch of tests. Keep a running record of all created tests and make sure the new model can still pass all of them. Add some randomness/branching into those tests and I think you’d have a recipe for an effective AI. I think Deepmind did something like that with AlphaStar and their tournament system.
holler|3 years ago
Mockapapella|3 years ago
> Create an architecture for an LLM that passes 99%+ of those test cases
Then use an evolutionary algorithm based on those <1% of cases to create the next batch of tests. Keep a running record of all created tests and make sure the new model can still pass all of them. Add some randomness/branching into those tests and I think you’d have a recipe for an effective AI. I think Deepmind did something like that with AlphaStar and their tournament system.