The worry is not that chatgpt will take over the world. It is that a future system will be unaligned with human interests and once it is created by gradient descent (the internals of the system are not understood by anyone - they're just matrices) there will be no guarantee that humanity will be safe. By looking at the power of gpt4 we have no clear idea of how fast it will continue to improve.
No comments yet.