One definition of AI, which is most frequently used in business and academic contexts, is a discipline of computer science that entails using computers in which the system (ie: a machine) learns from data. AGI can be something that we have virtually no understanding or recognition of, but which may have a significant understanding of us if it is given access to the Internet or a significant data repository. Such a lack of mutual understanding is where all of the real risks reside. This is what should be talking about when we talk about worst case scenarios. We erroneously assume that we will be able to recognize AGI as such… The best argument for why we will not be able understand AGI is quite simple: we don’t understand human intelligence. This is also a commonly given reason for why we are not close to creating AGI ourselves. An intelligence of this type is more likely to be emergent….
