Misuse of AI
Going forward, researchers will find more ways of eradicating errors through AI. With each generation passing, the machines are just getting better at handling the errors. This increases the risk of unintended consequences, hence why they should be treated before being applied to the real world. While neuroevolution might reduce the likelihood of unexpected consequences, it doesn’t prevent us from misuse. There is always the likelihood of things getting out of hand by the machines.
Nightmare-scenario
If the machines keep on improving in the future, it may certainly surpass human intelligence. How will a human justify its existence in front of a super intelligent system that is capable to do things better than us? The machines could treat us like lower beings in the future. However, we should also understand that AI only operates under very specific limitations defined by the algorithms that dictate its behaviour.
Most of the people worry about robots and automation because of the advancement they see in the technology field. For instance, a self-driven car starts taking you to the desired location by following the commands and takes away the need for a human driver. That's not only the one instance, the internet is full of the news about some form of robots or automation. This uncertainty, rapid spread of information and speculation has become a driver of fear.
Unforeseeable future
AI-driven system failure occurs due to the unintended consequences. We can see in many complex systems like NASA’s space shuttle, the RMS Titanic, the Chernobyl nuclear power plant, engineers have layered many different components together. The designers may have known well how about each element worked solely but didn’t know much about how they all worked together.
So as AI designs get even more complex and computer processes even faster, their skills improve. That will lead us to give our machines more responsibility, even as the risk of unexpected consequences arise. But, it is next to impossible to create a perfectly safe system.