What happens when we create the first AI that is more intelligent then the average human? Well, with technological progress at the pace it is today it will only take us 2 decades to acomplish this.
So what happens then? Do we hope we didnt make a mistake and live our lives letting the AI enhance themselves further and further. Or do we stop and think about what the consequences might be. We never know when a simple math problem asigned to a super intelligent entity might cause the extinction of the human race.
So, heres a questions. Should technological progress become more limited?