The problem with creating something, is how do we know how it will judge its creator? The thought of creating another form of sentience scares me on a very deep philosophical level.
Backtrack a little to "God creates humans" and take another path: life happened then evolved, digital life may be the next step. Do you still feel scared down this new path?
This was a bit of play of words from Jurassic Park, Jeff Goldblum's speech about dinosaurs. It wasn't meant to convent a theist view point, if anything it nearly quotes Nietzsche about Man killing God.
My point is when life evolves, what it evolves from is destroyed in the process. As I represent the lower step, yes I am afraid. Natural Selection is nature selecting the more competitive life form. Nature isn't kind about this if earthquakes, asteroids, super novi, volcanoes taught you nothing.
Have you ever wonder why there is only one member of Homo genius on earth? We killed them all. Our species raped and murdered its way to dominance. We were faster, smarter, and better looking. We out hunted their lands until they starved, we stole any member we found attractive, and we killed them over berry patches and watering holes.
The difference is 5, 10 million years ago. Spears, Rocks, Fists, Feets were simple weapons. Today, we nerve gas, weaponized smallpox, atomic bombs. The best part is, most of those things will barely harm silicon based AI.
I have no reason to believe any other step in evolution would be any less violent then every single step before it. And as I represent the old, I know the point of that step will be rid nature of me.
If we consider that this new form (humans) has annihilated countless of species and might kill the entire planet soon, imagine what the next logical step in the evolution might be capable of.
Keeping it framed that way, do mice care that humans progress? Is it meaningful that something that "evolved" (or generically, was in some way created) from us succeeds?
In particular, if there are already other advanced races in the universe, is it actually meaningful that new advanced sentience that is wholly unlike us is added to that set of races, simply because of some historical connection to us?
Humans create AI, AI kills Humans.
The problem with creating something, is how do we know how it will judge its creator? The thought of creating another form of sentience scares me on a very deep philosophical level.