> How can you possibly begin to discuss AI Ethics if you have no idea how it works or what's -realistically- possible?
What matters for ethics is the effects things have on people. You generally don't have to know how something works in order to understand what effects it has--someone who does understand how it works can figure that out and tell you.
For example, if you had to decide between on the ethics of using a nuclear weapon and using conventional weapons to destroy some legitimate military target you wouldn't need to know anything about the physics of nuclear weapons.
All you'd need to know about the nuke is how powerful it is, the long term illnesses it can cause, how it can affect people far away from the blast, how it can make the area unsafe for humans for a long time, and so on. To decide the ethical issues you are concerned with what happens, not how it happens.
If we ever get to general AI, and are dealing with ethical questions like whether it is murder to restore a robot to factory settings, whether it is slavery to own a robot, or whether a robot can own property then we will probably need ethicists who are also AI experts.
And then you’re dependent on experts to tell you that information.
In this case “using a nuclear weapon” is easier to reason about for a non expert. What about “using nuclear technology for renewable energy”? If the person doesn’t really understand the pros and cons of this by nature of being a ___domain expert, they’re just relying on whatever information they may have (incorrectly) learned or been indoctrinated about.
Otherwise smart ethics people may make stupid decisions because they think they understand what they’re talking about, but actually do not.
Just take existing ___domain experts and train them in ethics.
What matters for ethics is the effects things have on people. You generally don't have to know how something works in order to understand what effects it has--someone who does understand how it works can figure that out and tell you.
For example, if you had to decide between on the ethics of using a nuclear weapon and using conventional weapons to destroy some legitimate military target you wouldn't need to know anything about the physics of nuclear weapons.
All you'd need to know about the nuke is how powerful it is, the long term illnesses it can cause, how it can affect people far away from the blast, how it can make the area unsafe for humans for a long time, and so on. To decide the ethical issues you are concerned with what happens, not how it happens.
If we ever get to general AI, and are dealing with ethical questions like whether it is murder to restore a robot to factory settings, whether it is slavery to own a robot, or whether a robot can own property then we will probably need ethicists who are also AI experts.