Stephen Wolfram proposed some similar ideas on this topic. Namely allowing "final ranking providers" and "constraint providers" to modify the final outputs of the algorithms, without requiring full-on transparent explainability

https://writings.stephenwolfram.com/2019/06/testifying-at-th...