Hail Mary, Value Porosity, and Utility Diversication
Nick Bostrom · 2014
This paper introduces some new ideas related to the challenge of endowing a hypothetical future superintelligent AI with values that would cause it to act in ways that are benecial. Since candidates for rst-best solutions to this problem (e.g. coherent extrapolated volition) may be very dicult to implement, it is worth also looking for less-ideal solutions that may be more easily implementable, such as the Hail Mary approach. Here I introduce a novel concept|value porosity|for implementing a Hail Mary pass. I also discuss a possibly wider role of utility diversication in tackling the value-loading problem.