In pessimistic scenarios, the failure of (1) will likely be a important indicator that AI safety is insoluble and (two) will be the factor that makes it doable to convincingly demonstrate this to Other people. Then These are wonderful-tuned in myriad strategies, a few of which most likely have surprising unintended penalties. Because the fantast