MIRI???s primary concern about self-improving AI isn???t so much that it might be created by ???bad??? actors rather than ???good??? actors in the global sphere; rather most of our concern is in remedying the situation in which no one knows at all how to create a self-modifying AI with known, stable preferences. (This is why we see the main problem in terms of doing research and encouraging others