> I don't understand why people think that it matters whether AI is conscious or not

Exactly. Ethically important, we don't want to cause suffering. But danger? What special risk does consciousness bring to the table?