Working with screen readers is not the only possible problem. It is not very good if you disable loading fonts, or if you disable CSS as well, or using a browser that does not load fonts, etc.
Clever trick, but not great for accessibility and screen readers.