Can't the IMU sense if you are generating lift (or not)?
So if you're falling quickly the airflow comes from "below" which causes a high angle of attack even if the nose is pointing level compared to the horizon.
I wonder if it's possible to estimate the local air speed based on ground speed (GPS) and local weather data (can we measure wind speed at altitude?).