It does not try to stay level, but it does counter the movement. Couldn't fly at all otherwise, every multicopter does this.
Some intentionally disable the PIDs when throttle is zero but then that has drawbacks, can't bring throttle to 0 in flight. Betaflight for example has Air Mode that you...