Yeah this is kind of awkward, the exhaustion penalties don't update unless it moves from one threshold to another, it doesnt factor in dynamically changing thresholds due to rage, Aura of Vitality & other short.duration constitution buffs.
Can't wait for it to do the checks based on what it currently is rather than update only if the spectrum would change on that check