That's exactly correct, yeah.
Now, as to your AC not changing if you somehow drop your skill to 19 from 25, that's something different. Maybe a bug, maybe just part of how the system chooses when to recalculate your Parry AC. You'd expect to lose 2 AC to that, but it's possible it doesn't change until you change gear or apply a buff.