Our boat will turn off course if the wheel is left alone, too.
No real strain for our AP, and it makes little one and two degree corrections all the time. Wake stays pretty straight, tho.
As mentioned, it seems to be a function of prop rotation direction. More pronounced for fin keel designs and much less noticeable for long keels like Island Packets (to name just one example).
Kind of a trade off for sailing efficiency and maneuvering capability vs. tendency to go straight when the helm is unattended.
I have done several long deliveries on a long-keel Willard 30 cutter "nine ton" with its loooong shallow keel and prop in an aperture, and the running joke was that when turning the boat you turn the wheel and the boat "will take a message and get back to you!"
Everything really is a compromise....
Cheers,
Loren