I do wonder if some of your sensitivity is from the vertical flexibility of those thin tail booms.
Any elevator input will alter the force generated on the tail plane which if you think about it will cause a change in tail incidence that will tend to counter the elevator effect. Only when you apply a significant elevator input will boom stiffness come into play so giving a rather "delayed" elevator feel.
I note that on the full size Vampire the booms are not circular but oval, and even more so on the bigger heavier Sea Vixen, so are stiffer vertically than horizontally.
My Depron Venom with scale section tail booms built up in Depron are flexible enough to give this effect. particularly if flying fast when you expect the elevator to be more rather than less effective!
I know that "nearly lost it" sensation quite well.