removing tail waggle

I like to create my own designs and some times my 4 channel planes (aileron , elevator , rudder throttle ) have a slight bit of side to side tail waggle or i suppose you might call it yaw waggle. also i find with my flying wing designs if i use winglets i get the waggle if its a bit windy but...