Impossible? No. Potentially damaging? Absolutely.
Less Stable? Not at all. So long as the motors aren't being strained, yet have a high enough RPM to respond to changes, the stability will depend more on the flight control board (FCB) and ESCs-- there is a tendency of longer prop -> greater stability, but that doesn't make getting a clean image impossible at all. It will increase the agility of the platform, but the increased responsiveness can be managed in the chosen FCB. On the flip side, the higher voltage pack can give you longer flight times and larger cargo capacity (those two trade between each other).
The higher RPM will work against you in vibrations (which leads to Jello), but every rotorcraft will vibrate, even when you do your best to clean it up. You will have to have some form of vibration isolation on your camera in either case.
Are these motors inappropriate for AP? No. Are there motors better suited? Sure, but these are good middle-ground motors for a medium sized quad -- capable of being pushed aerobatically on a light-but-large platform, but equally capable of a modestly heavy lift. Your FCB and ESCs will play more into this than this motor/prop combo.
I suppose my overall point is don't expect clean video out of your maiden flight (although I recommend you don't maiden with camera gear anyway) -- your first few AP videos will look terrible. They might look amazing to you at the time -- that's great -- but looking back you'll see how far you'll come. Improve the tuning on your FCB, continue to reduce vibrations, and continue to improve isolation. Every positive step you make the video gets just that much cleaner.