The banking to the left or right and diving into the ground is because of the immediately going vertical and stalling - it loses enough speed that it quits flying. So, why is it going vertical?
I'm assuming that your elevator is straight in the neutral position and you've checked for proper control directions - Up, elevator deflects up, Right, right aileron deflects up.
If you start at full throttle that could do it. Try getting a decent take off roll at half throttle or so then slowly increase until it takes off.
If it still goes vertical you may need to put a couple of washers behind the top mounting screws for the motor to give it some down thrust.
That's where I'd start.