It's easy to lose control of your ship, but the quickest way to regain control is not to hold down on your thrusters, but to tap the thrusters so that you can make slower movements. The slower movements make it a lot easier to get control of your ship and not fly off to the side or spin out of control.