This paper deals with stochastic stability of systems with Markovian jumps and Brownian motion. Mainly, we present sufficient conditions for quadratic stabilization of Ito type stochastic linear and nonlinear systems with Markovian jumps and Brownian motion using state feedback control. We also prove the guaranteed cost property of the proposed control strategy for the linear case.