I live with me ex, he treats me like ****, how do I leave?

He's always putting me down, and making me feel like I'm a horrible person. We've been living together for 5 months apart. I've met someone new, naturally my ex hates him. My new boyfriend's been there for me and is helping me see how much I've been letting my ex walk all over me. I drive him places, keep the apartment clean. He never does ****. He also tells me who I "can't" hang out with, and things I "can't" do, like smoking. If he were to catch me smoking/spending time with someone he hates/going against his wants he'd yell, call me names, and make my life hell. He's ALWAYS yelling and putting me down. I've thought if leaving but every time I do he will break down and beg me not to leave him. I still love him so much and cannot say no. I suck at confronting him. When I do he yells and puts me down. I don't know what to do. I want to leave for school in September with my new boyfriend. How can I do about this without getting emotionally beaten, my new boyfriend physically beaten, or my car keyed. Thanks.