Am I the problem???

I’m not really looking to be told what to do exactly but just I’m hoping for some thought on weather or not I’m overreacting… my husband from the beginning wasn’t excited for this pregnancy. He originally thought it would be best for me to have an abortion. He yelled at me a lot in the beginning of the pregnancy, about a lot of random things. One thing we consistently argued about was how much marijuana he smoked. I was always uncomfortable with it because of the way it made him act. Lazy, driving dangerously because he was stoned and he was looking for a new job and most drug test upon hiring and I was concerned about his ability to get a better job. I’ve never smoked personally. One night we were at a family event and staying the night with family and he was smoking more than I had ever seen before and I confronted him. He lost his mind stormed out of the house and said he was sleeping outside, when I followed him out he told me he would never stop and threatened if I didn’t leave him alone he would hit me. He never did but I didn’t stop thinking about it. I was about 8 weeks along at this point. I wish I could just forget about this but I can’t. After this he had a few more really bad outbursts. I was dealing with HORRIBLE morning sickness in the first 12 weeks and one weekend he wanted us to go out with friends, and I told him I really didn’t feel up to it as I had been sick most the night and hadn’t been able to eat much in a couple days so I was really weak and couldn’t handle an entire day out/eating in a restaurant as smells made it SO bad. He lost his mind again, told me I was a shitty wife, told me to give him back his great grandmothers wedding ring he married me with so he could save it for someone he loved and that he was done. Yelled at me about some more random things and I eventually locked myself in the room because I was panicking. He eventually apologized and cooled down but I never really forgot about this. The last time he lost it was when we moved. I am in the process of getting my greencard so I haven’t been able to work for a while, we are living off his income currently. I am an accountant and plan to work immediately after getting my greencard. I spent a little money on some maternity clothes for myself and my anti nausea prescriptions (no more than $80) and he seen it on our bank account and told me he was removing me from his bank account and he would be filing for a divorce because I am running him dry. He told me “I will pay for you to get an abortion and buy you a plane ticket to leave” he yelled about some more small things and took me to the ATM so I could withdraw money from my personal Canadian bank account to reimburse him and once we got home I began packing my things to leave. He told me not to and apologized. I cried and tried to move on from it. I still think about these times. He’s still not very affectionate, sometimes he turns over in bed without saying goodnight and when I ask him if we could cuddle or if he could kiss me goodnight he yells at me and tells me I don’t respect him and that he has to get up early for work. He didn’t come to any OB appointments up until recently (my 34 week appointment) he doesn’t make an effort to do anything special for me, he doesn’t help me much, and when he does get a day off he doesn’t spend it with me which hurts because I don’t have anyone here and I wish we had more memories together during the pregnancy. Am I overreacting? I just can’t help but think I am doing something wrong.