Guilt settling in

So I'm 20F and tried sugar for the first time. He's 39M and married. I've known him for years. He treats me like a absolute princess and I'm in love not literally lol. But he took me on a couple dates then asked if I would go to Florida with him for a few days, I did. After that idk what set in but it was like guilt that I'm going out with a married man and he's sugaring me. This is my first time ever doing something like this, is this just normal and I should get over? Cause sometimes I really do feel bad about this.