I'm so sorry to hear you feeling that way about yourself, and sorry that you had to survive abuse of any kind.
I think it might help to just remind yourself -- because if you think this about you, you honestly probably DO also think it about others, which will inform your own judgment of yourself in this way -- that someone having had sex outside any kind of commitment or ongoing relationship doesn't assign them a value of any kind, including a value or lack of value as someone with whom to enter into an ongoing intimate relationship with.
You have not ruined your chances because of that unless that's how you or this person think, in other words. If you or someone else think the way I do up there about value and all this, it's a non-issue.
Heck, it can sometimes even be a thing that inclines someone to seek out a relationship more because they had an intimate experience with you already with sex, and now know they want to explore more kinds of intimacy with you. Since it sounds like you had a great time, changes are good he did, too, so it sure wouldn't be surprising if he -- like you -- DID want to see more of you.
You're good enough -- of course you are -- and this sounds like something you really want, and also have had at least some experience that suggests could be a really great thing for you. So, what help do you need to go ahead and make contact with him again to seek and pursue what you really want here? Can we help? Cheering minion GIFs, maybe, or letting you know you can pop back here to vent or whatever if you on't get the kind of response you wanted, or...?