It's a valid feeling, I think what you should make sure of however is that he cares about meeting YOUR needs as a partner, whatever they are. If he can do that, and is considerate of you, it can work.

But if it's just YOU giving up all of your desires and feelings because it makes him happy, and you want to love him unconditionally, but he isn't doing the same for you, it's not fair or healthy.