Here's my question did it bother you before your family and friends brought it up? Why is this only bothering you now, after you've paid this for a few years?
I think the most important thing it life is to discuss issues in a relationship with each other directly. Talk to him if it bothers you. He's not a stranger he's your boyfriend. Hearing the opinion of every one else on what they do might just confuse you on what you want.
This isn't maybe because you're confused on where the relationship stands because you want the relationship to move forward?