It looks as though you have already gotten plenty of excellent advice on this subject (bravo, Schumeany!!) but I just wanted to throw in my $0.02 on the issue, since this is something that happens to me all the time, too! Like you, I am blessed with the "tall" gene (hehe!) - woohoo 5'8" - and I also find that I am simply not attracted to guys that are shorter than I am... I like 'em to be about 6'-6'2",
just the perfect height for me!

I'm not sure why, but I think some part of me associates a man's shortness with a "little kid" vibe, and I just can't get attracted to a guy who looks like a kid to me. Sure, that might sound a little harsh, but you really can't help what you're attracted to! It's like many people on here have said--there are plenty of guys for whom I might be the perfect woman, but they'd never give me a chance because they're not attracted to large women. Yes, it sucks for the person who's being rejected for that reason, but IMO physical attraction is a very important part of a relationship... No, certainly not THE most important thing, and if a guy came along who I thought had the perfect personality and everything else about him was right for me, but he just happened to be a few inches shorter--sure, I'd go for it, because his other stellar qualities would make him attractive to me. But it doesn't sound to me like this guy is really blowing you away in the other departments, either, or else maybe you'd be willing to overlook his height, too. So I have to echo what some other posters have said and tell you that I don't think he's the right one for you, heh.
As far as I see it, everyone has certain physical features/traits that they find more/less attractive, and there's very little that can be done to help that. It's just something in our wiring, ya know? We're allowed to be selective, aren't we?--looks DO matter, I know they do, because that's one of the biggest reasons why it's hard for me to find a man, LOL! It would be nice if everyone could just look past other people's exteriors and find every person in the world equally attractive, but they don't... And in some ways, that's what makes it all the more special when you manage to find someone who is right for you on the inside AND out. Anyone who tries to make you feel guilty for being aware of your tastes, or who pretends that we live in a world where ones appearance
isn't important, is deluding themselves.