I really enjoy being tall - but fat and tall I feel like a giant. At times if I'm out with a gaggle of 5'0" - 5'2" friends I'll make a comment like "Well I feel like I'm chaperoning an elementary school field trip". I literally have to lean over to hear them! That drives me nuts. But given the choice, I'd stay tall.
That said, I love being called "cute".. it's happened once, and was more in comment to my personality/the situation, but I still wouldn't mind it more often.
And typically I don't pay much attention to other people's height unless they are so short I have to constantly lean over to talk to them, or they're taller than me. The latter because it's rare-ish so that is the distinguishing feature I remember ('holy crap, I'm looking up at someone!'

) But it's not in a negative/judgmental way, more of an appreciative mental note.
Edited to add - UG! I totally relate to the "Friends talking about size 12 with horror" statement. I remember in college I had a friend talking about OH MY GOD so n so is a Size 12 (on the phone). Well, the chick was my height and looked amazing / slender, so in some ways that made me feel better (I was a 14), but the shock of the "Size 12" number to some people has stuck with me.