I agree with AlmostMe. You can adjust most gym ellipticals to a less strenuous program so that you can build up stamina.
In any case, though, I wouldn't worry about what others at the gym think. I often do just 5 minutes on the elliptical, 5 minutes on the treadmill, 5 minutes on the bike, 5 minutes on the stair mill, etc., to mix it up & prevent boredom. Most people are just focusing on their workout or their music or whatever and not paying attention to those around them.
Clothes Sizes (not lbs):