The skipping lunch might have something to do with it, yes. An iced latte isn't really a meal, especially if it's made with skimmed milk.
What did you have for dinner? (What items, and what portion sizes?) Maybe it's not actually as big as it seemed, you know?