Honestly the idea of measuring out whta I don't drink/eat and then trying to figure out the difference would drive me batty.
And really the calorie difference - if we're talking about skim milk - is negligible.
I would measure out what you put in your cereal, count that, and move on from there.
.