I've heard it said that "A calorie is a calorie." Some people I know have had short-term success with eating one large meal a day, as long as it was creating a calorie deficit.
The down side to it is that it may slow your metabolism. They key to 5-6 small meals a day is that your metabolism is constantly burning calories each time you eat smaller calorie meals/snacks.
I've noticed something similar to what you describe - I eat light during the day because i'm busy at work. When I get home is when I have a high calorie meal. my issue is that I have to incorporate exercise back into my schedule.
So, is it ok? I would say as long as you're eating within your caloric limit and exercising - then see how it goes.
Good luck!