Ooh, that's a tough situation. Have you talked to the whole crew? They might not mind a mealtime that gets moved up a little, which would make the timing aspect a bit easier on you. If that doesn't work, you might want to have a pre-meal snack while cooking; one poster here described eating raw veggies throughout her Christmas cooking and it kept her going without overdoing on calories.
Skinny people can eat healthful food too!

I think the key here is to have a couple of components that everyone can enjoy, then a few additions here and there for those who follow a different plan. For example, you might eat just falafel and salad, but others might eat their falafel with pita bread or kebabs. You might have chicken soup, they might eat it as chicken and dumplings or a chicken pie or serve it over rice. Steak night? You have yours with spinach and a baked sweet potato, they have theirs with white potatoes and creamed spinach.
I live in a household of two, not four, but the logistical problems of feeding people with different dietary preferences and habits still comes up. Our best solution is pretty much what I described above. That way my husband still gets the calories he needs and I don't exceed the calories I need.