Sakai,
Yes, you have to go on your own. Don't let anyone else's attitude stop you from doing what you have to do.
About the weight difference. Many people weigh less in the mornings. One reason is that you haven't been eating all night--and so, your body has been burning stored energy to keep you alive.
When the body burns energy, it uses oxygen to convert sugars and other molecules (including fats) into carbon dioxide and water. So, in part, you're evaporating!

Seriously, you're losing mass in the air you breathe out. And water leaves the body in the form of vapor also. Plus, I'll bet that you pee first thing before you weigh--correct? Well, that's more weight gone. Remember, a half a cup of liquid is 8 ounces = half a pound.
Then, if you drink a couple of cups of water, coffee, tea, etc. you add liquid weight--and if you eat, the food weighs a certain amount. This goes on all day.
That's why to see real weight loss it's best to record your weight once a week, weighing at the same time of day.
Jay
Jay