Some people lose a lot the first week because they had a high sodium content in their previous way of eating (and they were retaining a lot of water). You probably didn't, and those 3 pounds you lost are fat, and not water.
You are off to a GREAT start, and NEVER compare your weight loss with others (especially men), it can be discouraging. We all lose at different rates
Much luck and much strength