Ok, chances are you didn't build muscle in the week you started exercising, but your body is probably holding onto water weight. Try to keep track of your measurements and see if you notice any changes.
If you stick to it then the weight will come off! Just be aware that you will likely not lose weight every week. So don't look for a day to day or week to week drop, but rather an overall downward trend