How much more weight did you expect to lose is 2 weeks? To be honest, 4 pounds is a great, healthy, sustainable loss for 2 weeks.
In 2 years you could be at goal or you could be where you are today or higher. It is your choice. Do you want to be healthier, happier, stronger, in better shape (and weigh less)? If so, please continue on plan.
You are doing AWESOME if you have lost 4 pounds in 2 weeks!!!