25 pounds since April is really good!
In your shoes, I'd probably try increasing my calories. Sure, it'll slow the rate you lose but if it helps reduce the feelings of deprivation and cravings, that would be worth it for me. There's the chance that it won't help, but I'd first try that route.
I think a counselor could probably help too, if you have access to one.
I don't think there's anything inherently wrong with junk food every day, especially if it helps you stay on track the majority of the time. Eliminating it might reduce cravings but, as you said, could also do more harm than good by triggering a binge. Consuming it though does displace other foods that could be more filling. This brings me back to earlier: I'd keep what you're eating and add in another 100 or so calories of filling food, like protein and/or fiber etc (whatever works best for you).
Just my two cents. I hope you find something that works for you soon.