It really depends on your diet, it's just one of those small sacrifices you make when dieting but it does come back so until your done just do the best you can, i'm starting to experience the same exact thing. At this point i just go for a good pump which is also pretty tricky. It's all worth it though!