Just because you "cut calories" doesn't mean you're cutting out the right thing.
If you're still eating fatty foods and drinking sugary drinks (ie: sodas), just because you cut 200 calories from your diet isn't going to do anything.
Also, if you're just being sedentary (sitting around all day, not getting up and getting any exorcise), it's not going to help either.
Age does play a factor as well. If you're still under 30, your metabolism can process the sugars and such faster. Well into your 30s though, you have to work harder (you can't keep eating pizza and cheeseburgers all the time).
This is from personal experience. Up until I was in my 30s, I had way too much soda in my diet and ate out a lot, and maybe only added a few pounds each year. But by the time I hit 35, the gain was tad bit more noticeable.
Found out I had the onset of fatty liver and gradually started a major diet change. After cutting out soda and such, on top of my normal 3 times a week working out, I saw some weight loss. (Though admittedly, where I thought I was cutting back, I later realized I was almost starving myself, and ended up crash dieting ... which REALLY did not help me at the time .... )
Starving yourself though isn't a good idea. While it might shave off 5-10 pounds "quickly", it will mess with your head and body, and the weight loss rarely stays gone.