No necessarily. It depends on what you're eating. As long as what you're eating is nutritious, what you're really doing is supplying the nutrients with food while your body fat is supplying the energy you need. As long as you are active and don't feel lethargic or cold, then your metabolism is probably still going strong. Once in a while, say every few days or so, add in a whack of good carbs like sweet potato or squash and basically eat until you aren't hungry.
The worst thing in my diet is rice/pasta. I can't get away from it. I always make sure I eat tons of veggies and meat with lunch/dinner, and sometimes breakfast depending on day of the week and wether or not I have time in the morning. After I lift I will have a double serving of meat. Snacks consist of fruits, nuts, and grains. Sometimes I will snack on homemade beef jerky. Always get in my 3-4 liters of water.
No soda, no dairy, no candy, no fast food. I give myself one cheat meal a week, usually I will go out with my wife and get take out chinese food. Occasionally if I have a huge surplus of calories or my sweet tooth is raging I will have a soy ice cream sandwich, or something similar. Everything in moderation though.