Will not eating/drinking milk, ice cream and coffee help me lose weight?

I exercise every day for 30-60 min. I eat pretty healthy except for those things I just listed. If I stop eating/drinking milk, ice cream and coffee will I give my diet a head start?
I usually have 1 cup of milk a day, 1/2-1 cup of ice cream and a cup of coffee every day.
15 answers 15