First you have to define what you mean by growing.
1. The icecaps may be covering a larger area. That's one type of growth and it would show up quickly in aerial photos. But that growth fails to register the volume of ice/water contained in the glacier. Studies of valley glaciers in Alaska and the Yukon found that glacial movement was largely a process of the ice caps surging forward 10 to 200 yards or meters, but with a resulting 'thining' of the ice in the glacier. The forward movement wasn't from a build up in volume, it was related to the thickness of the glacier and the resistence of the surface beneath the glacier.
While the glacier looked bigger, i.e., longer, there was no additional water locked in the ice. In one sense, no net gain.
2. The ice caps could be covering the same area or a larger area, but with increased thickness. If this is the case, then there is more precipitation falling. But does that imply warmer or colder weather?
For those people living in the latitudes that experience changes from a warm season to a cold season, there is always the saying that "it's too cold to snow". While that has been 'scientifically proven" (for those who accept science), to be false, there is some reality. The likelihood of snow is greatest at temperatures near freezing. Water vapor is still available in the air, but it's cold enough to condense.
Siple Station in the Antarctic recevies over 300" (7.6 m) of snow a year, yet it's percipitation is less than 5" (13 cm) a year. It all blows in from other parts of the continent.
So you're question is not complete to justify a decision related to global warming.
a. The ice cap could be growing as the temperatures warm, producing more water vapor off the ocean, which then condenses as snow over the Antarctic.
b. There could be no global cooling or warming, the glaciers simply have thinned and spread outwardly.
c. The planet could be cooling and more water is being locked up as ice for what little water continues to condense over the continent.
In the words of Robby the Robot, It does not compute.