from GP:

> Team Sky said that during a time trial stage bikes might be heavier to allow for better aerodynamic performance

(emphasis mine)

TDF time trials are almost never uphill. And yes, they have different bikes, showing that that while they might trade mass for drag during a time trial stage, they would do the opposite for hill climb stages. So "aero is the only thing that matters" is clearly false.