Sortilin is a multiligand sorting receptor responsible for the anterograde transport of lysosomal enzymes and substrates. Here we demonstrate that sortilin is also involved in retrograde protein traffic. In cultured 3T3-L1 adipocytes, sortilin together with retromer rescues Glut4 from degradation in lysosomes and retrieves it to the TGN, where insulin-responsive vesicles are formed. Mechanistically, the luminal Vps10p domain of sortilin interacts with the first luminal loop of Glut4, and the cytoplasmic tail of sortilin binds to retromer. Ablation of the retromer does not affect insulin signaling but decreases the stability of sortilin and Glut4 and blocks their entry into the small vesicular carriers. As a result, Glut4 cannot reach the insulin-responsive compartment, and insulin-stimulated glucose uptake in adipocytes is suppressed. We suggest that sortilin- and retromer-mediated Glut4 retrieval from endosomes may represent a step in the Glut4 pathway vulnerable to the development of insulin resistance and diabetes.