HIV-1 Nef protein down-regulates several important immunoreceptors through interactions with components of the intracellular sorting machinery. Nef expression is also known to induce modifications of the endocytic pathway. Here, we analyzed the effects of Nef on retrograde transport, from the plasma membrane to the endoplasmic reticulum using Shiga toxin B-subunit (STxB). Nef expression inhibited access of STxB to the endoplasmic reticulum, but did not modify the surface expression level of STxB receptor, Gb3, nor its internalization rate as measured with a newly developed assay. Mutation of the myristoylation site or of a di-leucine motif of Nef involved in the interaction with the clathrin adaptor complexes AP1 and AP2 abolished the inhibition of retrograde transport. In contrast, mutations of Nef motifs known to interact with PACS-1, beta COP or a subunit of the v-ATPase did not modify the inhibitory activity of Nef on retrograde transport. Ultrastructural analysis revealed that Nef was present in clusters located on endosomal or Golgi membranes together with internalized STxB. Furthermore, in strongly Nef-expressing cells, STxB accumulated in endosomal structures that labeled with AP1. Our observations show that Nef perturbs retrograde transport between the early endosome and the endoplasmic reticulum. The potential transport steps targeted by Nef are discussed.