The conserved oligomeric Golgi (COG) complex is thought to function in intra-Golgi retrograde trafficking mediated by coat protein I vesicles, a pathway essential for the proper structure and function of the Golgi apparatus. Previous work suggested that COG might act as a tethering factor to mediate the initial attachment between coat protein I vesicles and Golgi membranes. Here, we present extensive in vitro co-translation and immunoprecipitation experiments leading to a new model for the overall architecture of the mammalian COG complex. The eight COG subunits (Cog1-8) are found to form two heterotrimeric subassemblies (Cog2/3/4 and Cog5/6/7) linked by a heterodimer composed of the remaining subunits (Cog1/8). This model is in excellent agreement with in vivo data presented in an accompanying paper (Oka, T., Vasile, E., Penman, M., Novina, C. D., Dykxhoorn, D. M., Ungar, D., Hughson, F. M., and Krieger, M. (2005) J. Biol. Chem. 280, 32736-32745).