The occurrence of oligomannose-specific broadly neutralizing antibodies (bnAbs) has spurred efforts to develop immunogens that can elicit similar antibodies. Here, we report on the antigenicity and immunogenicity of a CRM197-conjugate of a previously reported oligomannose mimetic. Oligomannose-specific bnAbs that are less dependent on interactions with the HIV envelope protein sequence showed strong binding to the glycoconjugates, with affinities approximating those reported for their cognate epitope. The glycoconjugate is also recognized by inferred germline precursors of oligomannose-specific bnAbs, albeit with the expected low avidity, supporting its potential as an immunogen. Immunization of human-antibody transgenic mice revealed that only a TLR4-stimulating adjuvant formulation resulted in antibodies able to bind a panel of recombinant HIV trimers. These antibodies bound at relatively modest levels, possibly explaining their inability to neutralize HIV infectivity. Nevertheless, these findings contribute further to understanding conditions for eliciting HIV-cross-reactive oligomannose-specific antibodies and inform on next steps for improving on the elicited response.