U-processes and preference learning

Neural Comput. 2014 Dec;26(12):2896-924. doi: 10.1162/NECO_a_00674. Epub 2014 Sep 23.

Abstract

Preference learning has caused great attention in machining learning. In this letter we propose a learning framework for pairwise loss based on empirical risk minimization of U-processes via Rademacher complexity. We first establish a uniform version of Bernstein inequality of U-processes of degree 2 via the entropy methods. Then we estimate the bound of the excess risk by using the Bernstein inequality and peeling skills. Finally, we apply the excess risk bound to the pairwise preference and derive the convergence rates of pairwise preference learning algorithms with squared loss and indicator loss by using the empirical risk minimization with respect to U-processes.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Algorithms*
  • Artificial Intelligence*
  • Computer Simulation
  • Entropy
  • Humans
  • Learning / physiology*
  • Pattern Recognition, Automated