Attention is a central process of cognition and influences the execution of daily tasks. In humans, different types of work require different attentional skills and sport performance is associated with the ability to attention shift. Attention towards humans varies in dogs used for different types of work. Whether this variation is due to the recruitment of individuals suitable for specific types of work, or to the characteristics of the work, remains unclear. In the present study, we hypothesized that domestic horses (Equus caballus) trained for different types of work would also demonstrate different attentional characteristics but we also explored other possible factors of influence such as age, sex and breed. We exposed more than sixty horses, working in 4 different disciplines, and living in two types of housing conditions, to a visual attention test (VAT) performed in the home environment. Individual attentional characteristics in the test were not significantly influenced by age, sex, breed or conditions of life but were strongly related to the type of work. Riding school horses showed longer sequences and less fragmented attention than all other horses, including sport horses living in the same conditions. Interestingly, sport performance was correlated with attention fragmentation during the test in eventing horses, which may need more attention shifting during the competitions. Working conditions may influence attention characteristics indirectly through welfare, or directly through selection and training. Our study opens new lines of thought on the determinants of animal cognition and its plasticity and constitutes a further step towards understanding the interrelationship between working conditions and cognition.