Elderly people constitute a major portion of world's population. Many of them are physically and mentally vulnerable and need continuous support for their health and well-being. There is a growing trend that these elderly people are placed in an ambient assisted living environment (AAL) with an aim to receive better care and support. In such settings, a lot of attention has been given to continuous health monitoring for maintaining physical health status. However, much less attention has been given toward understanding the entertainment needs of the elderly people, which is an important factor relevant to their mental health and joyful living. This paper thus addresses the entertainment needs of the elderly and proposes a framework of an elderly entertainment support system. The proposed framework enables different categories of residents (e.g., elderly people and caregivers) to access various media services in both implicit and explicit manner in order to enhance the quality of their living experience in different contexts. Our experimental results demonstrate the viability of the proposed framework. We believe that the proposed approach will establish the need to develop entertainment systems and services for the elderly people and allow us to sensibly address the problems associated with their independent, happy and active living.