Accurate assessment of severity of viral respiratory illnesses (VRIs) allows early interventions to prevent morbidity and mortality in young children. This paper proposes a novel imaging biomarker framework with chest X-ray image for assessing VRI's severity in infants, developed specifically to meet the distinct challenges for pediatric population. The proposed framework integrates three novel technical contributions: a) lung segmentation using weighted partitioned active shape model, b) obtrusive object removal using graph cut segmentation with asymmetry constraint, and c) severity quantification using information-theoretic heterogeneity measures. This paper presents our pilot experimental results with a dataset of 148 images and the ground-truth severity scores given by a board-certified pediatric pulmonologist, demonstrating the effectiveness and clinical relevance of the presented framework.