Web-based consumer health information portals are on the increase. With such a large number of health related sites available, design and information quality are key concerns. This article provides an evaluation framework based on the work of Slack (2001) and the HONcode guidelines. Research shows that greater transparency is needed with regard to how rating instruments are constructed and validated. The consumer health portal index developed in this research has been tested for face and content validity through a series of focus groups following Sullivan's 5 step process.