Activins and inhibins are often antagonistic in the regulation of ovarian function. TGFbeta type III receptor, betaglycan, has been identified as a coreceptor to enhance the binding of inhibins to activin type II receptor and thus to prevent the binding of activins to their receptor. In this study we characterized the expression and regulation pattern of betaglycan gene in normal ovaries and sex cord-stromal tumors and in cultured human granulosa-luteal cells from women undergoing in vitro fertilization. Expression of betaglycan mRNA was detected by RT-PCR or Northern blotting in normal ovarian granulosa, thecal, and stroma cells as well as in granulosa-luteal cells. Immunohistochemical analysis revealed positive staining for betaglycan in antral and preovulatory follicular granulosa and thecal cells and in corpora lutea of normal ovaries. Furthermore, betaglycan expression was detected in the vast majority of granulosa cell tumors, thecomas, and fibromas, with weaker staining in granulosa cell tumors compared with fibrothecomas. In cultured granulosa-luteal cells, FSH and LH treatment increased dose-dependently the accumulation of betaglycan mRNA, as did the protein kinase A activator dibutyryl cAMP and the protein kinase C inhibitor staurosporine. In contrast, the protein kinase C activator 12-O-tetradecanoyl phorbol 13-acetate had no significant effect on betaglycan mRNA levels. Treatment with prostaglandin E(2) and with its receptor EP2 subtype agonist butaprost increased betaglycan mRNA accumulation and progesterone secretion dose- and time-dependently. In summary, betaglycan gene is expressed in normal human ovarian steroidogenic cells and sex cord-stromal ovarian tumors. The accumulation of its mRNA in cultured granulosa-luteal cells is up-regulated by gonadotropins and prostaglandin E(2), probably via the protein kinase A pathway. The specific expression and regulation pattern of betaglycan gene may be related to the functional antagonism of inhibins to activin signal transduction in human ovaries.