In fish, spermatogenesis and somatic growth are mainly regulated by hypothalamic-pituitary-gonadal (HPG) and hypothalamic-pituitary-somatic (HPS) axes, respectively. Xenoestrogens have been reported to impair spermatogenesis in some fishes, and arrest somatic growth in some others, whereas, whether xenoestrogens are capable of disrupting spermatogenesis and somatic growth simultaneously in fish that exhibits sexual dimorphic growth is little known, and the underlying mechanisms remain poorly understood. In this study, male juveniles of yellow catfish (Pelteobagrus fulvidraco), which exhibits a sexual dimorphic growth that favors males, were exposed to diethylstilbestrol (DES) for 28 days. After exposure, DES significantly disrupted the spermatogenesis (decreased gonadal-somatic index (GSI) and germ cell number) and arrested the somatic growth (declined body weight) of the catfish juveniles. Gene expression and plasma steroid analyses demonstrated the suppressed mRNA levels of genes in HPG axis (gnrh-II, fshβ, and lhβ in the brain and dmrt1, sf1, fshr, cyp17a1, cyp19a1a, and cyp11b2 in the testis) and decreased 17β-estrodial (E2) and 11-ketotestosterone (11-KT) levels in plasma. Further analysis revealed the arrested germ cell proliferation (cyclin d1), meiosis (dmc1, sycp3), and enhanced apoptosis (decreased bcl-2 and elevated bax/bcl-2 ratio) in the testis. Besides, DES also suppressed the mRNA levels of genes in HPS axis (ghrh, gh, and prl in the brain and ghr, igf1, igf2a, and igf2b in the liver). The suppressed HPG and HPS axes were thus supposed to disturb spermatogenesis and arrest somatic growth in yellow catfish. The present study greatly extended our understanding on the mechanisms underlying the toxicity of DES on spermatogenesis and somatic growth of fish.