Chromosomes determine if u have a penis or a vagina. There are 2 possible combinations XX which will make u a female and XY which will make u a male. Hormones imballance is a illness.
Of course, then gene expresion leads to hormone release which determines gender. For example, estrogen leads to brain masculinization under fetal development.
