All the evidence I have seen regarding penis size and genetics is anecdotal. I'm not convinced that there is any genetic determinant for penis size.
It would be close to impossible to do a well-conducted, controlled study. For any research in that area to have any validity at all, the researcher would have to keep records on every male in a family (including both the maternal and paternal branches) for several generations, and with a broad sample of families. Keeping a record of all penises in 100 families over 4 generations would be a daunting task - and even at that, 100 families is a fairly small sample.