Dwarfism tends too have certain features larger than others. A torso which is average adult size and short legs, or a full size adult head, and tiny torso, average leg length, so a dwarf might have a 10 inch penis or maybe an acorn (same as any other adult)
A miidget, tends to be small featured all over and proportionate, a miniature of a giant. The midget may have a very tiny penis or a larger than expected penis (same as any other adult), although it's more likely to be small, even if his dad is average size.
dwarfs and midgets and giants are the same as all other people depending on genetics and the graces of nature for genital size and for the females for the breast size as well.
Just like a man who is 5'5" can have a penis measuring 9"X7", and a 6'5" man can have a penis measuring 4"x4" and a 4'10 lady can have a 36DD breast size or a 6'1" woman can be nearly flat chested, genetics play a large role on everything.
Whether a large or even average penis might hurt a female dwarf or midget would depend on the depth and overall size of her vagina, same as with any woman.