same here. at the tallest on my side of the family is 6' or maybe 6'1". His mom's side they're not tall, his dad's side they are. DH is 1/2" taller than his dad too. Even the women are pretty tall.
Scary thing is, there's a shortening trend on my side!

My grandma never grew taller than my great-grandma, my mom never grew taller than grandma, and I never grew taller than my mom!