It really depends. If you're born 5'5 no matter how much you practice you aren't going to be a great athlete more than likely so genetics and "natural talent" will play a bigger factor in that sense. There are other things not based on genetics that can be practiced and I do think will out perform natural talent.
Short people can still do sports though bro. I've seen it. Gymnastics, horse racing (jockeys), martial arts (judo, BJJ, wrestling), weightlifting, diving, and soccer (especially wing/midfield positions).