Well they actually don't change that much length wise regardless of s,m,l etc. I got the small and they fit me with loads of room in the waist (I'm 34" waist, 5ft 8" tall).
If you are very tall any of them might look a little 'half mast' but other wise go for the small or medium