I was the chubby Gay kid, so of course, I was bullied all thru public and high school... Things got better once I got to college...
BUT, it seems you live in a very small town because you kept crossing paths with people of your past... I live in NYC and never have crossed paths with anyone who bullied me in the past..
Most people speak from impulse, and will say things meant innocent enough BUT that come out wrong... If a person seems offended (which might elude you because you never intended to say anything wrong) it would be prudent to just apologize....But we all have OOPS moments.
You are correct that the hurt you are dealt and felt in your early years stays with you, but hopefully it made you a stronger, more caring and considerate human being.