Well, for example, I was at a bus stop yesterday. It was only me and one other guy. I had my earbuds in. The guy tried to talk to me, but I refused to even look at him. After he gave up he lit a cigarette. Yuck.
Later one of the many losers who got on at the men's shelter sat next to me and tried to give me a religious tract. I still had my earbuds in. I was listening to "the Starless Sea" by Erin Morganstern which is wonderful. I said "what makes you think I want to talk to you?" He muttered something about how rude I was then changed his seat. I'll take that as a win.
You have more of a problem because your neighbor is your neighbor and not some rando. But anybody who comments on your weight, you can be as rude to that asshole as you want. You can just say, "I can't talk now. I have to finish mowing my lawn" or whatever. Besides, the language of ear bus should be universal.
Unless you borrow stuff from that guy, in which case you have more of a problem.