I don't think anyone is 'upset'. I think it is just some good nutured ribbing, thats all. Maybe this isn't the right forum for it though. Maybe someone will start a 'good natured ribbing' fellowship? Or is there already one somewhere?
I think that everyone should do something for the benefit of someone else, that they do not know you did, everyday. I think some take umbrage of, and get suspicious of the motives, of someone who pats themselves on their own back, for their charity work.
If it is only that persons perception.... then no harm, just ignore them...but becoming defensive, only makes one look that much more guilty of the charge.
Being right needs no defense!