You give people the wrong idea about him when you say things like that.
「人聞きが悪い」は、
You make 人 look bad by saying 〜. や
You give people the wrong idea about him when you say things like that.
などと言えると思います。
例）You make her look bad saying she's fat. She's not fat, just a little round/chubby.
「彼女が太ってるなんて人聞きが悪い。太ってるんじゃなくてふくよかなのよ。」
例）You give people the wrong idea about him when you say things like that.
「彼のことそんな風に言って、人聞きが悪いわよ。」
ご参考になれば幸いです！
日本 
