The more you use a towel, the more it changes colour, so you become more attached to it.
tarnish は衣類などに対してあまり使わないのでこの場合は次のように言うと良いでしょう。
ーThe more you use a towel, the more it changes colour, so you become even more attached to it.
「タオルを使えば使うほど変色して愛着がわく」
to become attached to ... で「…に愛着がわく」
tarnish を使った例文:
My mother has some old silverware that has become quite tarnished over the years.
「母は年を重ねてかなり変色した古い銀器を持っている」
ご参考まで!