At one time I used to be the most important person to him/her. But at some point, I became no more than a fleeting memory to them.
At one time I used to be the most important person to him/her. But at some point, I became no more than a fleeting memory to them.
At one time: かつては・昔は
at some point: ある時から・ある時点から
「邪魔な存在」の表現はfleeting memoryと意訳をしました。
fleetingは「儚い」というニュアンスでfleeting memoryと言うと「記憶から消えていく。」と言う意味になります。