The police charged him not with forgery but with stealing one yen.
He was charged by the police with stealing one yen and not with forgery.
こんにちは。
2つの言い方を紹介します。ほぼ同じ意味ですが。
1つ目は質問の直訳になります。「The police charged him not with forgery but with stealing one yen」ー 「警察は彼を偽札作りでなく1円を猫糞した罪で処罰した」
2つ目の文書は言葉使いは微妙に違います。
He was charged by the police with stealing one yen and not with forgery ー 「彼は偽札作りではなく、1円を盗んだ罪で警察に処罰された」
Forgery ー 偽造
Charge with のほかに to accuse of という言い方でもいいと思います。
The police accused him (he was accused) of stealing - 「警察は彼を窃盗罪で処罰した」