For me, I already have a hard time just answering the questions by saying either "yes" or "no".
Just trying to answer with a "yes" or a "no" is hard enough for me.
ご質問ありがとうございます。
① "For me,"=「私にとっては、」
"I already have a hard time"=「既に苦労しています」
"just answering the questions"=「質問に答えるだけで」
"by saying either "yes" or "no"."=「はい、かいいえと言うので。」
② "Just trying to answer with a "yes" or a "no" is hard enough for me."=「ただ、はい、又はいいえ、と答えるだけで十分大変です。」
ご参考までに。