"If we must remember offenses, let us remember only our own. And if we remember our own sins, we shall never store up the sins of others." St. John Chrysostom

In remembering the sins of others, it is an attempt to hide from our own sins. As Jesus implied it is easier to see the speck in another's eye but failed to acknowledge the plank in our own. Dealing with our own sins is a full time job, for they are many. God will hold me accountable for my sins.  If God asks us to deal with the sins of others, he wants us to do so, not in condemnation, but in love and humility, as he manifested in the scriptures. He didn't condemn the adulterous but invited her to repentance and a change of life. But first start with our own sinfulness before we deal with others.