I see two questions in your post, zachor_ve_kavod:
1. What do you have a greater desire for, that the evil be punished or that the good be rewarded?
2. Is it more important in this world to bring the perpetrators to justice, or is it more important to take care of the victims?
1. This is a more global aspect. Indeed, it's not an easy question.
Our Sages ask: why did G-d create the world? What is the reason of its existence? They answer, to give the righteous reward in the World To Come. To give people the opportunity to do good to earn the World to Come. So if G-d says the reward for the righteous is the most important, then it is really so.
2. This is a more specific case. Here I completely agree with republicandox:
The United States & Russia did not liberate the Jews from the death camps in Europe until they dealt with the perpetrators ( Nazis ) first.
In order to save people ( victims ) we must remove ( perpetrators ) first, otherwise we may end up being victims too.
Of cousre, in case it's possible to do these two things in parallel, it should be done so.
Doesn't G-d say that vengenace is His?? So, that answers that q.
On the other hand, G-d says "You shall eradicate the evil from your place"..
So the justice must be done but not to satisfy the desire for vengeance (though sometimes it's hard to resist to it), but to remove the evil so it won't threaten the other people and to educate other potential perpetrators of the consequences of doing evil.