A great passage from Lenny Goldberg's book "The Wit And Wisdom Of Rabbi Meir Kahane" that I thought was relevant in light of some recent posts;
Rabbi Kahane's movement both in America and Israel was often filled with all kinds of weirdos. Being an anti-establishment, rebel movement, it often attracted "rebel" and unstable types, who were sometimes prone to rebel against the Rabbi himself. Many well-meaning Jews disassociated themselves with his movement not for idealogical reasons, but because of the "crazies" who always seemed to be involved in the organization.
The Rabbi indirectly addressed this problem through examples from the Tanach: When David fled Saul and had to leave city and civilization for the dangerous and desolate desert of Judea-who went with him? The Bible is quite specific: 'Every man is distress,every man in debt,and every man embittered of spirit,gathered themselves to him;and he became their leader.With him were about four hundred men" [Samuel 1 22:2]. And when Yiftach had to flee his brethren for a strange land, we are told that 'there were gathered to him empty men' [anashim raikim] [Judges 11:3].
The Rabbi continues: "No, it is not surprising. The comfortable and ordinary do not go with Davids and Yiftachs-until they are a success. And the "nice and decent" physics majors and yeshiva students do not become involved with unpopular and uncomfortable and dangerous groups until they become winners".
The Rabbi thereby concluded that the problem wasn't 400 malcontents who went with David, but the good, stable people, afraid to leave their secure, tranquil lives, thereby leaving the struggle in the hands of the "crazies".