Who gets to use nonviolence? Everyone. Including those in positions of "worldly authority." Michael Nagler discusses this sometimes controversial issue from the standpoint of the dynamics of nonviolence and relates it to Gandhi's ability to "point nonviolence in any direction." In other words, it defies social constructions and points toward our common humanity.
