And.. JUST violent actions, right?
So... how much work would it be to train it to recognize other suspicious actions, people trying to evade detection, people walking guiltily, "loitering with intent", protesters, people working their way purposefully through a crowd instead of gawping? I'm sure you can come up with more. It's fun!