Too many Milwaukeeans live by courtesy of the criminals in their midst, lawbreakers who might live in the next block or even the next house.