In the run-up to the 2028 Olympics, some city leaders say development barriers need to be removed. But opponents say the damage to communities could be long-lasting.