I think you need to expand your definition of harm. There are very harmful actions that ate not physical, and harmful actions are sometimes a side consequence of good actions.