explain 'not move our arms so much'.

The poet is urging us to stop from any kind of movement that suggests communication. We use our hands to gesture or assist in bringing out what we want to convey. The poet asks us to desist from any sort of movement and just keep still.