why does the poet says 
"stop here or gently pass?

 

The poet is moved by the reaper's song. He does not want her to be interrupted or disturbed. Hence, he is requesting the passers-by  to either stop and listen to her song or to pass by, gently, without disturbing her.