The women came forward after the priest's first lover, a 49-year-old parishioner, reported him saying their relationship had become "too violent".
The priest has been transferred by the local curia.
A second priest has confessed to taking part in the orgies, the sources said.