Bishop Prowse's apology comes after one was read to Catholic congregations in Melbourne at masses last weekend.
The former Bishop of Sale, Jeremiah Coffee, publicly apologised to victims of sexual abuse in 2002.
Bishop Prowse says the abuse by priest brings shame on the church.
"The church must of course stand alongside these people and try as best we can by apologising just to let people know that this is something that we are trying ... in our own feeble way to come to terms with - as is the whole of society," he said.
"As I say, it's particularly grievous to note that there is evidence of this in our own ranks."
SIC: ABC