An 84-year-old priest who lives in Aylesbury is facing four historic allegations under the Sexual Offences Act.
Father Patrick Bailey now lives at a nursing home in Aylesbury, but his offences are alleged to have been committed in Bedford and Chesham.
Father Bailey was in charge of the Holy Child and St Joseph Catholic church in Midland Road, Bedford for many years.
He was also once the director for education for the Northampton Diocese.
Two of the allegations refer to indecent assaults that allegedly happened in Bedford between November 1989 and October 2001. They relate to two different men, both over 16 years of age.
Father Bailey faces two further allegations of intentionally touching another man in a sexual manner.
These relate to alleged incidents that happened in Chesham, Buckinghamshire, between December 2012 and August 2013.
A spokesman for the Northampton Diocese said the priest voluntarily withdrew from all active ministry following his police interview
Bishop of Northampton, the Rt Reverend Peter Doyle, said the Diocese would cooperate fully with the police.
A statement read: “Father Patrick Bailey, a priest of the Diocese of Northampton, has been interviewed as part of a police investigation into allegations of the non-recent sexual abuse of adults. He is due to be formally charged with four specific offences next month.
“Following the interview with police, Father Bailey voluntarily withdrew from all active ministry. This was in accord with the National Safeguarding Procedures of the Catholic Church in England & Wales. Father Bailey continues not to be involved in any active ministry.”
The Right Reverend Peter Doyle, Bishop of Northampton, affirmed that the diocese would continue to co-operate fully with the police investigation as the safeguarding of children and vulnerable people is of paramount importance to the Catholic Church. He assured all involved of his prayers and concern.