Christian Topiter, with addresses at Grand Canal House, Lower Rathmines Road and O'Shea's Hostel Merchant's Quay, is charged with criminal damage to mummified remains at St Michan’s Church belonging to Archdeacon David Pierpoint.
The court was told Mr Topiter was arrested in the vicinity of the Church yesterday after being identified on CCTV behind a locked gate in the church grounds.
He was remanded in custody with consent to bail and is due before Cloverhill District Court next week via video link.
Gardaí had objected to bail on the grounds of the seriousness of the alleged offence.
Garda James Kenny told the court that "priceless historical artefacts of national importance" had been irreparably damaged.
He said the maximum sentence for the offence was ten years in jail if convicted in a higher court.
Gda Kenny also said the accused man had behaved "erratically and aggressively" during his detention. He added gardaí were "not 100% satisfied" about his identity and were continuing inquiries.
However, defence solicitor John Shanley said no evidence was before the court to support the garda objections to bail.
He said his client, who is a Romanian national, has been engaged for the past four years to an Irish woman and has significant ties to the country.
He said Mr Topiter works casually as a security guard and was willing to abide by any conditions imposed by the court.
The man's fiancée was in court and told the court she could hand over her partner's national identity card as proof of identity.
Judge Shalom Binchy granted bail on his own bond of €10,000, with a requirement to lodge cash of €2,000.
Mr Topiter must also stay away from St. Michan's Church and have no contact with potential witnesses, surrender all travel documents and remain sober while in public.