The Red Mount chapel in Lynn has been damaged over the weekend.
West Norfolk Council has confirmed that there were two attempts to break into the site.
This has resulted in a door coming off its hinges.
Officers also found the remains of a small fire, which may have been lit for warmth .
Some minor damage has been caused in the incident but this has been repaired by council officers.
The door is back on its hinges so that the historic building is once again secure.