I talked to some guy on the road and started a quest called Extreme Cosplay. I told him to come with me and then went to explore the estate. I smashed open the door, went inside, and then went on Google to make sure the quest wasn't too long (I wanted to get on with the Wight quest already). I found out that it was supposedly difficult unless you were overleveled, so I left, finished with the Wight, and thought I'd try finishing Extreme Cosplay. When I go up to the front door that I smashed open earlier though, it's closed and there's a note on it that says "Danger!" and whenever I read it the quest fails.
The last save before when I left that quest hanging was before I started the Blood and Wine DLC questline, so I can't revert saves. Is there any way for me to complete the quest, or am I doomed to fail it now that I put it off?