Is it now a temple or something else in 4E of Skyrim?
2 Answers
The Wiki has no information on it, so it's safe to say there is no lore. There is no particular reason why anyone would remove it, so it likely still stands in timespan of TESV.
There doesn't seem to be any more info about this. It might've been like that forever, as it's mentioned to be a memorial of Martin. There's seems to be nothing else about this. That's all.