I would love to be able to build a district or ruin-specific buildings over ruins, the same way you can do over anomalies with "abbey of abnomalities", etc.

The ruin could still be available to other players through diplomacy.
Maybe a "pilgrimmage"  option, giving the opposite player a window of perhaps 15 days to visit the ruins, and exit your territory again, in return for dust or influence perhaps.