I have attached an outpost to a city, now I would like to make another city from that outpost. I am unable to find any button that would allow me to deattach an outpost from a city. Am I blind or is this impossible?

It is indeed impossible, which is sometimes very frustrating. However if they allow you to freely change the land ownership all the exploits needs to be recalculated due to the different non-district improvements.