It's a bug.

If you cancel it, you should get back your invested pearls. Like with any pearl improvement built inside a city. Now, you loose all the pearls.

Thanks for the report. I've taken it to the team.