If you are having this issue, odds are WordPress has cached some of the settings. If you are using a Cache plugin, please delete the cache and try again.

You can also try opening your website in an Incognito window to confirm that the Construction Mode plugin is off.