If we go on a controller and click 'Prepare for Shutdown', we get the red bar up top saying 'Jenkins is going to shut down'. But nothing else happens.
Environment
CloudBees Jenkins Enterprise
Resolution
The Prepare for Shutdown feature prevents any more jobs from running. When all jobs are finished, you still need to restart/stop the instance manually.
You can do this from https://<JENKINS_URL>/restart