Automatic Rackspace provisioning for Jenkins done right

Last Friday I casually updated our Jenkins server because it's the right thing to do. I didn't notice that Jenkins was about to be updated as well, next time I will pay attention to package proposed for upgrade...