It’s the little things that sneak up on you and can hurt the most, because they seem so… little. Updated configuration management didn’t pin the version of java, search system goes nuts, almost all had to be abandoned in a migration to a newly provisioned infra. Fascinating.
http://www.bonsai.io/blog/2013/11/11/october-post-mortem-analysis