{"id":2421,"date":"2014-03-14T09:22:45","date_gmt":"2014-03-14T17:22:45","guid":{"rendered":"http:\/\/www.atumvirt.com\/?p=2421"},"modified":"2014-03-14T09:22:45","modified_gmt":"2014-03-14T17:22:45","slug":"power-management-and-performance-for-virtual-machine-hosts","status":"publish","type":"post","link":"https:\/\/avtempwp.azurewebsites.net\/2014\/03\/power-management-and-performance-for-virtual-machine-hosts\/","title":{"rendered":"Power Management and Performance for Virtual Machine Hosts"},"content":{"rendered":"<p>Sometimes little things slip through, especially when you&#8217;re in a rush. \u00a0We recently discovered excessive CPU latency was affecting performance on a number of SQL servers on what should have been otherwise sufficient hosts. \u00a0The cause wasn&#8217;t immediately clear, but since we began monitoring the servers with Veeam Management Pack for VMware (review to come soon!) we did know that we had to isolate why only some of the hosts in the cluster exhibited the issue. \u00a0After searching around for a bit we found a thread where a user talked about using the HP &#8220;High Performance&#8221; power policy in the BIOS and experiencing latency, while setting it to &#8220;OS Managed&#8221; effectively eliminated the latency.<\/p>\n<p>We embarked on the journey &#8211; maintenance mode the host, reboot and check the BIOS setting when the horrifying reality became clear: \u00a0It wasn&#8217;t high performance at all, but rather the HP Default: \u00a0&#8220;Balanced&#8221;. \u00a0It certainly was not our standard configuration which was in fact, to set high performance, so it must have been missed during the last hardware refresh when the person deploying the server set up the server.<\/p>\n<p>After changing the setting to &#8220;OS Managed&#8221;, then in ESXi set the policy to high performance and the difference was staggering.<\/p>\n<div id=\"attachment_2431\" style=\"width: 1041px\" class=\"wp-caption aligncenter\"><a href=\"http:\/\/www.atumvirt.com\/wp-content\/uploads\/2014\/03\/CPULatencyPercent.png\"><img aria-describedby=\"caption-attachment-2431\" loading=\"lazy\" class=\"size-full wp-image-2431\" alt=\"Prior to 3\/11 at 5PM\" src=\"http:\/\/www.atumvirt.com\/wp-content\/uploads\/2014\/03\/CPULatencyPercent.png\" width=\"1031\" height=\"392\" srcset=\"\/wp-content\/uploads\/2014\/03\/CPULatencyPercent.png 1031w, \/wp-content\/uploads\/2014\/03\/CPULatencyPercent-300x114.png 300w, \/wp-content\/uploads\/2014\/03\/CPULatencyPercent-1024x389.png 1024w, \/wp-content\/uploads\/2014\/03\/CPULatencyPercent-768x292.png 768w\" sizes=\"(max-width: 1031px) 100vw, 1031px\" \/><\/a><p id=\"caption-attachment-2431\" class=\"wp-caption-text\">Prior to 3\/11 at 5PM<\/p><\/div>\n<p>&nbsp;<\/p>\n<p>Why such a setting is the default out of box given the nature of servers I don&#8217;t know. I can appreciate green initiatives but with the advent of virtualization and modern operating systems I can&#8217;t imagine that having the default selection (to be managed at the BIOS level only) is one that effectively and intentionally cripples the performance of your shiny new servers.<\/p>\n<p>The latency did seem to have a real impact on CPU intensive processes as well &#8211; we discovered the daily report that ran from 5:00 AM for 90 minutes began taking only 60 minutes after making the change.<\/p>\n<p>Moral of the story? \u00a0Review configurations before launching into production and use monitoring tools to alert you to things you may have missed. \u00a0Check out <a title=\"Power Management and Performance in ESXi 5.1\" href=\"http:\/\/blogs.vmware.com\/performance\/2013\/05\/power-management-and-performance-in-esxi-5-1.html\">this great post<\/a> from VMware discussing and comparing power management on ESXi.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Sometimes little things slip through, especially when you&#8217;re in a rush. \u00a0We recently discovered excessive CPU latency was affecting performance on a number of SQL servers on what should have been otherwise sufficient hosts. \u00a0The cause wasn&#8217;t immediately clear, but since we began monitoring the servers with Veeam Management Pack for VMware (review to come [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":2431,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[25,64],"tags":[],"_links":{"self":[{"href":"https:\/\/avtempwp.azurewebsites.net\/wp-json\/wp\/v2\/posts\/2421"}],"collection":[{"href":"https:\/\/avtempwp.azurewebsites.net\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/avtempwp.azurewebsites.net\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/avtempwp.azurewebsites.net\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/avtempwp.azurewebsites.net\/wp-json\/wp\/v2\/comments?post=2421"}],"version-history":[{"count":0,"href":"https:\/\/avtempwp.azurewebsites.net\/wp-json\/wp\/v2\/posts\/2421\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/avtempwp.azurewebsites.net\/wp-json\/wp\/v2\/media\/2431"}],"wp:attachment":[{"href":"https:\/\/avtempwp.azurewebsites.net\/wp-json\/wp\/v2\/media?parent=2421"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/avtempwp.azurewebsites.net\/wp-json\/wp\/v2\/categories?post=2421"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/avtempwp.azurewebsites.net\/wp-json\/wp\/v2\/tags?post=2421"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}