When folks from the data center industry got together about 3-5 years ago to create a data center efficiency metric, we knew that we should tie it to the actual work being created within the data center (i.e. transactions per watt, IOPs/watt, FLOPs/watt…). However, every data center and even more so, every computer has a different work being completed and thus metric to be applied. For example, a science research computer might complete one transaction per month with a lot of network and storage traffic for that one big “transaction”, while an eBay data center might have 1,000’s of transactions per second for one computer system.

So, we came up with a compromise, knowing that all data centers and their workloads were different, yet needing something to push us as an industry to higher efficiency. Well, the holly grail of data center metrics got released….P U E. Yes, Power Usage Effectiveness. While it was only a start, and a best compromise, and we knew we needed to improve upon it or come up with something better, yet is has had perhaps more influence on energy efficiency of our data centers than any other metric or industry movement.

While improving PUE only affects the infrastructure side of the data center, not the hardware or software–leaving that always equal to 1.0 with everything else being above one–more power use the higher the PUE. Our data centers have been averaging above 2.0 (meaning that at 2.0 the infrastructure power load is equal to the server load, higher than 2 means it uses more power than the server load). A recent report from EPA of about 200 data centers last year across the US shows that we are averaging north of 2.0. Other studies show that we had been averaging around 3.0 worldwide, so we have improved greatly but still can improve so much more. While 2.0 is much better than 3.0, using 50% less power for the infrastructure, we know we should be able to achieve PUEs of at most 1.5 any where in the world, any TIER level, yet at 2.0 we are using more than double the power we need to support the non-hardware loads.

One problem with the PUE metric is that it is instantaneous since it measures power and not energy and all data center power usage fluctuates with weather and usage, and really what we care about to reduce costs is total energy use over a period of time. Energy is power use over time, while power is instantaneous. Otherwise, PUE could be measured on the coldest day of the year when all systems are running more efficiently but that is not a good gauge of annual energy use and thus costs. In all of the projects I get involved with, and all of the PUEs I quote, I use total annual energy instead of one-time power measurement, and hardware measured at the rack to account within PUE UPS, PDU and other electrical distribution losses. So, PUE should be an annual average, and that is exactly what member representatives of Green Grid, SVLG, 7×24, EPA, DOE, USGBC, ASHRAE and UpTime recommended in December of this year at a meeting in DC. I provided recommendations from the SVLG along with Chris Page, Scott Noteboom and Tim Crawford representing the SVLG at this meeting with input from Olivie Sanche of Apple and many others.

Essentially the outcome was a revised PUE metric that now measures annual usage of infrastructure and IT load, which is fantastic! Also, a little more clarity or definition on how it should be measured and what should and should not be included. (Such as on-site power generation should never reduce one’s PUE, as energy in is energy in, regardless of source.) We’ll soon see PUE and PUE subscript 1, 2 & 3. These clarify where the server load was measured (UPS output, PDU or rack). Ideally, we’d all be measuring at the rack input, but many folks do not have this meter & monitoring capability, so the compromise was to allow for some acceptance of any of these points of measurement.

Even though the location of measurement will affect the measured PUE–meaning different measuring locations will result in different PUEs for the same data center–at least it’s an improvement, and will hopefully drive folks to measure at the rack–the most accurate location of measurement. It will also drive us to think about annual usage and costs, not one time or instantaneous, another big improvement in our thoughts about all buying and operational decisions. These are the key to improving efficiency and reducing costs: long-term measurement, long-term constant improvements, and buying decisions based on long-term economic analysis.

With our new PUE metric, it should re-invigorate the PUE discussions, comparisons, and improvements. Perhaps driving us all to lower PUEs, regardless of actual resulting PUE and type of data center. After all, we all gain when we each improve.

Tags: Chris Page, data center energy efficiency, EPA data center, Olivie Sanche, PUE, Scott Noteboom, SVLG, Tim Crawford

This entry was posted on Monday, June 21st, 2010 at 12:09 PM and is filed under Data Center, Energy Efficiency, MegaWatt Consulting. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.