Green Enterprise IT (GEIT) Awards due Feb 3rd

January 16th, 2012

Many of the technologies and end users we showcase in the case studies of the SVLG Data Center Efficiency Summit that I’ve chaired the last few years end up being winners of the GEIT awards. I’ve also been fortunate to have been asked to be a judge of these awards in the past and love to read about technologies and end users pushing the efficiency envelope.

If you have a data center project that pushes energy efficiency to a new level, or showcases a great way of increasing efficiency, take a look at the following information and apply!! A win will be a nice feather in your cap. (You can copy the URLs below to receive more information and apply.)

Do You Have Data Center Energy-Efficiency or Green IT Accomplishments to Showcase?
If so, the Uptime Institute encourages you to apply for the Green Enterprise IT (GEIT) Awards (http://symposium.uptimeinstitute.com/geit-awards). The Institute grants these awards to data center owners, operators and vendors for projects, ideas and products that significantly improve energy productivity and resource use in IT, data centers and beyond. Previous winners include Kaiser Permanente, Harris Corporation, AOL, Helsingin Energia, HP, Itaú, MassMutual Financial Group, Tieto, Capgemini and Verizon Wireless.
The GEIT Awards are open to applicants in all countries and are carefully judged by a committee of independent experts. Award winners for 2012 will be honored at the Uptime Institute Symposium (http://symposium.uptimeinstitute.com/) in Santa Clara, CA, May 14-17, 2012. The theme for this year’s event is Digital Infrastructure Convergence, with a Special Focus on Modular, Prefabricated and Containerized Data Centers.
As innovative leaders, GEIT Award winners are given the opportunity to share their accomplishments at Symposium; winners receive complimentary registrations to Symposium to present a case study, formal recognition during the GEIT Awards ceremony and numerous public relations benefits highlighting their vision and execution.
In 2012, the Institute invites applications in 8 categories:
• Facility Design – Innovation (http://symposium.uptimeinstitute.com/geit-awards/1427-facility-design-innovation)
• Facility Design – Implementation (http://symposium.uptimeinstitute.com/geit-awards/1431-facility-design-implementation)
• Facility Retrofit (http://symposium.uptimeinstitute.com/geit-awards/1432-facility-retrofit)
• IT Retrofit (http://symposium.uptimeinstitute.com/geit-awards/1433-it-retrofit)
• Facility Product Deployment (http://symposium.uptimeinstitute.com/geit-awards/1434-facility-product-deployment)
• IT Product Deployment (http://symposium.uptimeinstitute.com/geit-awards/1435-it-product-deployment)
• Modular Data Center Product Deployment (http://symposium.uptimeinstitute.com/geit-awards/1436-modular-data-center-product-deployment)
• Audacious Idea (http://symposium.uptimeinstitute.com/geit-awards/1437-audacious-idea)
To learn more about the GEIT Awards, visit our website (http://symposium.uptimeinstitute.com/geit-awards) or email us at GEIT@uptimeinstitute.com.
The competition closes at midnight PST, February 3, 2012. Applications require data that can take a few hours to gather, so we recommend you begin as soon as possible!
We look forward to learning about your project,
Uptime Institute
Green Enterprise IT Awards
GEIT@uptimeinstitute.com

We learn our skills in and out of the work place

September 19th, 2011

From time to time, I write a little about non-data center or energy things, just to mix it up and share with folks. Sometimes it is these blogs that generate the most interest and conversation from folks. Plus, I do believe that since we all work together, it’s nice to share some of our personal life with each other. After all, we are people working together based upon relationships, it is these things in our personal lives that drives us to work hard, and thus, they are essential parts of who we are as people and consequently, these personal things affect our daily work lives and relationships.

I also find that many of the things that I do in my personal life influence my work life. I’m sure we all find that at times, we reach an epiphany when walking the dog, talking to our spouse or friends, or some other activity that drives a decision or direction in our work the next day. I had one two weeks ago when talking with friends over dinner. But, that is not the topic of this blog.

Instead, it goes back another week but really starts when I was in college. I have always liked to push myself physically, and I get a lot out of those endorphins from a good physical challenge but also one with a mental challenge.

So I started mountain biking in college, riding longer and longer, more often and more often, until I was riding 365 days per year and training about 30+ hours per week. That on top of my 7-8 course load each semester (a consequence of earning multiple degrees simultaneously) and working part to full time year around. What can I say, I like to stay busy (also was on sports teams in addition to cycling, several clubs, an RA, etc, etc).

I then turned this “hobby” into training for races, became sponsored (it took me years to finish all those boxes of PowerBars I was provided), and finished races often in the top 10 out of hundreds or thousands of finishers. I earned enough points in my last year of racing and college to be in the top 10 nationally.

However, this, like many other hobbies, wasn’t my calling for a profession, and often hobbies and professions don’t mix very well. But I still get out to ride as often as I can and still love it. And do a race or two each year, purely for fun but also competitive. So on August 27th & 28th, I completed another 24-hour mountain bike race. I believe this is around my 6th, but I can’t remember nor have I been keeping track.

People ask how a 24 hour mountain bike race performs. Well, you ride a lap, usually about 10-15 miles long–which is usually takes about 45-90 minutes to finish–all on dirt, often much single track, climbs, descents, technical sections, fast sections, and complete as many laps as possible in 24 hours. Races can be completed as a solo team, or with up to 5 people on a team, trading off each lap in rotation, making each lap an all out sprint, then resting, downing as much water as your body can absorb, repairing your bike, recharging light batteries and trying to eat and sleep in the 45 min to 3 hour rest time before the next lap. Usually races start at about noon and end at noon the next day. Powerful bike light systems are used in the night laps, and the key is efficiency and speed while staying upright. Crashes not only hurt people–broken bones are quite common and sometimes trips in an ambulance for those racers that push their speed too fast for their ability at the time. Ability changes much after hours of riding, little sleep, little food, dehydration, and tired bodies. And especially at night when visibility is limited to a spot of light 5-20 feet in front of you as speeds exceed 30 mph in faster downhill and flat sections with still plenty of rocks, ditches and other obstacles to avoid.

The key to these races is to manage energy and speed to skill. Those that push too hard in the beginning of the race (a common mistake) or on any lap typically burn out before the race ends and either can’t finish it (often just finishing the race allows one to move up in the score board) or get hurt along the way.

So the key to 24-hour mountain bike racing is maintaining energy for 24 hours of riding with little sleep. It becomes somewhat of a mental game, especially in the late night laps. But even more so, a continual focus on the efficiency of every single pedal stroke–all 100,000 of them–and on the rest of the body, especially the lungs and heart. One must constantly “economize” while pushing their bike and self as hard (and consequently fast) as possible up every hill, down every descent, and around every lap to maintain the fastest average lap time. So any one slow lap kills the average, and hence, efficiency with the greatest speed. My lap times varied by less than 10%, even though temperatures ranged by 50 degrees F, some were in full sun, some in full dark; some with heavy traffic of other racers, some with passing  another racer only every 15 minutes; some with full energy, and last lap with maybe an hour of sleep over 24 hours, little food, and likely mild dehydration and most certainly tired legs and body, and even one with a mechanical and another with a flat tire.

In the data centers I design, efficiency doesn’t change much between hot and cold weather, day and night, packed full or empty of servers, mechanical failures or perfect operations. The key is being as efficient as possible all the time, not matter the adversity. It’s all about economizing and energy efficiency, just as my continuous focus in designing and operating data centers. I love it!

Here is a video of my most recent 24-hour race, the Coolest 24-Hours, which took place end of August in Soda Springs, CA (Donner Summit area of the Sierras). The race raised money for those dealing with cancer. In this video, I am the first rider out of the start of the 24 hour racers, wearing silver jersey, black and yellow cycling shorts with USD on the side (I still fit in my college cycling team shorts almost two decades later), red single speed 29″ Niner bike. I enjoyed being in first place for about the first mile before some of the racers pass me. You can see me do a little jump off the pavement start onto the dirt and also my buddy and fellow racer Stewart do the same in his third place position with red & white Niner Bikes jersey. I posted a photo of my aunt along the course–who died of cancer not long ago–which many photos of survivors and victims can be seen staked in the ground at the first turn. I finished the race with a smile, a dirty face, a dusty body, a respectable finish, and another lesson in efficiency. Enjoy the video and getting out to learn more! Here is the video: The Coolest 24 Hours, 2011–KC leads the pack at the start of the 24 hour race

The Olivier Sanche Tree and Room @ eBay

September 18th, 2011

This week I had the pleasure of not only flying on 8 Southwest flights in one week–I believe this may be a new record for me of flights in one week on the same airline–but I also had the pleasure and privilege to tour ebay’s Topaz data center.

While we all know that I wouldn’t release any confidential data. Having been in the data center industry now for well over a decade, worked for Yahoo, Google, Sun, BEA, and completed large data center projects for financial institutions, banks, government entities, educational and research entities, Facebook, Equinix, and many others, I know and understand the importance and value to not only my reputation but also the importance of maintaining other’s confidential information. So, I will not share anything more about the data center—you can learn from what is already available from public sources.

However, I do want to comment on one item that I did see which does not have any confidentiality tied to it—the Olivier Sanche Memorial Tree and conference room. It touched me very much. Olivier and I were working on a project and talking just literally two days before he passed. Olivier and I were the exact same age. His job at Apple was essentially the same as mine at Yahoo. And at the time he passed, we were both running fast, traveling to many countries, several continents and states each month. We were trying to do everything we could to support our growing data center demand at the lowest cost and the highest energy efficiency as possible, and to help the industry achieve more as well by collaborating, sharing and guiding. And just as he touched my heart and those of many others in the data center industry, he managed to be the best dad possible.

While I enjoyed touring the ebay data center, it was the moment I spent reading Olivier’s memorial against the now small tree yet growing in size to eventually become a large icon in the entrance of this facility. It was that moment under this tree, and reading the memorial, that I once again remembered Olivier, and the touching reminder of how he touched many.

I applaud the fine folks for the very kind memorial to Olivier—we should all strive to support each other, work together, collaborate, and most of all, enjoy each other’s company. Not get out there and do something good today.

Data Center Site Selections need to be more comprehensive than they once were

July 7th, 2011

Having completed site selections for many data centers and in about 20+ countries, including completing site selections for Yahoo, Google, Facebook, Equinix, Exodus, and many others, I’ve learned quite a few things. I’ve been part of the changing criteria evolving from just being near fiber lines to adding in power capacity, energy price, sales taxes, property taxes, and now including climate, carbon impact and water supply as well. I think we’ll soon see income tax added in to as a major cost driver for site selections. Having been doing this for over a decade, I’ve taken on these new elements of data center site selection, driving the focus on them. Nearly 10 years ago I considered power capacity, energy price, water supply, carbon intensity of power supply, climate and taxes, only to see the industry finally accepting all of these principals as primary decision factors.

While risk of natural and human disasters has always been a part of every data center site selection, it has seriously changed. My 20+ page checklist of hundreds of items from nearby man holes covers, flight paths and train tracks to nearest police station has not been as heavily used, as it seems to add less value than thinking about the BIG natural disasters that can occur and unforeseen human caused disasters. While we used to worry about trucks of guys jumping out with AK47’s to break into a data center, the reality is, this is a thin probability and one that is difficult to prevent. Meanwhile, the ones we can prevent that are known, potential and unforeseen, are the ones we have not focused on well.

For example, has anyone thought about their utility system being hacked and shut down for an extended period of time? Have you asked your electric utility if they are NERC CIP compliant to ensure that they have a much lower chance of being hacked and shut down? Have you thought about your electric utility meter, water meter, main switchboard and generator switchgear being connected to the Internet and/or your utilities and thus being able to be hacked into, shut down, or damaged?

And the main thing, how about natural disasters? As an industry, we’ve built data centers in seismically active areas (i.e. Japan, California, Oregon (also with extreme tsunami risks) and Washington) and build so the building stays up but don’t think about all of the IT gear shuffling about and the personnel getting hurt. A building that stands while the IT gear is rolling around like marbles isn’t a data center that will sustain an earthquake, only one that will memorialize that happened while we rebuild the inside.

We build data centers in hurricane and tornado areas (Texas, Kansas, Nebraska, North Carolina, South Carolina, Virginia, Georgia) and build for them pretty well, but do we think about what has not to come yet but likely will?

I’ve written before about the most dangerous seismic area in the US not being on the West Coast or even the East Coast, but yet the Madras Fault being right under Kansas City, St. Louis and a large part of middle America.

Lately we’ve had tremendous flooding along the Mississippi and Missouri Rivers; yesterday tremendous dust storms hit Arizona–look at these amazing photos of a dust storm that hit Phoenix yesterday. (http://www.time.com/time/photogallery/0,29307,2081646_2290849,00.html). And likely future heat storms will add to the dust storms in the Phoenix area. Do you want your data center operating in this?

Severe hurricane and tornado frequency has increased many fold over the last decade and we saw more serious renditions of each over the last several months, including in places we weren’t expecting to see them, such as Massachusetts and Missouri, where tornados tore thru very robust buildings, even a hospital data center (http://www.datacenterdynamics.com/focus/archive/2011/06/missouri-tornado-destroys-hospital-data-center). Look at these photos of devasatation in Alabama from recent tornadoes: (http://www.nytimes.com/2011/05/05/us/05missing.html?_r=1&nl=todaysheadlines&emc=tha23). Imagine you and your employees following something like this–would they even come to work? One would likely need to shut down their data center for human resources even if everything kept working.

My point is not to overlook the seriousness of your data center site selection. Consider what MAY happen, with some probability, and don’t assume that just because it hasn’t happened, that it really hasn’t or won’t. Research the probabilities. The web is wonderful tool for this information, and so are your data center site selection experts at MegaWatt Consulting and others. Use us to help you avoid future problems.

Stay healthy and let’s help each other grow our industry. KC Mares

The Design of NCAR’s “Chillerless” data center with over 600 Watts/SF

May 22nd, 2011

“Chiller-less”, “refrigeration-less”, and “compressor-less” designs have been something I have been striving for several years, with my testing and use of air-economized systems in data centers staring in 2002. In 2008-2009, I was lucky to join with Rumsey Engineers (now the Integral Group) as a consultant to work on data center projects. A fantastic experience, as Rumsey Engineers designs the most efficient mechanical systems of any team I know. In 2009, they believed that they had more Platinum LEED buildings than any engineering firm, and their numbers prove it.

Together in early 2009 we led a design Charrette for a new data center for the National Center for Atmospheric Research (NCAR), the folks who study climate data. As part of our design scope, we researched future generations of High-Performance Computing (HPC, aka supercomputer) equipment; it’s expected future energy use, load density and cooling system connections and inlet temperature requirements (some were air based, others water based). We looked at future generation of equipment as by the time the data center was built and the systems ordered and delivered, densities and cooling system connections would be different than today. This is a key point that we make with all of our projects: to look at what the hardware system needs will be several years from now, as it usually takes 1-2 years to build a data center, several years to fully load it, and we expect it to meet our operational needs for 10, 20 or more years. So, if the median of the data center’s life will be 7-15+ years away, than why would we design it to meet today’s computers? This is a mistake we see often in many people’s designs and site selections. Life changes, we must think ahead.

And this is why I research and pay attention to many cutting or leading edge technologies. Why I sit on boards of new and innovative technologies. This helps me see the future. And even though I was shocked to find future HPC systems had densities of over 2,500 Watt’s per square foot, I know that many computing systems of the future will use much lower densities than the average today, and there are always many technologies that we employ, not just one. Hence, we took a pragmatic approach to this analysis of future HPC systems and the needs of the leading researchers in climate change. (Incidentally, we also did an operating cost analysis of HPC systems that will come out between 2012 and 2014, and it yielded fairly broad cost differences, enough that first pass based upon compute performance would seem to lead to one system while just purchasing more of another system to get the same performance would still cost less, stressing the important point to always choose equipment that affords the lowest true total cost of ownership.)

Being that the site chosen for this data center was to be Cheyenne, Wyoming, a state with one the highest percentages of coal-generated electricity, energy efficiency in this design was essential. Although we were pretty certain we knew which type of mechanical system would be most energy efficient (and likely also lowest cost to build—they almost always go hand-in-hand when working pragmatically and holistically), we reviewed a rough design of several systems, including calculated annual PUE and a rough estimated build cost. We explored airside economization with 68F and 90F air a supply temps, the Kyoto cooling system (heat wheel), a modified heat wheel approach with economization, and waterside economization with 46F and 64F chilled supply water. Our modified heat wheel, and high supply temp air and water economized solutions did not require chillers, hence the temperatures as they were, as we pushed them until we did not require chillers. We choose the water economized system, which was our guess of the best system before we started any design analysis, as it provided 64F supply water, which was important as many HPC systems of the future will only run on chilled water and this temp is acceptable for the majority of the systems, and it also provided the lowest PUE of about 1.11 AND the lowest cost to build. This once again proves my motto that we build most efficient data centers at the lowest cost—the two seemingly disparate goals of capital cost and operating expense are once again aligned. Hence why we take a very pragmatic and holistic approach with an open mind to achieve the most.

This new 153,000 SF building designed to accommodate and secure the Scientific Computing Division’s (SCD) future in sustaining the computing initiatives and needs of UCAR’s scientific research constituents. Final design was based upon NCAR’s actual computing and data storage needs and a thorough review of future High Performance Computing (HPC) and storage technologies, leading to a 625 Watts/SF HPC space and a 250 Watts/SF medium density area. The data center is divided into two raised floor modules of 12,000 SF each with a separate data tape system area to reduce costs, increase efficiency and provide different temperature and humidity requirements than the HPC area. Also provided is a 16,000 SF office and visitor area heated by waste heat from the data center and a total facility capacity of 30 MVA.

Unique requirements of this high density, HPC data center were to also achieve ultra-high energy efficiency and LEED Silver certification for a modest construction budget. Various cooling options were analyzed, including Kyoto and other heat wheels, air economization, a creative solution of direct heat exchange with city water supply pipe and variations of water economized systems. Ultimately, LEED Gold certification and an annual operating PUE of about 1.14 is expected. This low of a PUE was thought to be impossible at the time of design (early 2009), especially for such high-density at TIER III. Through creative problem solving, the low PUE is obtained by designing a 9’ interstitial space above the raised floor combined with a 10’ waffle-grid raised floor to provide a low-pressure drop air recirculation system designed as part of the building. Ten day one chillers of 100 tons each provide supplemental cooling and optimum efficiency as load varies during hot summer months, while an indirect evaporative system with 96 fans in a fan wall provide ultra-low energy use cooling. An on site water supply tank, a total of nine standby generators at full build out of 2.5 MVA each, six 750 kVA UPS modules and other systems support the total low PUE and low construction budget for this high density HPC data center.

Here is a drawing of this data center now under construction: