Dear IT guys...

Caporegime
Joined
24 Oct 2012
Posts
26,697
Location
Yer nan's knickers
Please stop leaving stuff like this:

This is clearly a whole stack next to its enclosure. Here on the floor it gets absolute minimal cooling and this particular stack this morning sounded like a jet engine. There are holes in the floor in the bottom of the enclosure which is where air either gets sucked out to be cooled, or chilled air gets pumped in. By leaving the stack out of its enclosure, you are bypassing all the lovely cold air goodness:

lyFakmv.jpg


Please do not leave open holes in server room floors. As the floor is raised it also acts as a duct for cold air, which flows through the aforementioned holes in the bottom of the server enclosures. Holes like this allow cold air to escape in to the server room before actually cooling the servers, and is a breach of H&S as you could very easily break an ankle in them (seen it myself, nasty):

MGvcdPS.jpg


Please do not obstruct any grilles, ever. Even if there is clearly no airflow, these ducts are there for a reason. In this case, this comms room runs on a single up-flow unit. The aforementioned interruptions to the airflow in the comms room meant that the second unit was called for, but the air flow is clearly impeded by a box, making that unit largely useless. Just because a duct isn't flowing, doesn't mean it's not in use. These systems turn themselves off and on all the time. This is also not how a comms room should be kept:

ldqXT91.jpg


Ceiling tiles. Please don't ever leave them out, this again allows your nicely air conditioned air to escape in to a ceiling void which will easily soak up all the cold air pumped out by your air conditioning units.

RRcBeqG.jpg





I was called out this morning as the VESDA (stands for Very Early Smoke Detection Alarm) triggered due to the heat. We were at 40deg celsius in this comms room and it was still rising. Luckily I managed to reset all our alarms and crank the cooling to maximum but suffice to say these servers would've fallen over had I arrived a bit later.


Thanks for reading, your friendly HVAC engineer <3
 
Well this has escalated quickly. Turns out the comms room belongs to one of the biggest and most famous companies in the world (I can guarantee every single one of you have heard of it, and it's mentioned on various news channels and news outlets every single day of the year). They flew in a chap from Sweden who's apparently the best server man in the world or something. This is his work. This will not end well for him :(
 
I'm curious whether it is the work ethic of the individuals actually working first hand or the pressures and/or expectations they are trying to work with from those above them who might not understand the realities of the tasks.

Sadly seems to be becoming pervasive in all areas of industry - I see much worse but similar kind of mentality in respect to health and safety quite often and it is very frustrating.
 
Is that company more R&D focused, as opposed to hosting customer data/applications?

Before our new data centre got built, ours were a bit of a mess, although not that bad! Although it wouldn't be unusual to see a server running on a trolley or on the floor.

The joys of being fully R&D focused is that engineers are sometimes swapping around the hardware regularly, and to try and do that whilst it's rackmounted can be a royal PITA.

I remember years ago when we were adding SNMP functionality to our product, and i had the joyful task of stopping fans on a running server, along with yanking out power supplies etc. Ended up short-circuiting one of the boards once.
 
Well this has escalated quickly. Turns out the comms room belongs to one of the biggest and most famous companies in the world (I can guarantee every single one of you have heard of it, and it's mentioned on various news channels and news outlets every single day of the year). They flew in a chap from Sweden who's apparently the best server man in the world or something. This is his work. This will not end well for him :(

Was most of his server work with companies like Frankie and Benny's, TGI Fridays and Chiquito? If so I may have identified your issue.
 
It's a finance company. If you ever watch the news and see a share price ticker, you'll see their name. All I can say I'm afraid.


And yes, it is all 100% live and functioning. When I showed the office manager she almost fell over.
 
I've seen rooms like that. The general consensus from hired help is that if it works, leave it alone. I worked (briefly) for a cloud services provider to the financial sector and saw things that would make your toes curl...

Luckily, I am now my own dungeon master so everything gets racked, labeled and cabled in properly
 
Back
Top Bottom