TIA-942b-2017

ANSl/TIA-942-B-2017 APPROVED: JULY 12, 2017 ADY lNCIN6 GLOBAL COMMUNICATIONS TI AST ND RD Telecommunications Infrastructure Standard for Data Centers July 2017 TIA-942-8 Revision of TIA-942-A) L E C O M M U N I C A T I O ~ INDUSTRY SSOCI TION tiaonline org hi Telecommunlcatlons Industry Association d by IHS under license with TIA duclion or networking permitted wilhout license from IHS Order Number: 02167039 Sold to:UPSISTEMAS [202662100001 ] 2017-09-06 17:39:49 UTC NOTICE Tl.A. n ~ i n e e r i n g Standards and Pub li cations are designed to serve t h ~ pu.blic. interest t h r o ~ ~ 1 n t e r ~ h a n g e ~ b 1 l 1 t y m 1 ~ a t r n g misunderstandings between manufacturers and purchasers, and improvement of products, and assisti assisting the purchaser in selecting a nd obtaining with m.1nin:ium delay the proper product for their particular need. need. The existence of such such Standards Standard s and and Publicat ion ions s shall not in any respect preclude any member or non-member of ~ I from m a n u f a c ~ u r i n g or selling products not conforming to such standards and Publications. Neithe Neitherr shall the exi ex istence of such No n -TIA members, either domestically or Standards and. Publications preclude their voluntary use by Non internationally internationally. Standards and Publications are adopted by TIA in accordance with the American National Standards Institute ANSI) patent policy policy.. By such action, TIA does not assume assume any liability to any patent owner, nor does it assume any obligation whatever to parties adopting the Standard or Publication. This Standard does not purport to address all safety problems associated with its use or all applicable regulatory requirements. It is the responsibility of the user of this Standard to establish appropriate safety and health practices and to determine the applicability of regulatory limitations before its use. Any use of trademarks in this document are for information purposes and do not constitute an endorsement by TIA or this committee of the products or services of the company. From Standards Proposal No. ANSl/TIA-PN-942-B-D1, formulated under the cognizance of the TIA TR-42 Telecom Telecommunicat munications ions Cabling Systems, TR-42.1 TR-42.1 Subcommittee Subcom mittee on Commercial Building Telecommunications Cabling). Published by ©TELECOMMUNICATIONS INDUSTRY ASSOCIATION Technology and Standards Department 1320 N. Courthouse Road, Suite 200 Arlington, VA V A 222 22201 01 U.S.A. PRICE: Please refer to current Catalog of TIA TELECOMMUNICATIONS INDUSTRY ASSOCIATION STANDARDS AND ENGINEERING PUBLICATIONS or call IHS, USA and Canada 1-877-413-5187) International 303-397-28 303-397-2896) 96) or search online at http://www.tiaonline.org/standards/catalog/ All rights reserved Printed in U.S.A. :::opyrighl Telecommunications Industry Association ::irovided by IHS under li cense wi l h TIA l/o reproduction or nelworking permitted without license lrom IHS Order Number: 02167039 Sold lo U PSISTEM S 1202862100001 I 2 17· 9· 6 17:39:49 UT NOTI C E O F CO COP PYR IG HT This document is copyrighted by the TI T IA Reproduction of these documents either in hard copy or soft copy includi including ng posting on the web) is prohibited without copyright permission. For copyright permission to reproduce portions of this document, please contact the TIA Standards Department or go to the TIA website (www www..tiaonline.org tiaonline.org)) for details on how to request permission. Details are located at: http:l/www.tiaonline.org/standards/catalog/info.cfm copyright or Telecommunications Industry Association Association Technology Standards Department 1320 N Courthouse Road, Suite 200 Arlington, VA 2220 22201 1 USA +1.703.907.7700 Organizations may obtain permission to reproduce a limited number of copies by entering into a license agreement. For information, contact IHS 15 Inverness Way East Englewood, CO 80112-5704 or call USA and and Canada (1.800.525.7052) International Interna tional (303.790.0600) NOTICE OF OF DISCLAIMER DI SCLAIMER AND LIMITATION OF LIABILITY The document to which this Notice is affixed (the Document ) has been prepared by one or more Engineering Committees or Formulating Groups of the Telecommunications Industry Association ( TIA ). TIA is not the author of the Document contents, but publishes and claims copyright to the Document pursuant to licenses and permission granted by the authors of the contents. TIA Engineering Committees and Formulating Groups are expected to conduct their affairs in accordance with the TIA Procedures for American National Standards and TIA Engineering Committee Operating Procedures, the current and predecessor versions of which are available at http http:// ://www www..liaon li ne ne..org/standards org/standards//ec ec--proced procedu ures res)) /T /TIA's IA's function is to administer the process, but not the content, of document preparation in accordance with the Manual and, when appropriate, the policies and procedures of the American National Standards Institute ( ANSI ). TIA does not evaluate, test, verify or investigate the information, accuracy, soundness, or credibility of the contents of the Document. In publishing the Document, TIA disclaims any undertaking to perform any duty owed to or for anyone. If the Document is identified or marked as a project number (PN) document, or as a standards proposal (SP) document, persons or parties reading or in any way interested in the Document are cautioned that: (a) the Document is a proposal; (b) there is no assurance that the Document will be approved by any Committee of TIA or any other body in its present or any other form; (c) the Document may be amended, amended , modified or changed in the standards development or any editing process. The use or practice of contents of this Document may involve the use of intellectual property rights ( IPR ), including pending or issued patents, or copyrights, owned by one or more parties. TIA makes no search or investigation for IPR. When IPR consisting of patents and published pending patent applications are claimed and called to TIA's attention, a statement from the holder thereof is requested, all in accordance with the Manual. TIA takes no position with reference to and disclaims any obligation to investigate or inquire into, the scope or validity of any claims of IPR. TIA will neither be a party to discussions of any licensing terms or conditions, which are instead left to the parties involved, nor will TIA opine or judge whether proposed licensing terms or conditions are reasonable or non-discriminatory. TIA does not warrant or represent that procedures or practices suggested or provided in the Manual have been complied with as respects the Document or its contents contents.. If the Document contains one or more Normative References to a document published by another organization ( other SSO ) engaged in the formulation, development or publication of standards (whether designated as a standard, specification, recommendation or otherwise), whether such reference consists of mandatory, alternate or optional elements (as defined in the TIA Procedures for American National Standards) then (i) TIA disclaims any duty or obligation to search or investigate the records of any other SSO for IPR or letters of assurance relating to any such Normative Reference; (ii) TIA's policy of encouragement of voluntary disclosure (see TIA Procedures for American National Standards Annex C.1.2.3) of Essential Patent(s) and published pending patent applications shall apply; and (iii) Information as to claims of IPR in the records or publications of the other SSO shall not constitute identification to TIA of a claim of Essential Patent(s) or published pending patent applications. TIA does not enforce or monitor compliance with the contents of the Document. TIA does not certify, inspect, test or otherwise investigate products, designs or services or any claims of compliance with the contents of the Document. ALL WARRANTIES, EXPRESS OR IMPLIED, ARE DISCLAIMED, INCLUDING WITHOUT LIMITATION, ANY AND ALL WARRANTIES CONCERNING THE ACCURACY OF THE CONTENTS, ITS FITNESS OR APPROPRIATENESS FOR A PARTICULAR PURPOSE OR USE, ITS MERCHANTABILITY AND ITS NONINFRINGEMENT OF ANY THIRD PARTY'S INTELLECTUAL PROPERTY RIGHTS. TIA EXPRESSLY DISCLAIMS ANY AND ALL RESPONSIBILITIES FOR THE ACCURACY OF THE CONTENTS AND MAKES NO REPRESENTATIONS OR WARRANTIES REGARDING THE CONTENT'S COMPLIANCE WITH ANY APPLICABLE STATUTE, RULE OR REGULATION, OR THE SAFETY OR HEALTH EFFECTS OF THE CONTENTS CONTENT S OR ANY PRODUCT OR SERVICE REFERRED TO IN THE DOCUMENT OR PRODUCED OR RENDERED TO COMPLY WITH THE CONTENTS. TIA SHALL NOT BE LIABLE FOR ANY AND ALL DAMAGES, DIRECT OR INDIRECT, ARISING FROM OR RELATING TO ANY USE OF THE CONTENTS CONTAINED HEREIN, INCLUDING WITHOUT LIMITATION ANY AND ALL INDIRECT, SPECIAL, INCIDENTAL OR CONSEQUENTIAL DAMAGES FORCONTRACT, LOSS OF BUSINESS, LOSS OF PROFITS, LITIGATION, OR THE LIKE),DAMAGES WHETHER (INCLUDING BASED UPON BREACH OF BREACH OF WARRANTY, TORT (INCLUDING NEGLIGENCE), PRODUCT LIABILITY OR OTHERWISE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. THE FOREGOING NEGATION OF DAMAGES IS A FUNDAMENTAL ELEMENT OF THE USE OF THE CONTENTS HEREOF, AND THESE CONTENTS WOULD NOT BE PUBLISHED BY TIA WITHOUT SUCH LIMITATIONS. ~rl[J1 fJli ffiorm ' 0Yic.ted by IHS undm No roprodu oproduo ol I\ ti o t w o l o n f i tnd tndu u ~ n i ; o y Associal n with TIA pottMll lKI without license from IHS pottM Order Number: Number: 2167 39 Sold to to::UPSISTEMAS 1202862100001). 2017-09-06 17:39:49 UTC ANSl/TIA-PN-942-B Telecommunications Infrastructure for Standard Data Centers Table of ontents 1 SCOPE ................... ... .. . .... ..... ........... ......................... ............................ .............. .. .... ........ ..... ..... .. ... ....... .............. ......... ....... ............... ............ 1 2 NORMATIVE REFERENCES ....... .............. ............. ........... ...... ............ ... .. ... .................... .. .. .. .................. ....................... ....... 1 3 DEFINITION OF TERMS, ACRONYMS AND ABBREVIATIONS, AND UNITS OF MEASURE .......................................................................................................................... ............................................................................................................................. 2 General ................ .................................. .................... .. ... .. ...... ... ...... .. ............. .......... ............ ............ ............... .... ....... ................... ... Definition of terms .................. ... ... .. ...... ... ....... ............ ..... ..................................... ......................... Acronyms and abbrevia abbreviations tions ... ..... .. ... .. ....... ...... ....................................... ... ................ ............ Units of measure ..... ... .. .. ......... ........... .. .. .. .................. .................... ... ............. ... ............... ................... .... ....................... 3.1 3.2 3.3 3.4 4 2 2 7 8 DAT A CENTER DESIGN OVERVIEW ......... ................... .................... .................... ............... ..... .. .. .. ... .......... ........ ......... ........ ..... ... .......... 9 4.1 General .................................................................................... ....................... .. ....... .......... .. .. .. 9 4.2 4.3 4.4 Relationship Relationshi p of data center spaces to other building spaces . .................. .. ..... .. .. ..... .. .. .. .. 9 Availa bility and Securi Availability Security ty ......................... ....... ......................... .. ... ............... .................... ...... ...... ........... ..... 10 Consideration for involvement of professionals ........ ................ ............ .............................................. .......................................... 11 5 DATA DAT A CENTER CABL CABLING ING SYSTEM INFRASTRUCTU INFRASTRUCTURE RE ......... ................... ................... ............ ................. .............. .. 12 6 DATA CENT CENTER ER TELECOMMU TELECOMMUNICATIONS NICATIONS SPACES AND RELATED TOPOLOGIES ... 15 6 .1 General ..... ....... ........................................ ......... ................................... .... .............................. 6.2 Data center structure ............................. ..... ..................... ........... ... .................... .............................. .............. .... 6.2.1 Major elements ............................... .. ..................................... .................. ................................... 6.2.2 Basic data cente centerr topology ............. ................... ...................................... ................................ ............... ............................ ............. ....... 6.2.3 Reduced data center topologies ............................................ .................................. 6.2.4 Distributed data center topologi topologies es ............... ................................ .......................... ......... ......... .................. ......... ................ 6.2.5 Topologies Topologi es for broadband coaxial cabling ................... .......................... ....... ........... ..................................... . 6.3 Energy efficie efficient nt design .................... ........................................ ...................... .. .. ..................... ........ ............. .......................... ............... 15 15 15 16 17 17 18 18 6.3.1 General .................................................................................. ..... .. ........ ..... ............. ............... 18 6.3.2 Energy effici efficiency ency recommendation recommendations s ...................................... .................................. 19 6.4 Common require requirements ments for compute computerr rooms and entrance rooms .................................. 22 6.4.1 General ........... .. ..................... ....... ........ .... .... .. ...... .......... .. ...... ..... ............ ................ ... ......... 22 6.4.2 Architecturall design ........ Architectura ....................... ...................... ......... ... ... ... ... .............. ..................... ... ............................... 22 6.4.3 Environmental design .............. .......................... .............................................. .................................. ... ..... ..................... ......................... . 24 6.4.4 Electrical design ........................... ........... ...................................... ........................... .... ................ .................. 24 6.4.5 Fire protection ........... .................................. ....... ............................... .... . ........... .. .. ... ... ......... 25 6.4.6 Water infiltrati infiltration on ............................. .. ...................................... .. .......... ....... ... ............ 25 6.4.7 Access ....... ............................. ............ ............................................. ................................. .. ......... ................. .......................... 25 6.5 Computer Comput er room requireme requirements nts .............. ................... ......................................... .................................... .................................. 25 6.5.1 General .................................................. ........................................... ....... ...... ....................... ... ......... .. ....................... 25 6.5..2 6.5 Location .... ................................... ... ...................................... ..... ........... ....... ... ... .. ....... ......... ....... 26 6.5.3 Environmentall design - HVAC .......... ... .................. .......... Environmenta ................. ............ ................ ................. .......... .... .. ... .. 26 6.5..4 6.5 Electrical design ...................................................................... ..... .................................. 26 6.6 Entrance room requirements ............... .............................. .............................. ......................... .......... ......... .. ..... .................... 26 6.6.1 General ......... ................................................................................. ........................................................................ ........ ... ...... .......... .................. ........ 26 goi l ;1tuh1 T a l c c 4 m m o 1 C t 1 1 1 n ~ rn ustry N'"'liell d by IHS •1ntl er lico licoo oso whh TIA 1 l o n o f l IQ : luo tlon ot "6 WO( lcio g ponn ponnii ed w11ho ut license from JHS Order Number: 02167039 Sold to:UPSISTEMAS 202062100001 , 2017-09·06 17:39:49 UTC ..... ANSl/TIA-PN-942-B 6.6.2 Location .......... ........ .. ......... .................... ......... .............. ..................... .......................... ......... .... .. ....... ..... ...... 26 6.6.3 Quantity ............................................... ............................................. ............ ......... .. . 26 6.6.4 Entrance conduit routing unde underr access floor ..................... .................................... ............... .......... .. .. ........ . 27 6.6.5 Access provider and service provider spaces .......................... ................................. ....... ........... .. .... .. ... .. 27 6.6.6 Building entrance terminal ................. ................................... ................................... ............................ ........... .... .... ............. .. . 27 6.6.7 Architectural design ................. ................................. ................................ ................................ ................... ... .. .. ................ .......................... 27 6.7 Main distribution area .......................... ............................... ..... ................................................ .. .. .......... .................... 28 6. 7 1 General ...................................................................................... .............................. 28 6.7.2 Location ........... ... ... ............... ...... ....... ...... ............. .. ...... .......... ......... .. ... ............... .. ........ 28 6.7.3 Facility requirements ........... ............... ..... ........ .... .. ..... .... .......... ... ........ .... ............... ....... ...... 28 6.8 Intermediate Interme diate distributi distribution on area ............. ...................... ............... ...... .... .... ....... .... ...... .. .. ................................ 28 6.8.1 General ............................................................................................. .. .... ..... .... ......... ......... 28 6.8.2 Location .. ....................................... ... ...................................... .... ........ ........... ..... .... .... ... 29 6.8.3 Facility requirements ...................... .......................................... .... .. ... .. .......... .............. ....... 29 6.9 Horizontal distributi distribution on area .................. .. ................... ........ ......................... ...................... ..................... .. . 29 6.9.1 General ..................................................................................... .... .... .. ........... ..... .... ...... 29 6.9.2 Location ............................................................................................ ..... ........... ... ..... ..... 29 6.9.3 Facility requirements .................. .. ............................................... ...... ..... .. .. .... ... .. ..... 29 6.10 Zone distribution area .............. ............................... ................................. ................................ ............................... ............... ........... .... ..... .. . 29 6.11 Equipment distribution areas ..................... ...... ... .. ............................. ..... ....... .... ....... ...... 29 6.12 Telecommu Telecommunicati nications ons room ........... ... .. .. ....... ......... ............... ...... ...... .......... ...... .. ... ................. ............................... ... 30 6.13 Data center support areas areas.............. .............. ...... ............................................ ...................................... .. ...... .. .... .. .. ................... 30 6.14 Cabine Cabinets ts and racks ..................................................................................... .......... .......... 30 6.14.1 General ............................................................................................. ....................... 30 6.14.2 Hot and cold aisles .................... ......................................... ......................... ........................ ..... ... .. .. .. . .. ... ......... 30 6.14.3 Placement relative to floor tile grid .................................................... ............ .. ..... .. .. 31 6.14.4 Access floor tile cuts ............. ............................. ............................... .............................. ...................... ....... .. ..... ......... .......... ... .. ..... 31 6.14.5 Installation of racks on access floors ................................................ ......... .............. ............. .. 32 6.14.6 Rack Racks s and cabinets in entrance room, MDAs, IDAs and HDAs ........ .... .. .. .. ..... ............. 32 7 DATA DA TA CENTER CABLI CABLING NG SYSTEMS .......... .................... .................... .................... .................... ................. .............................. 33 7 .1 General. .... ... . ... .. ................... ....... .. ... .... ... .. .. ............ ............... ..... .... ........ .. .... .............................. 7 .2 Choosing media ........ ......................... .................... .. ....... .................................. ............ ................. .. .... 7.2.1 General ......................................... ..................................................... ........ .............. 7.2.2 Cable fire rating requireme requirements nts ..... .. .................................................... .......... .. ...... .. .. 73 Horizontal Cabling .............................................................................. .. .... .. .... ..... ................ .. 7.3.1 .. .. .. .. General ...................................... ..................................... .................................................... ....... .. .. .. .. .. .. 7.3.2 Topology .. .................................................................................... ..... .. .. .. .. ........ .. ..... 7.3.3 Horizontal cabling length .............. ............................. .............................. .............................. ....................... .............. ...... ... .. ....... .. .. 33 33 33 33 33 33 34 34 7.3.4 Direct attach cabling ................... ....................................... .................... .............................. ................................ ............. ................. .. ...... 34 7.3.5 Recognized media ............................................................................ .... ....:: ...... ... .. ...... 35 7.3.6 Optical fiber connectors .................. .... .............. .. ...... .... ............ .................. ...... .. ......... .. ............ 35 7.3.7 Coaxial cable connecto connectors rs .... ......... .... ..... .. ....... .. .......................... ..... .. ....................... 35 7.4 Backbone cabling ...................... .................................... .............. .................................................. ...................... 36 7.4.1 General .......................................... .. .. ............................................... ....................... 36 7.4.2 Topology ........................................ .. ................................................. ....................... 36 7.4.3 Redundant cabling topologi topologies es ........ .. ................................................ ............ .. ......... 37 7.4.4 Recognized media ............... ............................. ............................. .............................. ....................... ........ .... ..... ............ ................. ... .... 37 7.4.5 Optical fiber connectors ............... .... .. ......................................... .. .... ........... .. .......... 38 7.4.6 Coaxial cable connecto connectors rs ........... .. .................................................... ...................... .. 38 7.4.7 Backbone cabling lengths .......... ........................................................ .. ....... ............................. ...................... .. 38 7.5 Centralized Centralize d optical fiber cabling .... .... .... .... .... .... ................................ .. ...... ........................... ..................... . 38 7.5..1 7.5 General ..... .. .. .. .. ..................................... .... ... .. ................. .. ...... .......... ................................. 38 38 7.5.2 Implementation .... ...... ... . ...... ......................... ........... ................................... ......... .............. .............. ..... ........... ...... 38 7.6 Cabling transmissi transmission on performance and test requirements .................... ......................... 38 7.6.1 General .. ... ......................... ..................................................................... .. ............... 38 38 ii u p l r l a r 1raciamrnonl u:lliana l ndu :iu ry Auocftt. uocftt.tion tion JttWk iud by IHS nndar llcAt1H wl th TIA roptodu l l torklr torkl r r;ie1rulfted hn 01 l11 lg without license from IHS 110 Order Number: 02167039 Sold lo:UPSISTEMAS {202662100001 ). 2017·09·06 17:39:49 UTC ANSl/TIA-PN-942-B 7.6.2 8 Additional requireme requirements nts for field testing of 75-ohm coaxial cabling ... ...... ... ... ......... 38 DATA CENT CENTER ER CABLIN CABLING G PATHWAYS ... ...... ............... ............... ............ ................................................... 40 General ............................................................................................................ ........................................................................................................... ... ...... .... .... 40 8.2 Security for data center cabling ............... ............................... ................................ ................................ .................... .... .. .. ............... 40 8.3 Routing of telec telecommuni ommunication cations s cables ................... ..................................... ..................................... ..................... .. ... .............. 40 8 .3.1 Separation between power or lighting and balanced twisted-pair cables ...... ... .. . .... 41 8 .3.2 Separation offi er and balanced twisted-pair cabling ............................. ................ 41 8.1 8.4 Telecommu nications Telecommunicati ons entrance pathways ................. .................................. .................................. ...................... ..... ................ 41 Entrance pathway types .......................................................................................... ........................................................................... ............... 41 8.4.2 Diversity ............. ............................ .............................. ............................. ............................. .............................. ........................... ............ ......... ............. ... . 41 8.4.3 Sizing .......................... .. ........................................................................... ....... ........ . 41 8.5 Access floor systems .............. .............................. ................................ ................................ ................................ ........................ ........................ ................ 42 8.5.1 General ................................................................................................................... .................................................................................................... ................. 42 8.5.2 Access floor performance requirements ..................... .......................... ..... .......................... .............. 42 8 .5.3 Floor tile cut edging ..................... .......................................... .......................... ..... .. .................................... .. .. ......... 42 8.6 Cable trays ............... ............................. ............................ ............................ ............................ ............................ ............................ .................. ........ .... .. ......... 42 8 .6.1 General ......................... ........................................................................... .......................................................................... ......... ....... 42 8.6.2 Cable trays in access floor systems ...................................... .. ................... .. ... ........ 43 8.6.3 Overhead cable trays .............. ............................ ............................ ............................. ............................. ......................... ........... .. ....... ........... .... 43 8.6.4 Coordination of cable tray routes ............... .............................. ............................... ............................... .................. ... .. .. .. .. . .... 43 8.4.1 9 DATA CENTER REDUNDAN REDUNDANCY CY .... .................................... ........... ................................................ 44 .. Introduction mainten .................................................................... ......................................................................................... ..................... ...... .......... .............. .... 44 .... .......... .. ....... .. ........................ 45 Redundant maintenance ance holes and entrance pathways ...... Redundant acce ?S provider services .................................. ............................. ..... .. ................ .. ...... .. .............. .. 45 Redundant entranc entrance e room ................ ................................. .............................. .................................... ....................... .. ................... .... 45 Redundant main distributi distribution on area .... .. ...... .. ..................... .... .. ... ......... .. .. .. ........................ 46 Redundant backbon backbone e cabling .................... ................... ...... .... ........... ................ ..... .. ... .. .. ...... ... .. ................... .. ... 46 Redundant horizontal cabling .................. ..................................... ..................... ........... ............................. ...................... .. .. .. ...... .... ... 46 9.1 9.2 9.3 9.4 9.5 9.6 9.7 10 CABLING CABLIN G INSTA INSTALLATI LLATION ON REQUIREMENTS ........... ....................... ............... ... .. .. ......... .. .......................... 46 11 CABLING TRANSMISSIONG PERFORMANCE REQUIREMENTS ... . ............................. 46 12 CABLING CABLIN G FOR INTELLI INTELLIGENT GENT BUILDING SYSTEMS ......... ................... ................... ................. ........................... 46 13 CABLING CABL ING FOR WIRELESS ACCESS POINTS ............ ....................... ....................... ....................... ....................... .................. ........ 46 14 CABLING CABL ING FOR DISTRIBUTED ANTE ANTENNA NNA SYSTEMS ......... ................... .................... .................... .................... ............ .... . 46 15 POWER POWE R DELIVERY OVER BALANC BALANCED ED TWISTED-P TWISTED-PAIR AIR CABLING ............... ................. ........ ................ 46 16 GROUNDING AND BONDING ....... .............. .............. ......... .. .. ................. .......... ................................ ........................................ 46 17 FIRESTOPPING .. ....... ....... ... ...... ..... .. ........ ........... .... .... .... ... ................. ................... ... ..... ... ... ...... 47 18 PHYSICAL PHYSICA L SECURITY ......... ................... .................... .................... ............. ... ... ......................... ................ .... .. .. ........ .......... 47 19 ADMINISTRATION ................................................................ .............................................. 47 ANNEX A A.1 INFORMATIVE) CABL CABLING ING DESIGN CONSIDERATION CONSIDERATIONS S .................. ..................... ........ ............... 49 Application Applicati on cabling lengths ............... ............................... ................................ .............................. .............. ........ .. ..... ... .. ..... .. ...... 49 A.1.1 A.1.2 T-1, E-1, T-3 and E-3 circuit lengths ....................................... ............... .................... ..... .. .. ... ...... 49 Baluns E-3 and T-3 circuits ................... .. .............................. .... .. ........... .. . .... ........... 51 iii ~ ; : ~ ~ teiacxtfmmm ic icn ntum is lmfi m lry £ llr.tiflM l/J hh TIA ed by 11i S l4r s:soom lion Order Number: 02167039 Sold to:UPSISTEMAS [202862100001]. 1 6J lffic~Klllc Of e l W pormitled w)J hO W icense from IHS 2017-09-06 17:39:49 UTC ANSl/TIA-PN-942-B A.1.3 TIA-232 and TIA-56 TIA-561 1 console connections ................... ...................................... ................................... ................ ....... 52 A.2 Cross-connectio Cross-co nnections ns .............. ............................. ............................. ............................. .............................. .............................. .......................... ................. ........ 53 A.3 Separation of functions in the main distribution area ...................................................... ................................................ ...... 53 A.3.1 Twisted-pair main cross-connect ............................................................................. ...................................................................... ....... 53 A.3.2 Coaxial main cross-conn cross-connect.. ect.. ............... ............................... ................................. ................................. ............................. ............. ...... 53 A.3.3 Optical fibe fiberr main cross-c cross-connect onnect ................ ................................. .................................. .................................. ...................... ..... .. .. . 53 A.4 Separation of functions in the horizontal distribution area .............................................. ....................................... ....... 54 A.5 Cabling to end equipment ............................................................................................. ........................................................................................ ..... . 54 ... .. 54 A.6 Fiber Fib er design consideration considerati on ................................ ................ ................................ ............................... ............................... ......................... ......... A. 7 Balanced twisted-pair design design consideration consideration .......... ................... .................. .................. .................. ................... ............... ........ ..... 54 ANNEX B {INFORMATIVE) {INFORMATIV E) ACCESS PROVIDER INFORMATION ...................... ..................................... ............... .. 55 B.1 Access provider coordination .......................................................................................... ................................................................................... ....... 55 B.1.1 General .................................................................................................................... .................................................................................................................... 55 55 to to B.1.2 Information provide access providers .............................................................. ....................................................... ....... 55 B.1.3 Information that the access providers should provide ...................... ..................................... ............... ........ 55 B.2 Access provider demarcation in the entrance room ............................................... ........ 56 B.2.1 Organization .......................................................................................................... ... 56 B.2.2 Demarcation of low-speed circuits ................ ................................ ................................. .................................. .................... ......... ...... 56 B.2.3 Demarcation of T-1 circuits ...................................................................................... .............................................................................. ........ 59 B.2.4 B.2.5 ANNEX C Demarcation of E-3 T-3 circuit circuits s .................. ..................................... ..................................... ................................ .............. ..... ........ 59 Demarcation of optical fiber circuits ................ ................................. .................................. ................................ ............... ........ 60 INFORMATIVE) COORDINATION OF EQUIPMENT PLANS WIT WITH H OTHER ENGINEERS ................. ............................... .............. ......... ........... ........ .................. .................................................. ........... ANNEX D 6 INFORMATIVE) DATA CENTER SPACE CONSIDERATIONS .......... ............................ 62 INFORMATIVE) DATA CENTER SITE SELECTION AND BUILDING DESIGN CONSIDERATIONS ............................................................................................................ 63 NNEXE E.1 E.2 E.3 E.4 E.5 E.6 E. 7 General ............................................................................................. ........... .. ... ... . ... . ... .... Architectural Architec tural site selection and building design conside considerations rations .................. .. .. .. .. .... ... ..... Electrical site selection and buildi building ng design conside considerations rations ....................... .. .. .. .. .. .... ... ... Mechanical site selection and building design considerations .................. .. .... ..... .... ... .... Telecommunicat Teleco mmunications ions site selection and building design consider considerations ations .... ..... .. .. . ....... .. .. Security Securi ty site selection and building design conside considerations rations ........................ ...... ... . .... ..... .. Otherr site selection consid Othe consideratio erations ns ................ .................................. .................................... .......................... .................. ................. .. ... ANNEX F INFORMATIVE) DATA CENTER INFRASTRUCTURE RATING ...... .......................... 63 63 63 64 64 64 65 66 F.1 General .............................................................................................................. ... ..... ...... .... 66 F 1.1 Redundancy overview ..................................................................................... ..................................................................................... .... ...... .... 66 F.1.2 Overview .................................................................................................................... .................................................................................................................... ... 66 F.2 Redundancy ................................................................................................... .............................................................................................. ............. ........ ... .. .... 66 F.2.1 N - Base requirement .................. ............................ ................... ................... .................... ................... ................. ......................... ................. .... 66 N 1 redundancy .............................. .. ................................................. ..................... 67 F.2.2 F.2.3 N+x redundancy ....................... .. ................. .. .... .. ....... .... ....... .. ...... .. .... ..................... 67 F.2.4 2N or N+N redundancy ................... .. .................................................. .. ........ .. .......... .. . 67 F.2.5 2(N+1) redundan redundancy cy ................ ................................ ................................. .................................. ............................ ........... .. ...... .. ........... 67 F.2.6 Concurrent Concurr ent maintain maintainabilit ability y and testing capabilit capability y ........................ ............................... ....... ... .................. 67 F.2.7 Fault tolerant ................ ............................... ............................... ............................... ............................... ......................... ......... .. ...... ................... ............. 67 F.2.8 Capacity and scalabil scalability ity .............. ............................... ................................. ................................ ....................... .................... ............. .. ...... 67 F.2.9 Isolation .............. .............................. ............................... .............................. ............................... ............................... ................... ......................... ..................... 67 F 2.10 Data cente centerr rating ............... .............................. ............................. ............................. .............................. ...................... ....... .... ........... .... 67 F.3 Telecommunications ....................................................................................... ................................................................................... ...... ...... ........ ........ 68 F.3.1 I Data Center: Basic (telecommunications) ......................................... .................... 68 F.3.2 II Data Center: Redundant Component (telecommunications) ............ ... .... .. ........... 69 iv ~ o p y r i g h t ~ r o v i e cations Industry Ass ocialion Te1ecommunications by IHS under license with TIA \Jo reproduclion or networking permitted wilhoul license rrom IHS Order Number: 02167039 Sold lo UPSISTEMAS [202862100001 [. 2017-09-0617:39:49 UTC ANS l/TIA-PN-942-B F.3.3 Ill Data Center: Concurre Concurrently ntly Maintain Maintainable able telecommunicati telecommu nications) ons) .... ........... .. ......... F.3.4 IV Data Center: Fault Tolerant telecommu telecommunicatio nications) ns) ................... .................................. .................... ........... ...... F.4 Architectural and structural .................. ....................................... ......................................... ............................ ........ ............... ................... .... ....... F.4.1 General .......................................................................................... .............. ... .. ....... F.4.2 I Data Center: Basic architectur architectural) al) ...................... ............................................ .......................... ....................... ................... .. ..... II Data Center: Redundant Component architec F.4.3 architectural) tural) ................. ... ........................ F.4.4 Ill Data Center: Concurre Concurrently ntly Maintain Maintainable able architectur architectural) al) .......... .. ........ ......... .............. ...... ... F.4.5 IV Data Center: Fault Tolerant architec architectural) tural) ............................... .......... ................. 69 70 71 71 71 71 71 71 F.5 Electrical ................ ............................... ............................... ................................ ............................... .................. ... .. ............ ..................... ........................... 71 F.5.1 I Data Center: Basic electrical) .................... ........................................ .................... ............ ................. ...... ... .. ... ............. 71 F.5.2 II Data Center: Redundant Component electrica electrical) l) ...................... ...... .. ... ... ............. 72 F.5.3 Ill Data Center: Concurre Concurrently ntly Maintain Maintainable able electrical electrical)) ................ ........................ ........ ... ......... .. ..... . 72 F.5.4 IV Data Center: Fault Tolerant electrica electrical) l) ..................... .............................. ......... ..... ............ .. .... ... ....... 73 F.6 Mechanical systems ................ ................................ ............................... ............................... .............................. .............. ........ ... .... ....... ........... ..... 73 F.6.1 I Data Center: Basic mechanical mechanical)) ................ ................................. ................................ ............... ........................ .. . 73 F.6.2 II Data Center: Redundant Component mechani mechanical) cal) .................. .................. ......... ........ .. ....... ......... 73 F.6.3 Ill Data Center: Concurre Concurrently ntly Maintain Maintainable able mechanic mechanical) al) ............. ..................................... ........................ .. . 74 IV Data Center: Fault Tolerant mechanic F.6.4 mechanical) al) .................... ................................ ............ ............. .. ........ .... 74 ANNEX G G.1 G.2 G.3 INFORMATIVE) INFORM ATIVE) DAT DATA A CENTER DES DESIGN IGN EXAMPLES ... ... .... ....... ... .. ..... ........ .. ....... 88 Small data center design example ........................................... ..... .... ........... ....... .. ........ .... .. .... . .. 88 .. ..... Corporate data center design example ................ ................................ .................. .. .............. ....... .. .... .. ... ... 89 .......... Internet data cente centerr design example .................... ........................................ .................... ...... .. .......... ................. .. .. 91 ANNEX ANN EX H INFORMATIVE) CABL CABLING ING GUIDELINES FOR DA DATA TA CENTER FABRICS ..... ........ ... 94 H.1 Traditional Switch Architecture ................................................................................... .... 94 H.2 Multiple Connection Connections s .............. ............................. .............................. ............................. ............................. .............................. .......................... ........... .... 96 H.3 Data Center Switch Fabrics ................ ............................... .............................. ............................... ............................... ........................... .............. .. 97 H.3.1 Data center fabric fat-tree .................................................................................... .. .. 97 H.3.2 Data center fabric full-mesh ............. ............................ ............................. ............................ ............................ .......................... ............ . 101 H.3.3 Data center fabric inter-co inter-connected nnected meshes ................ ................................. .................................. ....................... ...... .. . 103 H.3.4 Data center fabric centralized switch ................ ................................ ................................ ................................ ................... ... .. 104 H.3.5 Data center fabric virtual switch ............. ............................ ............................. ............................ ............................ .................... ........ 106 ANNEX ANNE XI INFORMATIVE) BIBL BIBLIOGR IOGRAPHY APHY .......... .................... .................... .................... .................... ..................... ................... .......... 108 v No 1 l K:ntu;Jn lndll l/ry AsSt,X:1alion Wby1H Wby1 Hs U nt llctHls.6 w1 h TI A Order Number; 02167039 Sold lo:UPSISTEMAS [202862100001 ] e t • r ) J h ~ f ~ n g pa ml t a:d ~ h t n license from IHS 2017-09-06 17:39:49 UTC - ANSl/TIA-PN-942-B ist of figures Figure 1: Illustrative relationship between the ANSl/TIA-568 Series and other relevant TIA standards ............... .............................................. ............................... .......... . ................................... ...... .................. . x Figure 2: Relations Relationship hip of spaces in a data center .......... ............................................. ................................... ...................... .... 10 Figure 3: Functional elements of generic cabling topology ........................................................ ... 12 Figure 4: Examples of interconnecti interconnections ons and cross-conn cross-connections ections for Distributor A .... ...... ........ ..... 13 Figure 5: Example of a typical data cente centerr topology ....... ..... .. .... ...................... ....................... ... 14 Figure 6: Example of a basic data center topology .... ............ ........ ............................. ..... .................. ... 16 Figure 7: Example of a reduced data center topology ........................................ ...................... . 17 Figure 8: Example of a distributed data center topology with multiple entrance rooms ............ .... 18 Figure 9: Examples of routing cables and air flow contention ........................... ........ ............... . 20 Figure 10: Example of hot aisles, cold aisles and cabinet placement.. placement.... ................................ 31 Figure 11: Tile cuts should not be where it touches any of the lines on a cross formed by the corners of the tile ......... ................................... ...... ................................. ............ .................. 32 Figure 12: Typical horizontal cabling using a star topology .............................. ....... ............ 34 Figure 13: Typical backbone cabling using a star topology ..... ......................... ...... ...... ...... .... .. 37 Figure 14: Telecommunications cabling pathway and space redundancy ..... .................... 44 Figure 15: Cross-connection circuits to IDC connecting hardware cabled to modular jacks in the T568A 8-pin sequence ........................................................................................................... 57 Figure 16: Cross-connection circuits to IDC connecting hardware cabled to modular jacks in the T568B 8-pin sequence ........................................................................................................... 58 Figure 17: 17: Comput er room layou layoutt showing hot and cold aisles ................................................ 88 Figure 18: Example of corporate data center ................................................................................ 90 Figure 19: Example of Internet data center ............................................................... ....................................................... ........ .................... 92 Figure 20: Example of traditional three-tier data center switch architecture .... ........ ..................... 94 Figure 21: Example of ANSl/TIA-942-B cabling topology ....................... ............................ ..................... ................................. ................. 95 Figure 22: Examples of redundant connectivit connectivity y ............................................................................ 96 Figure 23: 23 : Fat-tree example .... .... ................... . ... ...... ....... .... ..... .. .... ....... ..... .......... ......... ..... ..... 97 Figure 24: Fat-tree with port extenders example ........................................................................... 98 Figure 25: Example of use of structured cabling for fat-tree switch architecture .... ...................... 99 Figure 26: Interconnected fat-tree pods example ........ ........................................... ................................... ............ ................. 100 Figure 27: Full-mesh example ........................................ ........................... ............................................... .................................. ........ ................... 101 Figure 28: Example of use of structured cabling for full-mesh switch architecture ..................... 102 Figure 29: Interconnected meshes example .................. ................................. ........ .................. 103 Figure 30: Example of use of structured cabling for interconnected mesh fabric ..... .................. 104 Figure 31: Example Centralized switch example ................. ......... ................ ....... .............................. ..... .................. Figure 32: of use of structured cabling for centralized switch fabric ............................ Figure 33: Virtual switch example ........................ ..... ..... .... ..... . .... .... ...... ......... ..... Figure 34 : Example of cabling for fabric virtual switc switch h architecture .................. ........................ 104 105 106 107 ist of o f tables Table 1: 1: Conduit sizes ........ ................................... ......... .............................. .......... ..... ..... 3 Table 2: 2 : Maximum Coaxial Cable Insertion Loss .... ...................................... ........ .......... ............ . 39 Table 3: 3 : Maximum circuit lengths with no DSX panel ...... ............................. .... . ............. 49 Table 4: 4 : Reduction in circuit lengths for DSX panel ..... ..... .......... ..... ........................ ................. 49 Table 5: 5 : Reduction in circuit lengths per connection or outlet... .... ......... ............... ...... ........ ..... ...... . . 50 Table 6: 6 : Maximum circuit lengths for the typical data center configuration ....... ...... .... ....... .... . 51 Table 7 7:: Maximum backbone length for the typical data center configuration ............ .. ....... 51 Table 8: 8 : Maximum circuit lengths over baluns NOT including insertion loss of baluns .......... ...... 52 vi :opyrighl Telecommunicelions Telecommunicelions lnduslry Associat Association ion >rovided by IHS under license wilh TIA o reproduction or networking permilled wilhout license from IHS Order Number: 02167039 Sold lo :UPSISTEMAS [202862100001 ), ), 2 17· 9 · 6 17:39:49 UTC Copy r o v ~ ore ANSl/TIA-PN-942-B Table 9: Reduction in maximum circuit length for each 1 dB insertion loss for a pair o baluns ... 52 Table 10: Reduction in maximum circuit length length for each additional twisted-pair connection after the 1st 1st two) . 52 Table 11: Reference guide telecommunic telecommunications) ations) .......... .................... .................... .................... ..................... ..................... .................... ............ .. 75 Table 12: Reference guide architectural) ......................... .................................... ..................... ..................... ..................... ..................... .................. ....... 76 Table 3: Reference guide electrical) ......... .................... ..................... ..................... ..................... .................... ..................... ..................... .................. ........ 8 Table 14: Reference guide gu ide mechanical) ........... ...................... ..................... ..................... ...................... ...................... ...................... ..................... .......... 86 vii ~ ( N0' h i l o o o n 1 m ~ m l r n l b 1 : lmJl.l Plty Asaocia1ion lid by IBS m d n r wllh TIA Order Number: 02167039 Sold to:UPSI STEMAS 202882100001 J O P<0 Uf1ruflg i 1or networking permitted without license from IHS 2017-09·08 17:39:49 UTC - ANS 1/TIA-PN-942-B FOREWORD (This foreword is not considered part of this Standard.) This Standard was developed by TIA Subcommittee TR-42.1 . Approval This o this Standard Standard was approved by the Telecommunications Industry Association (TIA) Subcommittee TR 42. 42 . 1 TIA Technical Engineering Committee TR 42, and the American National Standards Institute (ANSI). ANSI/TIA reviews standards every 5 years. At that time, standards are reaffirmed, revised, or withdrawn according to the submitted updates. Updates to be included in the next revision of this Standard should be sent to the committee chair or to TIA. Contributing organizations More than 60 organizations within the telecommunications industry (including manufacturers, consultants, end users, and other organizations) contributed their thei r expertise to the development of this Standard. Documents superseded This Standard replaces ANSl/TIA-942-A dated August 2012 and its addenda. This Standard incorporates the technical content of ANSl/TIA-942-A, Addendum 1 Guidelines for Data enter Fabrics abling Major modifications from ANSl/TIA 942 A The major modifications in ANSl/TIA-942-B from ANSl/TIA-942-A include: • Added Add ed MP0-1 MP0-16 6 and MP0-32 (ANSl/TIA-604-18) and MP0:24 (ANSl/TIA-604-5) as options for termination of more than two fibers in addition to the MP0-12 connector • Added category 8 as an allowed type of balanced twisted-pair cable cable.. Changed recommendation for category 6A balanced twisted-pair cable to category 6A or higher. • Added OMS as an allowed and recommended type of multimode fiber cable. • Added 75-ohm broadband coaxial cables and connectors as ANSl/TIA-568.4-D as allowed types of coaxial cables and connectors . • Added recommendation to not install optical fiber cords and cables (both (both bend insensi insensitive tive and non-bend insensitive) without adequate armoring or sufficiently thick jacket in pathways that can create microbends, microbends , such as non-continuous cable supports, supports , wire basket trays, trays , and cable ladders without radiused cable supports or solid bottoms. • Reduced quantit quantity y of conveni convenience ence outlets required on computer room walls. • Local fire protection codes may be use used d inste instead ad of o f NFPA 75. • Power for air conditio conditioning ning systems and controls in computer rooms and entrance rooms should be redundant, but do not need to be powered from the same PDUs or panel boards that serve ICT equipment in the room. • Recommended maximum cable lengths for direct attach cabling in EDAs has been reduced from 10 m (33 ft to 7 m (23 ft Additional guidance added that direct attach cabling between rows is not recommended . • Added recommendation that cabinets be at 1200 mm (48") deep and to consider cabinets wider than 600 mm (24") wide. specified in viii :;opyright Telecommunicalions Industry Association rovided by IHS undor license wilh TIA l o reproduction or networking permilled without license from IHS Order Number: 02167039 Sold to:UPSISTEMAS [202862100001 ] 2017-09-06 17:39:49 UTC Copyri Provid No rep ANSl/TIA-PN-942-B • Added recommendation to consider preterminated cabling to reduce installation time and improve consistency and quality qu ality of terminations. • Added recommendation to consider needs for proper labeling, cable routing, routing, cable management, and ability to insert and remove cords without disrupting existing or adjacent connect connections. ions. • Adds normative reference to ANSl/T ANSl/TIA-50 IA-5017 17 regarding physical security for the data center telecommunications infras infrastructur tructure. e. • Adds normative reference to ANSl/TI ANSl/TIA-862A-862-B B regarding requirements for cabling for intelligent building systems including networked data center electrical, mechanical, and security equipment. • Added reference to TIA TSB 162-A for guideline guidelines s regarding cabling for wireless access points in data centers • Added reference to TIA TSB-501 TSB-5018 8 for guideline guidelines s regarding cabling for distributed antenna systems in data centers. • Added reference reference to TIA TSB-184-A for guidelines guidelines regarding regarding power power delivery over balanced balanced twisted-pair cablin cabling. g. • Numerous changes to the rating tables in Annex F including those that specify concurrent maintainability maintainabil ity for RatingRating-3 3 (former (formerly ly Tier 3) and fault tolerance for Rating-4 (formerly Tier 4). Relationship to other TI standards and documents The following are related standards regarding various aspects o structured cabling that were developed and are maintained by Engineering Committee TIA TR-42. An illustrative diagram of the ANSl/TIA-568 Serie Series s relationship to other relevant TIA standards is given in figure 1. • ANSl/TIA-568.0-D, Generic Telecommunications Cabling f or Customer Premises • ANSl/TIA-568.1-D, Commercial Building Telecommunications Infrastructure Standard • ANSl/TIA-568-2.C, Balanced Twisted-Pair Telecommunications Cabling and Components standard • ANSl/TIA-568.3-D, Optical Fibe r Cabling • ANSl/TIA-568.4.D, Broadband Coaxial Cabling and Components Standard • ANSl/TIA-569-D, Telecommunications Pathways • ANSl/TIA-606-C, Administration Standard for Telecommunications Infrastructure • ANSl/TIA-607-C, Telecommunications Bonding and Grounding Grounding Premises • ANSl/TIA-758-B, Standard • ANSl/TIA-862-B, Structured Cabling Infrastructure Standa rd for Intelligent Building Systems • ANSl/TIA-5017, Telecommunications Physical Network Security Standard Customer-Owned nd Components Standard Outside nd Spaces Plant Telecommunications ix C<>pytlulu T I Pr ovld o n 61 n Dce 1nm u 11CHlkH 1 lHS u1 d aJ fce.11 1 • . h\i Jus try A 1UltiC'INl1on wlt ll T IA Earlhing) Earlhin g) for Customer Order Number: 02167039 Sold lo:UPSISTEMAS [2 28621 1 , Infrastructure p r )\tl i :J11 1 11on w1hvorkl n.o jXiITTl it led Wl1 1)aur license from IHS 2 17· 9· 6 17:39:49 UTC ANSl/TIA-PN-942-B Common Standards Premises Standards Cabling Component Standards I ANSl/TIA-568.1 Commercial) ANSl/TIA-568.0 Generic) AN Sl/TIA-568.2 Balanced twisted- pair) ANSl/TIA-569 Pathways and spaces) ANSl/TIA-570 Residential) ANSl/TIA-568.3 Opticall fiber) Optica ANSl/TIA-606 Administration) ANSl/TIA-942 Data centers) ANSl/TIA-607 Bonding and grounding {earthing]) AN Sl/TIA-568.4 Broadband coaxial) ANSl/TIA-1005 Industrial) ANSl/TIA-758 Outside plant) ANSl/TIA-1179 Healthcare) ANSl/TIA-862 Intelligent building systems) ANSl/TIA-4966 Educational) ANSl/TIA-5017 Physical network security) Figure 1: Illustrative relationship between the ANSl/TIA-568 Series and other relevant TI standards The following documents may also be useful to the reader: • National Electrical Safety • National Electrical ode® NESC®) ode® NEC®) (IEEE C 2-2012) (NFPA 70-2014) Useful supplements to this Standard are the BICSI Telecommunications Distribution Methods Manual, the Outside Plant Design Reference Manual, and the Information Transport Systems Installation Methods Manual. These manuals provide recommended practices and methods by which many o f the requirements requirements of this Standard may be implemented. Other references are listed in Annex I. x ~ o p y r i g h l Telecommunications Industry Association Jrovided by IHS under license with TIA fo reproduction or networking permitted without license lrom IHS Order Number: 02167039 Sold lo:UPSISTEMAS [202862100001 ] 2017-09-06 17:39:49 UTC a p y r i g ~ 'rovided lo repro ANSl/TIA-PN-942-B nnexes There are nine annexes to to this Standard. Annexes A B C D E F G H and I are informative and not considered to be requirements of this Standa Standard. rd. Purpose o this Standard The purpose of this Standard is to provide requirements and guidelines for the design and installation of a data center or computer room. It is intended for use by designers who need a comprehensive understanding of the data center design, including the facility planning, the cabling system, and the network design. The standard will enable the data center design to be considered early in the building development process, contributing to the architectural considerations, by providing information that cuts across the multidisciplinary design efforts, promoting cooperation in the design and construction phases. Adequate planning during building construction or renovation is significantly less expensive and less disruptive than after the facility is operational. Data centers in particular can benefit from infrastructure that is planned in advance to support growth and changes in the computer systems that the data centers are designed to support. This document presents an infrastructure topology for accessing and connecting the respective elements in the various cabling system configurations currently found in the data center environment. In order to determine the performance requirements of a generic cabling system, various telecommunications services and applications were considered. In addition, this document addresses the floor layout related to achieving the proper balance between security, rack density, and manageability. The standard specifies a generic telecommunications cabling system for the data center and related facilities whose primary function is information technology. Such application spaces may be dedicated to a private company or institution, or occupied by one or more service providers to host Internet connections and data storage devices. Data centers support a wide range of transmission protocols. Some of these transmission protocols impose length restrictions that are shorter than those imposed by this Standard. Consult standards, regulations, equipment vendors, and system service suppliers for: applicability, limitations, and ancillary requirements when applying specific transmission protocols. Consider consolidating standardized and proprietary cabling into a single structured cabling system. Data centers can be categorize categorized d according to whether they serve the private domain ( enterprise data centers) or the public domain (internet data centers, co-location data centers, and other service provider data centers). Enterprise facilities include private corporations, institutions or government agencies, agencies, and may involve the establishment of either intranets or extranets. Internet facilities include traditional telephone service providers, providers, unregulated competitive service providers and related commercial operators. The topologies specified in this document, however, are intended to be applicable to both in satisfying their respective requirements for connectivity (internet access and wide-area communications), operational hosting (web hosting, file storage and backup, database management, etc.), and additional services (application hosting, content distribution, etc.). Failsafe power, environmental controls, fire suppression, system redundancy and security are also common requirements to facilities that serve both the private and public domain. Stewardship Telecommunications infrastructure affects raw material consumption. The infrastructure design and installation methods also influence product life and sustainability o electronic equipment life cycling. These aspects o telecommunications infrastructure impact our environment. Since building life cycles are typically planned for decades, technological electronic equipment upgrades are necessary. The telecommunications infrastructure design and installation process magnifies the need for sustainable infrastructures with respect to building life, electronic equipment life cycling and considerations of effects on environmental waste. Telecommunications xi Order Number: 2167 39 Sold lo:UPSISTEMAS [202862100001], 2017-09·06 17:39:49 UTC ANSl/TIA-PN-942-B designers are encouraged to research local building practices for a sustainable environment and conservation of fossil fuels as part of the design process. See ANSl/TIA-4994 and TIA TSB-5046 for sustainability processes and guidelines. Specification o criteria Two categories o criteria are specified; mandatory and advisory. The mandatory requirements are designated by the word shall ; advisory adviso ry requirements are designat designated ed by the words should , may , or desirable which are used interchan interchangeably geably in this Standard . Mandatory criteria generally apply to protection, performance, administration and compatibility; they specify minimally acceptable requirements. Advisory criteria are presented when their attainment may enhance the general performance of the cabling system in all its contemplated applications. A note in the text, table, or figure is used for emphasis or offering informative suggestions, or providing additional information. Metric equivalents o US customary units The dimensions in this Standard are metric or US customary with approximate conversion to the other. ife o this Standard This Standard is a living document. The criteria contained in this Standard are subject to revisions and updating as warranted by advances in building construction techniques and telecommunications technology. xii ;opyrighl Telecommunic Telecommunications ations Industr Industry y Associatio Association n )rovided by IHS under license whh TIA Order Number: 02167039 Sold lo:UPSISTEMAS (202862100001 ] :iyright Te ~ i e by Jo reproduclion or networking permitled without license lrom IHS 2017·09-0617:39:49 UTC teprodu l ANSl/TIA-PN-942-8 SCOPE This Standard specifies the minimum requirements for telecommunications infrastructure of data centers and computer rooms, including single tenant enterprise data centers and multi-tenant data centers. The topology specified in this document is intended to be applicable to any size data center. 2 NORMATIVE REFERENCES The following standard contains provisions that, through references in this text, constitute provisions of this Standard. At the time of publication, the editions indicated were valid. All standards are subject to revision, and parties to agreements based on this Standard are encouraged to investigate the possibility of applying the most recent editions of the standards published by them. a) ANSl/ATIS 0600404:2005, Network Interface Specification b} ANSl/NFPA ANSl/NF PA 75-2 75-2017, 017, Standard for the Fire Protection c) ANSl/TIA-568.0-0:2015 ANSl/TIA-568.0-0 :2015 - Generic Telecommunications Cabling and Customer Installation Interfaces - DS3 and Metallic of Information Informat ion Technology Equipment® for Customer Premises d} ANSl/TIA-5 ANSl/TIA-568.1-0:2015 68.1-0:2015 - Commercial Building Telecommunications Infrastructure Standard e) ANSl/TIA-568-C.2:2009, f) Balanced Twisted-Pair Telecommunications Cabling and Components Standard ANSl/TIA-568.3-0:2016 - Optical Fiber Cabling ANSl/TIA-568.3-0:2016 Cabling an d Components Standard g) ANSl/TIA ANSl/TIA-568.4-0:20 -568.4-0:2017 17 - Broadband Coaxial Cable and Components Standard h} ANSl/TIA-569-0:2015- Telecommuni Telecommunications cations Pathways i) ANSl/TIA-604-5-E:2015 - FOCIS 5 - Fib Fiber er Optic Connector Conne ctor lntermateabili ty Standard, Standard, Ty Type pe MPO j ANSl/TIA-604-10-8:2008 - FOCIS 10 - Fiber Optic Connector lntermateability Standard, Type LC k) Conne ctor lntermateabil ity Standard, Standard, Typ Type e ANSl/TIA-604-18:2015 - FOCIS 18 - Fibe r Optic Connector and Spaces MP0 16 I) Telecommunications Infrast Infrastructure ructure ANSl/TIA-606-C:2017 - Administration Standard for Telecommunications m) ANSl/TIA-607-C:2015 Customer Premises Telecommunications Telecommunic ations Bonding and Grounding Earthing) for n) ANSl/TIA-758-8:2012 - Customer-Owned Outside Plant Telecommunications Infrastructure Standard o) ANSl/TIA-862-8:2016 - Structured Cabling Infrastructure Standard for Intelligent Building Systems p) ANSl/TIA-5017:2016 - Telecommuni Telecommunications cations Physical Network Security Standard q) ANSl/TIA-5048:2017 Automat ed infras infrastructu tructure re Requirements, data exchange and applications management AIM) r) OSHA CFR 1926.441 - Battery Rooms a nd Battery Charging s) Telcordia GR-63:2012 - NEBS™ Requirements: Physical Protection Protection t) Telcordia Telcord ia GR-3175:2014 - Generic Requirements for lntrabuilding Coaxial Cable ~ { i ~ l l . l h t llfl llfllllX:lg mrmmJ c.o UanB nCJ115 lry AsDo dn tion Order Number: 02167039 systems - U l>v IHS undnr or n 1 w o r ~ l r t wl 1h l IA Sold lo:UPSISTEMAS (202862100001]. 2017-09-06 17:39:49 UTC J>(l rm J led wi1hC l ll ,license from IHS ANSl/TIA-PN-942-B 3 3.1 DEFINITION OF TERM DEFINITION TERMS, S, ACRON ACRONYMS YMS AND ABBREVI ABBREVIATION ATIONS, S, AND UNITS OF MEASURE General The generic definitions in this clause have been formulated for use by the entire family of telecommunications infrastructure infrastructure standards. standards. Specifi Specific c requirements are are found found in the normative clauses of this Standard. 3.2 Definition o f terms For the purposes of this Standard, the following definitions apply . removable and interchangeable floor panels that access floor: A system consisting of completely removable are supported on adjustable pedestals pedest als or stringers or both) to allow access to the the area beneath. access provider: The operator of any facility that is used to convey telecommunications signals to and from a customer premises. access switch: A switch used to connect devices, such as servers, to a local area network. administration: The method for labeling, identification, documentation and usage needed to implement moves, additions and changes of the telecommunications infrastructure. aggregation switch: A switch that aggregates network traffic to and from access switches and that may also also connect to network service device devices s e.g., load balancers, network appliances, fire walls). backbone: A facility Cabling Subsystem 3. e.g., pathway, cable or bonding conductor) for cabling Subsystem 2 and backbone cable: See backbone . blocking switch fabric: A switch fabric that does not have sufficient bandwidth to ensure that any port can communicate with any other port in the switch fabric at the full bandwidth capacity of either port. bonding: The joining of metallic parts to form an electrically conductive path. cabinet: A container that may enclose connection devices, terminations, apparatus, wiring, and equipment. cable: An assembly of one or more insulated conductors or optical fibers, within an enveloping sheath. cabling: A combination of all cables, jumpers, cords, and connecting hardware. Cabling Subsystem 1: Cabling from the equipment outlet to Distributor A, Distributor B, or Distributor C. Cabling Subsystem 2: Cabling between Distributor A and either Distributor B or Distributor Distributor C if Distributor B is not implemented). Cabling Subsystem 3: Cabling between Distributor B and Distributor C. centralized cabling: A cabling configuration using a continuous cable, an interconnect, or a splice from an equipment outlet to a centralized cross-connect in Distributor B or Distributor C. centralized switch fabric: A data center switch fabric architecture in which the switch fabric is implemented in a single centralized switch . channel: The end-to-end transmission path between two points at which application-specific equipment is connected . 2 ;opyf ghl Telecommunicalion elecommunicalions s Industry Associalion J,-.wli l ed y IHS under license with TIA o reproduction or ne1working permilled without license rrom IHS Order Number: 02167039 Sold to:UPSISTEMAS {202862100001] 2017-09-00 17:39:49 UTC lyright T AJided b reproduc ANS l/TIA-P l/TIA-PN-942-B N-942-B common equipment room (telecommunications): An enclosed space used for equipment and backbone interconnections for more than one tenant in a building or campus. compartment alizati on: cr crea eatio tion n of a physical barrier between two or more compartments which have separate fire suppression and cooling systems. computer room: An processing equipment. architectural space whose primary function is to accommodate data concurrently maintainable: The ability to have planned maintenance performed at any time on any path, equipment or component of the system without interrupting the operation of the system. conduit: (1) A raceway of circular cross-section. cross-secti on. (2) A structure containing containi ng one or more ducts. NOTE: For the purposes of this Standard the term conduit includes electrical metallic tubing (EMT) or electrical non-metallic tubing (ENT). conduit sizes: For the purposes of this Standard, conduit sizes are designated according to metric designator and trade size as shown below: Table 1: Conduit sizes Metric Designator Trade Size 1/2 3/4 1 6 2 27 35 1 1 1/4 1/2 2 2 1/2 3 3 1/2 4 5 6 4 53 63 78 9 103 129 55 connecting hardware: A device providing mechanical cable terminations. consolidation point: A connection facility within Cabling Subsystem 1 for interconnection of cables extending from building pathways to the equipment outlet. cord (telecommunications): An assembly of cord cable with a plug on one or both ends. core switch: A backbone switch at the highest hierarchical layer of a network. cross connect: A facility enabling the termination of cable elements and their interconnection or cross-connection. cross connection: A connection scheme between cabling runs, subsystems, and equipment using patch cords or jumpers that attach to connecting hardware on each end. data center: A building or portion of a building whose primary function and its support areas areas.. is to house a computer room demarcation point: A point where the operational control or ownership changes. dew point: The temperature to which air must be cooled (assuming constant air pressure and moisture content) to reach a relative humidity humidi ty of 100 (i.e. saturation). direct attach cabling: Cabling that provides a connection between equipment without any interven ing connections. Note, intervening point-to-point cabling. as in prior versions of this standard direct attach cabling was known 3 Order Number: 02167039 Sold lo:UPSISTEMAS lo:UPSISTEMAS 202862100001]. 2017·09-0617:39:49 UT ANSl/TIA-PN-942-B Distributor A: Optional connection facility in a hierarchical star topology that is cabled between the equipment outlet and Distributor B or Distributor C. Distributor B: Optional intermediate connection facility in a hierarchical star topology that is cabled to Distributor C. Distributor C: Central connection facility in a hierarchical star topology. dry bulb temperature: The temperature of air measured by a thermometer freely exposed to the air but shielded from radiation (e.g., sunlight, radiant heat) and moisture. eart hin hing: g: Se See e grounding grounding.. electromagnetic interference: Radiated or conducted electromagnetic energy that has an undesirable effect on electronic equipment or signal transmissions. entrance point (tel eco ecommun mmunica ica tio tions) ns) : The point of emerge emergence nce for telecomm telecommunicat unications ions cabling cabling through an exterior wall, a floor, or from a conduit. entrance room or space (telecommunications): A space in which the joining of inter or intra building telecommunications cabling takes place. equipment cord: See cord. equipment distribution area: The computer room space occupied by equipment racks or cabinets. equipment outlet: Outermost connection facility in a hierarchical star topology. equipment room (telecommunications): An environmentally controlled centralized space for telecommunications equipment that usually houses Distributor B or Distributor C. external network interface: Interface between the computer room cabling and external cabling. fat tree, fabric: A switch connection topology where each access switch is connected to every interconnection switch within the fabric. fault tolerant: The ability to withstand a single fault fiber optic: See optical fiber. full-mesh, fabric: A switch connection topology where each switch is directly connected to all other switches within the mesh. ground: A conducting connection, whether intentional or accidental, between an electrical circuit (e.g., telecommunications) or equipment and the earth, or to some conducting body that serves in (e.g., place of earth. grounding: The act of creating a ground. grounding conductor: A conductor conduc tor used to connect the grounding ground ing electrode ele ctrode to the building build ing s main grounding busbar. horizontal cabling: Cabling Subsystem 1. horizontal cross connect: Distributor A. horizontal distribution area: A space in a data center where a horizontal cross-connect is located. identifier: An item of information that links a specific element of the telecommunications infrastructure with its corresponding record. infrastructure (telecommunications): A collection of those telecommunications components, excluding equipment, that together provide the basic support for the distribution of information within a building or campus. interconnected mesh fabric: A switch connection topology in which pods, each containing a full mesh fabric, are connected using interconnection switches. 4 ;opyright Telecommunicatio Telecommunications ns Industry Association Jrovided by IHS under license with TIA Order Number: 02167039 Sold to:UPSISTEMAS [202962100001 ] ri ht Telecc ided by IHS fo reproduction or networking permitted without without license lrom IHS tproduction 2017·09-0617:39:49 UTC ANSl/TIA-PN-942-B interconnection: A connection scheme that employs connecting hardware for the direct connection of o f a cable to another cable without a patch cord or jumper, or employs a patch cord or jumper to make a connection between connecting hardware and equipment. A switch used to interconnection switches, in a fabric. interconnection switch: connect access switches, or lower level interme diate cros s-conn ect: Dis Distri tribut butor or B. intermediate distribution area: A space in a data center where an intermediate cross-connect is located. jumper: 1) An assembly of twisted pairs without connectors, used to join telecommunications circuits/links circuit s/links at the cross-connect. 2) An assembly of optical fiber cable with a connector on each end (often referred to as a cord). leaf and spine switch fabric architecture: See fat tree, fabric. leaf switch: An access switch in a leaf and spine switch fabric architecture. link: A transmission path between two points, not including equipment and cords. liquidtight: Impervious to moisture ingress. main cross- conne ct: Dis Distri tribut butor or C. main distribution area: The space in a data center where the main cross-connect is located. mechanical room: An enclosed space serving the needs of mechanical building systems. media (telecommunications): Wire, cable, or conductors used for telecommunications. modular jack: A female telecommunications connector that may be keyed or unkeyed and may have 6 or 8 contact positions, but not all the positions need be equipped with jack contacts. multimode optical fiber: An optical fiber that carries many paths of light. non blocking switch switch fabric: A switch fabric that has sufficient bandwidth to ensure that any port can communicate with any other port in the switch fabric at the full bandwidth capacity of either port. optical fiber: Any filament made of dielectric materials that guides light. optical fiber cable: An assembly consisting of one or more optical fibers. over-subscribe (bandwidth): The assignment of more traffic to a link than the bandwidth capacity of the link. patch cord: A cord used to establish connections on a patch panel. patch panel: A connecting hardware system that facilitates cable termination and cabling administration using patch cords. pathway: A facility for the placement of telecommunications cable. plenum: A compartment or chamber to which one or more air ducts are connected and that forms part of the air distribution system. pod, data center: A modular subset of the data center. port: A connection point for one or more conductors or fibers. port extender: A device that provides additional ports to the controlling switch to which it is connected. post tensioned concrete: A type of reinforced concrete construction in which the embedded steel members are first put under tension, the concrete poured and allowed to harden, and the tension of the steel members released causing compression of the concrete. hrc 1r0 lKl I 5 . l=r: i 1nn nn1 1u11k<li1irmll lndlh :lry : lry A i llOctn lion Order Number: 02167039 l J< l,1L i Mcqn:s.o wllh T IA o r nMW<Mklnn 1Hmnil 1Hmnilled led wlt)1out license from IHS Sold lo:UPSISTEMAS lo:UPSISTEMAS 202962100001], 2017-09·06 17:39:49 UT ANSl/TIA-PN-942-B post-ten sion floor: A floor floor that that is constructed of post-tensioned concrete. private bra nch exc exchang hang e: A priv private ate telecommu telecommunicati nications ons switching switching system system.. pull box: A housing located in a pathway run used to facilitate the placing of wire or cables. rac k: Supporti rack: Supporting ng frame equipped with side mounting mounting rails to to which equipment and hardware are mounted. radio frequency interference interference:: Electromagnetic interference within the frequency band for radio transmission . transmission. return loss: A ratio expressed in dB of the power of the outgoing signal to the power of the reflected signal. screen: An element of a cable formed by a shield . service provider The operator of any service that furnishes telecommunications content transmissions) transmis sions) delivered over access provider facilities. facilities . sheath: See cable sheath. shield: 1 A metallic layer placed around a conductor or group of conductors . 2) The cylindrical outer conductor with the same axis as the center conductor that together form a coaxial transmission line. line . single-mode optical fiber: An optical fiber that carries only one path of light. space tel eco ecommun mmun ica tio ns) : An area area used used for hous housing ing the the installat installation ion and and termin termination ation of telecommunications equipment and cable. spanning tree protocol Link management protocol that provides path redundancy while preventing preven ting un-desirable loops in the network. network . spine switch An interconnection switch in a leaf and spine switch fabric architecture. splice: A joining of conductors, meant to be permanent. star topology point. A topology in which telecommunications cables are distributed from a central switch fabric : A network topology where devices connect with one another using network switches over multiple paths. paths . telecommunications The transmission and reception of information by cable, radio, optical or other electromagnetic system systems. s. telecommunications entrance point See entrance telecommunications telecommunications). entrance room or p o space: n ~ telecommunications).. telecommunications) See entrance room or space telecommunications equipment room: See equipment room telecommunications). telecommunications infrastructure See infrastructure telecommunications) telecommunications).. telecommunications media: Se See e media teleco mmunicat ions). telecommunications room: An enclosed architectural space for housing telecommunications equipment, cable terminations, or cross-connect cabling. telecommunications space: Se See e space telecommu nicati ons). termination block A connecting hardware system that facilitates cable termination and cabling administration using jumpers. jumpers . topology The physical or logical arrangement of a telecommunications system. ;opyrighl Telecommunicalions ons lnduslry Associatio Association n lrovtded by IHS under license with TIA Order Number: Number : 02167039 Sold to: to :UPSISTE MAS 202862100001 ]. I T elecommunic fo Sold to: to :UPSISTE MAS 202862100001 ]. 2017-09-06 17 :39 39::49 UTC reproduclion or networking permitted wilhoul license from IHS by IHS under f foclion or nelw ANSl/TIA-PN-942-B uninterruptible power supply A buffer between utility power or other power source and a load that requires continuous precise power. A switch connection topology in which a switch fabric is formed by interconnecting multiple switches to form a single large virtual switch. virtual switch fabric wire: n individually insulated solid or stranded metallic conductor. The use of radiated electromagnetic electromagn etic energy e.g., radio radio frequency and microwave signals, light) traveling through space to transport information. wireless zone distribution area: A space in a data center where an equipment outlet or a consolidation point is located. 3.3 Acronyms and abbreviations AHJ authority having jurisdiction ANSI American National Standa Standards rds Institute ASH RAE American Society of o f Heating, Refrigerating, and Air Conditioning Engineers BNC bayonet Neill-Concelman CCTV closed-circuit television CER common equipment room CP CPU consolidation point central processing unit CSA Canadian Standards Association International DSX digital signal cross-connect EDA equipment distribution area EMS energy management system ENI external network interface EO equipment outlet HC horizontal horizon tal cross-connect cross-conn ect HOA horizontal distribution area HVAC IC heating, ventilation and air conditioning intermediate interm ediate cross-connect ICT Information and communications technology IDA intermediate distribution area IDC insulation insulat ion displacement contact KVM keyboard, video, mouse L N local area network MC main mai n cross-connect MDA main distribution area MPO Multi-fiber Push On NE ® National Electrical Code® National Electrical Manufacturers Associati Association on NEMA 7 T;' ° 11 1 IHS tnw1lC1 t1; tki nm lmJ ttUry As sacl tion Order Number: 02167039 l r.; U . U rd u· H :.arn;Q with TI pd r1t1 l l ted wil wilh hu ul license rrom IHS Sold to:UPSISTEMAS [202662100001]. 2017-09-0617:39:49 UTC Ot I Lti l WOfkil Ofkilii EJ ANSl/TIA-PN-942-B NFPA National Fire Protection Association OSHA Occupational Safety and Health Administration PBX private branch exchange POU powe r distribution distribution unit SAN storage area network SDH synchronous digit digital al hierarchy SON ET synchronous optic optical al network STM synchronous transport model TIA Telecommunications Industry Association Association TNC threaded Neill-Concelman TR telecommunications room UL Underwriters Laboratories Inc. UPS uninterruptible power supply WAN wide area network ZDA zone distributi distribution on area 3.4 A Units o measure ampere dB decibel o degrees Celsius O degrees Fahrenheit ft feet, foot in inch kb/s kilobit per second km kilometer kPa kilopascal kVA kW kilovoltamp lbf pound-force m meter MHz megahertz mm millimeter nm nanometer µm micrometer micron) kilowatt 8 ::opyright Telecommunlcatio ns lndus lry Association =>rovided by IHS under license with TIA Order Number: 02167039 Sold to:UPSISTEMAS [202862100001 ], /llltil Teloc l IJo reproduction or networking permitted wl1hout license from IHS by IH 2017 09 0617:39:49 UTC J ltotfuoUc.ir ANSl/TIA-PN-942-B 4 41 DATA CENTER DESIGN OVERVIEW General The following information and recommendations are intended to enable an effective implementation of a data center design by identifying the appropriate actions to be taken in each step of the planning and design process. The design specific details are provided in the subsequent clauses and annexes. The steps in the design process described below apply to the design of a new data center or the expansion of an existing data center. It is essential for either case that the design of the telecommunications cabling system, equipment floor plan, electrical plans, architectural plan, HVAC, security, and lighting systems be coordinated. Ideally, the process should be: a Estimate equipmen equipmentt telecommunica telecommunications, tions, space, power, and cooling requirements of the data center at full capacity. Anticipate future telecommunications, power, and cooling trends over the lifetime of the data center. b Provide space, power, power, cooling, cooling, security, floor loading, grounding, electrical protect protection, ion, and and other facility requirements to architects and engineers. Provide requirements for operations center, loading dock, storage room, staging areas and other support areas. c Coordinat e preliminary data cente Coordinate centerr space plans from architect and engineers. Suggest changes as required. d Create an equipm equipment ent floor plan plan including placement of major major rooms and spaces for entrance rooms, main distribution areas, intermediate distribution areas, horizontal distribution areas, zone distribution areas and equipment distribution areas. Provide expected power, cooling, and floor loading requirements for equipment to engineers. Provide requirements for telecommunications pathways. e Obtain an updated plan from engineers with telecommunications pathways, electrical equipment, and mechanical equipment added to the data center floor plan at full capacity. f Design telecommuni telecommunications cations cabling system based on the needs of the existing and planned future equipment to be located in the data center. The data center shall meet the requirements of the AHJ and should follow NFPA 75 or other data center fire protection standard applicable for the country in whic which h the data center ce nter is built. 42 Relationship of data center spaces to other building spaces Figure 2 illustrates the major spaces of a typical data center and how they relate to each other and the spaces outside of the data center. See clause 6 for information concerning the telecommunications spaces within the data center. This Standard addresses telecommunications infrastructure for the data center spaces, which is the computer room and its associated support spaces. 9 Jtd y u ~ m ~ l c n lonl l lr D 6lry ~ \ ( K i : J B l i o n Order Number: 02167039 ~ a a u llda r lfc.ooi:;a wi h ·nA o or r Q twtiirldno permilled i ~ h o l t l license from IHS Sold \o:UPSISTEMAS 1202062100001 ] 2017-09-06 17:39:49 UTC ANSl/TIA-PN-942-B Building Site Building Envelope - Telecommunications Equipment Rooms serv serving ing General Office Space i. 1 spaces outside data center Data Center Support Staff Offices Entrance Room (s) Data Center Electrical Mechanical Rooms v Telecom p e r a t i o n s L Center - Room(s) serving data center spaces Storage Rooms oading Docks J - Computer Room Figure 2: Relationship o f spaces in a data center 4.3 vailability and Security This Standard includes information for availability and security of the data center facility infrastructure. Higher ratings correspond to higher availability and security. security . Annex F of this Standard provides detailed information. Refer to ANSl/TIA-5017 for information regarding physical security for telecommunications infrastructure. It is important to understand that certain intentional or accidental events, or acts of nature, pose a risk to the operation of data centers . It is important for the data center designer, administrator and manager to both assess and try to mitigate the risk to their facilities these events pose, as well as make contin contingency gency plans. The designer should provide a risk assessment, and 10 :::opyrighl Telecommunicalions Industry Association Order Number: 02167039 ighl Telecom ed by IHS u Sold to:UPSISTEMAS [202862100001 J. 2017-09-06 17:3Q:4Q UTC 'rovided by IHS under license wilh TIA l o reproduc1ion or networking permilled withou1 license from IHS roduclion o ANSl/TIA-PN-942-B recommend ways to manage that risk, whether intentional, accidental acciden tal or forces of nature. Risk management can take many forms including: a) a risk model to demonstr demonstrate ate the event probability probabilit y based on industry accepted models e.g., earthquake or lightning); b) risk avoidan avoidance ce separation, protection, security, etc.); c) resiliency and redundancy, at both a systems and facilities level; and d) replicating applications and data between data centers. 4.4 Consideration or involvement o professionals Data centers are designed to support the requirements of large quantities of computer and telecommunications equipment. Therefore, telecommunications and information technology professionals and specifications should be involved in the design of the data center from its inception. In addition to the space, environmental, adjacency, and operational requirements for the computer and telecommunications equipment, data center designs need to address the requirements o the telecommunications pathways and spaces specified in this Standard. Ci hr u 1 ea id bi . u l i n l rKJus ltlty y Aesoolalion Order Number: 02167039 d u e ~ llcense willl TIA networking permitted without llcen e from IHS Sold lo:UPSISTEMAS [202862100001] 2017-09-0617:39:49 UTC Ut\der tr ANSl/TIA-PN-942-B DATA CENTER CABLING SYSTEM INFRASTRUCTURE This Standard establishes a structure for data center cabling system based system structure in ANSl/TIA-568.0-D. the generic cabling on DC 0 / / / I I - © - DB I j0 I D r 1 I CP I ~ ~ ~ ~ rI EO CP - , ~ 1 I _ __ Legend: Cabling Subsystem 1 cable Distributor A ] Distributor B Cabling Subsystem 2 cable Distributor C Equipment outlet r 1 Optional consolidation point I CP I .0 Optional tie cabling Cabling Subsystem 3 cable NOTE - All elements shown represent represent cables cables and and connecting connecting hardware, hardware, not spaces or pathways. Figure : Functional Functi onal elements of generic cabling topology Figure 3 provides a representation of the functional elements that comprise a generic cabling system. It depicts the relationship between the elements and how they may be configured to create a total system. The functional elements are equip equipment ment outlets, distributor distributors, s, and cabling subsystems , which together comprise a generic telecommunications cabling system. Figure 4 shows examples of interconnections and cross-connections for Distributor configurations may be present for Distributor B and Distributor C A Similar 12 :::opyrighl Telecommunications Industry Associalion Order Number: 02167039 11 T elecommun Jrovided by IHS under license with TIA \lo reproduction or networking permitted without license from IHS I by IHS under Kluclion or netv Sold Jo:UPSISTEMAS {202862100001 J 2017-09-06 17:39:49 UTC ANSl/TIA-PN-942-B D D• D D I abling Subsystem 2 or Cabling Subsystem 3 Distributor A CJ Distributor A D Interconnection E Equipment/splitter _ Crossconnection 8 J 0 ·;:: 1i5 i5 Distributor A DD Interconnection Crossconnection Distributor A DD D DD Cabling Subsystem 1 _L Figure 4: Examples o f interconnections and cross connections fo r Distributor A Figure 5 illustrates a representative model for the various functional elements that comprise a cabling system for a data center. It depicts the relationship between the elements and how they are configured to create the total system. The basic elements of the data center cabling system structure are the following: a) Horizontal cabling Cabling Subsystem 1 - see clause clause 7.3 7.3)) .... b) Backbone cabling cabling Cabling Subsystem Subsystem 2 and Cabling Cabling Subsystem Subsystem 3 - see clause clause 7.4) c) Cross-connect in the entrance room room or main distribution area Distr Distributo ibutorr C, Distributor B or Distributor A) d) Main cross-conn cross-connect ect MC) in the main distrib distribution ution area Distri Distributor butor C or could also also be Distributor B or Distributor A) e) Optional intermediate intermediate cross-connect cross-connect IC) in the intermediate intermediate distribution area Distributor B) f) Horizontal cross-co cross-connect nnect HC) in the telecommunications room, horizontal distribution area or main distri distribution bution area Distri Distributor butor A or could also be Distributor B or Distributor C) g) Consolidation point in the zone distribution area optional) h) Equipment outlet EO) located in the equipment distribution area or zone distribution area 13 h s nrri lb 1l coulor.u ,: IJC lori J ' U u e n ~ l r y w t l IA Order Number: 02167039 Sold to:UPSISTEMAS [202062100001 ). 2017-09·06 17:39:49 UTC l o n r na1 .,. tlfll.lll1J 1umflllled wilhDY I icense rrom IHS ANSl/TIA-PN-942-B Access provider or campus cabling Access provider or campus cabling Entrance Room Entrance Room IDA TR IC HC t • o r i ~ o n t a l cabling for spaces outside computer room HOA HC .............. .... E J···· J····// I I I I I II _. ,-.:' . ...... t I I I \ I l ~M Ii I I I \ M M e backbone cabling horizontal cabling D cross-connect \ I , S E J I I I 1 · ~M ,. M CP nterconnect HC IC outlet EO MC Telecom space ENI TR MDA IDA HO \ I \ 11 : EDA EDA Order Number: 02167039 \ \ EDA Consolidation Point Horizontal Cross-Connect Intermediate Cross-Connect Equipment Outlet Main Cross-Connect External Network Interface Telecommunications Room Main Mai n Distrib ution Area Intermediate Distribution Area Horizontal Distribution Area Zone Distribution Area Equipment Distribution Area Example of a typical data center topology 4 :::opyright Telecommunications Industry Association ... S 8 8 S 8 M ZDA EDA 5: I I I \ • A ZDA is not part of the category 8 channel topology Figure I tI t I . I • I LEGEND ® II I . I I --,. -: ·-. ····-.l~.::j· Jrovided by IHS under license with TIA o reproduction or networking permilled withoul license from IHS Sold lo:UPSISTEMAS [202062100001], 2017-09-06 17:39:49 UTC ANSl/TIA-PN-942-B 6 61 DATA CENT DATA CENTER ER TELECO TELECOMMUNIC MMUNICATIONS ATIONS SPACES AND RELATED TOPOLOGIES General The data center requires spaces dedicated to supporting the telecommunications infrastructure. Telecommunications spaces shall be dedicated to support telecommunications cabling and equipment. Typical spaces found within a data center generally include the entrance room, main distribution distrib ution area MDA), intermediate distri distribution bution area area IDA), horizontal distri distribution bution area area HDA), zone distri distribution bution area area ZDA) and equi equipment pment distribution distributi on area area EDA). With the exception of the MDA and EDA, not all of these spaces may be present within the data center. These spaces shall be sized to accommodate the anticipated end-state size and demand forecast for all data center phases. These spaces should also be planned to provide for growth and transition to evolving technologies. These spaces may or may not be walled off or otherwise separated from the other computer room spaces. 62 621 Data center structure Major elements The data cente centerr telecommunications telecommunication s spaces include in clude the entrance room, room, main distribution distributi on area MDA), interme intermediate diate distribution area IDA), horizontal distributi distribution on area HDA), zone distribution area ZDA) and equipment distributio distribution n area EDA). The entrance room is the space used for the interface between data center structured cabling system and inter-building cabling, for both access provider and customer-owned cabling. This space includes the access provider demarcation hardware and access provider equipment. The entrance room may be located outside the computer room if the data center is in a building that includes general purpose offices or other types of spaces outside the data center. The entrance room may also be outside the computer room for improved security, as it avoids the need for access provider technicians to enter the computer room. Data centers may have multiple entrance rooms to provide additional redundancy or to avoid exceeding maximum cable lengths for access provider-provisioned circuits. The entrance room interfaces with the computer room through the MDA. In some cases, the secondary entrance rooms may have cabling to IDAs or HDAs to avoid exceeding maximum cable lengths for access provider-provisioned circuits. The entrance room may be adjacent to or combined with the MDA. The MDA inclu includes des the the main main cross-connect MC), which which is the central point of distribution for the data cente centerr structured cabling system and may include a horizontal cross-conne cross-c onnect ct HC) when equipment areas are served directly from the MDA. This space is inside the computer room; it may be located in a dedicated room in a multi-tenant data center for security. Every data center shall have at least one MDA. The computer room core routers, core LAN switches and core SAN switches are often located in the MDA, because this space is the hub of the cabling infrastructure for the data center. Access provider provisioning equipment is often located in the MDA rather than in the entrance room to avoid the need for a second entrance room due to circuit length restrictions. The MDA may serve one or more IDAs, HDAs, and EDAs within the data center and one or more telecommunications rooms located outside the computer room space to support office spaces, operations center and other external support rooms. The IDA may serve one or more HDAs and EDAs within the data center, and one or more telecommunications rooms located outside the computer room space. The HDA is used to serve the EDAs when the HC is not located in the MDA or an IDA. Therefore, when used, the HDA may include the HC, which is the distributor for cabling to the EDAs. The HDA is inside the computer compu ter room, room, but may be located in a dedicated room within the computer ~ 5 hv •Hs ur t:nucm ll t r y /\ wo nlion Jeem.re TIA ' ~ w b f k J n g fJUJ ;l ted °W u Order Number: 02167039 Sold lo:UPSISTEMAS [202862100001 ]. 2017-09-06 17:39:49 UTC license lrom IHS ANSl/TIA-PN-942-B room for additional security. The HDA typically includes LAN switches, SAN switches, and KeyboardNideo/ Keyboar dNideo/Mouse Mouse (KVM) switches switches for the the end equipment located located in the EDAs. A data center may have computer room spaces located on multiple floors with each floor being serviced by its own HC. Some data centers may require no HDAs, as the entire computer room may be able to be supported from the MDA. However, a typical data center will have several HDAs. The EDA is the space allocated for end equipment, including computer systems and telecommunications equipment (e.g., servers, mainframe, and storage arrays). These areas shall not serve the purposes of an entrance room, MDA, IDA, or HOA. There may be an optional interconnection within a ZDA that is called a consolidation point (see figure 5 . This consolidation point is between the horizontal cross-connect and the equipment outlet to facilitate moves, adds, and changes. 6.2.2 Basic data center topology The basic data center includes a single entrance room, possibly one or more telecommunications rooms, one MDA, and several HDAs. Figure 6 illustrates the basic data center topology. Access Providers (Carrier Equip Demarcation) Work Areas in Offices, Operations Center, Support Rooms 1 Horizontal Access Providers Entrance Room ---------- --------------------------- , TR (Office Operations Center LAN Switches) Computer Room Backbone cabling l l n ~ I I B ack b on e l cabling l l l MDA (Routers, Backbone LAN/SAN Switches, PBX, M13 Muxes) ~ : : : : _ I I I l I HOA (LAN/SAN/KVM Switches) l I I I I I II I l I Horizontal cabling ZD Horizontal cabling EDA (Rack/Cabinet) HOA (LAN/SAN/KVM Switches) HOA (LAN/SAN/KVM Switches) Horizontal cabling EDA (Rack/Cabinet) HOA (LAN/SAN/KVM Switches) Horizontal cabling Horizontal cab li ng EDA (Rack/Cabinet) ED (Rack/Cabinet) 1 L-----------------------------------------------------J Figure 6: Example o f a basic data center topology 16 :;opyrighl Telecommunications lnduslry Association Order Number: 02167039 lhl Telecomm )rovided by IHS under license with TIA .Jo reproduclion or nelworking permilled without license from IHS Kl by IHS und tldUclion or nE Sold to:UPSISTEMAS [202862100001 [, 2 0 1 7 0 9 ·0 6 17:39:49 UT ANSl/TIA-PN-942-B 6.2.3 6.2 .3 Redu ced data center topologies Data center designers can consolidate the main cross-connect, and horizontal cross-connect in a single MDA, possibly as small as a single cabinet or rack. The telecommunications room for cabling to the support areas and the entrance room may also be consolidated into the MDA in a reduced data center topology. The reduced data center topology is illustrated in figure 7. Access Providers --------------------- r 1 Work Areas in Offices, Operations Center, Support Rooms I I I I hl orizonta orizontall I ca bling I I I MDA Carrier Equi Equ ip Demarcation, Routers, Backbone LAN/SAN/ KVM Switches, PBX, M13 Muxes) ---------------- l 0 ZDA I I I I I I I I I I I I I I I I I Horizontal cabling EDA Room : •I 0 Rack/Cabinet) Computer : EDA Rack/Cabinet) I I I I I I L---------------------------------------------------------------------------------------------------------JJ Figure 7: Example o f a reduced data center topology 6.2.4 Distributed data center topologies Large data centers, centers , such as data centers located on multiple floors or in multiple rooms, may require intermediate cross-connects located in IDAs. Each room or floor may have one or more IDAs. Multiple telecommunications rooms may be required for data centers with large or widely separated office and support areas. In very large data centers, centers , circuit length restrictions may require multiple entrance rooms . The data center topology with multiple entrance rooms and IDAs is shown in Figure 8. The primary entrance room shall not have direct connections to IDAs and HDAs. Although cabling from the secondary entrance room directly to the IDAs and HDAs is not common practice or encouraged, it is allowed to meet certain circuit length limitations and redundancy needs . 17 O rdo dorr Number: Nu mber: 021 6 70 39 Sold Sol d •o :U P SIS SISTEM TEMAS AS [2 [ 2 02 862 100001] 100001],, 2017-09-0617:39:49 UTC ANSl/TIA-PN-942-B Access Providers Access Providers Prim ary Ent ran ce Room Secondary Entrance Room I Work Areas in Offices, Operations Center, Support I (Carrier Equip & Damarc;i marc;illo llo..n) n) (Carrier Equip & Oern arca tlon ) Rooms I I r ------------------- Horizontal cabling 1 Backbone cabling I I R (Office Operations Center LAN Switches) MDA i Backbon e ca blin g I I I I I I Backbone cabling (Routers, Backbone LAN/SAN Switches, PBX M13 Muxes) Backbone cabling Backbone cabling Backbone cabling Backbone cabling IDA (LAN/SAN (LAN/SA N Switches) - - - - o ~ ~ u ~ e ~ ~ ~ o ~ - I I I I I I I I I I I I IDA (LAN/SAN Switches) Backbone cabling Backbone cabling HOA (LAN/SAN/KVM Switches) Backbone cabling HOA Horizontal cabling (LAN/SAN/KVM Switches) ZDA Horizontal cabling Horizon tal cabling Backbone cabling HOA HOA (LAN/SAN/KVM Switches) (LAN/SAN/KVM Switches) Horizontal cabling I HOA (LAN/SAN/KVM Switches) Horizontal cabling I I ZDA Horizontal cabling Horizontal cabling EDA EDA EDA EDA EDA EDA (Rack/Cabinet) (Rack/Cabinet) (Rack/Cabinet) (Rack/Cabinet) (Rack/Cabinet) (Rack/Cabinet) L------------------------------------------------Figure 8: Example o f a distributed data center topology with multiple entrance rooms 6.2.5 Topologies for broadband coaxial cabling See ANSl/TIA-568.4-D for broadband coaxial cabling system topologies that can be used within data centers. 6.3 Energy efficient design 6.3.1 General Energy efficiency should be considered in the design of the data center. Clause 6.3.2 provides recommendations for design of telecommunications cabling, pathways, and spaces that can improve energy efficiency. Other methods involving other aspects of the data center design are described in other publications, including the following documents: • ASHRAE, ASHRA E, Best Practices for for Datacom Facility Energy Efficiency, Second Edition (2009) • ASHRAE, Design Considerati Considerations ons for Data and Communicati Communications ons Equipment Centers, Second Edition (2009) • ASHRAE, Thermal Guidelines for Data Processing Environments, Fourth Edition, 2015 • European Commission Commission,, 2017 Best Practices for EU Code of Conduct on Data Centres, Version 8.1.0 (2017) 18 :;opyrigh\ Telecommunicalions Indust :;opyrigh\ Industry ry Associalio Associalion n Jrovided by IHS under license with TIA o reproduction or nelworking permitted wilhout license from IHS Order Number: 02167039 Sold to:UPSISTEMAS [202662100001], IH ANS l/TIA-PN-942-B • European Commission, European Code of Conduc Conductt on Data Centre Energy Efficiency, Introductory guide for applications 2016, Version 3.1.2 6.3.2 6.3.2.1 Energy efficiency recommendations General By their nature, data centers consume large amounts of energy, most of which is converted to heat, requiring serious consideration to cooling efficiencies. There is no single thermal management architecture that is most energy efficient for all installations. Critical factors unique to the customer, application, and environment should be carefully evaluated in the start-up and operational analysis. 6.3.2.2 elecommunications cabling Overhead telecommunications cabling may improve cooling efficiency and is a best practice where ceiling heights permit because it can substantially reduce airflow losses due to airflow obstruction and turbulence caused by under floor cabling and cabling pathways. See ANSl/TIA569-D for additi additional onal guidance regarding overhe overhead ad pathways e.g., structural load). If telecommunications cabling is installed in an under floor space that is also used for cooling, under floor air obstructions can be reduced by: • using netwo network rk and cabling designs e.g., top-oftop-of-rack rack switching) that require less cabling; • selecting cables with smaller diameters to minimize the volum volume e of under unde r floor cabling; • utilizing higher strand count optical fibe fiberr cable cables s instead of several lower count optical fiber cables to minimize the volume of o f under floor cabling; • designing the cabling pathways to minimize adverse impact on under floor airflow airflow e.g e.g., ., routing cabling in hot aisles rather than cold aisles so as not to block airflow to ventilated tiles on cold aisles); • designing the cabling layout such that the cabling routes are opposit opposite e to the direction of air flow so that at the origin of airflow there is the minimal amount of cablin cabling g to impede flow see figure 9 for examples); and • properly sizing pathways and spaces to accommodat accommodate e cables with minimal obstruction e.g., shallower and wider trays). 19 l d o r lt g , ,, 1m1ot t1at w 2017-09-06 17:39:49 UT i>lo,:., ~ 1 1 - { s r u n - -.. tlC\ICll U1\l let lmlua y Association wl1hTll l > i ~ ~ ~ withoul license rrom IHS Order Number: 02167039 Sold lo:UPSISTEMAS [202862100001], 2017-09-06 17:39:49 UTC . l o n ~ rref16 1;1 ANSl/TIA-PN-942-8 Example of air flow and cable routing in maximum contention cables and cable trays should not block air flow to cabinets) E /) g Ci § a:: 2 0 > c: a 0 EU ~ Cable Path i ~ · Figure 9: Examples of Legend Air Flow routing cables and air flow contention Routing of tele telecommun communicati ications ons cabling within cabinets, racks, and othe otherr enclosu enclosure re systems should not hamper the proper cooling of the equipment equip ment within the enclosures e.g., avoid routing of cabling in front of vents). Sufficient airflow airflow as required by the the equipment manufacturer shall shall be maintained. In all cases, change management procedures should be in place and should include the removal of abandoned cable in accorda accordance nce with with the the best practices or the AHJ. AHJ. This assures pathways remain neat so as to not create a weight issue overhead or air dams in under floor systems. 6.3. 6. 3.2. 2.3 3 Telecomm unications pathways Telecommunications pathways should be placed in such a manner as to minimize disruption to airflow to and from equipment. For example, if placed under the access floor they should not be placed under ventilated tiles or where they disrupt the flow of air into or out of air conditioning equipment. Consider computational fluid dynamics CFO) models for large data centers to optimize location of air conditioning equipment, equipment enclosures, air return, air telecommunications vents, and ventilatedpathways, tiles. 20 3 opyrighl Telecommunications lnduslry Association rovided by IHS under license with TIA o reproduclion or networking ng permiUed wtthoul license from IHS f nlbar l rfu nun\r: b)' IHS Underlic1 Order Number: 02167039 Sold to:UPSISTEMAS 202862100001 I. 2017-09·06 17: 17:39:49 UTC hJ;; tt<M I ANSl/TIA-PN-942-B 6.3.2.4 elecommunications spaces Consider use of enclosures or enclosure systems that impr improve ove cooling efficiency : • cabinets with isolated air-supply; • cabinets with isolated air-return; • cabinets with in-cabi in-cabinet net cooling systems; • hot-aisle containment or cold-aisle containment syste systems ms.. Routing of cabling and cable pathways should not compromise the efficiency of the enclosure or enclosure system . For example, cable openings in the enclosure or enclosure system should use brushes brushe s or o r grommets to minimize loss of air. Commercially produced hardware and accessories specifically intended to prevent cold and hot air from mixing should be installed to improve energy efficiency. This may include: • Blanking panels in unused rack unit positions • Blanks in open port or module locations in patch panels • Angled covers above and below angled patch panels or a group of continuous angled patch panels • Panels, seals, and grommets to prevent air bypass between the cabinet rails and the side of the cabinets • Seals between the floor and the bottom of the cabinets front, side, and rear depending on the containment and cabinet design) • Seals or side panels between between cabinets with different front rail depths. Equipment with different environmental requirements should be segregated into different spaces to allow equipment with less restrictive environmental requirements to be operated in spaces in a more mor e energy-efficient environm environment. ent. Consider allocating and designing separate spaces dedicated to high density equipment so that the entire data center is not powered and cooled for the equipment with the greatest energy demands . It is recommended to use a cooling system that is able to vary the volume of air as needed. Equipment should match the airflow design for the enclosures and computer room space in which they are are placed. This generally means tha thatt equi equipment pment should should be mounted in cabinets/racks with air intakes facing the cold-aisle and air exhau exhausts sts facing the hot-aisle. Equi Equipment pment with non standard airflow may require specially designed enclosures or air baffles to avoid disruption of proper air flow. Cabinets and racks should be provisioned with power strips that permit monitoring of power and cooling levels to ensure that enclosures do not exceed designed power and cooling levels. levels . Use energy efficient efficie nt lighting and lighting schemes see 6.4.2.5). 6.4.2.5). Avoid exterior windows and sky lights in computer rooms and other environmentally controlled telecommunications spac spaces. es. Consider operation and design practices that minimize the need to cool unneeded equipment and spaces. • Build the compu computer ter room in phases or zones, only building and occupying spaces as needed. • In occupied data centers, institute a process to identify and remove equipment that is no longer needed or to identify and consolidate e.g ., virtualize) virtualize) underutilized equipment. • Install monitoring equipment and perform periodic periodi c reporting of total data cent center er energy use and energy use of individual systems such as power distribution units, air conditioning units, and IT equipment equip ment cabinets/racks. 2 or netwo •t , HS ~ ~ r r n ~ U ~ m . a Industry Association IC1KU\ n;llce~se with Working perm1t1ed without lic ense from IHS Order Number: 02167039 Sold to:UPS o:UPSISTEMAS ISTEMAS 202862100001 . 2017·09·06 17:39:49 UTC ANSl/TIA-PN-942-B • Consider air baffles and temporary room dividers that can be moved and adjusted as needed . Any temporary room dividers shall not create a code violation. 64 Common requirements for comput computer er rooms and entrance rooms 641 General The requirements of these sections apply to computer rooms, entrance rooms, and if they are separate rooms - the rooms containing MDAs, MDAs, IDAs, and HDAs. HDAs. The rooms shall meet the requirements for distributor rooms in ANSl/TIA-569-D with additional requirements, exceptions and allowances as specified in 6.4 through 6.11. 642 6421 Architectural design design Location The room should not have exterior windows, as exterior windows increase heat load and reduce security. 6422 Size The room shall be sized to meet the known requirements of specific equipment including proper clearances; this information can be obtained from the equipment provider(s). Sizing should include projected future as well as present requirements. See Annex D regarding data center space considerations. 6423 Guidelines for other equipment UPS containing flooded-cell batteries should be located in a separate room . 6424 Ceiling height The minimum height of the room shall be 2.6 m (8.5 ft) from the finished floor to any obstruction such as sprinklers, lighting fixtures, overhead cable tray or cameras. Cooling requirements or racks/cabinets taller than 2.13 m 7 ft) may dictate higher ceiling heights. A minimum of 460 mm (18 in) clearance shall be maintained from water sprinkler heads. 6425 Lighting Lighting fixtures should be located above aisles between cabinets rather than directly above cabinets or overhead cable pathway systems. Emergency lighting and signs shall be properly placed per AHJ such that an absence of primary lighting will not hamper emergency exit. It is recommended that a three-level lighting protocol be used in data centers depending on human occupancy: • Level 1: data center unoccupied unoccupied - lighti lighting ng should be sufficient sufficient to allow effective use of video surveillance equipment. surveillance • Level 2: initial entry into the data center - motion sensors should be used to activate lights in the immediate area of entry and be programmed to illuminate aisles and passageways. Sufficient lighting should be provided to allow safe passage through the space and to permit identification via security cameras. • Level 3: occupied space - when the the data data center is occupied for purposes of maintenance or interaction with equipment, lighting shall be 500 lux in the horizontal plane and 200 lux in the vertical plane, measured 1 m 3 ft) above the finished floor in the middle of all aisles between cabinets. In data centers larger than 230 m2 (2500 ft 2 zone lighting is recommended that provides Level 3 in the immediate area of work and Level 2 in all other zones. 22 :;opyrighl Telecommunications Industry Association Jrovided by IHS under license with TIA -.lo reproduction or networking permilled without license lrom IHS Order Number: 02167039 Sold lo UPSISTEMAS [202862100001 [. 2017-09-06 17:39:49 UTC ANSl/TIA-PN-942-B • Optional override: lighting in all zones at level 3. To allow improved energy efficiency and control, energy efficient lighting (e.g., LED) should be considered as an option to implement the three-level lighting protocol, depending on human occupancy and function in data centers. 6426 Doors Doors shall be a minimum of 1 m 3 ft) wide and 2.13 m 7 ft) high, with 2.44 m (8 ft) or higher recommended, or larger as required by AHJ, and should be sized to accommodate the largest expected equipment. equipme nt. The door shall have no doorsills and and be hinged to open outward (code permitting), slide side-to-side, or be removable. Doors shall be fitted with locks and have either no center posts or removable center posts to facilitate access for large equipment. Exit requirements for the room shall meet the requirements of the AHJ. 6427 Floor loading A structural engineer enginee r shall be consulted consulted during the design to specify the floor loading limit. limit. The minimum distributed floor loading capacity shall be 7.2 kPA (150 lbf/ ft 2 . The recommended distributed floor loading capacity is 12 kPA (250 lbf/ ft 2 . Floors should be appropriately reinforced if equipment exceeding these specifications is anticipated. This requirement also applies in the case of relocation of equipment at a later time. If extensive relocation is anticipated, the entire floor should be appropriately reinforced. The floor shall also have a minimum of 1.2 kPA (25 lbf/ ft 2 hanging capacity for supporting loads that are suspended from the bottom of the floor (for example, cable ladders suspended from the ceiling of the floor below). The recommended hanging capacity of the floor is 2.4 kPA (50 lbf/ ft 2 . Refer to Telcordia specification GR-63 regarding floor loading capacity measurement and test methods. 6428 Plywood backboards Where wall terminations are to be used for protectors and termination hardware, adequate wall space for all anticipated protectors and termination hardware shall be covered with 19 mm (3/4 inch) plywood. The backboard shall be 1.2 m 4 ft) x 2.4 m 8 ft sheets, mounted vertically, and with the bottom of the plywood mounted 150 mm (6 in) AFF with the best side toward the room. Plywood shall be A/C grade and finished with two coats of white fire retardant paint. Plywood shall be painted prior to installation of any equipment. Plywood shall be permanently fastened to the wall by means of wall anchors utilizing galvanized, zinc plated, or stainless-steel hardware with a flat head. Finished installation shall have flush appearance with countersunk screw heads to prevent splitting of the plywood. Drywall screws are not acceptable. 6429 Uninterruptable power notificat notification ion Entrance doors into a room where equipment is powered by uninterruptable power systems should bear the following warning on the exterior side of door: WARNING - Uni WARNING Uninte nterru rrupti ptible ble power is present in this area area.. Powe r will be present at equipment even in the event of a total building shutdown at the main service disconnect. The sign shall be as required required by AHJ. AHJ. If there are no requirements, then the sign should be permanently affixed to the door and be made mechanically to be both high visibility and high contrast with red laminate and white engraved letters that are 50 mm 2 in) minimum in height. 6 4 2 10 Signage Signage should be developed within the security plan of the building. 23 · ti ........ .,.,1 ...... ldii i ~ : ~ • t Jl l ~ u s t r y Association c i With ~ I A h t P9 rm1\\ed without license from IHS Order Number: 02167039 Sold to:UPSISTEMAS [202862100001]. 2017-09-0617:39:49 UTC ANSl/TIA-PN-942-B 6.4.2.11 Seismic considerations Specifications for related facilities shall accommodate the applicable seismic zone requirements . Refer to Telcordia specification GR-63 for more information regarding seismic considerations. 6.4.3 Environmental design 6.4.3.1 Environment of the computer room should be a M l C E environment ANSl/TIA-568.0-D). The location the Alternatively, computer room should be designed to create an environment compatible with M hC E classifications. 6.4.3.2 Contaminants The operating environment shall conform to environmental conditions defined as a C1 classification in ANSl ANSl/TIA-56 /TIA-568.0-D. 8.0-D. Common methods to ensure meeting C1 classification include vapor barriers, positive positi ve room pressure where permitted by the the AHJ), or absolut absolute e filtration. 6.4.3.3 HVAC 6.4. 6. 4.3. 3.3. 3.1 1 Opera tion tional al paramet ers Temperature and humidity shall be maintained to meet the requirements and should meet the recommendations for Classes A or A2 in ANSl/TIA-569-D. 6.4.3.3.2 Continuous operation HVAC shall be provided on a 24 hours-per-day, 365 days-per-year basis. If the building system cannot assure continuous operation, stand-alone unit s) shall be provided for the room. 6.4.3.3.3 Standby operation The HVAC system should be supported by the data center standby generator system, if one is installed. If the room does not have a dedicated standby generator system, the room HVAC should be connected to the building standby generator system, if one is installed. 6.4.3.4 Radio sources Consult with the information technology and telecommunications equipment manufacturers regarding the use of or restriction of wireless and radio systems in the room. 6.4.3.5 Batteries If batteries are used for backup, adequate ventilation and spill containment as required shall be provided. Refer to applicable codes and standards e.g., OSHA CFR 1926.441) for requirements. 6.4.3.6 Vibration Refer to Telcordia specification GR-63 for more information regarding vibration testing. 6.4.4 6.4.4.1 Electrical design Power The room shall have duplex convenience outlets for power tools, cleaning equipment, and equipment not suitable to plug into equipment cabinet power strips. The convenience outlets should not be on the same power distribution units PDUs) or electrical panels as the electrical circuits used for the telecommunications and computer equipment in the room. The convenience outlets shall be located on columns and along the room walls, with a minimum of one convenience convenien ce outlet per wall or as required by the AHJ. 24 T elecommunicalions lnduslry Association a tion )rovided by IHS under license with TIA ~ o p y r i g h l ..Jo reproduction or nelworking permilled wilhoul license tram IHS U JCOmmu r lt: l\llc S or.i.. li< n Order Number: 02167039 Sold to:UPSISTEMAS {202862100001 . 2017-09-06 17:39:49 UTC r ANSl/TIA-PN-942-B 6.4.4.2 Standby power The room electrical panels should be supported by a UPS. The UPS should be supported by a generator. If present, the generator shall be adequately sized to handle the full load including any potential harmonic load generated by the UPS and other connected load. Where no dedicated data center generator is installed, provisions should be made to connect the UPS and other data center equipment to the building generator. 6.4.4.3 Bonding and grounding (earthing) Refer to ANSl/TIA-607-C for bonding and grounding requirements for computer rooms, entrance rooms, distributor rooms, equipment cabinets, and racks. 6.4.5 Fire protection The fire protection systems and hand-held fire extinguishers shall comply with NFPA-75 or applicable regional code for fire extinguishers used in data centers. Sprinkler systems should be pre-action systems. 6.4.6 Water infiltration Where risk of water ingress exists, a means of evacuating water from the space shall be provided (e.g., a floor drain, water vacuum). Additionally, at least one drain or other means for evacuating water should be provided. Any water and drain pipes that run through the room should be located away from and not directly above equipment in the room. Any water drains that are deployed should be fitted with a means to prevent ingress of liquids or vermin into the room. Any floor drains below ground level shall be equipped with a backflow prevention device. The use of leak detectors is recommended where ever there are floor drains. 6.4. 7 Access Doors should provide access to authorized personnel only. Additionally, access to the room shall comply with the requirements of o f the AHJ. AHJ. For F or additional information on monitoring computer room access, see Annex F 6.5 Computer room requirements 651 General The computer room is an environmentally controlled space that serves the sole purpose of supporting equipment and cabling directly related to the computer systems, data storage systems, and other telecommunications systems. The floor layout should be consistent with equipment and facility providers requirements, such such as: • floor loading requirements including equipment, cables, patch cords cords,, and media (static (static concentrated load, static uniform floor load, dynamic rolling load); • service clearance requirem requirements ents (clearance requirements on each side of the equipment required for adequate servicing of the equipment); • air flow requireme requirements; nts; • mounting requirements; • power requirements and DC circuit length restrictions; and • equip ment connect equipment connectivity ivity length requirements (for example, maximum channel lengths to peripherals and consoles). 25 1 l m 1 c i r 1 W 1 1 1 ~ 1 •loct rntm c n IHs li l d , lfffiD Industry Association 1 Oif kion Order Number: 0216703 02167039 9 Sold lo:UPSISTEMAS [202862100001]. 2017 09 0617:39:49 UTC with .IA permitted without license from IHS ANSl/TIA-PN-942-8 6.5.2 Location When selecting the computer room site, avoid locations that are restricted by building components that limit expansion such as elevators, building core, outside walls, or other fixed building walls. Accessibility for the delivery o large equipment to the equipment room should be provided (see ANSl/TIA-569-D). 6.5.3 Environment Envir onmental al design HVAC be If the computer room doestonot dedicated HVAC system, the computer shall not located with ready access the have main aHVAC delivery system . A computer room room is typically recognized as such by the AHJ unless it has a dedicated HVAC, or utilizes the main building HVAC and has automatic dampers installed. 6.5.4 Electrical Electr ical design Separate supply circuits serving the computer room shall be provided and terminated in their own electrical panel or panels. The power shutdown requirements for computer room equipment are mandated by the AHJ and vary by jurisdiction. 6.6 661 Entrance room requirements General The entrance room is a space, preferably a room, in which access provider-owned facilities interface with the data center cabling system . It typically houses telecommunications access provider equipment and is the location where access providers typically hand off circuits to the customer. This hand-off point is called the demarcation point. It is where the telecommunications access provider s responsibility for the circuit typically ends and the customer s responsibility for the circuit begins. The entrance room will house entrance pathways, pathways , protector blocks for balanced twisted-pair and coaxial entrance cables, termination equipment for access provider cables, access provider equipment, and termination equipment for cabling to the computer room. 6.6.2 Location The entrance room should be located to ensure that maximum circuit lengths from the access provider demarcation points to the end equipment are not exceeded. The maximum circuit lengths need to include the entire cable route, including patch cords, changes in height, and cable management routing within racks or cabinets . Annex A provides specific circuit lengths (from demarcation point to end equipment) to consider when planning entrance room locations. NOTE: Repeaters can be used to extend circuits beyond the lengths specified in Annex A The entrance rooms may either be located inside or outside the computer room space. Security concerns may dictate that the entrance rooms are located outside the computer room to avoid the need for access provider technicians to access the computer compute r room room.. However, H owever, in larger data centers, circuit length concerns may require that the entrance room be located in the computer room. Cabling in the entrance rooms should use the same cable distribution (overhead or under floor) as used in the computer room; this will minimize cable lengths as it avoids a transition from overhead cable trays to under floor cable trays . 6.6.3 Quantity Large data centers may require multiple entrance rooms to support some circuit types throughout the computer room space and/or to provide additional redundancy. 6 h l Telecommunications Industry Association Jrovided by IHS under license with TIA \Jo reproduction or networking permitted without license lrom IHS ~ o p y r i Order Number: 02167039 Sold lo:UPSISTEMAS [202062100001 [ 2017·09 06 17:39:49 UTC ANSl/TIA-PN-942-B The additional entrance rooms may have their own entrance pathways for dedicated service feeds from the access providers. Alternatively, the additional entrance rooms may be subsidiaries of the primary entrance room, in which case the access provider service feeds come from the primary entrance room. 6.6.4 Entrance conduit routing under access floor If the entrance room is located in the computer room space, the entrance conduit runs should be designed to avoid interfering with airflow, chilled water piping and other cable routing under the access floor. 6.6.5 Access provider and service provider spaces Access provider and service provider spaces for data centers are typically located either in the entrance room or in the computer room. Refer to ANSl/TIA-569-D for information on access provider and service provider spaces. The access provider and service provider spaces in single user data center entrance rooms typically do not require partitions because access to the data center entrance rooms is carefully controlled. Access and service providers that lease space in the computer room typically require secure access to their spaces. 6.6.6 Building entrance terminal Outside terminals are typically used when the entrance connection is located in a closure on an outside wall of a building. Inside terminals are used when the outside cable will be connected to the inside distribution cabling system. Refer to ANSl/TIA-568.0-D, ANSl/TIA-569-D and ANSl/TIA-758-B for additional information on entrance facilities and entrance facility connections. 6.6.7 6.6.7.1 Architectural design General The decision of providing a room or open area should be based on security with consideration to both access and incidental contact), the need for wall space for protectors, entrance room size, and physical location. 6.6. 7 2 Size The entrance room shall be sized to meet known and projected maximum requirements for: for : • • • • • backboard and frame space for termination of access provider and campus cabling; access provid provider er racks; customer-owned equipment to be located in the entrance room; demarcation racks including termination hardware for cabling to the comput computer er room room;; pathways. The amount of space required for the entrance room is related more closely to the number of access providers, number of circuits, and type of circuits to be terminated in the room than to the size of the data center. Meet with all access providers to determine their initial and future space requirements. See Annex B for more information regarding access provider coordination and access provider demarcation. Space should also be provided for campus cabling. Cables containing metallic components, including optical fiber cables with metallic components, shall be terminated with protectors in the entrance room. The protectors may either be wall-mounted or frame-mounted. The space for protectors shall be located as close as practical to the point of entrance of the cables into the building. Optical fiber campus cables may be terminated in the main cross-connect instead of the entrance room if they have no metallic components for example, cable cable sheath or strength member). Refer to applicable codes regarding entrance cable and entrance cable termination requirements. 27 T~111Ti1 Linde o 1 _ 1.llllS d1 try r ;: fl OIHl \1 1 lh l tA r u l W a t Assoc1ahon permilled without license from IHS Order Number: 02167039 Sold lo:UPSISTEMAS [202862100001 ], UTC 2017-09-06 17:39:49 ANSl/TIA-PN-942-B 6673 Environmental design Consider having dedicated air conditioning for the entrance room. If the entrance room has dedicated air conditioning, then air conditioning equipment should be powered by panel boards which whic h have redundant redunda nt power powe r e.g. e.g.,, generato ge neratorr or alternativ alternative e power source). HVAC for the the equipment in the entrance room should have the same degree of redundancy and backup as the HVAC and power for the computer room. 6 6 7 4 Electrical design Consider having dedicated PDUs and UPS fed power panels for the entrance room. The quantity of electrical circuits for entrance rooms depends on the requirements of the equipment to be located in the room. room. The entrance rooms shall use the same electrical backup systems UPS and generators) as that used for the computer room. The degree of redundancy for entrance room mechanical and electrical systems shall be the same as that for the computer room. 67 671 Main distribution area General The main distribut distribution ion area area MDA) is the central space where the point of distribution for the structured cabling system in the data center is located. The data center shall have at least one MDA. The core routers and core switches for the data center networks are often located in or near the MDA. In data as disaster centers are used multiplefacilities, organizations, such data centers, web hosting datathat centers, and by colocation the MDA should be in a recovery secure space. 672 Location The MDA should be centrally located to avoid exceeding maximum length restrictions for the applications to be supported, including maximum cable lengths for access provider circuits served out of the entrance room. 673 Facility requirements If the MDA is in an enclosed room, consider dedicated HVAC, PDU, and UPS fed power panels for this area. If the MDA has dedicated air conditioning then the air conditioning equipment should be powered and controlled by panel boards which which have redundant power e.g., generat generator or or alternative power source). The architectural, mechanical, and electrical requirements .for the MDA are the same as that for the computer room. 68 681 Intermediate Intermedia te distribution area General The intermediate distribution area area IDA) is the space that supports the intermediate cross connect. It may be used to provide a second level cabling subsystem Cabling Subsystem 2) in data centers too large to be accommodated with only Cabling Cabling Subsystem 3 cabling from the the MDA)) and MDA and Cabling Subsystem Subsyst em 1 cabling from from HDAs to EDAs). The IDA is optional and may include active equipment. In data centers that are used by multiple organizations, such as disaster recovery data centers, web hosting data centers, and colocation facilities, the IDA should be in a secure space. 28 h l T elecomrnunicalions Industry Association Jrovided by IHS under license wi h TIA fo reproduclion or networking permitted withoul license from IHS ~ o p y r i O rder Number: 02167039 Sold 1o:UPSISTEMAS [202862100001) 2017 09 06 17:39:49 UTC ANSl/TIA-PN-942-B 682 Location The IOA should be centrally located to avoid exceeding maximum length restrictions for the applications to be supported, including maximum cable lengths for access provider circuits served out of the entrance room. 683 Facility requirements The facility requirements requirements of an IOA are the same as that for an HOA see 6.9. 6.9.3) 3).. 69 691 Horizontal distribution area General The horizontal distribution area area HOA) is the space that supports cabling to the EOAs and optionally ZOAs. The LAN, SAN, console, and KVM switches that support the end equipment are also typically located in the HOA. The MOA may serve as a HOA for nearby equipment or for the entire computer room . There should be a minimum of one horizontal cross-connect cross-c onnect HC) per floor . The HC may be in a HOA, IOA, or MOA. Additional HOAs may be required to support equipment beyond the horizontal cable length limitation . The maximum number of connections per HOA should be adjusted based on cable tray capacity, leaving room in the cable trays for future cabling . In data centers that are used by multiple organizations, such as disaster recovery data centers, web hosting data centers, and colocation facilities, the HOA should be in a secure space. 692 Location The HOAs should be located to avoid exceeding maximum backbone and horizontal cabling lengths for the media types. 693 Facility Facilit y requiremen requirements ts If the HOA is in an enclosed room, consideration regarding a dedicated HVAC, POUs, and UPS fed power panels for the HOA should be taken. If the HOA has dedicated air conditioning, then they should be powered by panel boards which have redundant power e .g., generator or alternative power source). The architectural, mechanical, and electrical requirements for the HOA are the same as that for the computer room . 6 10 Zone distribution area To avoid cable congestion a ZOA should be limited to 288 cables, cables , particularly for enclosures meant to be placed overhead or under 2 ft ft.. x 2 ft . or 600 mm x 600 mm) access floor tiles. Cross-connection shall not be used in the ZOA. ZOA . No more than one ZOA shall be used within the same horizontal cable run. There shall be no active equipment in the ZOA. ZOA . NOTE: Category 8 channel topologies do not contain a ZOA. 6 11 Equipment distribution areas The EOAs are spaces allocated for end equipment , including computer systems and communications equipment. The end equipment is typically floor standing equipment or equipment mounted in cabinets or racks. 29 ~ ~ 1 1WICJ:trf 1 N fl or iw f."' l Industry Associalion TIA rder Number:: 02167039 Number Sold lo: lo :UPSISTEMAS [202062100001 ] 2 17 · 09·06 17: 17 :39 :49 UTC U Perm1lled without license from IHS ANSl/TIA-PN-942-B Horizontal cables are terminated in EDAs on equipment outlets. Sufficient power receptacles and connecting hardware should be provided for each equipment cabinet and rack to minimize patch cord and power cord lengths. 6.12 Telecommu Telecommunicatio nications ns room data centers, the telecommunications room (TR) is a space that supports cabling to areas outside the computer room. The TR is normally located outside the computer room but, if necessary, it can be combined with a MDA, IDA, or HOA In The data center may support more than one telecommunications room if the areas to be served cannot be supported from a single telecommunications room. The telecommunication telecommunication rooms sha shallll meet the specifications of ANSl/TIA-569-0. ANSl/TIA-56 9-0. 6.13 6.1 3 Data center suppor supportt areas areas The data center support areas are spaces outside the computer room that are dedicated to supporting the data center facility. These may include but are not limited to: the operation center, support personnel offices, security rooms, electrical rooms, mechanical rooms, storage rooms, equipment staging rooms, and loading docks. The administrative and support areas shall be cabled similarly to standard office areas, as per ANSl/TIA-568.1-D. The operation center consoles and security consoles will require larger numbers of cables than standard work area requirements. The quantity should be determined with thefor assistance of the operations and technical staff. The may also require cabling large wall-mounted or ceiling-mounted displays (e.g.,operation monitors center and televisions). The electrical rooms, mechanical rooms, storage rooms, equipment staging rooms, and loading docks should have at least one wall phone each. The electrical and mechanical rooms should also have at least one data connection for access to the facility management system. If the data center serves a critical function for an enterprise, consider terminating telecommunications cabling for the data center support areas and office space from telecommunications rooms outside the computer room. 6.14 Cabinets and and racks racks 6 14 1 General Cabinets and racks shall meet the specifications of ANSl/TIA-569-D. provide adequate space for telecommunications cabling and power strips and also factoring for the increasing depths of equipment, cabinets and racks should be 1200 mm (48 in) deep for new installations. Additionally Additionally,, it is recommended to consider cabinets that are greater than 600mm (24 in) wide to accommodate management of cabling and avoid routing of cabling behind equipment exhausts where they may obstruct proper airflow. To 6.14.2 Hot and and cold aisles Where alignment of cabinets is used to separate hot air and cold air, cabinets and racks shall be arranged in an alternating pattern, with fronts of cabinets/racks facing each other in a row to create hot and cold aisles. More efficient methods of hot or cold air contai containment nment may may not require the orientation of cabinet/racks in a hot aisle/cold aisle configuration. Cold aisles are in front of racks and cabinets. If there is an access floor, distribution of power cables or busbars can be installed under the raised floor. Alternatively, power cables or busbars can be installed overhead. Hot aisles are behind racks and and cabinets. If there is an access floor, cable trays for telecommunications cabling should be located under the access floor in the hot aisles. 3 h l T elecommunicalions elecommunicalions lnduslry Associalion Jrovided by IHS under license wi1h TIA fo reproduclion r networking permitted withoul license from IHS Order Number: 02167039 Sold to:UPSISTEMAS [202862100001 j ~ o p y r i 2 0 1 7 0 9 0 6 1 7 :3 9 :4 9 UTC ANSl/TIA-PN-942-B I ront I Cabinets IRear rear Align front or with of cabinets edge of floor tiles HOT' ISLE Rear c abinet s) If installed underfloor telecommunications cables should be under the hot aisle Rear .Cabinets If they are uneven, cold aisles should be the larger ones to possibly provide more cool air and to provide more where equipment is typically installed IFront C d LD A SLE Fronjj of Ca >inets) Fron --+ If installed underfloor power cables should be under the cold aisle JFront a b i n e t s J Figure 10: Example of 6.14 6. 14.3 .3 Placem Placement ent relativ relative e to hot floor Rear I aisles, cold aisles and cabinet placement tile grid When placed on access floor, cabinets and racks shall be arranged so that they permit tiles in the front and rear of the cabinets and racks to be lifted. Cabinets should be aligned with either the front or rear edge along the edge of the floor tile. Racks should be placed such that the threaded rods that secure the racks to the slab will not penetrate an access floor stringer. 6.14.4 Access floor tile cuts Where under floor cooling is utilize utilized, d, floor flo or tile cuts should only be used use d to: • accomm odate cabinet vents or cooling systems, or • route cables from under floor to abov e floo floor. r. In all cases, floor tile openings should be designed to seal, as tight as possible, against the penetrations to to minimize loss of under floor air pressure. Brushes, flaps, or other methods to contain static air pressure should be used. Floor tile cuts for cabinets should be placed under the cabinets or other location where the floor tile cut will not create a tripping hazard. Floor tile cuts for racks should be placed either: under the vertical cable managers between the racks, or under the rack (at the opening between the bottom angles). Generally, placing the floor tile cut under the vertical cable managers is preferable as it allows equipment to be located at the bottom of the rack. 31 ~ ~ O h ~ 31 ' I'· tllou ~. nJ r _• llJ t 13q W ~ h I )' Tll\ Associalion Number: 02167039 Sold to:UPSISTEMAS [202862100001 2017-09-06 17:39:49 UTC Order Y\}fl J ri u Permitted wilhoU1 license from IHS ANSl/TIA-PN-942-B The floor tile cuts shall not reduce the strength of the floor tile below the floor loading requirements specified in 6.4.2.7. One method is to draw a cross over the raised floor tile between the four corners and make a cut out where it does not touch any of the lines see Figure 11 below. Draw a Figure 6 14 5 ross NOT OK OK NOT OK : Tile cuts should not be where it touches any of the lines on a cross formed by the corners of the tile Installation of racks on access floors Seismic cabinets and racks shall be appropriately secured either directly to the building structure or other means (e.g., seismic platform). Where cabinets and racks are secured directly to the building it will need to be done so in accordance with guidance provided by the AHJ or a structural engineer. Where threaded rods are used, the top shall be covered using domed nuts or other methods. 6 14 6 Racks and cabinets in entrance room MDAs IDAs and HDAs 480 mm (19 in) racks are typically used for patch panels and equipment. Service providers may also install their own equipment in the entrance room in either 585 mm (23 in) racks or proprietary cabinets. A vertical cable manager shall be installed between each pair of racks and at both ends of every row of racks. Vertical cable management shall be sized by calculating the maximum projected cable fill fill,, including a minimum 50 additional growth factor (see ANSl/TI ANSl/TIA-569A-569-D). D). Where projected cable fill information is not available, consider deploying 250 mm (10 in) wide vertical cable managers. The cable managers should extend from the floor to the top of the racks. Horizontal cable management, either integrated into the patch panel or as horizontal cable managers adjacent to each patch panel, should be. provided, unless the patch panels are angled installed and there is adequate vertical cable management. Where used, the preferred ratio of horizontal cable management RUs to patch panels RUs is 1: 1. The vertical cable management, horizontal cable management, and slack storage should be adequate to ensure that the cables can be neatly dressed and that bend radius requirements specified in ANSl/TIA-568.0-D are met. 32 h l T elecommunicalions lndus1ry Associalion y IHS under license with TIA reproduction or network networkii ng permilled without license from IHS Order Number: 02167039 Sold to:UPSISTEMAS [202862100001 ] 2017-09-06 17 39:49 UTC ~ o p y r i lrovided fo ANS 1/TIA-PN-942-8 D T CENTER CABLING SYSTEMS General 71 Data center cabling generally supports multiple device types and applications in the same environment. 7.2 721 hoosing media General Cabling specified by this document is applicable to different application requirements within the data center environment. Depending upon the characteristics of the individual application, choices with respect to transmission media should be made. In making this choice, factors to be considered include: • flexibility flexib ility with respect to supported services; • required useful life of cabling; • facility/site facility /site size and occupan occupantt population; • data through throughput put within the cabling system; and • equipment vendor recommendations or specificat specifications. ions. Selection of termination hardware should consider needs for proper labeling, cable routing, cable management, and ability to insert and remove cords without disrupting existing or adjacent connections. Consider preterm preterminated inated cabling to reduce installation time and improve consistency and quality of terminations . terminations. 7.2. 7. 2.2 2 Cable fir fire e rating requ irem irements ents Cable fire-rating requirements vary by installation conditions and jurisdiction . Consult the AHJ before deciding on the type of cable to use under access floors. NOTE - Consider the selection selection of cable types e.g. e.g.,, plenum-rated) and and fire suppress suppression ion practices that minimize damage to equipment and the facility in the event of fire 7.3 Horizontal 731 abling General The horizontal cabling extends from the equipment outlet to the horizontal cross-connect. The following partial listing of common services and systems should be considered when the horizontal cabling is designed: • voice, modem, and facsimile teleco telecommunica mmunications tions service; • premises switching equipment; • computer and telecommunications management connect connections; ions; • optical tap modules; • keyboard/video/mouse KVM) connections connections;; • data communications; • wide area networks WAN); • local area networks LAN); ~ ~ ~ t lnduslry Association f 111• with TIA INorlimg permitted without license from IHS Order Number: 02167039 Sold to:UPSISTEMAS 202862100001] , 2017-09-06 17:39:49 UTC ANS 1/TIA-PN-94 1/TIA-PN-942-B 2-B • storage area networks (SAN); and • other building signaling systems (building automation systems such as fire, security, power, HVAC, EMS, etc.). In addition to satisfying today s telecommunication requirements, the horizontal cabling should be planned to reduce ongoing maintenance and relocation. It should also accommodate future equipment, applications and service changes. Consideration should be given to accommodating a diversity of user applications in order to reduce or eliminate the probability of requiring changes to the horizontal cabling as equipment needs evolve. The horizontal cabling can be accessed for reconfiguration under the access floor or overhead on cable tray systems. However, in a properly planned facility, disturbance of the horizontal cabling should only occur during the addition of new cabling. 7.3.2 Topology Each equipment outlet in the equipment distribution area (EDA) shall be connected via horizontal cable to a horizontal cross-connect in the horizontal distribution area (HOA), intermediate distribution area (IDA (IDA), ), or main distribution area (MDA) as shown in Figure 12. Horizontal cabling shall contain no more than one consolidation point in the zone distribution area (ZDA) between the horizontal cross-connect and the equipment outlet. Refer to clause 6.10 for additional information regarding ZDAs. ZDA* ZD A* EDA LEGEN P lfV1\ era ss connecl [) m D inler-connecl outlet Telecom space ZDA and a crossconnection are not • MDA, IDA, or HOA ategory 5e 6 6A, or 8 horizontal c : ~ a b ~ l e ~ - - - - 1 DA EO part of the category 8 channel topology HC NOTE: category 8 channels do not contain a cross-connect or a CP Figure 12: Typical horizontal cabling using a star topology 7.3.3 Horizontal cabling length The horizontal cabling length shall meet the requirements of ANSl/TIA-568.0-D. The maximum horizontal cabling length for supporting 25 Gb/s and higher speed balanced twisted-pair applications shall be 30 m (98 ft) assuming a 24 m (78 ft) permanent link length and 6 m (20 ft) of cords with an insertion loss de-rating factor of 1 2 . The maximum length of horizontal coaxial cabling from the MDA shall be as specified in Annex A of this Standard for the type of applications intended to run over the coaxial cabling. 7.3.4 Direct attach cabling The use of direct attach cabling as an alternative to structured cabling should be limited to specific use cases. Direct attach cabling between rows is not recommended. Any direct attach cabling should be routed in cable management or accessible pathways, and not interfere with fixed cabling. Where direct attach cabling is used between cabinets, each end of a cable shall be 34 h l T elecommunica1ion elecommunica1ions s Industry Association Jrovided by IHS under license with TIA Jo reproduction or networking permilled without license from II-IS Order Number: 02167039 Sold to:UPSISTEMAS [202862100001]. 2017 09 06 17 39:49 UTC ~ o p y r i ANSl/TIA-PN-942-B labeled with a permanent label. When direct attach cables are no longer used, the cables shall be removed. Cable lengths for direct attach cabling between equipment in the EDA should be no greater than 7 m 23 ft and should be between equipment in immediately i.e. not multiple) adjacent racks racks or cabinets in the same row. Direct attach cabling within distributors distribut ors MDs, IDs, IDs, HDs) and entrance spaces should be constrained within the distributor or entrance space and within a contiguous row. 7.3.5 7.3 .5 Recognized media Due to the wide range of services and site sizes where horizontal cabling will be used, more than one transmission medium is recognized. This Standard specifies transmission media, which shall be used individually or in combination in the horizontal cabling. Recognized cables, related connecting hardware, jumpers, patch cords, equipment cords, and zone area cords shall meet the requirements specified in ANSl/TIA-S68.2-D and ANSl/TIA S68.3-D. The recognized media are: • 4-pair 100-oh 100-ohm m balanc balanced ed twisted-pair cable ANSl/TIA-S68.2-D) ANSl/TIA-S68.2-D) - category 6 category 6A, or category 8 with category 6A or higher recommended; • 8SO nm laser-optimized S0/125 um multimode fiber cable OM3, OM4, or OMS ANSl/TIA- 568.3-D), with OM4 or OMS recommended; Note: OMS asmultimode used in this document, is the cable specified in ANSl/TIA-S68.3-D using TIA-492AAAE fibers. • single-mode optical fiber cable ANSl/TIA-S68.3-D); • 7S-ohm 734 and 73S type coaxial coaxial cable cable Telcor Telcordia dia Technologies Technologies GR-317 GR-317S) S) - use used d for T-1 T-1,, T-3, E-1, and E-3 circuits only; and • 7S-ohm 7S-o hm broadband coaxial cables as specified in ANSl/TIA-S68.4-D. Channels constructed from recognized cables, associated connecting hardware, jumpers, patch cords, equipment cords, and zone area cords shall meet the requirements specified in ANSl/TIA S68.0-D, ANSl/TIA-S68.2-D, ANSl/TIA-S68.3-D and ANSl/ATIS-0600404 DS3). See TIA TSB-5019 that describes use cases for category 8 cabling in data centers. 7.3.6 Optical fiber connectors InANSl/TIA-604-10) LCconnection, new installations,shall where or two fibers arethan usedtwo to fibers make are a connection, the a connector be one used. Where more used to make the MPO connect connector or ANSl/TIA-604-S or ANSl/TIA-6 ANSl/TIA-604-18) 04-18) shall be used. The connector performance shall comply with ANSl/TIA-S68.3-D. See ANSl/TIA-S68.3-D for polarity guidelines. 7.3.7 7.3 .7 Coaxial Coaxi al cable connectors Coaxial connectors for 7S-ohm 734 and 73S type coaxial cables shall meet the requirements of ANSl/ATIS-0600404 and shall additionally meet the following specifications: • a charact characteristic eristic impedance of 7S-oh 7S-ohm; m; • a maximum insertion loss at 1 MHz to 22.S MHz of 0.02 dB; and • a minimum return return loss at 1 MHz to 22.S MHz of 3S dB. Annex A permits the use of either TNC or BNC connectors, BNC connectors are recommended. Coaxial connectors for broadband coaxial cables shall be as specified in ANSl/TIA-S68.4-D - Ftype male connector for series 6 or series 11 cable and S/8-24 male connector for trunk, feeder, distribution, or braided multipurpose cable. ~ ~ 3S l r y o r ~ ~ or °A '6 lndus1ry Association • lh TIA ,bPermilted wilhout license from IHS Order Number: 02167039 Sold lo:UPSISTEMAS [202862100001 J 2017-09-06 17:39:49 UTC ANS 1/TIA-PN-942-B 7.4 ackbone cabling 741 General The function of the backbone cabling is to provide connections between the MDAs, IDAs, HDAs, telecommunications rooms, and entrance facilities in the data center cabling system. Backbone cabling consists of the backbone cables, main cross-connects, intermediate cross-connects, horizontal cross-connects, mechanical terminations, and patch cord or jumpers used for backbone-to-backbone backbone-to-bac kbone cross-connection cross-connection.. The backbone cabling is expected to serve the needs of the data center occupants for multiple planning phases, each phase spanning a timeframe from months to years . During each planning period, the backbone cabling design should accommodate growth and changes in service requirements without the installation of additional cabling. The length of the planning period is ultimately dependent on the design logistics including material procurement, transportation, installation, and specification control. The backbone cabling shall allow network reconfiguration and future growth without disturbance of the backbone cabling. The backbone cabling should support different connectivity requirements, including both the network and physical console connectivity such as: local area networks, wide area networks , storage area networks, computer channels , equipment console connections and optical tap modules . 7.4.2 7.4.2.1 Topology Star topology The backbone cabling shall meet the hierarchal star topology requirements of ANSl/TIA-568.0-D. There shall be no more than two hierarchical levels of cross-connects in the backbone cabling. From the horizontal cross cross-conn -connect ect HC), no more than one cross-connect shall be passed through to reach the MC. Therefore, connections between any two HCs shall pass through three or fewer cross-connec cross-connectt facilities . Figure 13 shows an example of a typical data center backbone cabling using a star topology wherein each horizontal cross-connect in the HOA is cabled directly to a main cross-connect in the MDA. NOTE: The topology required by this Standard has been selected because of its acceptance and flexibility in meeting a variety of application requirements. The limitation to two levels of cross-connects is imposed to limit signal degradation for passive systems and to simplify moves, adds and changes. 36 ~ o p y r i h l Telecomrnunicalions Industry Associa11on lrovided by IHS under license with TIA fo reproduclion or nelworking permitted wilhoul license lrom IHS 1T Order Number: 02167039 Sold to:UPSISTEMAS [2 28621 2 17· 9· 6 17:39:49 UTC by ll1S 1[ d ct ANS l/TIA-PN-942-B HO TR HO IO - Backbone cables i O Backbone cables - IO Backbone cables MO Entrance Room Backbone cables - HO HO Figure 13: 13: Typical backbone cabling using a star topology If the horizontal cabling passes through the HDA, sufficient cable slack shall exist in the HDA to allow movement of the cables for potential future migration to a cross-connection. Backbone cabling cross-connects may be located in telecommunications rooms, equipment rooms, MDAs, IDAs, HDAs or at entrance rooms. 7.4.2.2 Accommodation of non star configurations The topology in Figure S, through the use of appropriate interconnections, electronics, or adapters in data center distribution areas, can often accommodate systems that are designed for non-star configurations such as ring, bus, or tree. Cabling between HDAs should be permitted to provide redundancy and to avoid exceeding legacy application length restrictions. 7.4. 7. 4.3 3 Redund ant cabl ing topologies 7.4.4 7.4. 4 Recognized Recogn ized media Redundant topologies can include a parallel hierarchy with redundant distribution areas. These topologies are in addition to the star topology specified in clauses 7.3.2 and 7.4.2. See clause 9 for additional information. Due to the wide range of services and site sizes where backbone cabling will be used, more than one transmission medium is recognized. This Standard specifies transmission media, which shall be used individually or in combination in the backbone cabling. The recognized media are: • 100-ohm balanced balanced twisted-pair cable recommended; ANSl/TIA-S68.2-D) with category 6A or higher • 8SO nm laser-optimized S0/12S um multimode fiber cable OM3, OM4, or OMS S68.3-D), with OM4 or OMS recommended; • single-mode optica opticall fiber cable ANSl/TIA-S68 ANSl/TIA-S68.3-D); .3-D); ANSl/TIA ll lrnu1 1 Q D u a 1 lO 1 1 nmwo. air 37 II U1~1k iurr er rn 1w hltl ltlu u .m·y Associalion T lA 1'.lnu permitted without license from IHS Order Number; 02167039 Sold lo:UPSISTEMAS [202862100001[, 2017-09-06 17:39:49 UTC ANS l/TIA-PN-942 l/TIA-PN-942-B -B • 75-ohm 734 and 735 type coaxial cable (Telcordia Technologies GR-3175 - used for T-1, T3, E-1 , and E-3 circuits only; and • 75-ohm broadband coaxial cables as specified in ANSl/TIA-568.4-0. Channels constructed from recognized cables, associated connecting hardware, hardware , jumpers, patch cords , equipment cords, and zone area cords shall meet the requirements specified in ANSl/TIA568.0-0, ANSl/TIA-568.2-0, ANSl/TIA -5 68.3-D and ANSl/ATIS-0600404 (DS3) . 7.4.5 Optical fiber connectors In new installations, where one or two fibers are used to make a connection, the LC connector (ANSl/TIA-604-10) shall be used. Where more than two fibers are used to make a connect conn ection , the MPO connector (ANSl/TIA-604(ANSl/TIA-604 -5-E or ANSl/TIA-604-18) shall be used used.. The conne connector ctor performance shall comply with ANSl/TIA-568.3-0. See ANSl/TIA-568.3-0 for polarity guidelines. 7.4.6 7.4. 6 Coaxial cabl cable e connectors Backbone coaxial cabling connectors shall meet the horizontal coaxial cabling connector specifications speci fications in 7.3 .7. 7.4.7 Backbone cabling lengths Cabling lengths are dependent upon the application and upon the specific media chosen (see ANSl/TIA-568.0-0 and the specific application standard) . Annex A of this document provides guidelines for backbone lengths for data center applic pplica ations. 7 .5 Centralize d optical fiber cabling 7.5.1 General Centralized optical fiber cabling shall meet the requirements of ANSl/TIA-568.0-0. In a data center,, centralized optical fiber cabling Is designed as an alternative to tl1e optical center cross-connection located in the HOA when deploying recognized optical fiber cable in the horizontal in suppor supportt of centralized electronic lectronics s. 7.5.2 Implementation The specifications of ANSl/TIA-568.0-0 shall be followed. In the cases of modular or containerized data center units, centralized optical fiber may extend beyond a single building. To ensure correct fiber polarity, centralized cabling shall be implemented as specified in ANS /TIA/TIA-568. 568. 3-0. 7.6 Cabling transmission performance and test requirements 7.6.1 General Transmission performance depends on cable characterist characteristiics, connecting hardware hardware,, patch cords and cross cross-- con nect wiring, the total number of connections. and the care with which they are installed insta lled and maintained . See ANSl/TIA-568 .0-0 for fie ld test specifications for postpost-installation performance performan ce measurements of o f cab cabling ling designed in accordance with this Standard . 7.6. 7. 6.2 2 Additional requirements for field testing o f 75-ohm coaxial cabling Coaxial cabling shall be tested for: • Center conductor continuity; • Shield continuity; • Impedance (75-ohms ; and \ 38 ;opy ngh ghll ) rovl ed 1l e c o li on• l odu Jlry Astt00irt. ion IHS utlltnr Uaonof) wllh TIA l\tl1WUr1t.r 1J po pou u nllled w au1 icense lrom IHS IJ fne nm11 '/fl IS U ~ h l f Order Number Number:: 02167039 Sold lo U " ~ I S E M I S /202862100001) , 2017-DP·· Ofl 17: 2017-DP 17 :Jg • g UTC > (I ff1• 'od"'4llion 14 or no ANSl/TIA-PN-942-B • Insertion loss less than the maximum specified in table 2 based on the planned applications for the cable). Table 2: Maximum Coaxial Cable Insertion Loss Application - Frequency Maximum insertion loss from access provider DSX to customer equipment CEPT-1 E-1) - 1 MHz CEPT-1 CEPT-3 CEPT -3 E-3 E-3)) - 17. 17.2 2 MHz T-3 - 22.4 MHz 3.6 dB 6 6dB 6.9 dB Coaxial cabling should be tested to ensure that end-to-end lengths are shorter than the lengths specified for the the planned planned applications applications - see Annex Annex A The cable tester should be calibrated for velocity of propagation using a sample length of the cable under test see ANSl/TIA-1152-A). As an alternative, length may be measured or determined using jacket length markings. markings. Note that the maximum lengths and maximum insertion loss values provided in this Standard are end-to-end from access provider DSX panel to customer equipment including coaxial cable patch cords. Additionally, the cabling should be visually inspected for: • Obvious damage to cable for example, pinched cable, cuts or abrasion that exposes the shield); • Incorrectt bend radii; and Incorrec • Loose or damaged connectors. 39 t dn r T t O l l ~ lnque1ry llnder license will 1TIA ssociation Pr networking permitted wilhoul license from IHS Order Number: 02167039 Sold lo:UPSISTEMAS 202862100001 ] 2017·09·06 17:39:49 UTC ANSl/TIA-PN-942-B 8 81 DATA CENTER CABLING PATHWAYS General Except where otherwise specified, data center cabling pathways shall adhere to the specifications of ANSl/TIA-569-D. Sizing of pathways should consider quantities of cables when the data center is fully occupied and all expansion areas are are built. Particular attention is required for adequate capacity of pathways at entrance rooms, main distribution areas (MDAs), intermediate distribution areas (IDAs), horizontal distribution areas (HDAs), and intersections of cabling pathways. Usable cross-section and corresponding maximum capacity should be reduced to allow cables to exit while maintaining proper bend radius where exiting or routing past fittings such as cable dropouts. Optical fiber cords and cables should be installed with continuous cable support and with radiused cable transition. Where cables are installed with non-continuous cable support and without radiused cable transition, the cable should have adequate robustness to maintain required performance. Examples of such supports are, but not limited to : • wire basket trays without solid bottoms, • ladders without radiused cross-members or solid bottoms, • or hooks without radiused cable supports. 82 Security for data center cabling Telecommunications cabling for data centers shall not be routed through spaces accessible by the public or by other tenants of the building unless the cables are in enclosed conduit or other secure pathways. Any maintenance holes, pull boxes, and splice boxes shall be equipped with locks. Any maintenance holes on building property or under control of the owner shall be locked and should be monitored by the security system using a camera, remote alarm or both. See ANSl/TIA-5017 for additional guidelines regarding physical network security. Telecommunications entrance cabling for data centers should not be routed through a common equipment room (CER). Access to pull boxes for data center cabling (entrance cabling or cabling between portions of the data center) that are located in public spaces or shared tenant spaces should be controlled. The pull boxes should also be monitored by the data center security system using a camera, remote alarm or both. Any splice boxes for data center cabling that are located in public spaces or shared tenant spaces should be locked and monitored by the data center security system using a camera, remote alarm or both. Entrance to utility tunnels used for telecommunications entrance rooms and other data center cabling should be locked. If the tunnels are used by multiple tenants or cannot be locked, telecommunications cabling for data centers shall be in solid metallic conduit or other secure pathway. 83 Routing of telecommuni telecommunications cations cables Separation is specified to accommodate the wide variety of equipment that may be present in a data center, but are not found in a typical office environment or telecommunications room. 40 ;opyrighl Te ecommunica ecommunicalions lions lnduslry Association )rovided by lHS under license with TIA Jo reproduction or networking permiUed wilhou1 license from IHS Order Number. Number. 02167039 Sold to:UPSISTEMAS [202862100001 1 J 1 2017 09 06 17:39:49 UTC ANSl/TIA-PN-942-8 8.3. 8. 3.1 1 Separ ation betwe between en power o r lighting and balanced twisted-p air cables The distances between power cables or lighting fixtures and balanced twisted-pair cables shall be maintained per ANSl/TIA-569-D. It is normally possible to meet the recommended separation distances through proper design and installation practices. In data centers that use overhead cable trays, the access headroom between the top of a tray or runway and the bottom of the tray or runway above shall be provided and maintained as specified in ANSl/TIA-569-D. This provides adequate separation if the electrical cables are shielded or if the power cable tray meets the specifications of the clause 8.3.1 and is above the telecommunications cable tray or runway. In data centers that employ access floor systems, adequate separation of power and telecommunications cabling can be accommodated through the following measures: • In the main aisles, allocate separate aisles for power and telecommunications cabling, if possible. • Provide both horizont horizontal al and vertical vertical separatio separation n of power and and telecommunications telecommunications cables where it is not possible to allocate separate aisles for power and telecommunications cabling in the main aisles. Provide horizontal separation by allocating different rows of tiles in the main aisles for power and telecommunications cabling, with the power and telecommunications cables as far apart from each other as possible. Additionally, provide vertical separation by placing the telecommunications cabling in cable trays or baskets as far above the power cables as possible. • In the equipment cabinet aisles, allocate separate aisles for power and telecommunications cabling. Refer to 6.3.2.2 and 6.14.2 for additional information on cable routing and hot and cold aisles design. 8.3.2 Separation of fiber and balanced twisted-pair cabling Fiber and balanced twisted-pair cabling in cable trays and other jointly used pathways should be separated so that it improves admini administratio stration n and operation. Additio Additionally, nally, cords and jump jumpers ers should be separated from other cabling. Physical barriers between the two types of cables are not necessary. Where it is not practical to separate fiber and balanced twisted-pair cables, fiber cables should be on top of o f balanced balanced twisted-pair cables. 8.4 8.4. 8. 4.1 1 elecommunications entrance pathways Entr ance pat pathwa hwa y types Telecommunications entrance pathways for data centers should be located underground. Aerial entrance pathways for telecommunications service entrance pathways are not recommended because of their vulnerability due to physic physical al exposu exposure. re. 8.4.2 Diversity Refer to ANSl/TIA-758-8 for information regarding entrance pathway divers diversity. ity. 8.4.3 If ts Sizing The number of entrance conduits required depends on the number of access providers that will provide service to the data center, and the number and type of circuits that the access providers will provide. The entrance pathways should also have adequate capacity to handle growth and additional access providers. Each access provider should have at least one metric designator 103 (trade size 4) conduit at each entrance point. Additional conduits may be required for campus cabling. Conduits used for 1 n u n l i ~ n r h ;i~ Of ~ < > r l < 1 41 '1JliftiDOOum 11lfcn l ott a l ndu ll ry Association \ln i1i IHS under lll loan JO Jun or n t w ~ r k i n g Yhh TIA permitted wilhout license lrom IHS Order Number: 02167039 Sold lo:UPSISTEMAS (202062100001]. 2017-09-06 17:39:49 UTC ANS 1/TIA-PN-942-B optical fiber entrance cables should have three innerducts [two metric designator 40 (trade size 1.5) and one metric designator 27 (trade size 1) or three metric designator 32 (trade size 1.25)]. Consider the use of soft-sided duct material as a substitute for innerduct, which may optimize the use of finite conduit cross-sectional area. 85 851 Access floor systems General Access floor systems should be used in data centers that support equipment that is designed to be cabled from below. Telecommunications cabling under the access floor shall be in pathways that do not block airflow such as non-continuous supports, wire basket trays, or cable ladders. Cables shall not be left abandoned under the access floor. Cables shall be terminated on at least one end in the MDA or a HDA, or shall be removed. For additional information on rack and cabinet installation with access flooring systems, refer to ANSl/TIA-569-D. 852 Access floor performa performance nce requirements Access flooring shal shalll meet the the performance requirem requirements ents of ANSl/TIA-569-D. Access floors for data centers should use a bolted stringer understructure, as they are more stable over time than stringerless systems. Pedestal adhesive should be applied under all base plates. Pedestal bases should also be bolted to the subfloor (with the exception of post-tension floors) for added stability in seismic areas. Consider installing access floor stringers in a 1.2 m 4 ft) long basketweave pattern where additional stabili stability ty is desired (e.g., in seismically active areas). 853 Floor tile cut edging Access floor tile cuts should have edging or grommets along all cut edges. If the edging or grommets are higher than the surface of the access floor, they shall be installed as not to interfere with placement of racks and cabinets. The edging or grommets shall not be placed where the racks and cabinets normally contact the surface of the access floor. In the case of down-flow AC systems where the access flooring is being used as an air distribution plenum, floor tile cuts should be limited in both size and quantity to ensure proper airflow. In addition, floor tiles with cement or wood cores should have their exposed cut edges to prevent sealed order core material being blown being the computer room. room . After cuts itare made tointhe access floor system and all from equipment racks, into cabinets, and frames are in place, is recommended that the AC system be properly balanced. 86 861 Cable trays General Typical cable tray types for cable installation include telco-type cable ladders, center spine cable tray, or wire basket cable tray. The maximum recommended depth of cable in any cable tray is 150 mm 6 in). Cable trays may be installed in several layers to provide additional capacity. Typical installations include two or three layers of cable trays, one for power cables and one or two for telecommunications cabling. One of the cable tray layers may employ brackets on one side that hold the data center bonding infrastructure. These cable trays may be supplemented by a duct or tray system for fiber patch cables. The fiber duct or tray may be secured to the same threaded rods or pedestals used to support the cable trays. trays . 42 ~ o p y r i h l 1 elecommunications Industry Association )rovided by IHS under license with TIA \lo reproduction or networking permille wilhou\ license from IHS Order Number: 02167039 Sold lo:UPSISTEMAS [2028621000 [202862100001]. 01]. 2017-09-0617:39:49 UTC ANSl/TIA-PN-942-B During the design phase, the weight of fully occupied cable pathways should be calculated and coordinated with a structural engineer engin eer (if overhead) and and access floor designer desi gner (if under floor). Cable pathways should not be located where they interfere with proper operation of fire suppression systems such water distribution from sprinkler heads. Cable trays should not block airflow into or out of cabinets or ventilated tiles. Cables shall not be left abandoned in cable trays. The cable tray system shall be bonded and ground grounded ed per ANSl/TIA-607-C. See ANSl/TIA-569-D for additional cable tray design considerations. Refer to NEMA VE 2-2013 for recommendations regarding installation of cable trays. 8.6.2 8.6. 2 Cable tray s in acce ss floor systems To provide room for cables to exit the pathways, there shall be a minimum of 20 mm (0.75 in) from the bottom of the access floor tiles to the top of the cable tray and cabling in a cable pathway that is loaded 100 of calcula calculated ted capacity. Underfloor cable tray should not be us.ed for direct attach cabling between rows. Under floor systems that require periodic access or maintenance such as valves, electrical receptacles, and smoke detectors should not be located below under floor cable trays unless there is an empty row of tiles adjacent to these trays. 8.6.3 8.6 .3 Overhead cable tra ys Overhead cable tray systems may alleviate the need for access floors in data centers that do not employ empl oy floor-standing systems syste ms tha thatt are are cabled from from belo below. w. Overhead cable trays also minimi minimize ze interference with under flo or cooling. Overhead cable trays should be suspended from the ceiling. Where building structural characteristics make overhead suspension of a cable tray impossible, the tray can be suspended from a structural grid that is supported by other means. If all racks and cabinets are of uniform height, the cable trays may be attached to the top of racks and cabinets, but this is not a recommended practice because suspended cable trays provide more flexibility for supporting cabinets and racks of various heights, and provide more flexibility for adding and removing cabinets and racks. In aisles and other common spaces in internet data centers, co-location facilities, and other shared tenant data centers, overhead cable trays should have solid bottoms or be placed at least 2.7 m (9 ft} above the finished floor to limit accessibility or be protected through alternate means from accidental and/or intentional damage. 8.6.4 Coordination o f cable tr y routes Planning of cable trays for telecommunications cabling should be coordinated with architects, mechanical engineers, and electrical engineers that are designing lighting, plumbing, air ducts, power, and fire protection systems. Cable trays should be routed to avoid impeding airflow, airflow, sprinkler sprinkl er patterns, and and lighting. This typically implies routing cable trays over cabinets and racks rather than above aisles between them. Lighting fixtures and sprinkler heads should be placed between overhead cable trays, not directly above cable trays. Cable trays should be located above cabinets and racks instead of above the aisles, where lighting should be located. 43 m r r m f t i Industry Association Order Number: 2 ~ 6 7 3 9 Sold to:UPSISTEMAS [202862100001]. 2017-09-06 17:39:49 UTC IHS under license with TIA networking permitted without license from IHS ' 1Ucr1ion or ANSl/TIA-PN-942-B D 9.1 T CENTER REDUNDANCY Introduction Data centers that are equipped with diverse telecommunications facilities may be able to continue their function under unplanned or adverse conditions that would otherwise interrupt the data center's telecommunications service. This Standard includes information on the planned availability of the data center facility infrastructure in Annex F. Figure 14 illustrates various redundant telecommunications infrastructure components that can be added to the basic infrastructure at different ratings . See Annex F for a description of data center infrastructure ratings. The reliability of the telecommunications infrastructure can be increased by providing redundant cross-connect areas and pathways that are physically separated. It is common for data centers to have multiple access providers providing services, redundant routers, redundant core distribution and edge switches. Although this network topology provides a certain level of redundancy, the duplication in services and hardware alone does not ensure that single points of failure have been eliminated. The proximity and response time of technicians required to perform repairs may affect reliability depending on the redundancy and architecture of the network and information technology infrastructure. Access Access - Provide r - Access • · · · ···· Provider _.Provider __..Access Provider : r ;_ / •.--: ·- • t\ Legend / ,.,.t. J ' 'I· <\'IJ r Rated 2 ._ : I I .. • I • •; ' I O. f • / I ~ . ~ I » . : . - ~ ~ Figure 14 14:: Telecommunications cabling pathway and space redundancy 44 ~ o p y r i g h t Telecommunications cations Industry Associalion lrovided by IHS under license with TIA -. o reproduclion or nelworking permilled without license from IHS O f 1 1 Order Number: 02167039 Sold lo:UPSISTEM lo:UPSISTEMAS AS [202062100001 J. 2017·09·0617:39:49 UTC 'ht Redundant maintenance holes and entrance pathway s Multiple entrance pathways from the property line to the entrance room s) eliminate a single point of failure for access provider services entering the building. These pathways will include customer-owned maintenance holes where the access provider conduits do not terminate at the building wall. The maintenance holes and entrance pathways should be separated at an appropriate distance to minimize risk of one unplanned event affecting both critical paths. The recommendation is a separation of o f 20 m 66 ft or more. In data centers with two entrance rooms and two maintenance holes, it is not necessary to install conduits from each entrance room to each of the two maintenance holes. holes . In such a configuration, each access provider is typically requested to install two entrance cables, one to the primary entrance room through the primary maintenance hole, and one to the secondary entrance room through the secondary maintenance hole. Conduits from the primary maintenance hole to the secondary entrance room and from the secondary maintenance hole to the primary maintenance hole provide flexibility, but are not required. In data centers with two entrance rooms, conduits may be installed between the two entrance rooms to provide a direct path for access provider provide r cabling between these thes e two rooms for example, to complete a SONET or SDH ring). 9.3 9. 3 Redundant access provi er services Continuity of telecommunications access provider services to the data center can be ensured by using multiple providers, access toprovider pathways from access the access providermultiple central offices the datacentral center. offices, and multiple diverse Utilizing multiple access providers may increase service reliability in the event of an access provider-wide outage or access provider financial failure that impacts service. Utilizing multiple access providers alone does not ensure continuity of service, because access providers often share space in central offices and share rights-of-way. The customer should ensure that its services are provisioned from different access provider central offices and the pathways to these central offices are diversely routed. These diversely routed pathways should be separated at an appropriate distance to minimize risk of one unplanned event affecting both critical paths. The recommendation is a separation of 20 m 66 ft or more at all points along their routes. 9.4 9. 4 y f lJPftl lJPftldU dU ANSl/TIA-PN-942-B 9.2 9. 2 T Redundant entrance room Multiple entrance rooms may be installed for redundancy rather than simply to alleviate maximum circuit length restrictions. Multiple entrance rooms improve redundancy, but complicate administration. Access providers should install circuit provisioning equipment in both entrance rooms so that circuits of all required types can be provisioned from either room. Care should be taken to distribute circuits between entrance rooms. The access provider provisioning equipment in one entrance room should not be subsidiary to the equipment in the other entrance room. The access provider equipment in each entrance room should be able to operate in the event of a failure in the other entrance room. The two entrance rooms should be separated at an appropriate distance to minimize risk of one unplanned unpla nned event affecting both both rooms. The recommendati recommendation on is a distance of 20 m 66 ft) or more. The two entrance rooms should be designed such that, power, fire protection and air conditioning equipment that support them ar are e concurrently maintainable. 5 1 Order Number: 02167039 Sold to to:UPSIST :UPSISTEMAS EMAS [202062100001 J 2017-09-0617:39:49 UTC Industry Association Under license wilh TIA or networking permitted wilhoul license lrom IHS bvAI aconvm1nlr:: uHnns rtQi. k ANSl/TIA-PN-942-8 9.5 Redundant ma main in distributio distribution n are area a A secondary main distribution area (MDA) provides additional redundancy, but at the cost o complicating administration. Core routers and switches should be distributed between the two MOAs. Circuits should also be distributed between the two spaces. The two MDAs should be designed such that, power, fire protection and air conditioning equipment that support the MOAs are concurrently maintainable. 9.6 Redundant backbone cabling Redundant backbone cabling protects against an outage caused by damage to backbone cabling. Redundant backbone cabling may be provided in several ways depending on the degree of protection desired. Backbone cabling between two spaces, for example, a HOA and a MDA, can be provided by running two cables between these spaces, preferably along different routes. If the data center has redundant MDAs or redundant IOAs, redundant backbone cabling to the HOA from each higher level distributor (IOA or MOA) is not necessary. However, the routing of cables from the HOA to the redundant IDAs or MDAs should follow different routes. 9.7 Redundant horizontal cabling Horizontal cabling to critical systems can be diversely routed to improved redundancy. Care should be taken not to exceed maximum horizontal cable lengths when selecting paths. Critical systems can be supported by two different HOAs as long as maximum cable length restrictions are not exceeded. The two HDAs should be in different fire protection zones for this degree of redundancy to provide maximum benefit. 10 CABLING INSTALLATION REQUIREMENTS The installation requirements in ANSl/TIA-568.0-0, in addition to the other clauses of this Standard, shall be followed. Cabling shall comply with applicable codes and regulations. CABLING PERFORMANCE REQUIREMENTS The transmission performance requirements of ANSl/TIA-568.2-0, ANSl/TIA-568.3-0 and ANSl/TIA-568.4-0 shall be met. 12 CABLING FOR INTELLIGENT BUILDING SYSTEMS Cabling for intelligent building systems that support the computer room, such as networked electrical, mech mechanical anical,, and security equipment shall follow the requirements of ANSl/TIA-862-8. ANSl/TIA-862-8 . 13 CABLING FOR WIRELESS ACCESS POINTS Cabling for wireless access points should follow the guidelines of TIA TSB-162-A. 14 CABLING FOR DISTRIBUTED ANTENNA SYSTEMS Cabling for distributed antenna systems should follow the guidelines of TIA TSB-5018. 15 POWER DELIVERY OVER BALANCED TWISTED PAIR CABLING Power delivery over balanced twisted-pair twisted-pai r cabling cabling shou should ld follow the guidelines of TIA TSB-184-A. 16 GROUNDING AND BONDING Grounding and bonding shall meet the requirements of ANSl/TIA-607-C. 46 :;opyrighl Telecommunications Industry Association Order Number: 02167039 Sold to:UPSISTEMAS [202862100001 [, 2017-09-06 17:39:49 UTC Jrovided by IHS under license with TIA -. o reproduction or networking permitted wilhout license from IHS iyright Tels( lided by IH tlproduclio1 ANSl/TIA-PN-942-B 7 FIRESTOPPING Firestopping shall be in accordance with ANSl/TIA-569-D. 8 PHYSICAL SECURITY Telecommunications infrastructure physical security shall shall meet the the requireme requirements nts of ANSl/TIA5017. 9 ADMINISTRATION Telecommunications administration shall meet the requirements of ANSl/TIA-606-C. A special attention should be given to administration of the data center environment that is deploying or migrating to fiber optic cabling infrastructure based on utilizing array connectivity along with high density of ports and connections (e.g., support for leaf spine network architecture). Implementation and administration of array connectivity infrastructure requires planni nning ng - ne need ed to know know what you have prior to making any changes, deployment thorough pla precis pre cision ion - con consis siste tency ncy in creating switching fabric, as well as continuous real-time infrastructure monitoring as a risk mitigating mechanism for reducing durations of network downtime. Automated Infrastructure Management (AIM) per the ANSl/TIA-5048 standard is useful to address the challenges of complex data center environments environments.. The standard defines AIM as an integrated hardware and software system that automatically detects the insertion or removal of cords, [and] documents the cabling infrastructure including connected equipment enabling management of the infrastructure and data exchange with other systems. AIM systems enable : Automated documentation of the cabling infrastructure Proper planning orders/instructions and implementation of connections via electronic work End-to-end connectivity tracing capabilities that are available from management software interface as well directly at the racks/cabinets Continuous automated monitoring of cabling infrastructure capable of generating real time alerts Accurately manage and monitor connectivity and port capacity of cabling infrastructure. 47 l e t o m m u oooc1otion c1otion lo uo try A ooo IHS uudat litense w h l IA f nolw 1kmo pof mllted wl1t1ou1 license from IHS Order Number Number:: 02167039 Sold lo :UPSIST EMAS 1202862100001 J UTC 2 17 · 9· 6 17: 17:39:49 :::opyrighl Telecommunications lnduslry Association Jrovided by IHS under license with TIA \lo reproduclion r networking permitted wilhout license from IHS Order Number: 02167039 Sold lo:UPSISTEMAS [202862100001 J 2017 09 0617:39:49 UTC l ANS l/TIA-PN-94 l/TIA-PN-942-B 2-B ANNEX ANNE X A (INFORMA (INFORMATIVE) TIVE) CABLIN CABLING G DESIGN DESIGN CONSIDERAT CONSIDERATIONS IONS This annex is informative only and is not part of this Standard. A.1 Application cabling lengths The maximum supportable lengths in this annex are application and media dependent. in ANSl/TIA-568.0-D See tablefor5 optical for balanced twisted-pair applications and table 6 in ANSl/TIA568.0-D fiber applications. A.1.1 T-1, E-1, T-3 and E-3 circuit lengths Table 3 provides the maximum circuit lengths for T-1, T-3, E-1, and E-3 circuits with no adjustments for intermediate connections or outlets between the circuit demarcation point and the end equipment. These calculations assume that there is no customer DSX panel between the access provider demarcation point (which may be a DSX) and the end equipment. The access provider DSX panel is not counted in determining maximum circuit lengths. Table 3: Maximum circuit lengths with no DSX panel 159 m Category Se, 6 6A 193 m CEPT-1 (E-1) (520 ft 116 m (380 ft) (632 ft) 146 m (477ft) T-3 - - CEPT-3 (E-3) - - Circuit type T-1 Category 3 734 Type Coaxial 73S Type Coaxial - - 332 m (10 88f t) 146 m (480 ft) 160 m (524 ft) 148 m (487 ft) 75 m (246 ft) 82 m (268 ft) NOTE: The lengths shown in table 3 are for for the specific applications application s used used in data centers and may be different from the lengths supported for various applications in ANSl/TIA-568.0-D. Repeaters can be used to extend circuits beyond the lengths specified above. These circuit lengths should be adjusted for insertion loss losses caused by a DSX panel between the access provider demarcation point (which may be a DSX panel) and the end equipment. Table 4 provides the reduction caused by DSX panels in maximum circuit lengths for T-1, T-3, E-1, and E-3 circuits over the recognized media type. Table 4: Reduction in circuit lengths for DSX panel CEPT-1 (E-1) (37 ft) 10 m (32 ft) Category Se, 6 6A 14 m 45 ft) 12 m 40 ft) T-3 - - CEPT-3 (E-3) - - Circuit type T-1 Category 3 11 m 734 Type Coaxial 73S Type Coaxial - - 64 m (209 ft) 13 m (44 ft) 15 m (50 ft) 28 m (93 ft) 7m (23 ft) Sm (26 ft) Maximum circuit lengths Table should5 provides be adjusted for insertion loss losses caused by for intermediate connections and outlets. the reduction circuit lengths T-1, T-3, in maximum E-1, and E-3 circuits over the recognized media type. 49 Order Number: 02167039 Sold to:UPSISTEMAS 1202862100001 , 2017·09-06 17:39:49 UTC I Ti0f:accii mnun tcn dor 1c1 lfl¢.1U l l try As lOC :i s lion llA A Ill ,., .,. ~ . . . . wM ll l c m tll n D w a rkl klng ng pt:tf pt:tfttn llted wi witl tl o UI license from IHS ANS 1/TIA-PN-942-B Table 5: Reduction in circuit lengths per connection or outlet Circuit type Category 3 CEPT-1 (E-1) 4.0 m (13.0ft} 3.9 m (12.8 ft) T-3 CEPT-3 (E-3) T-1 Category Se, 6, & 6A 1.9 m (6.4 ft) 2.0m 734 Type Coaxial 735 Type Coaxial - - 4.4 m 2.0 m (6.5 ft) (6.4 ft) 14.5ft) - - - - 0.9 m 3.1 ft) 1.1 m (3.5 ft) 0.5m (1.6 ft) 0.5m (1.8 ft) In the typical data center, there are a total of three connections in the backbone cabling, three connections in the horizontal cabling and no DSX panels between the access provider demarcation point and the end equipment. Backbone cabling: • one connection in the entrance room; • two connecti connections ons in the main cross-connect; • no intermediate cross-conne cross-connect. ct. Horizontal cabling: • two connection connections s in the horizontal cross-connect; • an outlet connection at the equip equipment ment distribution area. This typica typicall configuratio configuration n corresponds to the typical data center with an entrance room, main distribution area (MDA), one or more horizontal distribution areas (HDAs), and no zone distribution areas (ZDAs). Maximum circuit lengths for a typical data center configuration with six connections are shown in table 6. These maximum circuit lengths include backbone cabling, horizontal cabling, and all patch cords or jumpers between the access provider demarcation point and the end equipment. 50 ::opyrlghl Telecommunications lnduslry Association 'rovided by IHS under license with TIA \lo reproduction or networking permitted wilhout license from IHS Order Number: 02167039 Sold to:UPSISTEMAS 202862100001 ] 2017·09·0617:39:49 UTC ANSl/TIA-PN-942-B Table 6: Maximum circuit lengths for the typical data center configuration Circuit type T-1 CEPT-1 (E-1) T-3 CEPT-3 (E-3) 734 Type 135 m (442 ft) 92 m Category Se, 6 & 6A 184 m (603 ft) 134 m (303 ft) (439 ft) Category 3 - - - Coaxial 73S Type Coaxial - - 305 m 137 m (1001 ft) 141 m (462 ft) 153 m (503 ft) (448 ft) 7 m (236 ft) 78 m (257 ft) With maximum horizontal cable lengths, maximum patch cord lengths , no customer DSX, no intermediate distribution area (IDA), and no ZDA, ZDA , the maximum backbone cable lengths for T-1, E-1, T-3, or E-3 circuits are shown in table 7. 7 . This typical configurati configuration on assumes that the entrance room, MDA, MDA , and HDAs are separate rather than combined, and that there is no IDA. The maximum backbone cabling length is the sum of the length of cabling from the entrance room to the MDA and from the MDA to the HDA. Table 7: Maximum backbone length for the typical data center configuration Category 734 Type 73S Type Se, 6 & 6A 46 m (150 ft) <1 m (<3 ft) Coaxial Coaxial CEPT-1 (E-1) <1 m (<3 ft) <1 m (<3 ft) T-3 - - CEPT-3 (E-3) - - Circuit type T-1 Category 3 190 m (624 ft) 26 m (85 ft) 38 m (126 ft) - 29 m (95 ft) Om 0 ft) Om 0 ft) These calculations assume the following maximum patch cord lengths in the typical data center: • 10 m (32.8 ft) for balanced twist twisted-p ed-pair air and fiber in the entrance room , MDA MDA,, and HOA; • 5 m (16.4 ft) for 734-type coaxial cable in the entrance room, MDA, and HDA; • 2.5 m (8.2 ft) for 735-type coaxial cable in the entrance room, MDA, and HDA. Due to the very short lengths permitted by category 3 balanced twisted-pair cabling and 735 type coaxial cable for T-1 , T-3, E-1, and E-3 circuits, category 3 balanced twisted-pair and 735-type coaxial cables are not recommended for supporting these types of circuits . Backbone cabling lengths can be increased by: • limiting the the locations where T-1, T-1, E-1, T-3, and E-3 circuits are provisioned for example only in the MDA or horizontal cabling originating from the MDA ; • provisionin g circuits from multip provisioning multiplexer lexers s or other circuit provis provisioning ioning equipment located located in the MDA, IDA, or HDA; • provisioning provisionin g circuits using horizont horizontal al cabling fro from m the MDA, reducing the numb er of connections from six to two , and reducing the number of patch cords . A.1.2 Bal uns EE-3 3 and T-3 circuits Baluns permit E-3 and T-3 circuits to use twisted-pair cabling instead of 75-ohm coaxial cabling. 51 T e l f l r ~ m m n t c a l k m a Order Number: 67039 Sold to:UPSISTEMAS (202862100001 ]. 2017-09-06 17:39:49 UTC l lldut11lry Associalion by IHS under license whh 1 A - l kln or netw etwo o rki ng p e rm iUe d wit hout l ic ice e n se fr om IH S ANS l/TIA-PN-942-B Lengths for E-3 and T-3 circuits over twisted-pair cabling depends on a number of factors, including the electrical characteristics of the baluns, which are beyond the scope of this Standard. However, lengths for E-3 and T-3 circuits over twisted-pair cabling using baluns will be considerably shorter than the lengths for these circuits over 734 type coaxial cabling. Taking into account only the insertion loss of the cabling and two twisted-pair connections, the maximum lengths for E-3 and T-3 circuits with baluns over twisted-pair cabling is: Table 8: Maximum circuit lengths over baluns NO NOT T including insertion loss of baluns Category 6 Category 6A Category Se Circuit type Cable Panels Cable Panels Cable Panels T-3 60.0 m (196.8 ft 67 .8 m (222.5 ft 69..3 m (227.4 ft 69 CEPT-3 (E-3) 66.2 m (217.2 ft 74.5 m (244.2 ft) 75 .9 m (249.1 ft These calculations assume that the baluns are attached directly to the access provider DSX panel, that there is no custo customer mer DSX pane panel, l, and that there are two twisted-p twisted-pair air connections. The lengths above need to be reduced by the following lengths for each decibel of insertion loss for the pair of baluns: Table : Reduction in maximum circuit length for each 1 dB insertion loss for a pair o f baluns Circuit type Category Se Cable Category G Panels Cable Panels Category GA Cable Panels T-3 10.2 m (33.4 ft 11.1 m (36.6 ft 11.4 m (37.4 ft CEPT-3 (E-3) 11.7 m (38.3 ft) 12.8 m (41.9 ft 13 .0 m (42.7 ft If the circuit is to pass through more than two connections, the circuit lengths will need to be reduced as described in table 10. 10 . Table 10: Reduction in maximum circuit length for each additional twisted-pair connection (after the 1st two Circuit type A.1.3 Category Se Cable Category G Panel Cable Panel Category GA Cable Panel T-3 1.9 m (6.3 ft 1. 1 m (3.5 ft 1.1 m (3.5 ft CEPT-3 (E-3) 1.9 m (6.3 ft 1.1 m (3.5 ft) 1.1 m 3 .5 ft) TIA-232 and TIA-561 console connections The recommended maximum lengths for TIA-232-F and TIA-561/562 console connections up to 20 kb/s are: • 23.2 m (76.2 ft over category 3 balanced twisted-pair cable; • 27.4 m (89.8 ft over category Se or higher balanced twisted-pair cable. The recommended maximum lengths for TIA-232-F and TIA-561/562 console connections up to 64 kb/s are: • 8.1 m (26.5 ft over category 3 balanced twisted-pair cable; 52 ;opyrighl Telecommunications Industry Associalion 'rovided by IHS under license with TIA fo reproduclion or nelworking permitted wilhou1 license from IHS Order Number: 02167039 Sold to:UPSISTEMAS /202862100001 /, 2017·09·06 17:39:49 UTC ANSl/TIA-PN-942-B • 9.S m 31.2 ft) over category Se or higher balanced balanced twisted-pair cable . A.2 Cross connections In the entrance room, MDA, IDA, and HDA, jumper and patch cord lengths used for cross connecti on to backbone cabling should not exceed connection exceed 20 m 66 ft). ft). The only exception to these length restrictions should be in the case of 7S-ohm coaxial cables, for DS-3 patching, the maximum length should be Sm 16.4 ft for type 734 coaxial and 2.S m 8.2 ft for type 73S coaxial in the entrance room, main cross-connect, intermediate cross-connect, and horizontal cross-connect cross-connects s. A.3 Separation o f functions in the main distribution area The MDA should have separate racks for balanced twisted-pair, coaxial cable, and optical fiber distribution unless the data center is small and the main cross-connect can fit in one or two racks. Separate patching bays for balanced twisted-pair cables, coaxial cables, and optical fiber cables simplify management and serves to minimize the size of each type of patching bay. Arrange patching bays and equipment in close· proximity to minimize patch cord lengths . A.3. A. 3.1 1 Twisted-pair main cross-c onnec t The twisted-pair main cross-connect MC) supports supports twisted-pair cable cable for a wide wide range of applications including low speed circuits, T-1, E-1, consoles, out-of-band management, KVM, and LANs. Consider installing category 6A twisted-pair cabling for all balanced twisted-pair cabling from the MC to the intermediate intermediate cross-connects ICs) and HCs, as this will provide maximum flexibility for supporting supporti ng a wide wide variety of applicat applications. ions. Cabling from the E-1/T-1 E-1/T-1 demarcation area in the entrance room should be 4-pair category Se or higher. The type of terminations in the MC IDC connecting hardware or patch panels) depends on the desired density and and where the conversion from from 1- an and d 2-pair access provider cabling cabling to 4-pair computer room structured cabling occurs : • if the conversio conversion n fro from m 1- and 2-pair access provider cabli cabling ng occurs occurs in the entrance room, then balanced twisted-pair cable terminations in the MC are typically on patch panels. This is the recommended configuration; • if the conversion from 1- and 2-pair access provider cabling occurs in the MC, then balanced twisted-pair cable terminations in the MC should be on IDC connecting hardware. A.3.2 A.3 .2 Coaxial main cross-c onnec t The coaxial MC supports coaxial cable for T-3 and E-3 cabling two coaxial cables per circuit). For smaller data centers and shorter cable runs, 73S-type coaxial cable may be considered. All other coaxial cabling should be 734-type coaxial cable. Termination of coaxial cables should be on patch panels with 7S-ohm BNC connectors. The BNC connectors should be female-BNC on both the front and back of the patch panels. A.3.3 A.3 .3 Optical fib fiber er main cross- conne connect ct The fiber MC supports optical fiber cable for local area networks, storage area networks, metropolitan area networks, computer channels, and SON ET circuits. Termination of fiber cables should be on optical fiber patch panels. S3 h l itdt comrnunications Industry Associalion If by tHS under license th TIA or networking permi1ted wilhoul license from IHS Order Number: 02167039 Sold lo:UPSISTEMAS [202862100001 . 2017 -09-06 17:39:49 UTC 2017- ANS 1/TIA-PN-942-B A.4 Separation Separatio n of functions n the horizontal distribution area HDAs should have separate cabinets or racks for balanced twisted-pair, twisted-pair , coaxial cable, and optical fiber distribution unless the horizontal cross-connect is small and only requires one or two racks. Separate patching bays for balanced twisted-pair cables, coaxial cables , and optical fiber cables simplify management and minimize the size of each type of patching bay. bay . Arrange patching bays and equipment in close proximity to minimize patch cord lengths. The use of a single type of cable simplifies management and improves flexibility to support new applications . Consider installing only one type of balanced twisted-pair cable and only one type of optical fiber cable for horizontal cabling for example all category 6 or all all category A , and all OM4 cable or all OM3 cable) . A.5 Cabling Cabli ng to end equipment Equipment cord lengths from the ZDA to floor standing systems in which patch panels cannot be installed should be limited to a maximum of 22 m 72 ft), ft), equipment equipme nt cord cord lengths from from the ZDA to systems install in cabinets in which patch panels can be installed should be limited to a maximum of 10 33 ft) . If individual equipment outlets are located on the same equipment rack or cabinet as the equipment served in lieu of a ZDA, equipment cord lengt hs should be limited to to 5 m 16 ft). ft). A.6 Fiber design conside consideration ration High termination density can be achieved using multi-fiber increments and the use of MPO connectors. If cable lengths can be accurately pre-calculated, pre-terminated multi-fiber cable assemblies can reduce installation time . n these cases, the effects of additional connections should be considered to ensure overall fiber system performance. High data-rate end equipment may accommodate multi-fiber connectors directly e.g., 40/1 40/1 OOG Ethernet with mult multii mode optical fiber). A. 7 Balanced twisted pair design consideration The patch panels should provide adequate space for labeling of each patch panel with its identifier as well as labeling each port as per ANSl/TIA-606-C requirements. 5 :;opyrigh\ Telecommunications Industry Association Jrovided by IHS under license with TIA Jo reproduclion or nolworking permitted without license from IHS Order Number: 02167039 Sold lo:UPSISTEMAS [202862100001]. 2017-09-06 17:39:49 UTC ANSl/TIA-PN-942-B ANNEX ANN EX B (INFORMATIVE (INFORMATIVE)) ACCESS PROVIDER INFORMA INFORMATION TION This annex is informative only and is not part of this Standard. 8.1 ccess provider coordination 8.1.1 General Data center designers should coordinate with local access providers to determine the access providers provid ers requirements and to ensure that the data center requirements are provided to the access providers. B.1.2 Information to provide to access providers Access providers will typically require the following information for planning entrance rooms for a data center: • address of the building; • general information information concerning other uses of the building building,, including other tena tenants; nts; • plans of teleco telecommunicati mmunications ons entrance conduits from the property line to the entrance room, room, including location of maintenance holes, hand holes, and pull boxes; • assignment assig nment of conduits and and innerducts (or soft-sided subducts subducts)) to the access provider; • floor plans for the entrance faciliti facilities; es; • assigned location of the access provider providers s protectors, racks, and cabinets; • routing of cables within entran entrance ce room (under access floor, overhead cable ladders, other); • expected quantity and type of circuits to be provisioned by the access provider; • date that the access provider will be able to install entrance cables and equipment in the entrance room; • requested location and interface for demarcation of each type of circuit to be provided by the access provider; • requested service date; and • name, telephone number, and email address of primary customer contact and local site contact. B.1.3 Information that the access providers should provide The access provider should provide the following information: • conduitt requirements, includin condui including: g: o o o o o size and quanti quantity ty innerduct (or soft-sided subduct) subduct) size size an and d quantity (if owner installed) installed) bend limitati limitations ons pull string placem placement ent minimum burial depth locate wire or locate ball placement stub up location and specifications • bonding requirements; • backboard sizing; • final grading and landsca landscape pe impact; ~ Order Number: 02167039 Sold to:UPSISTEMAS [202862100001 ], 2017-09-06 17:39:49 UTC t e1 i.:om \ nlr.n l ku 1a od 1 Ui hV Association wil h TI TIA ?Y IHS under license wi ~ u o or networking permitted without license from IHS ANS l/TIA-PN-942-8 • handhole or maintena maintenance nce hole location; • space and mounting requirements for protectors on balanced twisted-pair cables; • quantity and dimensions of access provider racks and cabinets; • powerr requirements for equipment, including receptacl powe receptacle e types; • service clearances; and • installation installa tion and service schedule. B.2 ccess provider demarcation in the entrance room B.2.1 Organization The entrance room will have up to four separate areas for access provider demarcation: • demarcatio n for low-speed balanced twisteddemarcation twisted-pair pair circuits, including DS-0, DS-0, ISDN ISDN SRI, SRI, and telephone lines; • demarcation for high-speed DS-1 T-1 or fractional T-1, ISDN PRI) or CEPT-1 (E-1) balanced twisted-pair circui circuits; ts; • demarcatio n for circuits delivered on coaxial cable including DS-3 (T-3) and CEPT-3 (E-3); demarcation and • demarcation for optical fiber circuits (for example, SONET OC-x, SDH SDH STM-x STM-x,, Fast Ethernet, Gigabit Ethernet, 10 Gigabit Ethernet, 40 Gigabit Ethernet, and 100 Gigabit Ethernet). Ideally, all access providers provide demarcation for their circuits in the same location rather than in their own racks. This simplifies cross-connects and management of circuits . The centralized location for demarcation to all access providers is often called meet-me areas or meet-me racks. There should be separate meet-me or demarcation areas or racks for each type of circuit; low speed, E-1/T-1, E-3/T-3, and optical fiber. Cabling from the computer room to the entrance room should terminate in the demarcation areas. areas . If an access provider prefers to demarcate their services in their racks, the customer can install tie-cables tie-cabl es from that access provider provide r s demarcation point poi nt to to the desired meet-me/demarc mee t-me/demarcation ation area. B.2.2 Demarcation o f low-speed circuits on IDC Access providers should asked providers to provide demarcation of low-speed connecting hardware. Whilebe service may prefer a specific type of circuits IDC connecting hardware (e.g., 66 block), they may be willing to hand off circuits on another type of IDC connecting hardware upon request. Cabling from the low-speed circuit demarcation area to the MDA should be terminated on IDC connecting hardware near the access provider IDC connecting hardware. Circuits from access providers are terminated either in one or two pairs on the access provider IDC connecting hardware. Different circuits have different termination sequences, as illustrated in Figure 15 and Figure 16. Each 4-pair cable should be terminated in an eight-position modular jack at the EDA. The 100 ohm balanced twisted-pair equipment outleUconnector should meet the modular interface requirements specified in IEC 60603-7. In addition, the telecommunications outlet/connector for 100 ohm balanced twisted-pair cable should meet the requirements of ANSl/TIA-568 .2-D and the terminal marking and mounting requirements specified in ANSl/TIA-570-C . Pin/pair assignments should be as shown in Figure 15 or, optionally, per Figure 16 if necessary to accommodate certain 8-pin cabling systems. The colors shown are associated with the horizontal 56 :;opyrigh\ Telecornmunications lnduslry Association Jrovided by IHS under license wilh TIA reproduc1ion or networl<ing permtlled without license from IHS Order Number: 02167039 Sold to:UPSISTEMAS 1202862100001 ], 2017 09 06 17:39:49 UT ANSl/TIA-PN-942-B distribution cable. These illustrations depict the front view of the equipment outlet and provide the list of the pair position position for various circuit types. Pair 2 (Orange on block) / block) /\ 1 WhiteGreen Pair 4 Brown on block) Pair 1 Blue on Pair 3 (Green on block) /\ /\ 2 3 GreenWhite WhiteOrange 4 BlueWhite 5 WhiteBlue 6 OrangeWhite 8 BrownWhite 7 WhiteBrown Jack Pin Pin 's and Balanced Twisted-Pair Cable Wire Colors (View from Front of Jack or Back of Plug) 1) Phone Lines: 1-pair cross-connect to to Pair 1 Blue ) 2) ISDN BRI U·lnterface (U.S.): 1-pair cross-connect to Pair 1 (Blue) ( Blue) 3) ISDN BRI SIT-lntf (Intl): 2-pair cross-connect to Pairs 1 & 2 ( Blue & Orange ) 4) 56k/64k Leased Line: 2-pair cross-con cross-connect nect to Pairs Pairs 3 4 (Green (Green Brown) 5) E11T1: 2-pair cross-connect to Pairs 1 & 3 (Blue & Green Green)) 6) 10Base-Tl 100Base- T: 2-pair cross-connect cross-connect to to Pairs 2 & 3 (Orange & Green Green)) Figure 15: Cross-connection circuits to IDC connecting hardware cabled to modular jacks in the T568A 8-pin 8-pin sequence 7 1f to omm1mlc:aliang l nd ur i l ry Association y 1 1S i:to i:to1 1 klunJSo TIA . Ui::lion r;1 networking permitted without license from IHS Order Number: 02167039 Sold to:UPSISTEMAS [202862100001]. 2017-09-0617:39:49 UTC ANSl/TIA-PN-942-B Pair 3 (Green on block) Pair 2 (Orange on Pair 1 (Blue on block) block) /\ /\ 1 WhiteOrange 2 OrangeWhite 3 WhiteGreen 4 BlueWhite 5 WhiteBlue Pair4 Brown on block) \ 6 GreenWhite 7 WhiteBrown 8 BrownWhite Jac k Pin 's and Balanced Twisted-Pair Cable Wire Colors (View from from Fro nt of Jack or Back of Plug) 1) Phone Lines:1- pair cross-connect to Pair 1 Blue ) 2) ISDN BRI U-lnterface (U.S.): 1-pair cross-connect to Pair 1 (Blue) 3) ISDN BRI S/T-lntf (Intl): 2-pair cross-connect to Pairs 1 & 3 ( Blue & Green ) 4) 56k/64k Lea sed Line: 2-pair cross-connec cross-connectt to Pairs Pairs 2 & 4 ( Orange & Brown) 5) E1/T1: 2-pair cross-connect to Pairs 1 & 2 ( Blue & Orange ) 6) 10Base-T/100B ase-T: 2-pair cross-connect cross-connect to Pairs 2 & 3 (Orange & Green Green)) Figure 16: 16: Cross- connection circuits to IDC connecting hardware cabled to modular jacks in the T568B 8-pin sequence 8 ::opyrighl Telecommunicalions Industry Association :>rovided by IHS under license wilh TIA reproduction or networking permitted without license from IHS Order Number: 02167039 Sold to:UPSISTEMAS [202662100001[ tl m Te Tell eco < O l b1 IHS 2017-09-06 17:39:49 UTC K o ~ ANSl/TIA-PN-942-B The conversion from access provider 1-pair and 2-pair cabling to 4-pair cabling used by the data center structured cabling system can occur either in the low-speed circuit demarcation area or in the main distribution area (MDA). The access provider and customer IDC connecting hardware can be mounted on a plywood backboard, frame, rack, or cabinet. Dual-sided frames should be used for mounting large numbers of IDC connecting hardware (3000+ pairs). B.2.3 Demarcation of T-1 circuits Access providers should be asked to hand-off T-1 circuits on RJ48X jacks (individual 8-position modular jacks with loop back), preferably on a DSX-1 patch panel mounted on a customer-owned rack installed in the DS-1 demarcation area. Patch panels from multiple access providers and the customer may occupy the same rack. For example, in the United States and Canada, access providers typically use DSX-1 patch panels that fit 585 mm (23 in) racks. Thus, the DS-1 demarcation area should use one or more 585 mm (23 in) racks for access provider DS-1 patch panels. These same racks or adjacent 480 mm (19 in) racks can accommodate- patch panels for cabling to to the MDA. MDA. Outside the United States and Canada, access providers typically use DSX-1 panels that fit in 480 mm (19 in) racks. The DSX-1 DSX-1 patch panels may require power for indicator lights. Thus, racks supporting access acc ess provider DSX-1 patch panels should, at minimum have one 20A 120V circuit and a multi-outlet power strip. Allocate rack space for access provider and customer patch panels including growth. Access providers may require rack space for rectifiers to power DSX-1 patch panels. Access providers can alternatively hand off DS-1 circuits on IDC connecting hardware. These IDC connecting hardware can be placed on the same frame, backboard, rack, or cabinet as the IDC connecting hardware for low-speed circuits. A single 4-pair cable can accommodate one T1 transmit and receive pair. When multiple T1 signals are placed over multi-pair multi-pai r unshielded twisted-pair cable, the transmitted signals should be placed in one cable and the receive signals placed in a separate cable. If the data center support staff sta ff has has the test equipment equipme nt and and knowledge to troubleshoot trouble shoot T-1 circuits, the DS-1 demarcation area can use DSX-1 panels to terminate T-1 cabling to the MDA. These DSX-1 panels should should have either modular jacks or IDC terminations at the rear. The IDC connecting hardware, modular mod ular jack patch panels, or DSX-1 DSX-1 panels for cabling to the MDA can be on the same or separate racks, frames, or cabinets as the ones used for access provider DSX-1 patch panels. If they are separate, they should be adjacent to the racks assigned to the access providers. The customer (data center owner) may decide to provide its own multiplexers (M13 or similar multiplexer) to demultiplex access provider T-3 circuits to individual T-1 circuits. T-1 circuits from a customer-provided multiplexer should not be terminated in the T-1 demarcation area. B.2.4 Demarcation of E-3 T-3 circuits Access providers should be asked to hand-off E-3 or T-3 circuits on pairs of female BNC connectors, preferably on a DSX-3 patch panel on a customer-owned rack installed in the E-3/T-3 demarcation area. Patch panels from multiple access providers and the customer may occupy the same rack. In the United States and Canada, access providers typically use DSX-3 patch panels that fit 585 mm (23 in) racks. Thus, the E-3/T-3 demarcation area should use one or more 585 mm (23 in) racks provider patch DSX-3panels patch for panels. These same racks or adjacent 480 mm access (19 in) racks for canaccess accommodate cabling to the MDA. Outside North America, providers typically use DSX-3 panels that fit 480 mm (19 in) racks. 59 Telecommunications Industry Association b) IHS under license with TIA t tel ron or networking permitted without license from IHS Order Number: 02167039 Sold to:UPSISTEMAS [202662100001 ], 2017-09·06 17:39:49 UTC ANS 1/TIA-PN-942-B If the data center support staff has the test equipment and knowledge to troubleshoot E-3 or T-3 circuits, the E-3/T-3 demarcation area can use DSX-3 panels to terminate 734-type coaxial cabling to the MDA. These DSX-3 panels should have BNC connectors at the rear. The DSX-3 patch panels may require power for indicator lights. Thus, racks supporting access provider DSX-3 patch panels should, at minimum have one 20A 120V circuit and a multi-outlet power strip. Allocate rack space for access provider and customer patch panels including growth. Access providers may require rack space for rectifiers to power DSX-3 patch panels. Cabling from the E-3/T-3 demarcation area to the MDA should be 734-type coaxial cable . Cables in the E-3/T-3 demarcation area can be terminated on a customer patch panel with 75-ohm BNC connectors, or directly on an access provider DSX-3 patch panel. Access provider DSX-3 patch panels typically have the BNC connectors on the rear of the panels. Thus, BNC patch panels for cabling to the MDA should be oriented with the front of the patch panels on the same side of the rack as the rear of the access provider DSX-3 panels. All connectors and patch panels for E-3 and T-3 cabling should use 75-ohm BNC connectors. B.2.5 Demarcation of optic l fiber circuits Access providers should be asked to hand-off optical fiber circuits on fiber patch panels installed on racks in the fiber demarcation area. Fiber patch panels from multiple access providers and the customerr may occupy the same rack. If requested, access providers may be able to use the custome same connector to simplify patch cord requirements . In the United States and Canada, access providers typically use fiber patch panels that fit 585 mm 23 in) racks, but may be able to provide patch panels that fit 480 mm 19 in) racks, if requested. In the United States, it is usually prudent to use 585 mm 23 in) racks for access provider fiber patch panels in the fiber demarcation area. These same racks or adjacent 480 mm 19 in) racks can accommodate patch panels for cabling to the MDA. Outside North America, access providers typically use fiber patch panels that fit 480 mm 19 in) racks . The racks in the fiber demarcation area do not require power except possibly utility outlets for access provider and customer test equipment. Cabling from the demarcation area to the MDA should be same fiber type as the access provider cabling. 6 :::opyrighl Telecommunicalions lnduslry Association :lrovided by IHS under liconse wilh TIA >Jo reproduction or nelworking permilled without license from IHS Order Number: 02167039 Sold \o:UPSISTEMAS [202862100001 , 2017-09-06 17:39:49 UTC ~ · l ~ . . ANSl/TIA-PN-942-B ANNEX C INFORMAT INFORMATIVE) IVE) COORDINATION O PLANS WITH OTHER ENGINEERS l W1Uet1 \ EQUIPMENT This annex is informative only and is not part of this Standard. Coordinate placement of equipment and lighting in the data centers so that lighting fixtures are placed in aisles between cabinets and racks instead of directly over equipment rows. Coordinate placement of equipment and sprinklers in the data centers so that tall cabinets or overhead cable trays do not block water dispersal from from the sprinklers sprinklers - the minimum clearance clearance by Code is 460 mm (18 in). Electrical engineers will need to know placement and power requirements for equipment cabinets and racks. Coordinate routing of power cabling and receptacles with routing of telecommunications cabling and placement of equipment. Mechanical engineers will need to know cooling requirements for equipment cabinets and racks. Coordinate placement of cable trays and telecommunications cabling to ensure that adequate airflow is maintained to all parts of the computer room. Airflow from cooling equipment should be parallel to rows of cabinets and racks. Perforated tiles should be placed in cold aisles, not hot aisles. . 6 l li : c0tmnunfl n l l o ltld1 tt> lty ssociation I.. y IMS ur\d or llc llcon onoo oo wi th TI llUt;lk;.fl or nelworking permilled without license from IHS Order Number: 02167039 Sold to:UPSISTEMAS j202862100001]. 2017-09·06 17:39:4 17:39:49 9 UTC ANSl/TIA-PN-942-B ANNE X D INFORMATIVE) DA ANNEX DATA TA CEN CENTER TER SPACE CONSIDERATIONS This annex is informative only and is not part o this Standard. The data center should have an adequately sized storage room so that boxed equipment, spare air filters, spare floor tiles, spare cables, spare equipment, spare media, and spare paper can be stored outside the computer room. The data center should also have a staging area for unpacking and possibly for testing new equipment before deploying them in the computer room. t is possible to dramatically reduce the amount of airborne dust particles in the data center by having a policy of unpacking all equipment in the build/storage room. The required size of the computer room is intimately related to the layout of the space, including not only equipment racks and/or cabinets, but also cable management and other supporting systems such as electrical power, HVAC and fire suppression. These supporting systems have space requirements that depend upon the required level of redundancy. If the new data center replaces one or more existing data centers, one way to estimate the size of the data center is to inventory the equipment to be moved into the new data center and create a floor plan of the new data center with this equipment and expected future equipment with desired equipment adjacencies and desired clearances. The layout should assume that the cabinets and racks are efficiently filled with equipment. The floor plan should also take into account any planned technology changes that might affect the size of the equipment to be located in the new data center. The new computer room floor plan will need to include electrical and HVAC support equipment. Often an operations center and a printer room are spaces with data center adjacency requirements, and are best designed together with the data center. The printer room should be separated from the main computer room and have a separate HVAC system because the printers generate paper and toner dust, which are detrimental to computer equipment. Storage for spare media and forms should be separated. Additionally, it is a good practice to have a separate room for tape drives, automated tape libraries, and tape libraries to reduce fuel load and because of the toxicity of smoke from burning tape. Consider separate spaces or rooms outside the computer room for electrical, HVAC, and fire suppression system equipment, although space is not used as efficiently, security is improved because vendors and staff that service this equipment don t need to enter the computer room. 6 :;opyright T elecommu nicalion s Industry Association )rovided by IHS under license with TIA \lo reproduclion or nelworking permilled wilhoul license from IHS Order Number: 02167039 Sold lo:UPSISTEMAS /202862100001 2017-09-06 17:39:49 UTC J ANS l/TIA-PN-942-B ANNE X E (INFORMA ANNEX (INFORMATIVE) TIVE) DATA CENTER SITE SELECTION AND BUILDING DESI DESIGN GN CONSIDERATIONS This annex is informative only and is not part of this Standard. E.1 General in Considerations are importantthe to considerations the data centerinavailability and security are provided the F. Additionally, charts in Annexthat this annex apply to higher reliability data centers. The building should conform to all applicable national, state, and local codes. The building and site should meet all current applicable local, state, and federal accessibility guidelines and standards. The building should conform to the seismic standards applicable to the International Building Code Seismic Zone of the site. The building should be free of asbestos, paint containing lead, polychlorinated biphenyl, and other environmental hazards. Consideration should be given to zoning ordinances and environmental laws governing land use, fuel storage, sound generation, and hydrocarbon emissions that may restrict fuel storage and generator operation. Consideration should be given to geographic location as it may impact power and cooling efficiency and availability. The difficulty in properly cooling equipment increases with altitude, thus data centers should be located below 3050 m (10,000 ft} elevation as recommended by ASH RAE. E.2 Architectural site selection and and building design considerations The need for redundant access to the building from separate roads should be considered. Sufficient space should be provided for all mechanical and electrical support equipment, including indoor, outdoor, and rooftop equipment. Consideration should be given to future equipment requirements. The building should have a sufficiently large loading dock, freight elevator, and pathway to handle all anticipated deliveries deliveri es of supplies and equipment. E1 The computer room should conform to ANSl/TIA-568.0-D classification. The data center and all support equipment should be located above the highest expected floodwater levels. No critical electronic, mechanical or electrical equipment should be located in basement levels. Avoid locating computer room below plumbed areas such as rest rooms, janitor closets, kitchens, laboratories, and mechanical rooms. The computer room should have no exterior windows. If there are windows in a proposed computer room space, they should be covered for security rec:rsons and to minimize any solar heat gain. E.3 Electrical site selection and building design considerations The local utility company should be able to provide adequate power to supply all initial and future power requirements for the data center. The availability and economics of redundant utility feeders possibly from separate utility substations should be considered where applicable. If the local utility cannot provide adequate power, the site should be able to support self-generation, co- 63 dyh1Tl .l lor:.pm mt u11t:a1rrmr: rnd1.l >l ry r lA llX:I IHS ur dor llconBe O h1 on o r· 11Jlw:ortdt i] ~ o r r n l e d l wl 11 tJ I Order Number: 021670 02167039 39 Sold to:UPSISTEMAS [202862100001 ], 2017-09-06 17:39:49 UTC o n icense from IHS ANS l/TIA-PN-942-B generation or distributed generation equipment. Underground utility feeders are preferable to overhead feeders to minimize exposure to lightning, trees, traffic accidents, and vandalism. E4 Mechanical site selection and building design considerations A multi-tenant building will require a location designated by the landlord either on the roof or on grade for air conditioning conditioni ng heat rejection equipment condensing units, cooling towers, or dry fluid coolers). If the building has an existing fire suppression system, it should be easily modified to a pre-action sprinkler system dedicated to the data center. If the building has an existing air conditioning system serving the data center space it should be sized appropriately to ensure it can support the computer room space and support areas. If heat rejection equipment is to be placed on-grade, then a data center site should have adequate on-grade space for the equipment and the area should be provided with unobstructed access for equipment installation and removal. E5 Telecommunication Telecommu nications s site selection and building design considerations Where applicable, the building should be served by at least two diversely routed optical fiber entrance rooms. These entrance rooms should be fed from different local access provider offices. If the building is only served by a single local central office, then the service feed from the second local central office should be capable of being added without major construction or delays in obtaining permits. Multiple telecommunications access providers should provide service or be able to provide service to to the building without major construction construction or delays in obtaining permits. The data center should be served by dedicated access provider equipment located in the data center space and not in shared tenant space. The access provider entrance cables should be enclosed in conduit within the building and be inaccessible to other tenants where routed through shared pathways. The building should have dedicated conduits serving the data center space for telecommunications service. E6 Security site selection and building design considerations If cooling equipment, generators, fuel tanks, or access provider equipment is situated outside the customer space, then this equipment should be adequately secured. Also, the data center owner will need access to this space 24 hours/day, 7 days/week. Common areas should be monitored by cameras, including parking lots, loading docks, and building entrances. The computer room should not be located directly in close proximity to a parking garage. The site should not be located in a flood plain, near an earthquake fault, on a hill subject to slide risk, or downstream from a dam or water tower. Additionally, there should be no nearby sites that could create falling debris during an earthquake. The site should not be in the flight path of any nearby airports. The site should not be within km 1/.i mile) of a chemical plant, landfill, river, coastline, or dam. The site should not be within 0.8 km 1h mile) of a military base. 04 The site should not be within 1.6 km 1 mile) of nuclear, munitions, or defense plants. The site should not be located adjacent to a foreign embassy. The site should not be located in high crime areas. See Table 12 in Annex F for additional additional considerations. 64 ::;opyright T elecommunicalions Industry Association Order Number: 02167039 Jrovided by IHS under license with TIA lilo reproduclion or nelworking permitted without license Sold l o UPSI STEM AS [202862100001 [ 2017-09-06 17:39:49 UTC l rom I HS ANSl/TIA-PN-942-B E Other site selection considerations Other data center site selection criteria to consider are: • risk of contamination contamination;; • proximity • general access; • zoning ordinance ordinances; s; • vibration; • environmental environm ental issues; and • alternate uses strategies). of police stations, fire stations, and hospitals; of the building or site after it is no longer needed as a data center (exit 6 lt i or1 Industry Association i e.l00o m1rnml fti ffo Y HS under license with TIA or networking permitted without license from i duci Order Number: 02167039 Sold lo UPSISTEMAS (202862100001]. 2017-09-06 17:39:49 UTC IHS ANSl/TIA-PN-942-B ANNEX F RATING INFORMATIVE) DATA CENTER INFRASTRUCTURE This annex is informative only and is not part of this Standard . F1 General It should be noted that human factors and operating procedures may have a greater impact on availability than the rating of the data center. This rating scheme suggests a limited number of design criteria that should be taken into consideration to improve data center reliability and security. It is not intended to bebe- all-inclus all-inclusive. ive. Additional or alternative alternative schemes are are available in other standards and best practices. F11 Redundancy overview Single points of failure should be eliminated to improve redundancy and reliability, both within the data center and support infrastructure as well as in the external services and utility supplies. This Standard includes four ratings relating to various levels of o f resiliency of the data center facility infrastructure. The definitions of each have been expanded in this Standard. F.1.2 Overview This Standard includes four ratings relating to various levels of resiliency of the data center facility infrastructure. Higher ratings not only correspond to higher resiliency, but also lead to higher construction costs. In all cases, higher ratings are inclusive of lower level requirements unless otherwise specified. A data center may have different ratings for different portions of its infrastructure. For example, a data center may be rated 3 for electrical, but 2 for mechanical. For the sake o simplicity, a data center that is rated the same for all subsystems (telecommunications, architectural and structural, electrical and mechanical) can be called out by its overall rating (e.g., a data center rated 2 would have a 2 rating in all subsystems). Howeve Howeverr where not all portions of the infrastructure are the same level, the rating should be called out specifically. For example, a data center may be rated Tz E3 A1 Mz where: • telecommunications is rated 2 T2); • electrical is rated 3 E3); • architectural infrastructu infrastructure re is rated 1 A1 ); and • mechanicall infrastructure is rated 2 M2). mechanica Although typically a data center s overall rating is based on.its weakest component, there may be mitigating circumstances relative to that facilities specific risk profile, operational requirements or other factors that justify the lower rating in one or more subsystems. Different areas within a data center may also be built and or used at different ratings dependent on operational needs. In such cases care should be given to describe these differences, for example an area of a data center that has a rating of 2 risk avoidance profile because it has T2 Ez, Az Mz services may be within a facility that is rated 3. Care should be taken to maintain mechanical and electrical system capacity to the correct rating as the data center load increases over time. For example, a data center may be degraded from 3 or 4 to 1 or 2 as redundant capacity is utilized to support new computer and telecommunications equipment. F.2 Redundancy F21 N - Bas Base e requirement requirement System meets base requirements and has no redundancy redundancy.. :opyrighl T elecommunicalions Industry Association )rovided by IHS under license with TIA \lo reproduction or networking permilted wilhoul license from IHS Order Number: 02167039 Sold lo;UPSlSTEMAS [202862100001] 2017-09-06 17:39:49 UTC L ANSl/TIA-PN-942-B F.2.2 N 1 N 1 redundancy redundancy can be implemented at the equipment level and/or path level. Where N 1 is implemented at the equipment level within a single path, it would allow for maintenance, and potential failure, on a single piece of equipment. Path maintenance or failure could lead to an interrupt of the operations . Where N 1 is implemented at the path level, one path is active N) and the other path +1) can be either on standby or active. active . This will allow for planned maintenance or a single fault without disrupting the operations. F.2.3 N+x redundancy N+x redundancy provides x additional units , modules modules,, paths, or systems in addition to the minimum required to satisfy the base requirement. The failure or maintenance of any two single units, modules, or paths will not disrupt operations if x is 2 or higher. F.2.4 2N or N+N redundancy or N+N redundancy provides two complete units, modules, paths, or systems for every one required for a base system. Failure or maintenance of one entire unit, module, path, or system will not disrupt operations. 2N F.2.5 2 N+1) redundancy 2 N+1) redundancy provides two two complete N+1) units, modules, modules, paths, or systems. Even Even in the event of failure or maintenance of one unit, module, path, or system, some redundancy will be provided and operations will not be disrupted. F.2.6 oncurrent maintainability and testing capability The facilities should operations. F.2.7 be capable of being maintained, upgraded, and tested without interruption of Fault tolerant Allows for a single fault at any given time without causing disruption to the data center operations . The system should automatically detect the fault, isolate it and ensure continuous operations of the facilities. F.2.8 F. 2.8 Capa cit city y and scalability F.2.9 Isolation Data centers and support infrastructure should be designed little or no disruption to services. to accommodate future growth with Data centers should be where practical) used solely for the purposes for which they were intended and should be isolated from non-essential operations. F 2.10 Data center rating The four data center ratings are : Rated-1 Rated1 Data Center: Basic A Basic data center is susceptible to disruptions from both planned and unplanned activity on the distribution path path and/or equipment e.g., building power shutdo shutdown, wn, maintenance/failure of equipment equipme nt and/or distrib distribution ution path). path). Operation errors or spontaneo spontaneous us failures of site infrastructure infrastruct ure components may cause cause a data center disruption. 7 E n i r : : n t l o n ~ lod rhy AssociaHon 4 ~ S undoi licru 1Wl with Tli\ on or nalworl<ing permilled withoul license from IHS Order Number: 02167039 Sold lo :UPS :UPSISTEMAS ISTEMAS 20206210000 20206210 0001 1 2017-09-0617:39:49 201709-0617:39:49 UTC ANSl/TIA-PN-942-B RatedRat ed-1 1 data centers have a single path for distribution of power, cooling and telecommunications. There is no requirement for component or equipment redundancy. RatedRat ed-1 1 data centers have little to no requirements for fo r compartmentalization compartmentalization for critical facilities. A generator is not required, but if present, is sized for UPS mechanical systems without redundancy. Rated-1 Rat ed-1 data centers will typically typica lly have limited physical security sec urity controls. Ra ted-2 Dat a Ce nt nte er: Red und unda ant Compon ompone ent A Redundant Component data center is susceptible to disruptions from both planned and unplanned activity on the distriblftion path (e.g., building power shutdown, maintenance or failure of a distribution path). It is able to handle planned maintenance or fault on a single piece of equipment. equipme nt. A generator genera tor is required and sized for UPS mechanical systems witho without ut redundancy. Rated-2 data centers have a single path for distribution o power, cooling and telecommunications. telecommunication s. There is a requirement for component/equipment redundancy. Rated-2 data centers have little to no requirements for compartm compartmentalization entalization for critical facilities. Rated-2 data centers will typically have basic physical security controls. Preventative maintenance should be performed as specified by manufacturers and may require a shut down. Rated-3 Dat a Ce nt nte er : Concurr Concurre e ntly Ma Maintain intaina abl e A Concurrently Maintainable data center is able to handle planned maintenance on any part of the distribution path or any single piece o equipment or component without causing interruption to the data center cen ter operations. Rated-3 data centers have, at a minimum, one active (N) and one standby (+1) path for distribution of power, cooling and telecommunications. There is no requirement for component/equipment redundancy within each distribution path. Rated-3 data centers do not require, but should be compartmentalized for electrical, mechanical and telecommunication criti critical cal facilities. Rated-3 data centers have improved physical security controls. Rated-4 Data Center: Fault Tolerant A Fault Tolerant data center is able to handle one single fault at a time on any part of the distribution path or any single piece of equipment or component without causing interruption to the data center operations. Rated-4 data centers have, at a minimum, dual active (2N N+N) path for distribution of power, cooling and telecommunications. There is no requirement for component/equipment redundancy within each distribution path. · Rated-4 data centers require compartmentalization telecommunication critical facilities. Rated-4 data centers have strong physical security controls. F.3 for electrical, mechanical and Telecommunications Figure 14 in clause 9 illustrates data center telecommunications cabling pathway infrastructure redundancy. F31 I Data Center: Basic telecommun telecommunications) ications) In addition to the requirements and guidelines in this Standard, a Basic facility will have one customer owned maintenance hole and entrance pathway to the facility. The access provider services will befrom terminated within room one entrance room. The telecommunications infrastructure will be distributed the entrance to the main distribution and horizontal distribution areas (HDAs) throughout the data center via a single pathway. Although logical redundancy may be 68 ::opyrighl Telecommunications Industry Association rovided by IHS under license with TIA Ila reproduclian or nelworking permitled wilhout license from IHS Order Number: 02167039 Sold lo:UPSISTEMAS [202662100001 J 2017-09-0617:39:49 UTC ANSl/TIA-PN-942-B built into the network topology, there is no requirement for physical redundancy or diversification provided within such a facility. Some potential single points of failure of such a facility are: • access provid provider er outage, central central office outage, or disrupt disruption ion along an access provider right-ofway; • access provider equipment maintenan maintenance ce or failure; • router or or switch maintenance or failure, if they are are not redundant; • any catastr catastrophic ophic event or maintenance within the entrance room, main distribu distribution tion area area MDA), or maintenance hole may disrupt all telecommunications services to the data center; and • damage or disconnection of backbon backbone e or horizontal cabli cabling. ng. F.3.2 Data ta Cente Center: r: Redundant Componen t telecommunications) II Da The telecommunications infrastructure should meet the requirements of section F.3.1. Critical telecommunications equipment, access provider provisioning equipment, production routers, production LAN switches, and production SAN switches, should have redundant components power supplies, processors). Intra-data center LAN and SAN backbone cabling from switches to backbone switches should have redundant fiber or wire pairs within the overall star configuration. The redundant connections may be in the same or different cable sheaths. Logical configurations are possible and may be in a ring or mesh topology superimposed onto the physical star configuration. Such Suc h a facility addresses vulnerability of o f telecommunications services entering the building. Such a facility should have two customer owned maintenance holes and entrance pathways to the facility. The two redundant entrance pathways will be terminated within one entrance room. All patch cords and jumpers should be labeled at both ends of the cable with the name of the connection at both ends o the cable. Some potential single points of failure of such a facility are: • access provider outage, central office outage, or disruption along an access provider right-of way; • access provider equipment located in the entrance room connected to same electrical distribution and supported by single HVAC components or systems; • redundant LAN or SAN switches connected to same electrical circuit or supported by single HVAC components or systems; • any catastrophic catastrophic event or maintenance maintenance within the entrance entrance room room or MDA may disrupt all telecommunications services to the data center; and • any catastrophic event within a distributor may disrupt all services to the area it serves. F.3. F. 3.3 3 Ill Da Data ta Center: Conc urre ntly Mainta inabl e telec ommun icati ons) The telecommunications infrastructure should meet the requirements of section F.3.2 . The data center should be served by at least two access providers. Service should be provided from at least two different access provider central offices or points-of-presences. Access provider cabling including maintenance maint enance holes) from thei theirr central offices or points points-of-pre -of-presences sences should be 9 I Telecommunications lnduslry Associalion by IHS under license wilh TIA Jumlo n or nelworking permitted without license from IHS Order Number: 02167039 Sold lo:UPSISTEMAS lo:UPSISTEMAS 202862100001 J 2017·09·06 17:39:49 UTC ANSl/TIA-PN-942-B separated as much as practical and by at least 20 m 66 ft along their entire routes to be considered diversely routed. The data center should have two entrance rooms preferably at opposite ends of the data center, but a minimum o 20 m 66 ft) ft) physical separation separat ion between the two rooms. rooms. Do not share access provider provisioning equipment, fire protection zones, power distribution units, and air conditioning equipment between the two entrance rooms. The access provider provisioning equipment in each entrance room should be able to continue operating if the equipment in the other entrance room is undergoing planned maintenance. Consideration should be given, although not required, to have an automated failover so that catastrophic failures of equipment in one room does not cause a disruption to the data center operations. The data center should have redundant backbone pathways between the entrance rooms, MDA, IDAs, and HDAs. Intra-data center LAN and SAN backbone cabling from switches to backbone switches should have redundant fiber or wire pairs within the overall star configuration. The redundant connections should be in diversely routed cables. All cabling, cross-connects and patch cords should be documented using software systems or automated automa ted infrastructure management systems as described in the ANSl/TIA-606-C. Some potential single points of failure of such a facility are: • any catastrophic event within the MDA may disrupt disrupt all all telecommunications services services to the the data center; and • any catastrophic event event within a HDA may disrupt all services to the area it serves. F.3.4 IV Data Cente Center: r: Fault Tolerant telecommunications) The telecommunications infrastruct infrastructure ure should meet the requirements requirements o section F.3.3. Data center backbone cabling and distributor locations should be redundant. Cabling between two spaces should follow physically separate routes, with common paths only inside the two end spaces. There should be automatic backup for all critical telecommunications equipment, access provider provisioning equipment, core layer production routers and core layer production LAN/SAN switches. Sessions/connections should switch automatically to the backup equipment. The data center should have redundant MDAs preferably at opposite ends of the data center, but a minimum of 20 m 66 ft) physical physical separation separa tion between the two spaces. Do not share fire protection zones, power distribution units, and air conditioning equipment between the redundant MDAs. The redundant MDA is optional, if the computer room is a single continuous space, as there is probably little to be gained by implementing two MDAs in this case. The two MDAs should have separate pathways to each entrance room. There should also be a telecommunications cabling pathway between the MDAs. The redundant routers and switches should be distributed between redundant distribution spaces e.g., redundant MDAs, redundant pair of IDAs, or redundant pair of HDAs, or redundant pair of entrance rooms). Each HDA should be provided with connect connectivity ivity to two different IDAs or MDAs. MDAs. Similarly, each IDA should be provided with connectivity to both MDAs. Critical systems should have horizontal cabling to two HDAs. Some potential single points of failure of such a facility are at: • • the MDA if the secondary distributi distribution on area is not implemented); and the HDA and horizontal cabling if redunda redundant nt horizontal cabling is not installed). 7 :;opyrighl Telecommunications Industry Associalion Jrovided by IHS under license with TIA \lo reproduclion or nelworking permitted wilhoul license from IHS Order Number: 02167039 Sold lo:UPSISTEMAS [202862100001]. 2017·09 06 17:39:49 UTC ANSl/TIA-PN-942-B F.4 Architectural and structural F 4.1 General The buil bui lding structural system sh shou ld be either ste el or concr concrete ete.. At a mini mu m, the bu ilding frame shou shoulld be designed to wit hstand wind loads in ac acco co rda nce with the app li ca ble bu ilding codes for the location un der considerat consideratiion and in acco accordanc rdance e with provis provisiions fo r st ruct ructures ures as esse designated essen ntia tiall ·faciliti facilities for exampl examp le Building Classification Ill from the International Building Code). F.4. F. 4.2 2 I Da Data ta Center: Basi c architec tural) Architecturally, a Basic data center is a data center with no requirements for protection against physical events, events , intentional or accidental, accidental , natural or man-made, which could cause the data center to fail. F.4.3 Data ta Center: Redunda nt Comp onen t architec tural) II Da Redundant component data centers · have minimal protections against some physical events, intentional or accidental, natural or man-made, which could cause the data center to fail. They have minimal security measures in place such as perimeter security and entry control of the facilities areas and computer room. F.4. F. 4.4 4 Ill Dat Data a Center: Conc urr entl y Maintain able archit ectural ) F.4. F. 4.5 5 IV Da Data ta Center: Fault Toler ant archit ectura l) Concurrently Maintainable data centers have appropriate protections against some physical events, intentional or accidental, natural or man-made, which could cause the data center to fail. It has adequate security and monitoring for critical/restricted areas. It should preferably have compartmentalization of at least the electrical, mechanical, and telecommunication spaces. spaces . A Fault Tolerant data center has considered all potential physical events that could cause the data center to fail. Such a data center has provided specific and in some cases redundant protections against such events. Such data centers consider the potential problems with natural disasters such as seismic events, floods, fire , hurricanes, and storms, as well as potential problems with terrorism and disgruntled employees. These data centers have control over all aspects of their facility. It has full security and monitoring for critical/restricted areas. It has compartmentalization across all electrical, mechanical and telecommunication spaces. F.5 Electrical F.5.1 I Da Data ta Center: Basic electrical) A Basic facility provides the minimum level of power distribution to meet the electrical load requirements. It has no redundancy. The electrical systems are single path and have single components whereby a failure of or maintenance to a component or part of the distribution path will cause partial or total interruption of operations. Generators may be installed as single units or paralleled for capacity, but there is no redundancy requirement. One or more automatic transfer switches are typically used to sense loss of normal power, initiation of generator start and transfer of loads to the generator system. Provisions to connect portable load banks should be provided for generator and UPS testing. 7 ~ e l e c o m m u n i c a t i o n s Ind ustry Assoc iation ha by IHS under license wilh T IA au flon or nelworking permitled wi1houl license rrom IHS Order um er: 02167039 Sold to:UPSI STEMAS 202862100001 , 2017-09-06 17:39: 17:39 :49 UTC ANS l/TIA-PN-942-B The uninterruptible power supply system can be installed as a single unit or paralleled for capacity. Static, rotary or hybrid UPS technologies can be utilized, with VI (Voltage Independent) or VFI (Voltage and Frequency Independent) designs. Compatibility of the UPS system with the generator system is required. The UPS system should have a maintenance bypass feature to allow continuous operation durin during g maintenance of the UPS system. Separate transformers and pan panel el boards are acceptable for the distribution of power to the critic critical al electronic loads in these data centers. The transformers should be designed to handle the non linear load that they are intended to feed. Harmonic canceling transformers can also be used lieu of K-rated transformers. in Power distribution units (POU) or discrete transformers and panel boards may be used to distribute power to the critical electronic loads. Any code compliant wiring method may be utilized. Grounding system should conform to minimum code requirements. Monitoring F.5.2 of electrical and mechanical systems is optional. Data Center: Redundant Componen Componentt electrical) Redundant Component installations should meet all requirements of section F.5.1. In addition, such a facility provides for N 1 redundant UPS modules. A generator system sized to handle all data center loads is required, although redundant generator sets are not required. No redundancy is required in the utility service entrance or power distribution system. Provisions to connect portable load banks should be provided for generator and UPS testing. Power distribution is based on a single path. Although not required, it is recommended to have two PDU s at common output of the UPS cluster allowing for the provisioning of an A and B feed to each ICT equipment. Usage of color-coding is recommended. A circuit should not serve more than one rack/cabinet to prevent a circuit fault from affecting more than one rack/cabinet. To provide redundancy, racks and cabinets should each have two dedicated electrical circuits fed from two different power distribution units (PDUs) or electrical panels. Each receptacle recep tacle should be identified with the POU and and ci rcu it number, which serves serve s it. it. Redundant feeder to mechanical system distribution board is recommended but not required. Consider redundancy and isolation in the fuel storage system to ensure that fuel system contamination or a mechanical fuel system failure does not affect the entire generator system. F.5.3 Ill Data Center: Concurrently Maintain Maintainable able electrical) There should be two utility entrance feeds which are allowed to come from a single substation. Where no multiple utility feeds are available, self-generation is acceptable. Generators should be present in an N 1 configuration which is allowed to be shared between each of the utility entrances. Dual path distribution should be from utility entrance all the way to the ICT equipment. All equipment should be dual corded. Where this is not available an STS should be installed. At a minimum one feed should be active with N capacity and the other feed (+1) is allowed to be on standby to allow for planned maintenance activities. It is highly recommended to have both feeds active so that an unplanned event on the active feed could facilitate an automatic switch over to the other feed. Equipment for each path should be compartmentalized so that maintenance on any electrical room for one path will not lead to a disruption to the other path. A central power and environmental monitoring and control system (PEMCS) should be provided to monitor all major electrical equipment such as main switchgears, generator systems, UPS systems, automatic static transfer switches (ASTS), power distribution units, automatic transfer switches, motor control centers, transient surge suppression systems, and mechanical systems. A separate programmable logic voltage control system should be provided, programmed to 72 :;opyrighl g hl T elecommunicalions lnduslry Associalion Jrovided by IHS under license with TIA Jo reproduclion or nelworking permitted wilhoul license from IHS Order Number: 02167039 Sold lo:UPSISTEMAS [202862100001], 2017-09-06 17:39:49 UTC ANS 1/TIA-PN-942-B manage the mechanical system, optimize efficiency, cycle usage of equipment and indicate alarm condition. F.5.4 IV Data Center: Fault Tolerant electrical) There should be two utility entrance feeds which should come from different substations. Where no multiple utility feeds are available, self-generation is acceptable. Generators shall be present in at least an N configuration for each feed and shall not be shared between each of the utility entrances. Dual path distribution should be from utility entrance all the way to the ICT equipment. All equipment shall be dual corded. Where this is not available an STS should be installed. All feeds shall be active with N capacity. Any single planned or unplanned event on any feed must facilitate an automatic switch over to the other feed. Equipment for each path shall be compartmentalized so that maintenance or a catastrophic failure on any electrical room for one path will not lead to a disruption to the other path. Battery monitoring should be at least at the string level performed by the UPS. Preference is for a battery monitoring monitoring system capable of individually monitoring the impedance or resistance of each cell and temperature of each battery jar and alarming on impending battery failure. F.6 Mechanical syst systems ems F61 I Data Center: Basic mechanical) The HVAC system of a Basic facility includes single or multiple air conditioning units with the combined cooling capacity to maintain critical space temperature and relative humidity at design conditions with no redundant units. If these air conditioning units are served by a water-side heat rejection system, such as a chilled water or condenser water system, the components of these systems are likewise sized to maintain design conditions, with no redundant units. The piping system or systems are single path, whereby a failure of or maintenance to a section of pipe will cause partial or total interruption of the air conditioning system. Electrical distribution to the air conditioning equipment is single path. Any failure may cause disruption of cooling. or maintenance If a generator is provided, all air conditioning equipment should be powered by the standby generator system. The required cooling capacity should be calculated based on the kW not kVA) supply available from the UPS system. F.6.2 II Data Center: Redundant Compone Component nt mechanical) The HVAC system of a Redundant Component facility includes multiple air conditioning units with the combined cooling capacity to maintain critical space temperature and relative humidity at design conditions, with one redundant unit (N+1 ). If these air conditioning units are served by a water system, the components of these systems are likewise sized to maintain design conditions conditions,, with one redundant unit s). The piping system or systems are single path, whereby a failure o or maintenance to a section of pipe will cause partial or total inferruption of the air conditioning system. Air conditioning systems should be designed for continuous operation 7 days/24 hours/365 days/year, and incorporate a minimum of N+1 redundancy in the computer room air conditioning CRAG) units. The computer room air conditi conditioners oners CRAC) system should be provided with N+1 redundancy, with a minimum of one redundant unit for every five to eight required units. Air conditioning equipment should have backup power from the standby generator system. 7 rt1 t{rCQt mntm fc n ona l f nl Ln lry Asandlt. Asandlt.lion lion by lljS tnot1•t liqo nw i lA t0dlll 11Q n f 11tMIOfklng pit pitm m ill illled led w. tt l U license from IHS Order Number: 02167039 Sold to:UPSISTEMAS [202862100001 ], 2017-09-06 17:39:49 UTC ANS l/TIA-PN-942-B Although redundancy is not required for the power distribution to the air conditioning equipment, if redundancy is provided, it is advisable to distribute power connect connections ions o the air conditioners over multiple electrical boards. Alternatively, a transfer switch could be used to provide the equipment with two power feeds. Air supply to the data center should be coordinated with the types and layouts of the cabinets and racks to be installed. The air handling plant should have sufficient capacity to support the total projected heat load from equipment, lighting, the environment, etc., and maintain constant relative humidity levels within the data center. F.6.3 ll Data Cente Center: r: Concurrently Maintainable mechanical) The HVAC system of a Concurrently Maintainable facility includes multiple air conditioning units with the combined cooling capacity to maintain critical space temperature and relative humidity at design conditions, with sufficient redundant units to allow maintenance to any equipment or path. If these air conditioning units are served by a water-side heat rejection system, such as a chilled water or condenser water system, the components of these systems are likewise sized to maintain design conditions, with one electrical switchboard removed from service. This level of redundancy can be obtained by either furnishing two sources of power to each air conditioning unit, or dividing the air conditioning equipment among multiple sources of power. The piping system or systems shall be designed such that maintenance to a section of pipe will not cause interruption of the air conditioning system. Alternatively, other cooling back measures could enable maintenance to piping such s dual-coil condenser water water supply/direct expansion) air air conditioning systems. Redundant computer room air conditionin conditioning g CRAC) units should be served from separate panels to provide electrical redundancy. All computer room air conditio conditioners ners CRAC) units should be backed up by generator power. Concurrently maintainable refrigeration equipment should be dedicated to the data center. Sufficient redundancy should be provided to enable isolation of any item of equipment as required for essential maintenance without affecting the services being provided with cooling. F.6.4 V Data Center: Fault Fault Tolerant mechanical) The HVAC system of a Fault Tolerant facility includes multiple air conditioning units with the combined cooling capacity to maintain critical space temperature and relative humidity at design conditions, with sufficient redundant units to allow failure of or service to one electrical switchboard. If these air conditioning units are served by a water-side heat rejection system, such s a chilled water or condenser water system, the components of these systems are likewise sized to redundancy maintain design electrical switchboard removed from service. level of can conditions, be obtainedwith by one either furnishing two sources of power to each his air conditioning unit, or dividing the air conditioning equipment among multiple sources of power. The piping system or systems should be designed such that maintenance or failure to a section of pipe will not cause interruption of the air conditioning system. Alternatively, other cooling back measures could enable maintenance to piping such such as dual-coil dual-coil condenser water supply/direct expansion) air conditioning systems. All computer room air conditi conditioners oners CRAC) units should be backed up by generator power. Fault tolerant refrigeration equipment should be dedicated to the data center. Sufficient redundancy should be provided to enable isolation of any item of equipment s required for essential maintenance or failure without affecting the services being provided with cooling. 7 Telecommunications tnduslry Association ~ o p y r i g h )rovided by IHS under license with TIA \lo reproduction or networking permilled wilhoul license from IHS Order Number 02167039 Sold to:UPSISTEMAS [202862100001 J 2017 09 06 17:39:49 UTC .qJ J l= ANS fTIA-PN-94 fTIA-PN-942-B 2-B 9r ; f ~ ~ i ': = c '< 0 0 Table 11: Reference guide telecommunications) g £ 5 g 1 T1) 2 T2) Yes Yes Yes Yes Not required Yes Yes Yes Not required Not required Yes Yes Redundant entrance room Not required Not required Yes Yes Redundant main distribution area Not required Not required Not required Yes Redundant intermediate distribution areas (if present) Not required Not required Not required Yes Redundant backbone cabling and pathways Not required Not required Yes Yes Redundant horizontal cabling and pathways Not required Not required Not required Yes Routers and switches have redundant power supplies, processors Not required Yes Yes Yes Not required Not required Yes Yes Yes Yes Yes Yes Not required Yes Yes Yes Not required Not required Yes Yes 0 (T3) 4 T4) TELECOMMUNICATIONS 0 3 i Genera n Cabling,, racks, cabinets, Cabling cabinets , & pathways compliant with relevant TIA specification specifications s Diversely routed access provider entrances and maintenance holes with minimum 20 m seoaration Redundant access provider services - multipl multiple e access providers, central offices, access provider riaht-of-wavs g 0: 0 c n 1i -< Redundant routers and switches with redundant uplinks Patch panels, outlets, outlets , and cabling to be labeled per ANSlfTIA-606-C. Cabinets and racks to be labeled on front and rear. m ;:: )> n Patch cords and jumpers to be labeled on both ends with the name o the connection at both ends o the cable Patch panel and patch cable documentation compliant with ANSlfTIA-606-C . 75 f j. 0 ANSl/TIA-PN-942-B 6 Xm i 8 n § E:; 3 3 i Table 12: Reference guide architectural) i ~ i ~ j ; ~ - 5 s. r a 3 r rn 8 Qi g· 1 A1) 2 A2) 3 A3) 4 A4) ARCHITECTURAL ~ i t selection Proximity to flood flood hazard area as mapp ed on a federal Flood Hazard Boundary or Flood Insurance Rate Map Not required Not required Not within 1 1DO-year DO-year flood hazard area Greater than 91 m (300 ft) from 1DO-year flood hazard area Proximity to coastal or navigable inland waterways Not required Not required Greater than 91 m (300 ft) Greater than 0. 0 .8 km (1/2 mile) Proximity to major highway traffic arteries and main rail lines Not required Not required Greater than 91 m (300 ft) Greater than 0.8 km (1/2 mile) Proximity to major airports Not required Not required Greater than 1.6 km 1 mile) Separate visitor and employee parking areas Not require required d Not required Yes (physically (physically separated by fence or wall with separate entries) Yes (physically (physically separated by fence or wall with separate entries) Separate from loading docks Not required Not required Yes (physically separated with separate entries) Yes (physically separated by fence or wall with separate entries) Physical barriers to prevent vehicles from driving to wall of data center facilities areas or computer room Allowed if all tenants are data Greater than 8 km 5 miles Parking g Proximity of visitor parking to data center perimeter building walls Physical barriers to prevent vehicles Not required Not required a: 0 C /) Multi tenant non data center occupant within Allowed only if occupancies are non- from driving to wall of data center facilities areas or computer room Allowed if all tenants are data hazardous centers or telecommunications companies centers or telecommunications comoanies No restriction No restriction Type llA, lllA, or VA Type IA or 18 Exterior bearing walls Code allowable Code allowable 1 Hour minimum 4 Hours minimum Interior bearing walls Code allowable Code allowable 1 Hour minimum 2 Hour minimum Exterior nonbearing walls Code allowable Code allowable 1 Hour minimum 4 Hours minimum Structural frame Code allowable Code allowable 1 Hour minimum 2 Hour minimum Interior non-computer room partition walls Code allowable Code allowable 1 Hour minimum 1 Hour minimum Interior computer room partition walls Code allowable Code allowable 1 Hour minimum 2 Hour minimum Shaft enclosures Code allowable Code allowable 1 Hour minimum 2 Hour minimum Floors and floor-ceilings Code allowable Code allowable 1 Hour minimum 2 Hour minimum Roofs and roof-ceilings Code allowable Code allowable 1 Hour minimum 2 Hour minimum Not required Yes Yes Yes No restricti restriction on building u ; s Building construction Type of construction (IBC 2015) or equivalent locally adooted buildinQ code rn i Fire resistive requirements Meet NFPA 75 or alternatively the data center fire orotection standard aoolicable for the location 76 - · = = = = = ~ : r r = - - - = = = = = = = = = = = = = - = = = = = = = = = = = = = ~ = = = = = = = = ~ = = = = = = = = = = - - = - - - = = = = = - = = = = . = = = = = = = - ~ ~ ~ iJi 4 l _ u g ; ~ § ANSl/TIA PN 942 B . 1 1 gj g 1 A1) g Miscellaneous 3 2 A2) 3 A3) 4 A4) Yes Yes Yes (primary building entrance manned) Yes (primary building entrance manned) uilding components Vapor barriers for walls, floors , and ceiling o computer room Not required Yes for walls, Not required for ceiling Building entrances with security checkpoints Not required Not required Access floor panel construction (when provided) No requirement No requirement Computer grade with appropriate floor loadina caoabilitv Computer grade with appropriate floor loadina caoabilitv Understructure (when access floor is provided) No requirement No requirement bolted stringer bolted stringer No restrictions Class A I en Roofing Class Type No restrictions Roof Slope o restrictions Class A Class A Non-redundant with noncombustible deck (no mechanically attached systems) Double redundant with concrete deck (no mechanically attached systems) 1 48 (1/4 per foot) minimum 1 24 (1/2 per foot) minimum Minimum Code requirements Minimum Code requirements Fire rating Minimum Code requirements Minimum Code requirements Minimum Code requirements (not less than 3/4 hour at computer room) Minimum Code requirements (not less than 1 1 2 hour at computer room) Windows on perimeter o computer room Allowed with minimum Code required fire rating Allowed with minimum Code required fire rating Interior windows allowed with minimum 1-hour fire rating , no exterior windows allowed Interior windows with minimum 2hour fire rating , no exterior windows allowed Not required Yes Yes Yes Minimum Code requirements Minimum Code requirements Minimum Code requirements (not less than 1 hour) Minimum Code requirements (not less than 2 hour) Security counter Not required Not required Yes Yes (physically separated from other areas o th the e data ce c ente r} Single person interlock, portal or other hardware desiqned to prevent oiaavbackinq or oass back Not required Not required Yes Yes 3 AJ) 4 A4) in in Doors and windows g c C: n u --< m ; J> 1 Entry en ' obby Physically separate from other areas o data center Fire separation from other areas o data center 77 i i ~ 0 , Cl r ii n g § 3 " g IC Bl [ 1 i g· ANSl TIA-PN-942-B 1 A1) 2 A2) Not required Yes dministrative offices Physically separate from other areas of data center Yes Yes Fire separation from other areas of data center J: /) Minimum Code requirements Minimum Code requirements Minimum Code requirements (not less than 1 hour) Minimum Code requirements (not less than 2 hour) Not required Not required Yes Yes Minimum Code requirements Minimum Code requirements Minimum Code requirements (not less than 1 hour) Minimum Code requirements (not less than 2 hour) Not required Yes Yes Yes Not required Yes Yes, solid core, reinforced or steel doors Yes, solid core, reinforced or steel doors Not required Not required Yes Yes Not required Not required 1 hour 2 hour No requirement No requirement Security office Physically separate from other areas of data center Fire separation from other areas of data center 180-degree peepholes or CCTV on security equipment and monitorinq rooms Dedicated and hardened security equipment and monitoring rooms Operations enter Operations Center physically separate from other areas of data center Fire separation from other non-computer room areas of data center Restrooms and break room areas & 0 Proximity to computer room and support areas c ;ii Fire separation from computer room and support areas :' l> /) ;;; Not immediately adjacent and provided with leak prevention barrier If immediately adjacent, provided with leak prevention barrier Minimum Code requirements Minimum Code requirements (not less than 1 hour) Minimum Code requirements (not less than 2 hour) No requirement Minimum Code requirements (not less than 1.2 m (4 ft) clear) Minimum Code requirements (not less than 1.2 m (4 ft) clear) Minimum Code requirements (not less than 1.2 m 4 ft) clear) Minimum Code requirements Minimum Code requirements Minimum Code requirements (not less than 1 hour) Minimum Code requirements (not less than 2 hour) Fire separation from computer room and support areas Minimum Code requirements Minimum Code requirements Minimum Code requirements (not less than 1 hour) Minimum Code requirements (not less than 2 hour) Width Minimum Code requirements Minimum Code requirements Minimum Code requirements of 1.2 m (4 ft), whichever is greater Minimum Code requirements of 1.2 m 4 ft), whichever is greater i n i m ~ m Code requirements UPS and Battery Rooms Aisle widths for maintenance , repair, or equipment removal Fire separation from computer room and other areas of data center Required Exit Corridors 78 $ ""'"' - - 1$ ANSlfTIA-PN-942-B 5 Q., iii g::::i lH [ l ~ • s Ia > er g 3 'l: ' A1) Shipping and receiving Ai) 3 A3) 4 A4) re Shipping and receiving area physically separate from other areas of data center No shipping and receiving area provided Not required Yes Yes Fire separation from other areas Minimum Code requirements if shipping and receiving area present Minimum Code requirements 1 hour 2 hour of data center Number of loading docks Generator and fuel storage No requirement re minimum of 1 minimum of 1 mi nimum of 1 with an alternate delivery route for small/rack mountable mountabl e eouioment s As per code requirements. If within data center building, provided with a minimum of 2 hr fire rated wall. If outside of data center building appropriate security measures shall be orovided Appropriate distance or protective measures Proximity to computer room and support areas No requirement No requirement Proximity to publicly accessible areas No requirement No requirement System CPU UPS capacity No requirement Building UPS Building UPS c ' Data Gathering Panels (Field Panels) UPS Capacity No requirement Building UPS or local battery backup (4 hour min\ Building UPS or local battery backup 8 hour min\ ;:: > Field Device UPS Capacity No requirement Building UPS(4orhour localmin) battery backup Building UPS8 hour local battery backup min) No requirement During scheduled operation (typically 5 days a week during normal business hours) 7 days a week, week , 24 hours a day As per code requirements. If within data center building, building , provided with a minimum of 2 hr fire rated wall. If outside of data center building appropriate security measures shall be orovided Appropriate distance or protective measures Security g> c: 0 --< m i ' ' 0 0 0 Physical security staffing I or Building UPS or local battery backup 18 hour min) Building UPS or local battery backup 124 hour min\ Building UPS local battery backup 1 or 4h ou ourr min) 7 days a week, 24 hours a day with sufficient spare personnel to allow for physical inspections, walk alongs, supervisions etc _ 79 0 - 3 ~ 5 : ~ § ~ ~ ANSl/TIA-PN-942-B g · ~ g 3 c 0 i Hi .. l 1 A1) : : : 111> t i j ; ~ ,,. c 5 8 = er Security ccess 2 I I ' 3 A3) 4 (A4) Control/Monitoring at: Perimeter and restricted areas industrial grade lock intrusion detection with intrusion detection with door/window open alarm card access or biometric with intrusion detection with door/window open alarm Main door onto computer room floor industrial grade lock card access or biometric with intrusion detection with door open alarm card access or biometric with intrusion detection with door open alarm No requirement No requirement Level 3 (min) Level 3 (min) Restricted areas and perimeter (e.g., building perimeter, generators, generators , computer room, MEP rooms, telecommunications rooms. entrance rooms) Not required ot required Yes Yes Access Controlled Doors Not required Yes Yes ?" £ (Ai) Bullet resistant walls windows Security Counter in card access or biometric with intrusion detection with door/windo w open alarm Single person interlock, portal or other hardware designed to prevent piggybacking or pass back o access credential doors Lobby CCTV Monitoring Yes CCTV CCTV Recording g> o all activity on all cameras Recording rate (frames per second) Not required Not required Yes; digital Yes; digital No requirement No requirement 20 frames/sec (min) 20 frames/sec (min) 0: 0 c,, ' i)i) < m ;::. ' ' 0 0 0 0 80 f ANS /TIA-PN-942-B iSI (> c 0 §- .f iP :r>< c. > g £· g a 3 Facility design to International Building Code (IBC) Seismic Design Category (SOC) requirements J n 0 C: -0 S n 2 A1) 4 A4) 3 AJ) Ai) tructural Per local country standards for the Per local country standards for the Per local country standards for the Per local country standards for the building location (at minimum) or building location (at minimum) or IBC building location (at minimum) or IBC building location (at minimum) or IBC IBC SOC requirements for building SOC requirements for building location SDC-C requirements or higher for SOC requirements for building location (if they exceed local building location (if they exceed local location (if they exceed local (if they exceed local requirements) requirements) requirements) requirements) Site Specific Response Response Spectra - Degree of local Seismic acceleration accelerations s No requirement No requirement Importance Importan ce factor - assists to ensure greater than code design 1=1 1=1.5 1=1 .5 1=1.5 Telecommunications equipment racks/cabi Telecommunications racks/cabinets nets anchored to base or supported at top and base or equipped with seismic platforms or other protective measures No requirement Yes Yes Yes Deflection limitation on telecommunications equipment within limits acceptable by the electrical attachments Not required Not required Yes Yes Bracing of electrical conduits runs and cable trays per code per code w/ Importance per code w/ Importance per code w/ Importance Bracing of mechanical system major duct runs per code per code w/ Importance per code w/ Importance per code w/ Importance 12 kPa (250 lbf/ft 12 kPa (250 lbf/ft 2 Floor loading capacity superimposed live load 7 .2 kPa (150 lbf/ft 2 . 8.4 kPa (175 lbf/ft with Operation Status after 10 year event 2 2 in 50- with Operation Status after 5 100-year event in Floor hanging capacity for ancillary loads suspended from below m > ' R 1.2 kPa (25 lbf/ft2 1.2 kPa (25 lbf/ lbf/ ft2 2.4 kPa (50 lbf/ft 2 2.4 kPa (50 lbf/ft 2 Concrete Slab Thickness at ground 127 mm (5 in) 127 mm 5 in) 127 mm (5 in) 127 mm 5 in) Minimum concrete topping over flutes for equipment anchorage when concrete filled metal deck structure used for elevated floors 102 mm (4 in) 102 mm (4 in 102 mm (4 in) 102 mm 4 in) Steel/Concrete Moment Frame Concrete Shearwall / Steel Braced Frame Concrete Shearwall / Steel Braced Frame Concrete Shearwall / Steel Braced Frame Minimum code requirements Minimum code requirements passive dampers for IBC Seismic Design Category D or higher passive dampers/base isolation f or IBC Seismic Design Category D or hiqher PT concrete CIP Mild Concrete Steel Deck & Fill Steel Deck & Fill Building LFRS (Shearwall/Braced Frame/Moment Frame) indicates displacement of structure Building Energy Dissipation - Passive Dampers/Base Isolation (energy absorption) Construction of Floors above ground level. (Steel structures with concrete filled metal decks are more easily upgraded for intense loads in Battery/UPS rooms. (Also, (Also , better for installing floor anchors). anchors) . 8 Ht ANSlfflA-PN-942-B a :r:m g C ] g Table 13: 13: Reference guide electrical ) -;CJJ ~ : s : ~ = c l> '. = g g 2 E2) 1 E1) 3 E3) E4) ELECTRICAL er eneral J: ' System allows concurrent maintenance Not required Fault Tolerant Not required Not required but preferred for critical oarts of infrastructure Not required Yes Not required Yes Up-to-date short circuit study, study , ccordination study, arc flash analysis, and load flow study Redundant Cord Feed with 100% capacity on remaining cord or cords Power System Analysis Up-to-date short circuit study, coordination study, and arc flash analysis Up-to-date short circuit study study,, coordination study, and arc flash analysis Up-to-date short circuit study, study , coordination study, arc flash analysis, and load flow studv Computer & Telecommunications Equipment Power Cords Single Cord Feed with 100% capacity Single Cord Feed with 100% capacity Redundant Cord Feed with 100% capacity on remaining cord or cords I Utility Utility Entrance Main Utility g> 0 Single Feed Single Feed Minimum 1 active, 1 standby. standby . Same substation allowed. Self-generation allowed Shared Shared Dedicated Dedicated Panel board with bolt on circuit breakers Switchboard with stationary circuit breakers Switchboard with draw out circuit breakers Switchgear with draw out circuit breakers Not required Not required Yes Yes Minimum 2 active. Different substation. Self-generation allowed witchboard Service a: Yes C ' 0 < Construction m ' Surge Suppression 0 82 t ; I iH Ii 0 P. 3 a [ 1· ANSl TIA-PN-942-B c 5 ;: § r > g 1 E1) 2 E2) 3 E3) 4 E4) N N+1 equipment level, single path N+1 N for active, N for passive oath) 2N I N+N N for each active path) Uninterruptible Uninterruptib le Power Supply System Redundancy a 3 Single or Parallel-Modules Parallel Modules Distributed Redundant Modules or Block Redundant System Distributed Redundant Modules or Block Redundant System Automatic Bypass Not required Yes, with non-dedicated feeder to automatic bypass Yes, with dedicated feeder to automatic bypass Yes, with dedicated feeder to automatic bypass Maintenance Bypass Arrangement Not required Dedicated maintenance bypass feeder serving UPS output switchboard Dedicated maintenance bypass feeder serving UPS output switchboard Dedicated string for each module Dedicated string for each module 5 or 10-year design life batteries or flywheel 5 or 10-year design life batteries or flywheel Topology J CJ) Battery type 5 or 10-year design life batteries or flywheel Non dedicated maintenance bypass feeder to UPS output switchboard Single or common string for multiple modules modular UPS. Dedicated string for standalone modules 5 or 10-year design life ife batteries or flywheel Battery minimum back up time with design load at end of battery life 10 Minutes or flywheel capacity 10 Minutes or flywheel capacity 10 Minutes or flywheel capacity 10 Minutes or flywheel capacity Not required Not required String level by UPS System String level by UPS system or centralized battery monitoring system Standard high efficiency Standard high efficiency K-Rated or harmonic cancelling, high efficiency K-Rated or harmonic cancelling, low Inrush high efficiency Dedicated over-current protection device on input of static bypass Not required Not required Yes Yes Maintenance Bypass Not required Not required Yes Yes 3 E3) 4 E4) Battery String g a: Battery Monitoring System 0 Single or common string for multiple modules C O CJ) c;; Power Distribution Unit < m s > CJ Transformer ;;; i utomatic Static Transfer Switch 0 0 0 83 a ] a 0 ~ ~ ~ ANSl/TIA-PN-942-B g · ~ g g ~ C l l f > ti g 5 = r I n Grounding and bonding Based on risk analysis as per NFPA 780 and insurance requirements. Based on risk analysis as per NFPA 780 and insurance requirements. Yes Yes Not required Not required Yes Yes As required by ANSl TIA-607-C As required by ANSl TIA-607-C As required by ANSl TIA-607-C As required by ANSl TIA-607-C Installation If required by AHJ, type as required with cover guard and warning label. If required by AHJ, type as required with cover guard and warning label. If required by AHJ, type as required with cover guard and warning label. Test Mode Yes Yes Yes If required by AHJ, type as required with cover guard and warninq label. Yes cr g 2 E2) E1) >.;;? c [ Lightning protection system Lighting fixtures neutral isolated from service entrance derived from lighting transformer for ground fault isolation Data center bonding and grounding infrastructure in computer room Computer Room Emergency Power Off EPO) Svstem Alarm Disable/enable switch Yes As allowed by local codes Yes s allowed by local codes ' Yes s allowed by local codes Yes As allowed by local codes Central Power Monitoring a 0 C . Utility UPS Generator Not required Control Room Console Control Room Console, Pager, Email, and/or text message Separate from UPS Equipment Rooms Not required Not required Battery in UPS room allowed if allowed by code, preference for separate battery room Battery in UPS room allowed if allowed by code, preference for separate battery room Individual Battery Strings Isolated from Each Other Not required Not required Yes Yes Shatterproof Viewing Glass in Battery Room Door or CCTV Not required Not required Not required Yes Monitored Points Not required n m I Utility, Main Transformer, UPS, Utility, Generator, Feeder Circuit Breakers, Automatic Static Transfer Switch. POU, Automatic Transfer Switches, Surge Protection Device, Critical Load Utility, Main Transformer, Transformer, UPS, Generator, Feeder Circuit Breakers, Automatic Static Transfer Switch, POU, Automatic Transfer Switches g> n Notification Method 0 0 0 Branch Circuits Control Room Console, Pager, Email, and/or text message to multiple facility personnel Battery Room 84 p f a f ; ~ £ ANS fTIA-PN-942-B _ § ~ ~ ~ 11 0 g ~ : ; ::r g. 3 s ~ ~ 1 E1) > c It g E 2 E2) 3 E3) 4 E4) Standby Generating System If installed, sized for UPS mechanical systems without redundancy Sized for UPS mechanical system without redundancy Sized for total building load N+1 distributed redundancy Sized for total building load with 2N distributed redundancy Yes Yes Yes No Installation No requirement Provision for portable Provision for portable Equipment Tested No requirement Generator Not required Not required Factory Acceptance Testing Not required Not required UPS and Generator Systems Site circuit breaker testing Not required Not required As per local code with a minimum of contact resistance test of all critical circuit breakers at the primary distribution of the electrical system Commissioning Not required Component level Component level and System level Onsite Day Shift only. only . On-call at other times Onsite 24 hrs M-F, on-call on weekends Generator Sizing a 3 Generators on Single Bus 'I' ' Load bank Auto Shutdown Provision for portable with a preference for permanent Generator Generator UPS Automatic upon failure of utility UPS Automatic upon failure of utility Testing 0 C: 0 [? UPS and Generator Systems, Generator controls, ASTS As per local code with a minimum of contact resistanc resistance e test of all critical circuit breakers at the primary distribution of the electrical svstem Component level, system level, and integrated system including total outaae testina Equipment Maintenance "' s: > Operation and Maintenance Staff "' I Offsite. On call . Preventative Maintenance No requirement Generator maintenance Generator and UPS maintenance Facility Training Programs No requirement Limited training by manufact urer Comprehensive training program for normal operation of equipment Onsite 24/7 Comprehensive preventative maintenance program Comprehensive training program for normal operation of equipment and manual operation of equipment during emergency operation 85 • 3 g 0 t l ~ ~ ~ ~ g [ li : ¥ ANSl/TIA-PN-942-B ... .. m Table 14: 14: Reference guide mechanical) __, 0 l if g 2 M2) 1 M1) MECHANICAL g General 5 3 r CJ g> a: c J u ; m s: l 3 M3) 4 M4) N 1 redundancy for mechanical equipment to allow for concurrently maintainability. Temporary loss of electrical power or interruption of water supply (where applicable) will not cause loss of cooling, but may cause temperature to elevate within operational range of critical equipment. The switchover from N to 1 may be performed manually. redundancy for mechanical equipment to allow for Fault Tolerance. Extended loss of supply path of power or piping (where applicable) will not cause loss of cooling outside operational range of critical equipment. The switch over from N to 1 should be fully automated Not permitted N 1 Redundancy for mechanical equipment (e.g., air conditioning units, units , coolers , pumps pumps,, cooling towers, towers , condensers).. These redundancy requirements condensers) extend to all support areas that are critical to the uninterrupted operation of the computer/serve computer/serverr room. Not required redundancy for mechanical equipment. Loss of electrical supply path or water supply (where applicable) could lead to loss of cooling Routing of water or drain piping not associated with the data center equipment in data center spaces Permitted but not recommended Permitted but not recommended Not permitted Positive pressure in computer room and associated spaces relative to outdoors and non-data center spaces Not required Yes Yes Yes Floor drains in computer room for condensate drain water, humidifier flush water. and sprinkler water, discharge water Yes Yes Yes Yes Not required Yes De-humidification/humidification, Yes De-humidification/humidification , where applicable, provided Yes De-humidification/humidification, where applicable , provided Mechanical systems on standby generator Humidity Control for Computer Room N 1 • Not required , where annlicable, provided where applicable, provided where applicable , provided No redundant air conditioning units One redundant air conditioning unit per critical area One additional air conditioning unit for every 5-8 units installed One additional air conditioning unit for every 5-8 units installed Single path of electrical power to AC equipment Single path of electrical power to AC equipment configured to allow for concurrent maintenance 2N/N+N configured to allow for fault tolerance Single path Single path Piping systems allow for concurrent maintenance Piping systems provide fault tolerance CJ i Water Cooled System (; Indoor Terminal Air Conditioning Units Electrical Service to Mechanical Equipment N 1 Heat Rejection Piping Systems 86 ~ : ' . ' ANSlfTIA-PN-942-B ; a 33 c 0 HI : r 1 (M1) ~ - 4 5 Q i > ~ 5 g 5 6 i a3 2 (Mz) 4 (M4) 3 (M3) Chilled Water & Ai r Cooled Systems N+1 configured to be concurrently maintainable 2N/N+N configured to allow for fault tolerance Control system design should be concurrently maintainable Control system design should be fault tolerant Single path of electrical power to HVAC control system Dual path of electrical power in N+1 configuration designed to be concurrently maintainab maintainable le Dual path of electrical power in 2N/N+N configuration designed for fault tolerance Single water supply, with no onsite back-up storage Dual sources of water, or one source + on-site storage with a minimum equal to duration o cienerator fuel supply Dual sources o water, or one source + on-site storage with a minimum equal to duration of cienerator fuel supply Dual sources of water, or one source + on-site storage with a minimum equal to duration of cienerator fuel supply Single point of connection Single point of connection Two points of connection If generator is presen present, t, minimum belly/onboard fuel tank filled up to 80 capacity 24 hours as allowed by AHJ 72 hours as allowed by AHJ 96 hours as allowed by AHJ Single storage tank Single storage tanks Multiple storage tanks Multiple storage tanks Single pump and/or supply pipe Multiple pumps, single supply pipes Fuel supply designed for concurrently maintainab maintainability ility Fuel supply designed for fault tolerance Single path o electrical power to AC equipment Single path of electrical power to AC equipment HVAC Control System Control system interrupt cooling to failure criticalwill areas Control system failure will not interrupt cooling to critical areas but might prevent further control o temperature/humidity temperature /humidity (steady state) Power Source to HVAC Control System Single path of electrical power to HVAC control system Electrical Service to Mechanical Equipment HVAC Control System c ' Plumbing for water-cooled heat rejection) Make-up Water Points Point s of Connection to Condenser Water System ' 0 c, n' -< m ;:: )> ;;' 0 0 0 g Two points o connection i=uel Oil System . Onsite generator fuel storage Bulk Storage Tanks Storage Tank Pumps and Piping I Fire Suppression Fire detection system Yes Yes Yes Yes Fire sprinkler system When required Pre-action (when required) No requirement above AHJ No requirement above AHJ Pre-action (when required) When used, clean agents should be allowed by local code . Alternative systems (e.g . hypoxic, mist) are allowed Pre-action (when required) When used, clean agents should be allowed by local code. Alternative Alternati ve systems (e.g . hypoxic hypoxic,, mist) are allowed Yes Yes Yes Yes Yes Yes Gaseous suppression system for computer rooms and entrance rooms containing active ICT equipment Early Warning Smoke Detection System for computer rooms and entrance rooms containing active ICT equioment Water Leak Detection System for computer rooms and entrance rooms containing active ICT equipment No requirement above AHJ No requirement above AHJ 87 ANSl/TIA-PN-942-B ANNEX G {INFORMATIVE D T CENTER DESIGN EXAMPLES This annex is informative only and is not part of this Standard. G1 Small data center design example One example layout for a small data center is shown below. This is an example of a data center that is small enough to be supported by a main distribution area and no horizontal distribution areas (HDAs). l 1• 1\I [ 1101 AISI I •I( ) M ~ \ J l ~ ) ) M ITil T 1 I fl I -, - -I I I 11 1 I l l l I l I l l 1 i l1 rr L J J L r r C:Ol IJ A1S,' CR,\C HOT 11 CR1\C C ~ A I S L ~ COi i) AiSi I CRAC w HOT /\ISi F _JJ C:O ll Al'>I I : =: l :gJ_ l E§ l:gJ_ SW i CH N ~ r J r/\TCH \ IJ Rfl K<; Figure 17: Computer room layout showing hot and cold aisles This computer room space is about 178 square meters (1,920 square feet). It has 73 server cabinets in the equipme equipment nt distribution distributio n areas (EDAs) and and six 19 racks in the main distribution area (MDA). The six MDA racks are the six 'SWITCH AND PATCHING RACKS' at the bottom of the drawing. It was not necessary to put the MDA in the center of the computer room because length limitations were not an issue. However, cable lengths and cable congestion in the aisles perpendicular to the cabinet aisles could have been r e d u c ~ d by placing the MDA in the center of the room instead. The MDA supports the HC for horizonta horizontall cabling to the EDAs. In a data center with a high density of cabling to the equipment cabinets, it would probably be necessary to have HDAs to minimize cable congestion near the MDA. The rack and cabinet rows are parallel to the direction of under floor airflow created by the Computer Room Air Conditioning (CRAC) units. Each CRAC is located facing the hot aisl aisles es to allow more efficient return air to each CRAC unit. Serverr cabinets are arranged to form alternating hot and cold aisles. Serve Telecommunications cables are run in wire basket trays in the hot aisle, Power cables are run under the access floor in the cold aisles. The computer room is separate from the Network Operations Center (NOC is not shown) for access and contaminant control. 88 :;opyrighl Telecommunications lnduslry Association Jrovided by IHS under license wilh TIA \lo reproduction or networking permilled without license lrom IHS Order Number: 02167039 Sold to:UPSISTEMAS [202862100001], 2017-09-06 17:39:49 UTC ANS 1/TIA-PN-942-B G.2 G. 2 Corpo rate data enter design example The following example is for an Internet or web hosting data center used to house computer and telecommunications equipmen equipmentt for multiple corporate web sites. The corporate data center in this example has two floors of about 4,140 m 2 44 44,,500 ft2 each. This data center is an example of a data center with several HDAs, each differentiated primarily by the type of systems that they support. Due to the density of cabling to the personal computer based servers,, these systems are served by two HDAs , each supporting only 24 server cabinets . Seven servers additional HDAs are planned to support additional server cabinets. cabinets . Thus Thus,, HDAs may be required not only for different functional areas, areas , but also to minimize cable congestion in the HDA. HDA. Each HOA was designed to support a maximum of 2,000 4-pair balanced balanced twisted-pair twiste d-pair cables. cables . Note that the Internet and PC HDAs are located near the center of the rows that they support to ensure that lengths for category 8 cabling remains within 24 meters for permanent links and 30 meters for channels. channels . The category 8 cabling can support 25GBASE-T and 40GBASE-T. The st floor includes the electrical rooms, mechanical rooms, storage rooms, loading dock, security room, reception area, operations center, and entrance room. The computer room is on the 2nd floor and is entirely on access floor. floor . All telecommunications cabling is run under the access floor space in wire-basket cable trays . In some locations where the volume of cables is the greatest and where they do not impede airflow , the cable trays are installed in two layers. layers . The drawing below shows the 2nd floor computer room with cable trays . In the example below, the cable trays are in blue and the IT cabinets and equipment are in gray. 9 N.... ;, ' l f t t l . o f c n lnl u 111y Association S Under ense wilh TIA on Qr networking permilled wilhout license from IHS Order Number: 02167039 Sold lo :UPSIST :UPSISTEMAS EMAS [202862100001 J 2017-09·06 17:39:49 UTC .s c Q) CJ .f C CI "C ~0 0 eCJ 0 Q) Q. E ~ :Jm co <C ~ = ; ;;; • Ill ._ I' I I I J'I [1 111 lf 11 [ I 1 1.1 , 1 n 1...1 ....,>Jo..,.• I T' I r J l rI I I' I lf Tll T I I Fl I ' b:::I:ll 1 111 TTI r rm ITl1J I [ 1 I li 1 - . i - - - - -...... , -... j /. _ 1 _____ _ m '.'r 1 11 111 r 1 " J I Li [ F ~ ~ [ OJ ~ z a.. <{ - n1n- . _ __ O< •a D 1r 11, LfJ T ~ ~ o·--·u-11_ E I , ~ ~ 11 i...____ L L .. I I ~ ~ "l.-ITTT'M I c c · rrTn. mTl i l r , I 1 ". 1 .1 dJ w r ...... IJ c t: l:J :J · ~ · • s: 1'I - - I I I 11 fTT I N LJ 1 .... r ,_.__.._.""""" .... _.................... I I "1L.IlII] - I I I l I I I I IT ' Tm I - t: Ci5 z <( ::;opyright Telecommunications Indust Industry ry Association Jrovided by IHS under license with TIA Jo reproduction or nelworking permitted without license rrom IHS I C> Order Number: 02167039 Sold lo:UPSISTEMAS 1202862100001 , 2017-09-08 17:39:49 UTC ANSl/TIA-PN-942-B Telecommunications cabling is installed in the hot aisles behind the server cabinets. Electrical cabling is installed in the cold aisles in front of the server cabinets. cabinets . Both telecommunications cabling and electrical cabling follow the main aisles in the east/west direction, but follow separate pathways to maintain separation separation of o f power and telecommunications cabling. u 0 cr> The locations of the Entrance Room on the 151 floor and MDA on the 2n 2nd floor are carefully positioned so that T-1 and T-3 circuits can be terminated on equipment anywhere in the computer room. Cabinets for rack-mounted servers have standardized cabling that includes multimode fiber and balanced twisted-pair. Administration is somewhat simplified if cabinets have a standard cabling configuration.. configuration In this data center, center , due to the very wide variety of cabling requirements for floor standing systems, it was not possible to develop a standardized configuration for equipment outlets in ZDAs. G3 Internet data center design example The Internet data center in this example has one floor of approximately 9,500 m 2 (102,000 ft 2 ) with a computer room of about 6400 m2 (6 (69 9 ,000 ft2 . It is an example of a data center where HDAs are differentiated primarily by the area served rather than the type of systems that they support.. The drawi support drawing below shows the data center floor plan with cable trays . MDA and HOA racks are shown but customer racks and cabinets are are not. not. Cable trays and ladders are in blue. Distributor racks are black. Architectural features such as stairs, doors, and permanent walls are in red. 91 ~ O l t w r i u n c l t l o n s IOdlt J lry Association 1o i Under license with TlA or nelworking permitted wi1hout license lrom IHS UJ () <x: o::: · 0 1- (fJ Order Number: 02167039 Sold to:UPSISTEMAS [202B62100001J, 2017-09-0617:39:49 UTC ~ . ~ ~ I ..iiiiiiiiiiiiiiiiiii~ ~ N ~ i i ~ ~ -1 ~ I j I I GI GI CJ CO 1G C I c GI .5 0 GI Q. E CO >< w ·1 I· - a a .... I :J en u:: ·-. (.) r1 I >i IC F I AISLE o. 0, 0 - ·' OPEN OFFICE LL, ·--=--' ° ' o ........ 0 tn i > ~ D h: 0 (.) ca rx: .... 0: :0 tn 0 ca ... I Q) J:l ca 0 ::::s CL J:l u IllI . N c <t CJ) I z a.. cd: ((j E: z <( ;opyright Telecommunications Industry Association >rovided by IHS under license with TIA o reproduclion or networking permitted without license from IHS Order Number: 02167039 Sold lo:UPSISTEMAS (202862100001(, 2017·09·06 17:39: 17:39 :49 UTC ANSl/TIA-PN-942-B The main distribution distributi on area MDA) incorporates incorpo rates the function of the entrance entra nce room and the main cross-connect. It accommodates 50 access provider racks and 20 racks for the main cross connect space. This room is supported by two dedicated PDUs, two dedicated computer room air and is on is in N CJ conditioning units, and is on access floor. The MDA is in a dedicated room with a separate entrance that allows access and service providers to work in this room without entering the customer spaces in the main computer room. The locations of the MDA and HDAs were planned to ensure that circuit lengths for T 1 and T-3 circuits will not be exceeded for circuits to any rack in the computer room . Automated tape libraries, storage servers , and control equipment for storage services are in a dedicated SAN room adjacent to the MDA. This equipment is provided and managed by third parties, not by the owner of the internet data center. A separate room for this equipment allows storage service provider providers s to manage their equipment without entering the main computer room. The computer room space has 4,300 customer racks. The customer space is supported by six HDAs to limit the volume of cable in the under floor cable trays . Each HDA supports approximately 2,000 balanced twisted-pair connections. These HDAs are in the center of the spaces they serve to minimize cable lengths. lengths . Cabling from the HDAs to the customer racks is standardized to simplify administration. However, additional cabling may be run to customer racks as required. Telecommunications cabling to storage and staging areas east of the computer room are supported from the MDA. Telecommunications cabling for the offices west of the computer room are supported by a teleco telecommunica mmunications tions room TR). _ ~ . 93 ~ r n u n l m l l o n n tt l i y Association IS Under license TIA TI A Ion or networking permitted wilhout license from IHS Order Number: 02167039 Sold to:UPSISTEMAS [202662100001 [. 2017-09-06 17:39:49 UTC ANS l/TIA-PN-942-B ANNEX H INFORMATIVE) CABLIN CABLING G GUIDELI GUIDELINES NES FOR DA DATA TA CENTER FABRICS This annex is informative only and is not part of this Standard. Traditional H.1 Switch Architecture Figure 20 provides an example of the traditional three-tier data center switch architecture. Core Core witch witch Core switches typically in MDAs Aggregation switches may be in MDAs MDAs,, IDAs, or HDAs Access switches in HDAs for End/Middle of Row or EDAs for Top for Rack Servers in EDAs (server cabinets) LEGEND: A c tiv tive e S1 v1tcl 1to - S w1t c h Connecti o n Figure 20: 20: Example Inactive ~ c k u p Switch to Switch Connection of Server con nections traditional three-tier data center switch architecture Some of the characteristics of the traditional three-tier switch architecture are: • Backup connect connections ions (the dashed red lines in figure 20) to access switches are not active due to spanning tree protocols used to prevent routing loops (some protocols do not have this limitation) • Connections are typically over-subscribed (i.e . more traffic assigned to the link than the bandwidth capacity of the link) • When access switches are located in the EDA (i.e., top of rack), more switch ports may be available in each cabinet than necessary • Traffic between two access switches switches may need to travers traverse e as many as three intermediate switches The traditional architecture is well-suited for traffic between servers on the same access switch and from servers to external destinations. However, it isn t suitable for large virtualized virtualiz ed data centers where compute and storage servers may be located anywhere in the data center. 94 :;opyrightt Te lecommun icatio :;opyrigh ication n s lnd ndu uslry Associ Associa lio ion n .lrovided by IH IHS S un unde r license license wi1 h T IA lo reproduclion or ne nettworking permitled without license fr f rom IH I HS Orde r Nu Order Numbe berr : 02 167039 Sold l o :U PS PSIISTEMAS (202862 2028621 10000 00001 1. 2017-09-06 17: 17: 9:49 U TC ANSl/TIA-PN-942-B All cabling for the traditional architecture follows the hierarchical cabling topology specified in this Standard. See figure 21 for an example. LEGEND hierarchical backbone cabling Access provider or campus cabling optional backbone cabling between peer level cross-connects ES b l i n g ® e m D ross-connect interconnection outlet MDA Telecom space CP - consol consolidatio idation n point point EDA - equipment distr distributi ibution on area area ENII - external network EN network interf interface ace EO - equi equipment pment out outlet let ES - entr entrance ance roo room m or space space HC - horizont horizontal al cross-co cross-connect nnect HDA - horizont horizontal al distribu distribution tion area area TR HC ID intermediate ate cross cross-conne -connect ct IC - intermedi IDA - interme intermediate diate distribu distribution tion area area MC - mai main n cross-con cross-connec nectt MDA - main distribu distribution tion area area TR - telecomm telecommunication unications s room room ZDA - zone distrib distribution ution are area a Horizontal cabling for spaces outside computer room c;; ~ - - - - - - - - - - - ··------ ------------ ',•' I \ •• ··------------- J--------------------- · I \ I ZDA ZDA I ' EDA EDA •••••• ••••• EDA • • • I I E1 8 EDA EDA • • • • • J C8 I ~ EDA I \ I \ ~ EDA g EDA[ EDA g \ ·1 , \ § ] EDA Figure 21: Example o f ANSl/TIA-942-B cabling topology 95 n l 3 1 l i o r 1 1 1 lnrit.1 1tty Associalion under license wl 111 IJ\ or networking permitted without license from tHS Order Number: 02167039 Sold to:UPSISTEMAS [202862100001 [. 2017-09·06 17:39:49 UTC ANSl/TIA-PN-942-B H.2 Multiple Connections Compute and storage servers often have have multiple connections to to provide redundancy redundancy additional bandwidth or to support diffe different rent functions. The connections may be to a singl single e switch to multiple switches within the same network or to multiple switches switche s in different networks. See figure 22. Access Switch Multiple connections to the same switch Server Multiple connections to different switches on the same network Access ccess Switch switch Multiple connections to different switches on different networks Server Figure 22: Examples of redundant connectivity 96 Apyrlgh t T elecommunicalkms Industry Associalion =iro11dad Uy IHS um1Qr J lfl \ilo teprodUation or t 1 llh O.lklhg r.i.tnmit r.i.tnmi tlc1d wilhout license from IHS Order Number: 02167039 Sold to:UPSISTEMAS [202862100001] 2017·09·0617:39:49 UTC ANSl/TIA-PN-942-B H.3 Data Center Switch Fabrics Data center switch fabric architectures are intended to provide low-latency and high-bandwidth communication between any two points in the switch fabric. Data center switch fabric architectures typically use only one or two tiers of switches. These switches have large numbers of connections to other switches. These connections are all active to provide multiple paths that minimize latency and to provide maximum switch fabric bandwidth. Data center switch fabric architectures can be accommodated using the cabling topology in this Standard . Some data center switch fabric architectures require backbone cabling specified between peer level distributors, for example between HDAs (see figure 21 ). Some require direct cabling between switches located in different EDAs (for example, between top-of-rack/cabinet switches). Direct attach cabling between switches in EDAs should adhere to the guidelines specified in 7.3.4 7.3.4.. In all of the architectures described in this annex, compute and storage servers may connected to multiple access switches for redundancy . H.3. H. 3.1 1 be Data center fabr fabric ic fat-tr fat-tree ee Figure 23 is an example of the fat-tree switch fabric architecture (also called the leaf and spine switch architecture). architecture) . This architecture has no more than one switch between any two access switches and can be non-blocking by providing sufficient bandwidth from each access switch to the interconnection switches. Interconnection Switch Interconnection Switch Interconnection Switch Interconnection Switch Interconnection switches (Spine switches) typically in MDAs, but may be in IDAs Access switches (Leaf switches) in • HDAs for End/Middle of Row/Zone • EDAs for Top for Rack Servers in EDAs (server cabinets) LEGEND:: LEGEND Active Sw it ch- to -S -Sw w it c h Co nn nnect ect io n • Server connectio connections ns • • Repeated components Figure 23: Fat-tree example the fat-tree architecture, all access switches are connected to every interconnection switch. The interconnection switches are typically located in one or more MDAs and don t need to be connected to each other. other . If the data center switch fabric only serves a subset of the data center supported by one or more IDAs, the interconnection switches may be located in IDAs In The access switches may rows of cabinets . be in the HDAs or EDAs. HDAs can serve a single row or multiple For this architecture to be non-blocking, the sum of the bandwidth of all server connections on each access switch must be less than or equal to the sum of the bandwidth of all of the uplinks 9 ndu uslry ~ D l t t t n l c r u l Q l l s l nd und er license license wi th TIA Ion ss oc iation or ne nel wo worrking p ermi ermillll ed withou withoutt licen se fro from m IH S O rd er N u mber: 021 6 7039 Sold So ld t o:U PSIS SISTEM TEM A S 12 02862 100001 I 2017-09-06 17:39:49 UTC ANSl/TIA-PN-942-B from the access switch to the interconnection switches. Specifically, an access switch with twenty-four 10 Gbps server ports will need at minimum of: of : twenty-four 10 Gbps Gbps,, six 40 Gbps, or three 100 Gbps uplinks. This architecture requires more cabling than the traditional three-tier architecture, architecture , but all of the cabling follows the standard ANSl/TIA-942-B cabling topology. There will be a limit on the size of the fabric imposed by the number of ports available on the interconnection switches. switches . For this reason , the fat fat--tree architecture will typically be implemented in a large data center with the access switches located in HDAs. A variant of the fat-tree that extends the port-interfaces of the switches to top-of-rack/cabinet port extenders is shown in figure 24. Interconnection Switch lnt arc o n nac tlo tlo..n Interconn e cti Interc tion on Switch Switch Interconnection switches Spine switches) typically in MDAs MDAs,, but may be in IDAs Switch Access switches Leaf switches) in • HDAs for End/Middl End/Middle e of Row/Zone • EDAs for Top for Rack Port Extenders typically in EDAs at top of rack Servers in EDAs server cabinets) LEGEND:: LEGEND Ar t1ve S v ch - to -Sw 1ch Co nr 1ec 1ectior tior 1 Server c onnections I [ Servers e e e Repeated components Figure 24 24:: Fat-tree with port extenders example Port extenders are physical extensions of access switches to which they are attached . Typically , they map many lower-speed ports for server communication to fewer higher-speed ports on the access switch . For the switch fabric to be non-blocking, the connection between the access switch and the port extender must have as much bandwidth as the total bandwidth of the server ports on the port extender. extender . The connection between the port extender and the access switch may use structured cabling depending on the protocol used for this connection. See figure 25 for an example of structured cabling supporting a fat-tree switch fabric architecture . 9 :opytighl Telecomm ecommun unica icall ions l nd ndu uslry Associ Assoc iati o n rovi ovid ded by IH S under lice licen ns wilh TI A to rep reprroduclio oduclion n or ne l working per pe rmilled wil wi l houl license from IH IHS O rder Num Number ber:: 02 021 16 7039 So ld lo l o :U PS PSIISTE STEM MAS 2026 202 662 621 10000 00001 1J 2017-09-06 17: 9:49 UT C ANSl/TIA-PN-942-8 iMo ____________________________ ____ ___: I i t I lritwconriectlon Switch Interconn ection Interconnection Switch Interconnection Switch / 1 Interconnection I I I I I I I I I I I Spine) switches I L_ _ _ _ _ I I I I I I I I I I I • • • I I I I I I Access Leaf) switches I I I I I I I :HOA 1 HOA Horizontal Cabling Horizon al Cabling ,---- I I I I I I I I I I I I I Port extenders I • • • II I I I II I I I I I t EDA LEGEND : I Switch II Figure 25: Example of ervers use I ~ : Teleco Telecom m : 1 Space 1 Patch Panel -------- o f structured cabling for ••• fat-tree Repeated components switch architecture Larger switch fabrics may be created by interconnecting fat-trees or pods) using a second layer of inter-connection or spine) switches. See figure 26 99 .1t~o m m m i' IH S und n lndustry Association lr license with TIA Ut:tlcn 1or networking permitted without license from IHS Order Number: 0.2167039 Sold lo:UPSISTEMAS [202862100001]. 2017-09-06 7: 39: 49 UTC ANSl/TIA-PN-942-B level Interconnection (Spine) switches connected to all 2 d interconnection switches In all pods Pods - each Pod is is a fat-tree with one-layer o interconnection (spine) switches Server LEGEND: Active Switch-to-Switch Connection [ Server connections II Pod . 4 . . . . . • • • Repeated components Figure 26: Interconnected fat-tree pods example 100 opyrighl Telecommunicatlona lnduetry Aeaocialion roykJaQ v IHS urn te 1 i: an1e with TIA tflllrodll lion ar ci lwa tflllrod walidng lidng permltled wllhout llcen88 from IHS Order Number. 02167039 Sold lo:UPSISTEMAS lo:UPSISTEMAS 202662100001], 2017-09-06 17: 17 : :49 UTC ANSl/TIA-PN-942-8 H.3.2 H.3 .2 Data cent er fabric full mesh Figure 27 is an example of the full-mesh switch fabric architecture . This architecture has no intermediate switches between any two access switches and is typically non-block non-blocking. ing. Servers in EDAs server cabinets) Fabric Switch Fabric Switch Fabric Switch Fabric Switch Fabric Fabric switches Fabric may be located in MDAs, IDAs , HDAs, or in small data centers in EDAs Switch Fabric Switch Servers in EDAs server cabinets) LEGEND:: LEGEND Active Switch-to-Switch Connection erver connections Figure 27: Full-mesh example In the full-mesh architecture, all switches are connected to every other switch. To be a non blocking fabric, fabric , the sum of the bandwidth on server ports on each switch must be less than or equal to the sum of the bandwidth on ports to other switches. The architecture does not scale well because of the requirement that each switch connect to every other switch. For this reason, reason , the switches are typically not located in the EDA i.e i.e.., not implemented using top-of-rack/cabinet switches) except in small data centers. centers . Cabling for the full-mesh architecture should follow the ANSl/TIA-942-B cabling scheme. It may require the optional backbone cabling between peer level cross-connects cross-conne cts e.g., HDA-to-HDA). See Figure 28 for an example of structured cabling supporting a full-mesh switch fabric architecture. 1 1 O rd rder er Number Numbe r : 02 16 167039 7039 Sold to to :UPSIS UPSIST T EMAS [202 20266210 6621000 0001 [ 20 1717-09·06 09·06 17 :39 39::49 U TC o . n indiss1 indiss 1y Association Un d e r li cen cense se w T 1/l l°1 or ne networkin tworkin g permiU ad without li cens ense e f ro m IH S e ANS l/TIA PN 942 B - - 1 MDA I r it c h r rnd s I I Horizontal Cabling Horizontal Cabllng Honzontal Cabling Horizontal Cabling I I I I I ~ D -------- Patch Panel LEGEND: : Telecom : 1 Space 1 -- - - Figure 28: Example o f use of structured cabling for full mesh switch architecture 102 ;opyrighl Te/ecommunicalions lnduslry Association cense w;th TIA l ro rovided vided by IHS under lilicense reprroduction or networking permilled without license from 1HS rep Order Number: Number : 02167039 Sold to: to :UPSISTEM S {202862100001 I. 2017 09 00 17: 17 :39 :49 UTC ANSl/TIA-PN-942-8 H.3.3 Data center fabric inter-connected meshes Figure 29 is an example of the interconnected mesh switch switch fabric architectu architecture. re. This architecture has between one and three intermediate switches between any two access switches. It is typically non-blocking within a pod a portion of a data center) and might not be non-blocking between pods. lnterconne··ctlon lnterconne Switch l Interconnection switches typically in MDAs, but may be in IDAs l e r c d n n l l ~ l l o n Switch Access switches in HDAs for End/Middle of Row/Zone EDAs for Top for Rack Servers in EDAs server cabinets) LEGEND: e e e Active Swi\cil -to-Switch Server connections Co1111ect1on ·· · -- · ·· Repeated components Figu re 29: Interconnected meshes example In this example, the architecture within a pod is a full-mesh. This pod might contain systems that are all dedicated to related applications. If the interconnection switches are connected to all access switches in all pods, the maximum number of intermediate switches between access switches in different pods is one switch. Otherwise, the maximum number of intermediate switches between access switches in different pods is three. The access switches may be in the HOAs or EOAs. HOAs can serve a single row or multiple rows of cabinets. Cabling for the interconnected meshes architecture should follow the ANSl/TIA-942-8 cabling scheme. It can use the optional HOA-to-HOA backbone cabling if the access switches are located in the HOAs. Additionally, cabling between equipment in EOAs may be used if the access switches are located in the EOAs. EOAs. If dire direct ct attach cabling is used, it should be no greater than 7 m 23 ft) and should be between cabinets/racks in the same row. This direct attach cabling should be routed in cable management or accessible pathways, and not interfere with fixed cabling. See figure 30 for an example of structured cabling supporting-· supporting-· an interconnected mesh switch fabric architectur architecture. e. 103 Order Number: 02167039 lw. lalqc;t.1m m11 1l qn ho ru lnduslry Association by IHS under license with TIA IJ Sold to:UPSISTEMAS l2 28621 1 2017-09-06 17:39:49 UTC lcm or nelworking permilled without license from IHS ANSl/TIA-PN-942-B ~ ~ ~ 1 I lnterconneotfon Switch i lnterconneclion Switch I J I I I I I I Pod full Pod (full mes me s h mesh ) r -------.. I LEGEND: Figure 30: Example H.3.4 Data cen center ter of f bric use Patch Panel of structured centralized I 1 I 1 Telecom Space 1 I 1 ···... ·· · · , 1 : L--------1 cabling for Pod i• • • 1 ·· ········ ·· · · · Repeated 1 componen s interconnected mesh f bric switch Figure 31 is an example of the centralized switch fabric architecture. With this architecture, the fabric is implemented within the backplane of the switch. There may be one or more switches if redundancy is desired. The architecture is non-blocking and has no switch-to-switch latency. Fabric Switch Centralized switches typically located in MDA (may be in IDA or HOA if the switch fabric only supports servers in a Fabric Switch portion of the data center) Servers in EDAs (server cabinets) LEGEND: Server connections Figure 31: Centralized switch example 104 :;opyrigh1 Telecommunications Industry Associalion Jrovided by IHS under license wilh TIA -Jo reproduclion or networking permilled withou1 license from IHS Order Number: 02167039 Sold lo:UPSISTEMAS 1202862100001 I 2017-09-06 17:39:49 UTC ANSl/TIA-PN-942-B With the centralized switch architecture, architecture , all compute and storage servers are connected to all fabric switches and all connections are active . The switches may be located in any distributor that supports horizontal cabling to all of the servers. This is typically the MDA, but it may be an IDA or HDA if the data center switch fabric only supports a portion of the data center . The switches do not need to be interconnected. Cabling for the centralized switch architecture follows the ANSl/TIA-942-B cabling scheme . This architecture, while being simple and having very low latency, does not scale well because it cannot support more servers than the maximum number of ports available on a single switch. See figure .3 architecture. architecture for an example of structured cabling supporting a centralized switch fabric ~ MD I Fabric Switch Two centralized : switch fabrics in t this example for 1 redundancy Fabric Switch I I I I I Patch Panel LEGEND : Figure 32: Example of use of structured cabling for 1 I Telecom Space L centralized ~ 1 I 1 switch fabric The scalability of a single switch can be alleviated to some extent by connecting several switches into one large virtual switch . ~ 105 m m u n i c t i o n s Indust ry Assoc Assoc iali ialio on IHS under lice icen nse wilh TI TIA A docUCM or netw or kin g po rmill ed wi tho ut lic icen en se fr from om IHS O rd rde er Number: 2 167 39 Sold Sol d lo :UPS PSIISTEMAS [2 [ 202062 020621 10000 00001 1, 2017-09-06 17 17::39 :49 UTC ANSl/TIA-PN-942-B H.3.5 H.3. 5 Data center fabric virtual switch Figure 33 is an example of the virtual switch fabric architecture . Virtual switch formed from multiple physical switches; may be located in MDAs, IDAs, HDAs, or EDAs Access Switch Servers in EDAs server cabinets) LEGEND : Active Switch-to-Switch Connection Server connections Figure 33: Virtual switch example This architecture is similar to the centralized switch architecture except the centralized switch is implemented using multiple switches interconnected to form a single large virtual switch. The switches may be connected using stacking cables cables used used to to interconnect stackable switches [a switch that can operate either alone as an independent switch or joined with other stackable switches to operate as a single larger switch]) , high-speed Ethernet connections, or other scheme. scheme . Each server may be connected to multiple virtual switches for redundancy. This architecture may be non-blocking if the virtual switch backplane bandwidth is greater than or equal to the total bandwidth of server connections . Latency between switches within a virtual switch may be higher than that for other architectures if the virtual switch is composed of many daisy-chained switches. As with the centralized switch architecture, this architecture does not scale well unless a fat-tree or full-mesh is implemented between virtual switches. switches . The switches may be located in any distribu distributor tor MDA, IDA, IDA, HOA) or in the EDAs. EDAs . Cabling for the virtual switch architec architecture ture should follow the ANSl/ ANSl/TIA-94 TIA-942-B 2-B cabling scheme. It can use the optional HDA-to-HDA backbone cabling if the access switches are located in the HDAs. Additionally, cabling between equipme equipment nt in EDAs may be used if the access switches are located in the EDAs . If direct attach cabling is used, it should be no greater than than 7 m 23 ft and should be between cabinets/racks in the same row. This direct attach cabling should be routed in cable management or accessible pathways and not interfere with fixed cabling. See figure 34 for an example of cabling supporting virtual switch fabric architecture . 106 : opy ight Telecommuni mmunica cati tio ons ln lnd d u sl ry Associali Associa lio on l rov oviided b y S und er li ense wil h T A a reµrodu ction or nel ne l wo rk ng permilted withou witho ut licen lice n se fr o m IHS Orde r N umb e l: 0 2 167039 Sold to :UP SIST STE EMAS 2028 202862 10000 00001 1, 2017--09 2017 09--06 17 39 39::49 UT U TC ANSl/TIA-PN-942-B r - - - - - - - , 1I I I I1 I1 11 - - ,r II II II ---- --- 1I1 I1 I1 - - , I I I I I I l Access Switch 1f 1I I Access Switch Access Switch I1 II Access Switch I 1 : I I I I I I I I I I I I I1 II I I1 I DA DA LEDA ______ LE______ JLEDA ______ J LE______ JI 1 r 1 LEGEND: I 1 . . Telecom Space L------- 1 I 1 Switch-to switch cabling Equipment Cords Figure 34: Example o f cabling for fabric virtual switch architecture 107 O rd rde e r Number : 02 167039 Sold to to::UPSISTEMAS 20286 2 10 0001 J 2017-09-06 17:39: 7:39:4 4 9 UTC l it T eleco eleco mmun tca tcattions Indu Indus stry Associa A ssociattio ion n by IH S under l icen se wi th TI or netwo netw o rk i ng pe rmitt rm itte e d cense fr o m IH S fro '°duodon without li od ANS l/TIA-PN-942l/TIA-PN-942-B B ANNEX I INFORMATIVE) INFORMA TIVE) BIBLIOGR BIBLIOGRAPHY APHY This annex is informative only and is not part of this Standard. This annex contains information on the documents that are related to or have been referenced this document. Many of the documents are in in print and are distributed and maintained by national or international standards organizations. These documents can be obtained through contact with the associated standards body or designated representatives. The applicable electrical code the United States is in the National Electrical Code. • ANSI/IEEE ANSI/IE EE C2-2017, National Electrical Safety Code® • ASH RAE, Best Practices for Datacom Facility Energy Efficiency, Second Edition (2009) • ASHRAE, Design Considerations for Data a nd Communications Equipmen t Centers, Centers, Second Edition (2009) • ASH RAE, Thermal Guidelines for Data Processing Environments, Environments, Fourth Edition, 2015 • ASTM 8539 8539-02 -02 2013, Standard Test Methods for Measuring Resistance Electrical of Connections (Static Contacts) • Design an d Implementation Best Practices ANSl/BICSI 002-201 002-2014, 4, Data Cen ter Design • BICSI Telecommunications Distribution Methods Manual (TDMM}, • BICSI Information Technology Systems Installation Methods Manual (ITS/MM), 1 h Edition, 2014 Edition,, Edition fh 2017 • BICSI Outside Plant Design Reference Manual (OSPDRM}, • European Commiss Commission, ion, 2017 Best Practices for Version 8.1.0 (2017); • European Commission, European Code of Conduct on Data Centre Energy Efficiency, Introductory guide for applications 2016, Version 3.1.2 • Federal Communic Communications ations Commissio Commission n (FCC) Washingt Washington on D.C., EU th Edition, 2010 Code of Conduct on Data Centres, The Code of Federal Regulations Regul ations,, FCC 47 CFR 68 • Federal Telecommunications Recommendation 1090-1997, Commercial Building Telecommunications Cabling Standard, by National Communications System (NCS) • IBC, International Building Code, 2015 Edition • IEEE Std. 142, Recommended Practice for Grounding of Industrial and Commercial Power Systems IEEE Std . 446, Recommended Practice for Emergency • nd Standby Power Systems for Industrial and Commercial Applications • IEEE Std. 1100, Recommended Practice for Powering and Grounding Electronic Equipment • ANSI/IEEE 802.3-20 802.3-2015, 15, IEEE Standard for Ethernet 108 Alpyrighl Telecommunicalions Industry Associalion rovtded by IHS under license wi h TIA reproduction or networking permilled wilhout license from IHS Order Number: Number: 02167039 Sold to :UPSISTEMAS (202862100001). (202862100001). 2017 09 0617 :39:49 UTC ANSl/TIA-PN-942-B • IEEE Standard 518-1982, Guide for the installation electrical noise t controllers o f external sources of electrical equipment t minimize • IFMA - International Facility Management Association - Ergonomics for Facility Managers June 2000 • National al Fire Alarm Code Code 2016 NFPA 72 Nation • Code ® 2015 NFPA 101 Life Safety Code® • NFP • Installation ion NFPA 780-201 780-2017, 7, Standard for the Installat Edition 2001, Standard on clean agent fire extinguishing systems 2015 Edition of Lightning Protection Systems - See more more at: http://catalog. nfpa .orglN FPA-780-Standard-for-the-Installation-of-Lightni nstallation-of-Lightning-Protection Systems VE 2-2013, Cable Tray Installation Guidelines • NEM • ANSl/TIA- 4994-2015 - Standard for Sustainable Information Communications Technology • TIA TSB-162-A:2013 - Telecommunicatio Telecommunications ns Cabling Guidelines for Wirele Wireless ss Acces s Points • TI • TIA TSB-5018:2016 - Structured Cabling Infrastructure Guidelines for Support Antenna Systems • TIA TSB-5019-2015, High Performance Structured Cabling Use Cases for Data Centers TSB-184-A:2016 - Guidelines for Supporting Power Delivery ov er Balanced Twisted-Pair TSB-184-A: Cabling 2016 of Distributed Other Premises • TIA TSB-5046-2016 - Standard Process for Sustainable Information Communications Technology Manufacturers • UL 444/CSA-C 22 22..2 No . 214-08,, Communications Cables 214-08 109 I Tallli:ummUnic oUnru; ~ ° ' a d by u ~ 1 y Association I IS nd ll icenso wi h l l reproduclion or networking permilted without license from IHS Order Number: 02167039 Sold to:UPSI STEMAS 20266210000 1 , 2017-09-06 17:39:49 UTC ANSl/TIA-PN-942-B The organizations listed below can be contacted to obtain reference information. nd

TIA-942b-2017

Related documents

Products

Support

TIA-942b-2017

Related documents

Add this document to collection(s)

Add this document to saved

Suggest us how to improve StudyLib