EMC Greenplum Data Computing Appliance and Data Integration Accelerator Replacement of Field Replaceable Units Field Procedures DCA SOFTWARE 1.0.3.0 P/N 300-012-282 A04 EMC Corporation Corporate Headquarters: Hopkinton, MA 01748-9103 1-508-435-1000 www.EMC.com Copyright © 2011 EMC Corporation. All rights reserved. Published November, 2011 EMC believes the information in this publication is accurate as of its publication date. The information is subject to change without notice. THE INFORMATION IN THIS PUBLICATION IS PROVIDED “AS IS.” EMC CORPORATION MAKES NO REPRESENTATIONS OR WARRANTIES OF ANY KIND WITH RESPECT TO THE INFORMATION IN THIS PUBLICATION, AND SPECIFICALLY DISCLAIMS IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Use, copying, and distribution of any EMC software described in this publication requires an applicable software license. For the most up‐to‐date regulatory document for your product line, go to the Technical Documentation and Advisories section on EMC Powerlink. For the most up‐to‐date listing of EMC product names, see EMC Corporation Trademarks on EMC.com. All other trademarks used herein are the property of their respective owners. 2 Replacement of Field Replaceable Units — EMC Greenplum DCA Contents Warnings and Cautions Preface Chapter 1 Introduction Identify the DCA Software Version ..................................................................... 18 Overview.................................................................................................................. 19 System Components............................................................................................... 21 Chapter 2 Dell PowerEdge R610 Master or Standby Server Overview.................................................................................................................. 32 Replacing Dell R610 Primary Master and Standby Master Servers ................ 33 Scenario 1: Standby Master is Active — Must Replace Primary Master ........ 34 Scenario 2: Must Replace Primary Master — Still Serving As Active Master 38 Scenario 3: Must Replace Standby Master — Primary Master is Active ........ 39 Scenario 4: No Greenplum Database is Initialized ‐ Must Replace Primary or Standby Master Server ............................................................................................ 41 Installing the Replacement Server into a Rack ................................................... 45 Chapter 3 DCA Segment and DIA Server Replacement Replacing the Dell R510 DCA Segment and DIA Server .................................. 52 Reseat Cables before Replacement....................................................................... 53 How to Install and Remove a Server to and from the Rack ............................. 64 Chapter 4 Drive Replacement Replacing a Drive in the Dell R610 Master or Standby Server......................... 68 Replacing a Drive in the Dell R510 DCA Segment and DIA Server................ 70 Chapter 5 Power Supply Replacement Replacing a Server Power Supply in the Dell R610 ........................................... 74 Replacement of Field Replaceable Units — EMC Greenplum DCA 3 Replacing a Server Power Supply in the Dell R510............................................ 76 Chapter 6 Switch Replacement Replacing a Failed Brocade 8000 Fully‐configured Switch ............................... 80 Replacing the Brocade 8000 Power Supply ......................................................... 91 Replacing the AT‐9924TL Switch .......................................................................... 96 Chapter 7 Cable Replacement How to Replace Cabling....................................................................................... 100 Appendix A Connecting to the DCA from a Workstation How to Connect to the DCA in the Field........................................................... 108 Using SCP to Copy a File to the Greenplum Master........................................ 112 Appendix B Reconfiguring iDRAC IP Address Configuring iDRAC IP Address Through HTTP ............................................. 116 Configuring iDRAC IP Address if the Default IP is Unknown...................... 120 Appendix C Accessing the iDRAC Web Interface with SSH Using SSH to Connect to the iDRAC Web Interface ........................................ 124 Appendix D Using the iDRAC Serial Console Emulator Using the Serial Console Emulator..................................................................... 130 Appendix E 4 Greenplum DCA Part Numbers Replacement of Field Replaceable Units — EMC Greenplum DCA Figures Title Page 1 Greenplum GP10 (Front and Rear View of Quarter‐Rack)............................................. 24 2 Greenplum GP1000 (Front and Rear View of One‐Rack) ............................................... 26 3 Greenplum GP1000 +1 Scale‐Out (Front View of Two‐Rack)......................................... 27 4 DIA10 (Front and Rear View).............................................................................................. 28 5 DIA100 (Front and Rear View)............................................................................................ 29 6 DIA1000 (Front and Rear View).......................................................................................... 30 7 Foreign Disk Configuration — First Message Prompt .................................................... 35 8 Foreign Disk Configuration — Second Message Prompt ............................................... 35 9 Message Prompt .................................................................................................................... 36 10 Verify the Primary Server is Synchronized ....................................................................... 37 11 Standby Status ....................................................................................................................... 39 12 Removing the Standby Server............................................................................................. 39 13 Foreign Disk Configuration — First Message Prompt .................................................... 42 14 Foreign Disk Configuration — Second Message Prompt ............................................... 42 15 Verify /data type xfs is mounted......................................................................................... 43 16 Removing the Stabilizer Screws.......................................................................................... 46 17 Releasing the Inner Rail........................................................................................................ 47 18 Releasing the Inner Rail Lock .............................................................................................. 47 19 Removing a Server from a Cabinet..................................................................................... 48 20 Attaching Inner Rails ............................................................................................................ 48 21 Inserting the Server in the Cabinet ..................................................................................... 49 22 Reseat cables connected to server ports............................................................................. 53 23 Foreign Disk Configuration ‐ First Message Prompt....................................................... 56 24 Foreign Disk Configuration ‐ Second Message Prompt .................................................. 57 25 Message Prompt .................................................................................................................... 58 26 Foreign Disk Configuration ‐ First Message Prompt....................................................... 61 27 Foreign Disk Configuration ‐ Second Message Prompt .................................................. 61 Replacement of Field Replaceable Units — EMC Greenplum DCA 5 6 28 Message Prompt .................................................................................................................... 63 29 Attaching Inner Rails to the New Server ........................................................................... 65 30 Inserting the Server in the Cabinet...................................................................................... 66 31 Removing and Replacing a Drive ....................................................................................... 69 32 Drive Status LED Indicators ................................................................................................ 70 33 Removing and Replacing a Drive ....................................................................................... 71 34 Power Supply LED Indicators ............................................................................................. 74 35 Removing and Replacing a Power Supply ........................................................................ 75 36 Power Supply LED Indicators ............................................................................................. 76 37 Removing and Replacing a Power Supply ........................................................................ 77 38 Brocade 8000 Switch — Back Panel..................................................................................... 81 39 Brocade 8000 Switch in Greenplum DIA ‐ Back Panel..................................................... 81 40 Serial Option in a Putty Session .......................................................................................... 82 41 Location of the Power Supplies for the Brocade 8000 ...................................................... 92 42 Inserting the Power Supply in the Brocade 8000 .............................................................. 93 43 Fan Assembly into the Brocade 8000 .................................................................................. 93 44 Inserting the Fan Assembly into the Brocade 8000........................................................... 95 45 Brocade Switch..................................................................................................................... 100 46 Port LEDs .............................................................................................................................. 100 47 Cabling from the Segment/DIA Servers to the Upper Brocade 8000 Switch ‐ Port 1 (Left) 101 48 Cabling from the Segment/DIA Servers to the Upper Brocade 8000 Switch ‐ Port 1 (Left) 102 49 Cabling from the Segment/DIA Servers to the Lower Brocade 8000 Switch ‐ Port 0 (Right) 103 50 Cabling from the Segment/DIA Servers to the Lower Brocade 8000 Switch ‐ Port 0 (Right) 104 51 Cabling from the segment/DIA servers (1 through 8) to the Allied Telesis 9924TL Switch 105 52 Cabling from the Segment/DIA Servers (9 through 16) to the Allied Telesis 9924TL Switch 106 53 iDRAC Login Window ....................................................................................................... 116 54 iDRAC Remote Access........................................................................................................ 117 55 iDRAC IPv4 Settings ........................................................................................................... 118 56 iDRAC — Appling Changes .............................................................................................. 119 57 Dell R610 Master Server VGA Port Location................................................................... 120 58 Dell R510 Segment/DIA Server VGA Port Location....................................................... 120 59 Press CTRL‐E for Remote Access Setup ........................................................................... 121 60 Select LAN Parameters from the menu............................................................................ 121 Replacement of Field Replaceable Units — EMC Greenplum DCA 61 Press ENTER to edit the IPv4 Address ............................................................................ 122 62 Press ENTER to edit the Subnet Mask ............................................................................. 122 63 Putty Client — Change Settings........................................................................................ 124 64 Putty Client — SSH Tunnel Configuration 1 .................................................................. 125 65 Putty Client — SSH Tunnel Configuration 2 .................................................................. 126 66 iDRAC Login Window ....................................................................................................... 127 Replacement of Field Replaceable Units — EMC Greenplum DCA 7 8 Replacement of Field Replaceable Units — EMC Greenplum DCA Tables Title Page 1 DCA and DIA Components................................................................................................. 21 2 Greenplum GP10 (Quarter‐Rack) Components................................................................ 21 3 Greenplum GP100 (Half‐Rack) Components.................................................................... 22 4 Greenplum GP1000 (One‐Rack) Components .................................................................. 22 5 Greenplum GP1000 +1 Scale‐Out (Two‐Rack) Components .......................................... 22 6 DIA10 (Quarter Rack)Components .................................................................................... 23 7 DIA100 (Half Rack)Components ........................................................................................ 23 8 DIA1000 (Full Rack)Components ....................................................................................... 23 9 Brocade IP Addresses ........................................................................................................... 83 10 Power Supply Status Led Behavior, Description, and Required Actions..................... 91 11 Fan Status LED Behavior, Description, and Required Actions ...................................... 94 12 DCA and DIA Switch IP Addresses ................................................................................... 98 13 Default Network Configuration Information ................................................................. 109 14 Default User Passwords ..................................................................................................... 110 15 DRAC Connection Types................................................................................................... 111 16 Master Host Connection Information .............................................................................. 112 17 DCA FRU Part Numbers.................................................................................................... 133 Replacement of Field Replaceable Units — EMC Greenplum DCA 9 10 Replacement of Field Replaceable Units — EMC Greenplum DCA Warnings and Cautions The following warnings and cautions pertain throughout this guide. Trained service personnel only. This EMC product has more than one power supply cord. To reduce the risk of electric shock, disconnect all power supply cords before servicing. Ground‐circuit continuity is vital for safe operation of the machine. Never operate the machine with grounding conductors disconnected. Remember to reconnect any grounding conductors removed for or during any installation procedure. Resérvé au personnel autorisé. Cet appareil EMC comporte plus dʹun cordon dʹalimentation. Afin de prévenir les chocs électriques, débranchez tous les cordons dʹalimentation avant de faire le dépannage. Un circuit de terre continu est essentiel en vue du fonctionnement sécurisé de lʹappareil. Ne mettez jamais lʹappareil en marche lorsque le conducteur de mise à la terre est débranché. Nur für authorisiertes Fachpersonal. Dieses EMC Produkt verfügt über mehrere elektrische Netzanschlüsse. Zur Vermeidung eines elektrischen Schlages sind vor Servicearbeiten an der Stromversorgung alle Netzanschlüsse zu trennen. Kontinuierliche Erdung ist notwendig während der gesamten Betriebsdauer des Gerätes. Es ist unzulässig das Gerät ohne Erdung zu betreiben. Gerät muss geerdet werden, bevor es am Stromnetz angeschlossen wird. Replacement of Field Replaceable Units — EMC Greenplum DCA 11 Warnings and Cautions Additional Warnings and Cautions Before attempting to service the EMC hardware described in this document, observe the following additional Warnings and Cautions: The hardware enclosure contains no user‐serviceable parts, so it should not be moved or opened for any reason by untrained persons. If the hardware needs to be relocated or repaired, only qualified personnel familiar with safety procedures for electrical equipment and EMC hardware should access components inside the unit or move the unit. This product operates at high voltages. To protect against physical harm, power off the system whenever possible while servicing. In case of fire or other emergency involving the EMC product, isolate the product’s power and alert appropriate personnel. Trained personnel are advised to exercise great care at all times when working on EMC hardware. Remember to: Static Precautions Remove rings, watches, or other jewelry and neckties before you begin any procedures. Use caution near any moving part and any part that may start unexpectedly such as fans, motors, solenoids, etc. Always use the correct tools for the job. Always use the correct replacement parts. Keep all paperwork, including incident reports, up to date, complete, and accurate. EMC incorporates state‐of‐the‐art technology in its designs, including the use of LSI and VLSI components. These chips are very susceptible to damage caused by static discharge and need to be handled accordingly. Before handling printed circuit boards or other parts containing LSI and/or VLSI components, observe the following precautions: 12 Store all printed circuit boards in antistatic bags. Use a ground strap whenever you handle a printed circuit board. Unless specifically designed for non‐disruptive replacement, never plug or unplug printed circuit boards with the power on. Severe component damage may result. Replacement of Field Replaceable Units — EMC Greenplum DCA Preface As part of an effort to improve and enhance the performance and capabilities of its product lines, EMC periodically releases revisions of its hardware and software. Therefore, some functions described in this document may not be supported by all versions of the software or hardware currently in use. For the most up‐to‐date information on product features, refer to your product release notes. If a product does not function properly or does not function as described in this document, please contact your EMC representative. Note: This document was accurate as of the time of publication. However, as information is added, new versions of this document may be released to the EMC Powerlink Web site. Check the Powerlink Web site to ensure that you are using the latest version of this document. Purpose Audience This document describes FRU procedures for the EMC Greenplum Data Computing Appliance (DCA). This manual is intended for the field service engineers as part of a professional services engagement only. Replacement of Field Replaceable Units — EMC Greenplum DCA 13 Preface Conventions Used in this Document EMC uses the following conventions for special notices: DANGER indicates a hazardous situation which, if not avoided, will result in death or serious injury. WARNING indicates a hazardous situation which, if not avoided, could result in death or serious injury. CAUTION, used with the safety alert symbol, indicates a hazardous situation which, if not avoided, could result in minor or moderate injury. NOTICE is used to address practices not related to personal injury. Note: A note presents information that is important, but not hazard‐related. IMPORTANT An important notice contains information essential to software or hardware operation. Typographical Conventions EMC uses the following type style conventions in this document. Normal Used in running (nonprocedural) text for: • Names of interface elements (such as names of windows, dialog boxes, buttons, fields, and menus) • Names of resources, attributes, pools, Boolean expressions, buttons, DQL statements, keywords, clauses, environment variables, functions, utilities • URLs, path names, file names, directory names, computer names, filenames, links, groups, service keys, file systems, notifications Bold Used in running (nonprocedural) text for: • Names of commands, daemons, options, programs, processes, services, applications, utilities, kernels, notifications, system calls, man pages Used in procedures for: • Names of interface elements (such as names of windows, dialog boxes, buttons, fields, and menus) • What user specifically selects, clicks, presses, or types Italic 14 Used in all text (including procedures) for: • Full titles of publications referenced in text • Emphasis (for example a new term) • Variables Replacement of Field Replaceable Units — EMC Greenplum DCA Preface Where to Get Help Courier Used for: • System output, such as an error message or script • URLs, complete paths, filenames, prompts, and syntax when shown outside of running text Courier bold Used for: • Specific user input (such as commands) Courier italic Used in procedures for: • Variables on command line • User input variables < > Angle brackets enclose parameter or variable values supplied by the user [ ] Square brackets enclose optional values | Vertical bar indicates alternate selections - the bar means “or” { } Braces indicate content that you must specify (that is, x or y or z) ... Ellipses indicate nonessential information omitted from the example EMC support, product, and licensing information can be obtained as follows. Product information — For documentation, release notes, software updates, or for information about EMC products, licensing, and service, go to the EMC Powerlink Web site (registration required) at: http://Powerlink.EMC.com Technical support — For technical support, go to Powerlink and choose Support. On the Support page, you will see several options, including one for making a service request. Note that to open a service request, you must have a valid support agreement. Please contact your EMC sales representative for details about obtaining a valid support agreement or with questions about your account. Your Comments Your suggestions will help us continue to improve the accuracy, organization, and overall quality of the user publications. Please send your opinions of this document to: techpubcomments@emc.com Replacement of Field Replaceable Units — EMC Greenplum DCA 15 Preface 16 Replacement of Field Replaceable Units — EMC Greenplum DCA 1 Introduction This chapter provides an overview about removing, installing, and storing FRUs, avoiding electostatic discharge, and field service requirements for replacing FRUs for an EMC Greenplum Data Computing Appliance (DCA) and EMC Greenplum Data Integration Accelerator (DIA). It includes: Identify the DCA Software Version ............................................................................ 18 Overview ........................................................................................................................ 19 System Components ..................................................................................................... 21 Introduction 17 Introduction Identify the DCA Software Version The replacement procedures in this guide only pertain to DCA clusters with software version 1.0.3.x. DCA documentation is tied to a version of the DCA Software. Before beginning any replacement procedure on a DCA, you should verify the software version matches the version of guide you are using. Perform the following steps to identify the DCA Software Version: 1. Log into the Primary Master Server of the DCA as the user root. For instructions on how to log in to the server from your laptop, refer to “How to Connect to the DCA in the Field” on page 108. 2. View the contents of the /opt/greenplum/conf/build‐version.txt file. Verify the ISO_VERSION value is 1.0.3.x # cat /opt/greenplum/conf/build-version.txt ISO_BUILD_DATE="Fri Mar 11 12:01:37 PST 2010" ISO_VERSION="1.0.3.0" ISO_BUILD_VERSION="9" 3. If the version displayed is not 1.0.3.x, download the documentation from Powerlink for that software version. 18 Replacement of Field Replaceable Units — EMC Greenplum DCA Introduction Overview These Field Upgrade Instructions document the procedure for replacing FRUs for the following EMC Greenplum systems: EMC Greenplum Data Computing Appliance (DCA) ‐ Balanced and Capacity • GP10 • GP100 • GP1000 • GP1000+1 Scale‐Out EMC Greenplum Data Integration Accelerator (DIA) • DIA10 • DIA100 • DIA1000 There are a number of FRUs including: Servers • Complete Server • Disk Drives • Power Supplies Switches • Complete switch • Power Supply (Brocade 8000 only) • Fans (Brocade 8000 only) Cabling • Twin‐axial cables • Power Cables • Cat6 Ethernet Cables The following sections provide an overview on removing, installing, or storing FRUs, avoiding electostatic discharge, and field service requirements. Replacement of server components, including disk drives, power supplies, or chassis by unauthorized personnel can void service warranties. Removing, Installing, or Storing FRUs Follow these precautions to protect FRUs: Do not remove a failed FRU from the cabinet until you have the replacement available. Do not remove the replacement FRU from its antistatic bag and/or container until you are ready to install it. After installing the FRU, save the bag/container in case you need to return the FRU at a later time. Handle the replacement FRU gently and with care. Do not use excessive force to remove or install an FRU. Overview 19 Introduction Avoiding Electrostatic Discharge Damage (ESD) When replacing or installing field replaceable units (FRUs), inadvertent damage to the sensitive electronic circuits in the equipment can occur simply by touching them. Electrostatic charge that has accumulated on your body can discharge through the circuits. If the air in the work area is dry, running a humidifier in the work area can help decrease the risk of electrostatic discharge (ESD) damage. Read and understand the following guidelines: 20 Provide enough room to work on the equipment. Clear the work site of any unnecessary materials or those that naturally build up electrostatic charge such as foam packaging, foam cups, cellophane wrappers, and similar items. Do not remove replacement or upgrade FRUs from their antistatic packaging until you are ready to install them. Set up your EMC‐issued ESD kit and all other materials needed before servicing a Greenplum system. Once servicing begins, avoid moving away from the work site; otherwise, your body can build up an electrostatic charge. Use the ESD kit when handling system components. Use an ESD wristband. Attach the clip of the ESD wristband to any bare (unpainted) metal in the bay; then place the wristband around your wrist with the metal button against your skin. Replacement of Field Replaceable Units — EMC Greenplum DCA Introduction System Components The EMC Greenplum Data Computing Appliance (DCA) and Greenplum DIA consists of the following components: DCA/DIA Components Table 1 DCA and DIA Components Component Purpose Quantity Admin Switch • Purpose is to provide administrative access to all the DCA and DIA components. • Out-of-band (Database) management and monitoring of the entire DCA and DIA. 1 Master Servers (Primary and Standby) *The Greenplum DIA does not contains any master servers. • Distributes the work load between the EMC Greenplum Database segment instances. • Authenticates client connections. • Processes incoming SQL commands. • Coordinates the results returned by each of the segment instances. • Presents the final results to the client program. 2 DCA Segment or DIA Server • Acts as a host to the Greenplum Database segment instances. • Each Segment Server runs six (6) active segment instances and six (6) mirror segment instances. • The database segment instances on the Segment Servers handle data processing and storage. • In the Greenplum DIA, these servers run the loading processes to the DCA. 8 Interconnect Switch • Enables high-speed communication between all nodes (Master Servers and Segment Servers) in the DCA. • Provides connectivity to DIA hosts for data loads. • The Interconnect Switch consists of two (2) Brocade 8000 CEE/FCoE switches. 2 Greenplum GP10 (Half-Rack) Components Table 2 Greenplum GP10 (Quarter-Rack) Components Component Quantity Admin Switch 1 Master Server 2 Segment Server 4 Interconnect Switch 2 System Components 21 Introduction Greenplum GP100 (Half-Rack) Components Table 3 Greenplum GP100 (Half-Rack) Components Component Quantity Admin Switch 1 Master Server 2 Segment Server 8 Interconnect Switch 2 Greenplum GP1000 (One-Rack) Components Table 4 Greenplum GP1000 (One-Rack) Components Component Quantity Admin Switch 1 Master Server 2 Segment Server 16 Interconnect Switch 2 Greenplum GP1000 +1 Scale-Out (Two-Rack) Components Table 5 22 Greenplum GP1000 +1 Scale-Out (Two-Rack) Components Component Quantity Admin Switch 2 Master Server 2 Segment Server 32 Interconnect Switch 4 Replacement of Field Replaceable Units — EMC Greenplum DCA Introduction Greenplum DIA DIA10 (Quarter Rack) Table 6 DIA10 (Quarter Rack)Components Component Quantity Admin Switch 1 DIA Hosts 4 Interconnect Switch 2 Greenplum DIA DIA100 (Half Rack) Table 7 DIA100 (Half Rack)Components Component Quantity Admin Switch 1 DIA Hosts 8 Interconnect Switch 2 Greenplum DIA DIA1000 (Full Rack) Table 8 DIA1000 (Full Rack)Components Component Quantity Admin Switch 1 DIA Hosts 16 Interconnect Switch 2 System Components 23 Introduction DCA Configuration Diagrams The following diagrams show the front and rear views of the DCA configurations: Quarter-Rack Appliance Front View Rear View EMC 40U-C cabinet (Rack) ATI 9924TL Admin Switch a-SW-1 a-SW-1 Brocade 8000 Interconnect Bus i-SW-2 i-SW-1 smdw mdw S AS SAS SAS S AS SAS SAS S AS SAS SAS S AS SAS SAS Switch 2 Brocade 8000 Switch 1 Dell 610 Standby Master Dell 610 Primary Master EST EST i-SW-2 1 2 1 2 Gb 1 Gb2 Gb 3 Gb 4 Gb 1 Gb2 Gb 3 Gb 4 i-SW-1 smdw mdw SAS 600GB 15K SAS 600GB 15K SAS 1 2 Gb 1 3 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K 600GB 15K SAS SAS 600GB 15K SAS 600GB 15K SAS SAS 600GB 15K 1 ST sdw4 600GB 15K Dell R510 4 Segment Servers sdw4 2 SAS 600GB 15K 600GB 15K SAS SAS 1 2 Gb 1 3 600GB 15K SAS 600GB 15K 600GB 15K SAS SAS 600GB 15K SAS SAS 600GB 15K 600GB 15K SAS SAS 600GB 15K 600GB 15K SAS SAS 600GB 15K 1 ST sdw3 600GB 15K Gb 2 sdw3 2 SAS 600GB 15K 600GB 15K SAS SAS 1 2 Gb 1 3 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K 600GB 15K SAS SAS 600GB 15K SAS 600GB 15K SAS SAS 600GB 15K 1 ST sdw2 600GB 15K Gb 2 sdw2 2 SAS 600GB 15K 600GB 15K SAS SAS 2 3 Gb 2 Figure 1 24 Greenplum GP10 (Front and Rear View of Quarter-Rack) Replacement of Field Replaceable Units — EMC Greenplum DCA 1 Gb 1 600GB 15K SAS 600GB 15K 600GB 15K SAS SAS 600GB 15K SAS SAS 600GB 15K 600GB 15K SAS SAS 600GB 15K 600GB 15K SAS SAS 600GB 15K 1 ST sdw1 600GB 15K Gb 2 2 sdw1 SAS SAS SAS 600GB 15K SAS 600GB 15K SAS SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 60 0GB 15K SAS 60 0GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 60 0GB 15K SAS 60 0GB 15K SAS 60 0GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS SAS 600GB 15K 1 SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K 600GB 15K 600GB 15K SAS SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K 600GB 15K 600GB 15K SAS SAS 600GB 15K SAS 600GB 15K SAS 1 SAS SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 60 0GB 15K S AS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS SAS Dell 510 8 Segment Servers 2 ST 600GB 15K SAS SAS SAS S AS ST sdw1 SAS S AS ST sdw2 E ST S AS Switch 2 Brocade 8000 Switch 1 Dell 610 Standby Master Dell 610 Primary Master ST sdw3 E ST EMC 40U-C cabinet (Rack) ST sdw4 600GB 15K i-SW-2 ST sdw5 SAS a-SW-1 2 ST sdw6 600GB 15K sdw7 SAS sdw8 600GB 15K Front View ST SAS i-SW-1 smdw mdw 600GB 15K Introduction Half-Rack Appliance Rear View ATI 9924TL Admin Switch a-SW-1 Brocade 8000 Interconnect Bus i-SW-2 1 2 1 2 Gb 1 Gb2 Gb 3 Gb 4 Gb 1 Gb2 Gb 3 Gb 4 i-SW-1 smdw mdw G b1 G b2 1 3 2 3 1 2 1 3 1 1 2 3 1 1 G b1 2 3 1 1 G b1 2 3 1 1 G b1 2 G b2 3 2 1 1 G b1 3 2 1 G b1 System Components sdw8 G b1 G b2 2 sdw7 G b1 G b2 2 sdw6 G b2 2 sdw5 G b2 2 sdw4 sdw3 G b2 2 sdw2 G b2 2 sdw1 Greenplum GP100 (Front and Rear View of Half-Rack) 25 26 SAS SAS SAS 600GB 15K 1 SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS SAS SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K 600GB 15K 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS SAS 600GB 15K 1 SAS 600GB 15K SAS 60 0GB 15K SAS 60 0GB 15K 600GB 15K 600GB 15K SAS SAS 60 0GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K 600GB 15K 600GB 15K SAS SAS 600GB 15K SAS 600GB 15K S AS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K S AS SAS 600GB 15K SAS 600GB 15K SAS SAS Replacement of Field Replaceable Units — EMC Greenplum DCA Dell 510 8 Segment Servers 2 Greenplum GP1000 (Front and Rear View of One-Rack) ST Figure 2 S AS Switch 2 Brocade 8000 Switch 1 Dell 610 Standby Master Dell 610 Primary Master ST sdw1 S AS S AS SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K 600GB 15K 600GB 15K SAS SAS 600GB 15K SAS 600GB 15K Brocade 8000 Interconnect Bus ST sdw2 S AS S AS SAS SAS SAS 600GB 15K SAS 600GB 15K 2 SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K 600GB 15K 600GB 15K SAS SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K Dell 510 8 Segment Servers ST sdw3 SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K 600GB 15K 600GB 15K SAS SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K SAS 600GB 15K EMC 40U-C cabinet (Rack) ST sdw4 S AS SAS ST sdw5 E ST SAS 2 ST sdw6 E ST ST sdw7 600GB 15K sdw8 SAS a-SW-1 ST i-SW-1 smdw mdw 600GB 15K sdw9 1 ST i-SW-2 ST sdw10 ST sdw11 SAS Front View ST sdw12 ST sdw13 ST sdw14 600GB 15K sdw15 ST SAS sdw16 600GB 15K Introduction One-Rack Appliance Full-Rack Appliance Rear View ATI 9924TL Admin Switch 1 1 2 1 2 Gb 2 Gb 1 Gb 2 Gb 3 Gb4 Gb 1 Gb 2 Gb 3 Gb4 3 1 a-SW-1 Gb 1 Gb 2 2 Gb 1 3 1 2 2 1 3 1 1 Gb 1 2 3 1 Gb 1 2 Gb 1 3 1 2 2 3 2 1 1 Gb 1 3 2 2 Gb 1 Gb 1 3 1 2 2 3 2 Gb 1 1 3 2 1 1 3 1 1 2 3 1 1 Gb 1 2 3 1 1 Gb 1 2 3 1 1 Gb 1 2 3 1 1 Gb 1 3 2 1 Gb 1 2 sdw16 Gb 2 2 sdw15 Gb 2 2 1 sdw14 Gb 2 1 sdw13 Gb 2 sdw12 Gb 2 1 sdw11 Gb 2 1 sdw10 Gb 2 sdw9 i-SW-2 i-SW-1 smdw mdw Gb 2 2 sdw8 Gb 1 Gb 2 2 sdw7 Gb 1 Gb 2 2 sdw6 Gb 2 2 sdw5 Gb 2 2 sdw4 Gb 2 2 sdw3 Gb 2 2 sdw2 sdw1 Introduction Two-Rack Appliance Figure 3 Greenplum GP1000 +1 Scale-Out (Front View of Two-Rack) System Components 27 Introduction Figure 4 28 DIA10 (Front and Rear View) Replacement of Field Replaceable Units — EMC Greenplum DCA Introduction Figure 5 DIA100 (Front and Rear View) System Components 29 Introduction Figure 6 30 DIA1000 (Front and Rear View) Replacement of Field Replaceable Units — EMC Greenplum DCA 2 Dell PowerEdge R610 Master or Standby Server This chapter describes how to replace the Dell PowerEdge R610 Master or Standby server. Overview ........................................................................................................................ 32 Replacing Dell R610 Primary Master and Standby Master Servers....................... 33 Scenario 1: Standby Master is Active — Must Replace Primary Master............... 34 Scenario 2: Must Replace Primary Master — Still Serving As Active Master...... 38 Scenario 3: Must Replace Standby Master — Primary Master is Active............... 39 Scenario 4: No Greenplum Database is Initialized ‐ Must Replace Primary or Standby Master Server.................................................................................................. 41 Installing the Replacement Server into a Rack.......................................................... 45 Dell PowerEdge R610 Master or Standby Server 31 Dell PowerEdge R610 Master or Standby Server Overview Replacing the Primary or Secondary Server (Dell R610) involves removing the failed server from the cabinet, moving its hard disks to the replacement server and installing the new Master server to the cabinet in the same slot as the old server. To resume operation of the Greenplum Database, a manual failover process needs to be executed on the Standby Server. Once the database is back online, then the Primary Master can be replaced. To get the Greenplum Database back into operation, you need to activate the Standby Server in its place. Once the database is back online using the Standby Server, then you can replace the server. Tools The following tools are required: #2 Phillips screwdriver Wrist grounding strap Service Tag Location When replacing any hardware component, it is important to properly de‐brief the part. The Master Server serial number tag is located on a pull‐out tab on the bottom left corner of the server. Identify DCA Software Version Before continuing with the replacement, verify the DCA Software version is 1.0.3.x. Follow the steps in “Identify the DCA Software Version” on page 18. 32 Replacement of Field Replaceable Units — EMC Greenplum DCA Dell PowerEdge R610 Master or Standby Server Replacing Dell R610 Primary Master and Standby Master Servers There are three scenarios for replacing the Master Servers as detailed in the following sections: “Scenario 1: Standby Master is Active — Must Replace Primary Master” on page 34 “Scenario 2: Must Replace Primary Master — Still Serving As Active Master” on page 38 “Scenario 3: Must Replace Standby Master — Primary Master is Active” on page 39 “Scenario 4: No Greenplum Database is Initialized ‐ Must Replace Primary or Standby Master Server” on page 41 Replacing Dell R610 Primary Master and Standby Master Servers 33 Dell PowerEdge R610 Master or Standby Server Scenario 1: Standby Master is Active — Must Replace Primary Master The following scenario will occur if remote support has performed a Standby Master failover. You will need to replace the failed server and fail back so each server retains its primary role. 1. Activate the server identification light on the Primary Master Server by pushing the button on the front or back panels of the server. This causes the LCD panel on the front, and the system status indicator on the chassis back panel, to flash blue until you push one of the buttons again. 2. If the failed Primary Master Server is accessible through SSH, log into the server as the user root. If the Primary Master Server is NOT accessible through SSH, skip to step 4. For instructions on how to log in to the server from your laptop, refer to “How to Connect to the DCA in the Field” on page 108. 3. Issue the following command to shutdown the server: shutdown -h now 4. If the server is not accessible through SSH, shutdown the server by pressing the power button. Note: If you experience performance issues with the Dell iDRAC Virtual Console (for example, slow/delayed keystroke response), see “Using the iDRAC Serial Console Emulator” on page 129 to configure an alternate connection method. 5. Label and disconnect all cables from the server you are replacing. 6. Remove the failed server from the rack. See “Removing the Server from the Cabinet” on page 46 for details. The server is very heavy. EMC recommends use of a lift‐tool or two service personnel when removing servers. 7. Install the replacement server into the rack. See “Installing the Replacement Server into a Rack” on page 45 for details. 8. Swap one drive slot at a time between the failed Segment Server and the replacement server. IMPORTANT Use caution and be careful when swapping drives. Only swap one drive at a time. 9. Connect the power, ethernet, and twin‐ax cables to the new server. Refer to your cable labeling to ensure correct positioning. 10. From the working master server, issue the following commands to identify the IP address of the new server: # service dhcpd stop # service dhcpd start # tail /var/log/messages 34 Replacement of Field Replaceable Units — EMC Greenplum DCA Dell PowerEdge R610 Master or Standby Server Aug 16 11:28:09 mdw dhcpd: DHCPACK on 172.28.4.197 to 84:2b:2b:15:b4:2d (idrac-B7DKXP1) via eth0 The value in BOLD is the IP Address that was assigned to the new hardware. Use this IP Address to connect to the server’s iDRAC port. 11. Set the iDRAC IP address from its manufacturing default of DHCP to the IP address for mdw - 172.28.0.250. For details, refer to “Reconfiguring iDRAC IP Address” on page 115 12. Log back into the iDRAC through its correct IP address. Under the Virtual Console Preview section, click Launch. The console viewer opens. 13. Click OK if any security warnings appear in your web browser. 14. Select Power > Power On System. Click OK. The system will begin to boot. 15. Upon boot, the system displays an error indicating that it has found a foreign disk configuration. Figure 7 Foreign Disk Configuration — First Message Prompt 16. Press the F key to import the configuration. The replacement server might reboot after the import. Figure 8 Foreign Disk Configuration — Second Message Prompt Scenario 1: Standby Master is Active — Must Replace Primary Master 35 Dell PowerEdge R610 Master or Standby Server If the F key is not pressed within 10 seconds, the script will show a message “All of the disks from your previous configuration is gone, if this is an unexpected error, then please power off your system and check your cables to ensure all disks are present.” Power off the server and verify all LED lights are off. Power on the server and retry this part of the procedure. 17. Press any key to continue. Verify that the following screen output text displays: “4 Virtual Drives(s) handled by BIOS” This output only displays for one to three seconds. If you do not see this output, or the operating system fails to boot up, contact EMC support. 18. Log in as ‘root’ with the password “changeme”. Issue the following commands to modify the network settings to function with the new server chassis. If the path /opt/greenplum/bin does not exist, use /opt/greenplum/gpclone instead. # source /usr/local/greenplum-db/greenplum_path.sh # cd /opt/greenplum/bin # ifconfig –a Note: Make sure you see ethernet interfaces eth0, eth1, eth2, and eth3. You should not see interfaces that start with __tmp. # /etc/init.d/network stop # ./setMac.py mdw # /etc/init.d/network start 19. Verify that the drives have been successfully mounted by running the following command: # mount You should see an entry for /data. Figure 9 Message Prompt 20. SSH into the Standby Master Server and ping the replaced server on all of its interfaces to ensure that the server is back online. Run the following commands: # ping mdw-sp 36 Replacement of Field Replaceable Units — EMC Greenplum DCA Dell PowerEdge R610 Master or Standby Server # ping mdw-cm # ping mdw # ping mdw-2 Note: If any of the interfaces display the message “Destination Host Unreachable” there is a communication issue. Verify that your cables are connected to the correct ports. If you continue to experience issues, contact the EMC Support Center for assistance. 21. From the Standby Master Server, login as gpadmin and run the following command: $ gpinitstandby -s mdw 22. Stop the Greenplum database on the Standby Master by running the following command: $ gpstop -m IMPORTANT This step causes database unavailability. Make sure the customer is aware of this issue. 23. SSH into the Primary Master Server and log in as gpadmin (this is the server that you just replaced). 24. Run the following command to activate the server as the Primary Master Server: gpactivatestandby -f -d $ MASTER_DATA_DIRECTORY 25. Run the following command to verify that the Primary Master Server that you just replaced is synchronized: gpstate -f Figure 10 Verify the Primary Server is Synchronized Note: If the status displays that it is synchronizing, wait a few minutes and re‐run the command. Proceed to the next step when “synchronized” is displayed. 26. Revert the Standby Master Server back to its original role as a Standby Server. From the Standby Master Server (smdw) and run the following command: rm –r /data/master/* From the Primary Master Server (mdw), run the following command: gpinitstandby -s smdw Scenario 1: Standby Master is Active — Must Replace Primary Master 37 Dell PowerEdge R610 Master or Standby Server Scenario 2: Must Replace Primary Master — Still Serving As Active Master Plan a downtime schedule at the customer site. Procedure A will result in less downtime than Procedure B. Procedure A To replace the Primary Master Server when it is still serving as the active Primary Master Server, you can failover to the Standby Server during replacement. Failing over to the Standby Server is necessary if the customer requires a shorter downtime period. 1. Ensure the Standby Server is valid. Verify the summary state displays “synchronized.” Issue the following command: gpstate -f See Figure 10 on page 37. 2. Shut down the master instance. Run the following command: gpstop -m 3. Failover to the Standby Master Server by running the following command: gpactivatestandby -d $MASTER_DATA_DIRECTORY 4. Replace the Primary Master Server, follow step 1 on page 34 to step 26 on page 37 Procedure B If the Primary Master Server needs to be replaced (but it is still serving as the active Primary Master Server) and a longer downtime has been schedule with the customer, you can replace the Primary Master Server without failing over to the Standby Master Server. 1. Ensure the Standby Server is valid. Verify the summary state displays “synchronized.” Issue the following command: gpstate -f See Figure 10 on page 37. 2. Shut down the Greenplum Database by running the following command: gpstop 3. Replace the Primary Master Server, follow step 1 on page 34 to step 20 on page 36 4. Once you have completed the previous steps, continue to the next step. 5. Run the following command from the Primary Master Server to start the Greenplum database: gpstart 38 Replacement of Field Replaceable Units — EMC Greenplum DCA Dell PowerEdge R610 Master or Standby Server Scenario 3: Must Replace Standby Master — Primary Master is Active Follow this procedure if the Standby Master Server requires replacement. The Primary Master Server should still be operational and serving as the active master server. 1. Activate the server identification LED on the Standby Server by pressing the identification button on the front or rear of the server. 2. Connect your laptop to the system, refer to “Connecting to the DCA from a Workstation” on page 107 for details. 3. Connect to the Master Server through SSH (for example, using the IP address 172.28.4.250). 4. Confirm the standby serverʹs failed status by running the following command: gpstate -f The Standby status displays as “Status could not be determined.” Figure 11 Standby Status 5. Remove the Standby Master Server from the configuration using the gpinitstandby -r command. When prompted, enter Y to continue. Figure 12 Removing the Standby Server 6. Change to the user root $ su 7. Shutdown the server # shutdown -h now 8. Physically remove the failed server and replace with the new server. Refer to “Installing the Replacement Server into a Rack” on page 45 for instructions on how to perform this step. 9. Swap one drive at a time from the failed Master Server to the new server. Scenario 3: Must Replace Standby Master — Primary Master is Active 39 Dell PowerEdge R610 Master or Standby Server Be careful you do not confuse drives between the old and the new. 10. From the working master server, issue the following commands to identify the IP address of the new server: # service dhcpd stop # service dhcpd start # tail /var/log/messages Aug 16 11:28:09 mdw dhcpd: DHCPACK on 172.28.4.197 to 84:2b:2b:15:b4:2d (idrac-B7DKXP1) via eth0 The value in BOLD is the IP Address that was assigned to the new hardware. Use this IP Address to connect to the server’s iDRAC port. Note: Set the iDRAC IP address from its manufacturing default of DHCP to the IP address for smdw - 172.28.0.251. For details, refer to “Reconfiguring iDRAC IP Address” on page 115 11. Power up the replacement server. 12. Upon boot, the system displays an error indicating that it has found a foreign disk configuration. See Figure 7 on page 35 for this message prompt. 13. Press the F key to import the configuration. The replacement server might reboot after the import. See on page 36 for this message prompt. If the F key is not pressed within 10 seconds, the script will show a message “All of the disks from your previous configuration is gone, if this is an unexpected error, then please power off your system and check your cables to ensure all disks are present.” Power off the server and verify all LED lights are off. Power on the server and retry this part of the procedure. 14. Press any key to continue. Verify that the following screen output text displays: “4 Virtual Drives(s) handled by BIOS” This output only displays for one to three seconds. If you do not see this output, or the operating system fails to boot up, contact EMC support. 15. Log in as gpadmin with the password “changeme”. 16. From the Master Server, re‐initialize the Standby Master Server by running the following command: gpinitsystem -s smdw 40 Replacement of Field Replaceable Units — EMC Greenplum DCA Dell PowerEdge R610 Master or Standby Server Scenario 4: No Greenplum Database is Initialized - Must Replace Primary or Standby Master Server The following scenario will occur if you are installing a DCA and a hardware failure is discovered on a Primary or Standby Master server.. 1. Activate the server identification light on the Primary Master Server by pushing the button on the front or back panels of the server. This causes the LCD panel on the front, and the system status indicator on the chassis back panel, to flash blue until you push one of the buttons again. 2. If the failed server is accessible through SSH, log into the server as the user root. If the Primary Master Server is NOT accessible through SSH, skip to step 4. For instructions on how to log in to the server from your laptop, refer to “How to Connect to the DCA in the Field” on page 108. 3. Issue the following command to shutdown the server: shutdown -h now 4. If the server is not accessible through SSH, shutdown the server by pressing the power button. Note: If you experience performance issues with the Dell iDRAC Virtual Console (for example, slow/delayed keystroke response), see “Using the iDRAC Serial Console Emulator” on page 129 to configure an alternate connection method. 5. Label and remove the cables from the server you are replacing. 6. Remove the failed server from the rack. See “Removing the Server from the Cabinet” on page 46 for details. The server is very heavy. EMC recommends use of a lift‐tool or two service personnel when removing and installing servers. 7. Install the replacement server into the rack. See “Installing the Replacement Server into a Rack” on page 45 for details. 8. Swap one drive slot at a time between the failed Segment Server and the replacement server. IMPORTANT Use caution and be careful when swapping drives. Only swap one drive at a time. 9. Connect the power, ethernet, and twin‐ax cables to the new server. Refer to your cable labeling to ensure correct positioning. 10. From the working master server, issue the following commands to identify the IP address of the new server: # service dhcpd stop # service dhcpd start # tail /var/log/messages Scenario 4: No Greenplum Database is Initialized - Must Replace Primary or Standby Master Server 41 Dell PowerEdge R610 Master or Standby Server Aug 16 11:28:09 mdw dhcpd: DHCPACK on 172.28.4.197 to 84:2b:2b:15:b4:2d (idrac-B7DKXP1) via eth0 The value in BOLD is the IP Address that was assigned to the new hardware. Use this IP Address to connect to the server’s iDRAC port. 11. Set the iDRAC IP address from its manufacturing default of DHCP to the IP address for mdw or smdw - 172.28.0.250 / 172.28.0.251. For details, refer to “Reconfiguring iDRAC IP Address” on page 115 12. Log back into the iDRAC through its correct IP address. Under the Virtual Console Preview section, click Launch. The console viewer opens. 13. Click OK if any security warnings appear in your web browser. 14. Select Power > Power On System. Click OK. The system will begin to boot. 15. Upon boot, the system displays an error indicating that it has found a foreign disk configuration. Figure 13 Foreign Disk Configuration — First Message Prompt 16. Press the F key to import the configuration. The replacement server might reboot after the import. Figure 14 42 Foreign Disk Configuration — Second Message Prompt Replacement of Field Replaceable Units — EMC Greenplum DCA Dell PowerEdge R610 Master or Standby Server If the F key is not pressed within 10 seconds, the script will show a message “All of the disks from your previous configuration is gone, if this is an unexpected error, then please power off your system and check your cables to ensure all disks are present.” Power off the server and verify all LED lights are off. Power on the server and retry this part of the procedure. 17. Press any key to continue. Verify that the following screen output text displays: “4 Virtual Drives(s) handled by BIOS” This output only displays for one to three seconds. If you do not see this output, or the operating system fails to boot up, contact EMC support. 18. Log in as ‘root’ with the password “changeme”. 19. Issue the following commands to modify network settings to function with the new server chassis. If the path /opt/greenplum/bin does not exist, use /opt/greenplum/gpclone instead. # source /usr/local/greenplum-db/greenplum_path.sh # cd /opt/greenplum/bin # ifconfig –a Note: Make sure you see ethernet interfaces eth0, eth1, eth2, and eth3. You should not see interfaces that start with __tmp. # /etc/init.d/network stop # ./setMac.py mdw # /etc/init.d/network start 20. Verify that the drives have been successfully mounted by running the following command: # mount You should see an entry for /data. Figure 15 Verify /data type xfs is mounted 21. SSH into the Standby Master Server (if you replaced the Primary Master Server) or the Primary Master Server (if you replaced the Standby Master Server) and ping the replaced server on all of its interfaces to ensure that the server is back online. Scenario 4: No Greenplum Database is Initialized - Must Replace Primary or Standby Master Server 43 Dell PowerEdge R610 Master or Standby Server For example, if you replaced a primary master server, run the following commands: # ping mdw-sp # ping mdw-cm # ping mdw # ping mdw-2 Note: If any of the interfaces display the message “Destination Host Unreachable” there is a communication issue. Verify that your cables are connected to the correct ports. If you continue to experience issues, contact the EMC Support Center for assistance. 44 Replacement of Field Replaceable Units — EMC Greenplum DCA Dell PowerEdge R610 Master or Standby Server Installing the Replacement Server into a Rack This section describes how to install a replacement server into a rack. It is divided into the following sections: Mounting Kit Parts “Mounting Kit Parts” on page 45 “Task 1: Removing the Server from the Cabinet” on page 46 “Task 2: Attaching the Inner Rails” on page 48 “Task 3: Installing the server in the cabinet” on page 49 The server mounting kit includes rails and hardware as listed in the following table. Component Use Two adjustable universal slide rails Attach front to back on either side between NEMA channels (includes inner rails for connection to server) Two Phillips M5 18 mm screws Stabilize the rail mounting Installing the Replacement Server into a Rack 45 Dell PowerEdge R610 Master or Standby Server Task 1: Removing the Server from the Cabinet 1. Remove all power, Ethernet, and Twin‐axial cables from the back of the server. Label the cables so they can be easily identified when they are connected to the replacement server. 2. Remove the stabilizer screws behind the latch brackets on each side. See Figure 16. CL4536 Figure 16 Removing the Stabilizer Screws 3. Pull the inner rail release buttons, then pull the server forward until it extends into the locked position. See Figure 17. 46 Replacement of Field Replaceable Units — EMC Greenplum DCA Dell PowerEdge R610 Master or Standby Server CL4539 Figure 17 Releasing the Inner Rail 4. Slide the white disconnect tabs forward to release the inner rails from the slides, then slowly pull the server forward. See Figure 18 on page 47. The server is heavy and should be removed from a rack by two people. To avoid personal injury and/or damage to the equipment, do not attempt to lift and install the server into a rack without a mechanical lift and/or help from another person. 11 2 CL4354a Figure 18 Releasing the Inner Rail Lock Installing the Replacement Server into a Rack 47 Dell PowerEdge R610 Master or Standby Server 5. Carefully remove the server from the cabinet. See Figure 19. CL4355 Figure 19 Removing a Server from a Cabinet Task 2: Attaching the Inner Rails Figure 20 shows how to attach inner rails to each side of the server. 1. Align the protruding rail notches with the connection studs on the server. 2. Push the rail along the server until the studs fit securely into the notches; an audible click indicates that the rail is secure. Click! CL4347a Figure 20 48 Attaching Inner Rails Replacement of Field Replaceable Units — EMC Greenplum DCA Dell PowerEdge R610 Master or Standby Server Task 3: Installing the server in the cabinet The enclosure is heavy and should be installed into a rack by two people. To avoid personal injury and/or damage to the equipment, do not attempt to lift and install the enclosure into a rack without a mechanical lift and/or help from another person. 1. Figure 21 shows how to install the server in the rackmount cabinet. From the front of the cabinet, align the inner rails attached to the server with the mounting channels on the slide rails. 2. Slide the server into the slide rails. CL4349 Figure 21 Inserting the Server in the Cabinet Installing the Replacement Server into a Rack 49 Dell PowerEdge R610 Master or Standby Server 50 Replacement of Field Replaceable Units — EMC Greenplum DCA 3 DCA Segment and DIA Server Replacement This chapter describes how to replace the Dell PowerEdge R510 DCA Segment and DIA Server, remove the failed server in its chassis, and swap the disk drives into the new server. Replacing the Dell R510 DCA Segment and DIA Server......................................... 52 How to Install and Remove a Server to and from the Rack.................................... 64 DCA Segment and DIA Server Replacement 51 DCA Segment and DIA Server Replacement Replacing the Dell R510 DCA Segment and DIA Server Total server failure is when all segments on that host are down and those segments fail over to the mirrors. Total server failure causes all Greenplum Database Segment Instances to fail over to their mirror Segment servers. On a Greenplum DIA, server failure will result in degraded performance as the loading processes on the DIA host will be unavailable. Replacing the Dell PowerEdge R510 server involves removing the failed server from its chassis then removing the disk drives and installing them in the new server. Note: This procedure requires a brief Greenplum Database downtime if replacing a Segment Server. Verify that the customer is aware of the downtime and that the replacement schedule is agreed upon. There is no downtime to the Greenplum Database if an Greenplum DIA server fails. Tools The following tools are required: #2 Phillips screwdriver Wrist grounding strap Service Tag Location When replacing any hardware component, it is important to properly de‐brief the part. The segment and DIA servers serial number tag is located on a pull‐out tab on the bottom left corner of the server. Identify DCA Software Version Before continuing with the replacement, verify the DCA Software version is 1.0.3.x. Follow the steps in “Identify the DCA Software Version” on page 18. 52 Replacement of Field Replaceable Units — EMC Greenplum DCA DCA Segment and DIA Server Replacement Reseat Cables before Replacement Before replacement of a segment or DIA server, cables should be removed and re‐connected to validate the issue the server is experiencing isn’t due to a faulty connection. Perform these steps before continuing with replacement. 1. Activate the server identification light by pushing the button on the front or back panels of the server (large button with the letter “i” on it). Note: If the server is completely non‐operational, the light might not work. 2. Connect your service laptop to the DCA as described in “Connecting to the DCA from a Workstation” on page 107. Note: If you experience performance issues with the Dell iDRAC Virtual Console (for example, slow/delayed keystroke response), see “Using the iDRAC Serial Console Emulator” on page 129 to configure an alternate connection method. 3. Login to the Primary Master Server as the user root (for example, use IP Address 172.28.4.250). 4. Power down the server. If the server can be accessed by SSH: Enter the following command. Replace the hostname in BOLD with the hostname of the segment server you are working on: # ssh sdw1 # shutdown -h now If the server cannot be accessed by SSH: Verify it is powered down, use the power button on the front of the server if necessary. 5. Once the server is powered off, unplug and reconnect the admin network cable, two interconnect cables, and two power supply AC cables. Figure 22 shows the connections which should be reseated. Figure 22 Reseat cables connected to server ports 6. Power on the server by pressing the power button located on the front of the server. 7. Wait 5 minutes for the server to boot ‐ from the Primary Master server, issue the ping command to each interface of the server. Replace the text in BOLD with the hostname of the server you are working on: # ping sdw1-cm # ping sdw1-1 Reseat Cables before Replacement 53 DCA Segment and DIA Server Replacement # ping sdw1-2 8. If there is no response, the server should be replaced. If the server can be reached on ALL interfaces, a replacement is not necessary. Issue the commands below to recover the segment instances ‐ this does not apply if the server is part of a DIA. # su - gpadmin $ gprecoverseg $ gpstop -r Note: The step in italics will restart the Greenplum Database. Verify this is OK with the customer before issuing the gpstop command. Replacing a Failed Segment/DIA Server Follow one of the procedures below based on the failure scenario of the server: The Failed Server is running an Active Greenplum Database “The Failed Server is running an Active Greenplum Database” “The Failed Server is NOT running an active Greenplum Database” This procedure should be followed on a Segment Server that was part of a DCA running Greenplum Database. This procedure includes instructions to replace the server hardware as well as Greenplum Database commands that must be run to recover segment instances. 1. Activate the server identification light by pushing the button on the front or back panels of the server (large button with the letter “i” on it). Note: If the server is completely non‐operational, the light might not work. 2. Connect your service laptop to the DCA as described in “Connecting to the DCA from a Workstation” on page 107. Note: If you experience performance issues with the Dell iDRAC Virtual Console (for example, slow/delayed keystroke response), see “Using the iDRAC Serial Console Emulator” on page 129 to configure an alternate connection method. 3. Login to the Primary Master Server as the gpadmin user (for example, use IP Address 172.28.4.250). 4. If the server you are replacing is in the Greenplum DIA, skip to Step 6. 5. Perform one of the following actions: If the Segment Server is still accessible via SSH: 1. Confirm that the mirrors are synchronized for that server by running the gpstate -m command on the Master Server. 2. Verify that the Data status column indicates that the mirrors for the server being taken offline are synchronized. 54 Replacement of Field Replaceable Units — EMC Greenplum DCA DCA Segment and DIA Server Replacement Note: If the mirrors are not synchronizing, contact the EMC Support Lab. If the server has failed completely: 1. Run the gpstate -s command on the Master Server to confirm that the Greenplum database has marked the Segment Server as down. 2. In the output, locate the Segment Server that has failed and verify that the Segment status row displays “Down in configuration.” This means that the Greenplum database has identified the server as failed. 6. Power down the failed server. 7. Label and disconnect cables from the failed server. 8. Remove the failed server from the rack. See “How to Install and Remove a Server to and from the Rack” on page 64 for details. The server is very heavy. EMC recommends use of a lift‐tool or two service personnel when removing servers. 9. Install the new server into the rack. 10. Swap one drive slot at a time between the failed Segment/DIA Server and the replacement server. IMPORTANT Use caution and be careful when swapping drives. Only swap one drive at a time. 11. Connect the power, ethernet, and twin‐ax cables to the new server. Refer to your cable labeling to ensure correct positioning. DO NOT POWER ON THE SERVER. 12. From the master server, issue the following commands to identify the IP address of the new server: Reseat Cables before Replacement 55 DCA Segment and DIA Server Replacement # service dhcpd stop # service dhcpd start # tail /var/log/messages Aug 16 11:28:09 mdw dhcpd: DHCPACK on 172.28.4.197 to 84:2b:2b:15:b4:2d (idrac-B7DKXP1) via eth0 The value in BOLD is the IP Address that was assigned to the new hardware. Use this IP Address to connect to the server’s iDRAC port. 13. Set the iDRAC IP address from its manufacturing default of DHCP to the IP address for the segment server you are replacing sdw#- 172.28.0.#. For details, refer to “Reconfiguring iDRAC IP Address” on page 115 14. Log back into the iDRAC via its correct IP address. Under the Virtual Console Preview section, click Launch. The console viewer opens. 15. Click OK if any security warnings appear in your web browser. 16. Select Power > Power On System. Click OK. The system will begin to boot. 17. Upon boot, the system displays an error indicating that it has found a foreign disk configuration. Figure 23 56 Foreign Disk Configuration - First Message Prompt Replacement of Field Replaceable Units — EMC Greenplum DCA DCA Segment and DIA Server Replacement 18. Press the F key to import the configuration. The replacement server might reboot after the import. Figure 24 Foreign Disk Configuration - Second Message Prompt If the F key is not pressed within 10 seconds, the script will show a message “All of the disks from your previous configuration is gone, if this is an unexpected error, then please power off your system and check your cables to ensure all disks are present.” Power off the server and verify all LED lights are off. Power on the server and retry this part of the procedure. 19. Press any key to continue. Verify that the following screen output text displays: “4 Virtual Drives(s) handled by BIOS” This output only displays for one to three seconds. If you do not see this output, or the operating system fails to boot up, contact EMC support. 20. The system will load the operating system. In a few minutes, the login prompt appears. Log in as root with the password “changeme”. 21. Run the following commands to modify the network to function on the new server chassis. If the path /opt/greenpum/bin does not exist, use /opt/greenplum/gpclone instead. # source /usr/local/greenplum-db/greenplum_path.sh # cd /opt/greenplum/bin # ifconfig –a Make note of the MAC address of the adapter eth1 Note: Make sure you see ethernet interfaces eth0, eth1, eth2, and eth3. You should not see interfaces that start with __tmp. # /etc/init.d/network stop # ./setMac.py [hostname] where “hostname” is sdw# or etl# based on the server number that was replaced. Reseat Cables before Replacement 57 DCA Segment and DIA Server Replacement 22. If the server replaced was an DIA host, edit the file /etc/sysconfig/network-scripts/ifcfg-eth1 and change the the HWADDR setting using the MAC address listed in Step 20. The value to change is in bold. All other settings should remain as is: DEVICE=eth1 BOOTPROTO=static IPADDR=10.6.193.46 NETMASK=255.255.252.0 ONBOOT=YES MTU=1500 HWADDR=b8:ac:6f:15:92:73 23. Run the following command to start the network services after changing MAC addresses: # /etc/init.d/network start 24. Verify that the drives have been successfully mounted by running the following command. You should see an entry for /data1 and /data2: # mount Figure 25 Message Prompt 25. Log into the Master Server as the user gpadmin, ping the replaced server on all of its interfaces to ensure that the server is back online. 26. Run the following commands: $ ping sdw#-sp $ ping sdw#-cm $ ping sdw#-1 $ ping sdw#-2 where, # is the Segment Server number you just replaced. Replace sdw with etl if the server is part of the Greenplum DIA. 58 Replacement of Field Replaceable Units — EMC Greenplum DCA DCA Segment and DIA Server Replacement Note: If any of the interfaces display the message “Destination Host Unreachable” there is a communication issue, contact the EMC Support Center for assistance. 27. If you are replacing a Greenplum DIA server, the replacement procedure is now complete. Continue to Step 28 if you replaced a DCA Segment Server. 28. Run the gprecoverseg recovery utility. $ gprecoverseg 29. Select Y to continue at the prompt. 30. After gprecoverseg completes, run the gpstate -m command to verify the status of the data resynchronization process. 31. Run gpstate -m again until the status displays as synchronized. Allow a few minutes for the synchronization. The status during resynchronization displays as resynchronizing. Once complete, the status displays as synchronized. This means that the primary and mirrored segments are synchronized. 32. Run gpstop ‐r to return the Greenplum system to its optimal configuration. Note: This step briefly brings down the Greenplum database. 33. Run gpstate -e and verify that no segments are listed. If there is no output, this indicates that there are no segments with error conditions 34. De‐activate the server identification light when service is complete by pushing the button on the front or back panels of the server. The Failed Server is NOT running an active Greenplum Database This procedure should only be used if you are replacing a DCA host that was part of an un‐initialized system or a DIA host. An un‐initialized system has not been installed yet, or is new hardware to be used for an upgrade. This procedure involves swapping drives from the failed server to the new server. Make sure you swap one drive slot at a time as specified in Step 10. 1. Activate the server identification light by pushing the button on the front or back panels of the server (large button with the letter “i” on it). Depending on the failure of the server, the identification light may not work. 2. Connect your service laptop to the DCA as described in “Connecting to the DCA from a Workstation” on page 107. Reseat Cables before Replacement 59 DCA Segment and DIA Server Replacement Note: If you experience performance issues with the Dell iDRAC Virtual Console (for example, slow/delayed keystroke response), see “Using the iDRAC Serial Console Emulator” on page 129 to configure an alternate connection method. 3. Login to the Primary Master Server as the gpadmin user (for example, use IP Address 172.28.4.250). 4. Label and remove cables from the failed server. 5. Remove the failed server from the rack. See “How to Install and Remove a Server to and from the Rack” on page 64 for details. The server is very heavy. EMC recommends use of a lift‐tool or two service personnel when removing servers. 6. Install the new server into the rack. 7. Swap one drive slot at a time between the failed Segment/DIA Server and the replacement server. IMPORTANT Use caution and be careful when swapping drives. Only swap one drive at a time. 8. Connect the power, ethernet, and twin‐ax cables to the new server. Refer to your cable labeling to ensure correct positioning. DO NOT POWER ON THE SERVER. 9. Set the iDRAC IP address from its manufacturing default to the address of its rack position. For details, refer to “Reconfiguring iDRAC IP Address” on page 115. 10. Log back into the iDRAC via its correct IP address. Under the Virtual Console Preview section, click Launch. The console viewer opens. 11. Click OK if any security warnings appear in your web browser. 12. Select Power > Power On System. Click OK. The system will begin to boot. 13. Upon boot, the system displays an error indicating that it has found a foreign disk configuration. 60 Replacement of Field Replaceable Units — EMC Greenplum DCA DCA Segment and DIA Server Replacement Figure 26 Foreign Disk Configuration - First Message Prompt 14. Press the F key to import the configuration. The replacement server might reboot after the import. Figure 27 Foreign Disk Configuration - Second Message Prompt If the F key is not pressed within 10 seconds, the script will show a message “All of the disks from your previous configuration is gone, if this is an unexpected error, then please power off your system and check your cables to ensure all disks are present.” Power off the server and verify all LED lights are off. Power on the server and retry this part of the procedure. 15. Press any key to continue. Verify that the following screen output text displays: “4 Virtual Drives(s) handled by BIOS” This output only displays for one to three seconds. If you do not see this output, or the operating system fails to boot up, contact EMC support. 16. The system will load the operating system. In a few minutes, the login prompt appears. Log in as root with the password “changeme”. Reseat Cables before Replacement 61 DCA Segment and DIA Server Replacement 17. Run the following commands to modify the network to function with the new server chassis. If the path /opt/greenplum/bin does not exist, use /opt/greenplum/gpclone instead. # source /usr/local/greenplum-db/greenplum_path.sh # cd /opt/greenplum/bin # ifconfig –a Make note of the MAC address of the adapter eth1 Note: Make sure you see ethernet interfaces eth0, eth1, eth2, and eth3. You should not see interfaces that start with __tmp. # /etc/init.d/network stop # ./setMac.py [hostname] where “hostname” is sdw# or etl# based on the server number that was replaced. 18. If the server replaced was a DIA host, you must set the external interface IP address. Edit the file /etc/sysconfig/network-scripts/ifcfg-eth1 and change the the HWADDR setting using the MAC address listed in Step 16. The value to change is in bold. All other settings should remain as is: DEVICE=eth1 BOOTPROTO=static IPADDR=10.6.193.46 NETMASK=255.255.252.0 ONBOOT=YES MTU=1500 HWADDR=b8:ac:6f:15:92:73 19. Run the following command to start the network services after changing MAC addresses: # /etc/init.d/network start 20. Verify that the drives have been successfully mounted by running the following command. You should see an entry for /data1 and /data2: # mount 62 Replacement of Field Replaceable Units — EMC Greenplum DCA DCA Segment and DIA Server Replacement Figure 28 Message Prompt 21. Run the following commands: # ping sdw#-sp # ping sdw#-cm # ping sdw#-1 # ping sdw#-2 where, # is the Segment Server number you just replaced. Replace sdw with etl if the server is part of the Greenplum DIA. Note: If any of the interfaces display the message “Destination Host Unreachable” there is a communication issue, contact the EMC Support Center for assistance. Reseat Cables before Replacement 63 DCA Segment and DIA Server Replacement How to Install and Remove a Server to and from the Rack This section describes how to remove an existing segment server from and install a replacement Segment Server into a rack. It is divided into the following sections: Mounting Kit Parts “Mounting Kit Parts” on page 64 “Task 1: Removing the Server from the Cabinet” on page 64 “Task 2: Attaching the Inner Rails to the New Server” on page 65 “Task 3: Installing the Server in the Cabinet” on page 65 The server mounting kit includes rails and hardware as listed in the following table. Component Use Two adjustable universal slide rails Attach front to back on either side between NEMA channels (includes inner rails for connection to server) Some product implementations do not include a front bezel. Task 1: Removing the Server from the Cabinet 1. Remove all power, Ethernet, and other cables from the back of the server. Label the cables so they can be easily identified when they are connected to the replacement server. 2. Loosen the captive stabilizing screws from the rails on each side. 3. From the back of the rack, push the server forward slightly. 4. From the front of the rack, pull the server forward. If you pull the server forward, it will come completely out of the rack. 64 Replacement of Field Replaceable Units — EMC Greenplum DCA DCA Segment and DIA Server Replacement Task 2: Attaching the Inner Rails to the New Server 1. Remove the inner rails from the server you are replacing by pulling out the clips at the front of the server to release the rails. 2. On the new server, align the protruding rail notches with the connection studs on the server as shown in Figure 29. Click! CL4347 Figure 29 Attaching Inner Rails to the New Server 3. Push the rail along the server until the studs fit securely into the notches; an audible click indicates that the rail is secure. Task 3: Installing the Server in the Cabinet The enclosure is heavy and should be installed into a rack by two people. To avoid personal injury and/or damage to the equipment, do not attempt to lift and install the enclosure into a rack without a mechanical lift and/or help from another person. Figure 30, shows how to install the server in the rackmount cabinet: 1. From the front of the cabinet, align the inner rails attached to the server with the mounting channels on the slide rails. 2. Slide the server into the slide rails. How to Install and Remove a Server to and from the Rack 65 DCA Segment and DIA Server Replacement CL4349 Figure 30 Inserting the Server in the Cabinet 3. Tighten the captive screws at the front of the server to secure it to the rack. 66 Replacement of Field Replaceable Units — EMC Greenplum DCA 4 Drive Replacement This section describes replacing a failed drive in the Dell R610 Primary Master or Standby Server or a Dell R510 DCA Segment and DIA Server. Replacing a Drive in the Dell R610 Master or Standby Server ............................... 68 Replacing a Drive in the Dell R510 DCA Segment and DIA Server ...................... 70 Drive Replacement 67 Drive Replacement Replacing a Drive in the Dell R610 Master or Standby Server Replacing a drive on a Primary Master or Standby Server (Dell 600 KB 10 K RPM SAS 2.5‐inch disk drive in an 11 G disk sled) consists of the following tasks: Identifying the failed drive Replacing the failed drive All drives are installed at the front of the server and connect to the system board through the SAS backplane. Hard drives are supplied in special hot‐swappable hard‐drive carriers that fit in the hard‐drive bays. Use only drives that have been tested and approved by EMC for use with the SAS backplane board. Use appropriate ESD precautions, including the use of a grounding strap, when performing the drive replacement procedure. Identifying the Failed Drive Before you can replace the failed drive, you must confirm which drive has failed and confirm the drive specified for replacement is the failed drive. 1. Activate the server identification light by pushing the button on the front or back panels of the server. This causes the LCD panel on the front and the system status indicator on the chassis back panel to flash blue until you push one of the buttons again. 2. Notice that each drive sled has LED indicators that show the current status of the drive. A failed drive has an amber LED indicator or the green indicator flashes with a fixed, regular interval. 3. If your information from the dial‐home contains a drive number, reference the diagram below for drive position information in the Dell R610 chassis: 68 DISK 0 DISK 2 DISK 4 DISK 1 DISK 3 DISK 5 Replacement of Field Replaceable Units — EMC Greenplum DCA Drive Replacement Replacing the Failed Drive 1. Press the release button, open the drive handle, and pull the failed hard drive from the server chassis. See Figure 31. Figure 31 Removing and Replacing a Drive When installing a hard drive, ensure that the adjacent drives are fully installed. Inserting a hard‐drive carrier and attempting to lock its handle next to a partially installed carrier can damage the partially installed carrierʹs shield spring and make it unusable. 2. Install the hard drive. a. Press the button on the front of the drive carrier and open the handle. b. Insert the hard‐drive carrier into the drive bay until the carrier contacts the backplane. c. Close the handle to lock the drive in place. The LED on the drive turns green and flashes as it automatically starts rebuilding. 3. De‐activate the server identification LED. Replacing a Drive in the Dell R610 Master or Standby Server 69 Drive Replacement Replacing a Drive in the Dell R510 DCA Segment and DIA Server This section describes replacing a failed drive. Replacing the drive consists of the following steps: Identifying the failed drive Replacing the failed drive Note: A single disk failure should not cause a segment to go down if using RAID; however, there might be a performance impact. All drives are installed at the front of the server and connect to the system board through the SAS backplane ‐ the backplane is compatible with SATA and SAS drives. Hard drives are supplied in special hot‐swappable hard‐drive carriers that fit in the hard‐drive bays. Use only drives that have been tested and approved for use with the SAS backplane board. Do not turn off or reboot your system while the drive is being formatted as this can cause a drive failure. Use appropriate ESD precautions, including the use of a grounding strap, when performing the drive replacement procedure. Identifying the Failed Drive Before you can replace the failed drive, you must identify which drive has failed. 1. Activate the server identification light by pushing the button on the front or back panels of the server. 2. Notice that each drive sled has LED indicators that show the current status of the drive. A failed drive has an amber LED indicator or the green indicator flashes with a fixed, regular interval. Figure 32 70 Drive Status LED Indicators Replacement of Field Replaceable Units — EMC Greenplum DCA Drive Replacement 3. If your information from the dial‐home contains a drive number, reference the diagram below for drive position information in the Dell R510 chassis: Replacing the failed drive DISK 0 DISK 3 DISK 6 DISK 9 DISK 1 DISK 4 DISK 7 DISK 10 DISK 2 DISK 5 DISK 8 DISK 11 Once you have identified the failed drive: 1. Press the release button, open the drive handle, and pull the failed hard drive from the server chassis See Figure 33. 2. Make note of the capacity specified on the drive label of the OLD drive. Verify this capacity matches the NEW drive. Drives are available as 600GB SAS and 2TB SATA ‐ these cannot be mixed within a system. Figure 33 Removing and Replacing a Drive When installing a hard drive, ensure that the adjacent drives are fully installed. Inserting a hard‐drive next to a partially installed carrier can damage the partially installed carrier and make it unusable. 3. Install the hard drive as shown in Figure 33 on page 71. a. Press the button on the front of the drive carrier and open the handle. b. Insert the hard‐drive carrier into the drive bay until the carrier contacts the backplane. c. Close the handle to lock the drive in place. The LED on the drive turns green and flashes as it automatically starts rebuilding. 4. De‐activate the server identification light when service is complete. The drive replacement procedure is complete. Replacing a Drive in the Dell R510 DCA Segment and DIA Server 71 Drive Replacement 72 Replacement of Field Replaceable Units — EMC Greenplum DCA 5 Power Supply Replacement This chapter describes how to replace the various power supply field replacement instructions for the DCA and DIA system. Replacing a Server Power Supply in the Dell R610.................................................. 74 Replacing a Server Power Supply in the Dell R510.................................................. 76 Power Supply Replacement 73 Power Supply Replacement Replacing a Server Power Supply in the Dell R610 The server is powered by redundant, hot‐swappable power supplies (Dell R610 717 high‐output power supply) that slide into the rear of the server chassis. Once you have identified the failed power supply, you can replace it and return the system to normal operation. This section describes how to replace a failed power supply. Replacing a server power supply consists of the following tasks: Identifying the failed power supply Removing the power supply Replacing the power supply Note: The power supplies are “hot‐swappable” and can be replaced during normal system operation. Use appropriate ESD precautions, including the use of a grounding strap, when performing the power supply replacement procedure. Identifying the Failed Power Supply 1. Verify the power supply that has failed. The server power supplies have LED indicators that turn amber when the power supply has failed. The LED on a failed power supply may not display any light depending on how badly the power supply has failed. 2. Activate the server identification light before starting any service by pushing the button on the front or back panels of the server. 3. Verify that the LED on the redundant power supply is green. On the R610s, a server that has a failed component does not have a blue light on the left of the server. See Figure 34. Figure 34 74 Power Supply LED Indicators Replacement of Field Replaceable Units — EMC Greenplum DCA Power Supply Replacement Removing the Power Supply To remove and replace the power supply: The power supply might be hot. Use caution when removing the failed power supply. 1. Disconnect the power cable from the power source and the power supply you intend to remove. 2. Press the lever release latch and slide the power supply out of the chassis. See Figure 35 on page 75. Figure 35 Replacing the Power Supply Removing and Replacing a Power Supply To replace the power supply: 1. Ensure that the new power supply part number ‐ located on the packaging not on the part ‐ matches the power supply you removed. They should have the same type and same maximum output power. Note: The maximum output power (shown in watts) is listed on the power supply label. 2. Slide the new power supply into the chassis until the power supply is fully seated and the release latch snaps into place. See Figure 35 on page 75. 3. Connect the power cable to the power supply and plug the cable into a power outlet and secure it with the Velcro straps. 4. De‐activate the server identification light. Note: When installing a new power supply, allow several seconds for the system to recognize the power supply and determine its status. The power‐supply status indicator turns green to signify that the power supply is functioning properly. The amber light on the front of the server goes out. 5. The power supply replacement procedure is complete. Replacing a Server Power Supply in the Dell R610 75 Power Supply Replacement Replacing a Server Power Supply in the Dell R510 The server is powered by redundant, hot‐swappable power supplies located in the back of the cabinet. Once you have identified the failed power supply, you can replace it and return the system to normal operation. This section describes how to replace a failed power supply. Replacing a server power supply consists of the following tasks: Identifying the failed power supply Removing the power supply Replacing the power supply Note: The power supplies are “hot‐swappable” and can be replaced during normal system operation. Use appropriate ESD precautions, including the use of a grounding strap, when performing the power supply replacement procedure. Task 1: Identifying the Failed Power Supply 1. Before you can replace a failed power supply verify the power supply that has failed. The server power supplies have LED indicators that turn amber when the power supply has failed. 2. Activate the server identification light before starting any service by pushing the button on the front or back panels of the server. Verify that the LED on the redundant power supply is green. See Figure 36. Figure 36 76 Power Supply LED Indicators Replacement of Field Replaceable Units — EMC Greenplum DCA Power Supply Replacement Task 2: Removing the Power Supply 1. Disconnect the power cable from the power supply you intend to remove. 2. Press the lever release latch and slide the power supply out of the chassis. See Figure 37 on page 77. Figure 37 Removing and Replacing a Power Supply The power supply might be hot. Use caution when removing the failed power supply. Task 3: Replacing the Power Supply Note: The maximum output power (shown in watts) is listed on the power supply label. 1. Ensure that the new power supply part number (EMC P/N 105‐000‐201), located on the packaging not on the part, matches the power supply you removed. They should have the same type and same maximum output power. 2. Slide the new power supply into the chassis until the power supply is fully seated and the release latch snaps into place. See Figure 37. 3. Connect the power cable to the power supply and plug the cable into a power outlet. When connecting the power cable, secure the cable with the Velcro strap. Note: When installing a new power supply, allow several seconds for the system to recognize the power supply and determine its status. The power‐supply status indicator turns green to signify that the power supply is functioning properly. 4. The power supply replacement procedure is complete. Replacing a Server Power Supply in the Dell R510 77 Power Supply Replacement 78 Replacement of Field Replaceable Units — EMC Greenplum DCA 6 Switch Replacement This chapter describes procedures to replace a failed Brocade 8000 switch or a failed AT‐9924TL switch. Replacing a Failed Brocade 8000 Fully‐configured Switch..................................... 80 Replacing the Brocade 8000 Power Supply ............................................................... 91 Replacing the AT‐9924TL Switch ................................................................................ 96 Switch Replacement 79 Switch Replacement Replacing a Failed Brocade 8000 Fully-configured Switch Replacing a Brocade 8000 switch involves removing the failed switch in its chassis, then installing the new switch and configuring it. Figure 38 on page 81 shows a detailed view of each port in the Brocade 8000 switch. Tools The following tools are recommended: Wrist grounding strap 9‐Pin serial cable (RJ‐45 to 9‐pin) Materials to label 20 cables Note: If your laptop is not equipped with a serial cable, you must use a USB serial adapter in additional to a serial cable. Phillips #2 screwdriver 1/4‐inch slotted‐blade screwdriver Identify DCA Software Version Before continuing with the replacement, verify the DCA Software version is 1.0.3.x. Follow the steps in “Identify the DCA Software Version” on page 18. Removing the Failed Switch 1. Identify the failed switch in the rack, refer to Figure 1 on page 24. 2. Verify that each cable connected to the switch is properly labeled. A proper label indicates the server and port where the cable originates and the port number on the brocade switch the cable uses. Do not disconnect any cable that is not labeled; label the cable prior to disconnect if necessary. 3. Switch off the Brocade switches through the switches on the power supplies, then disconnect all cables and power leads. 4. Remove the Brocade switch from the rack. Remove the rails from the failed switch and attach them to the new switch before sliding it into the rack. 80 Replacement of Field Replaceable Units — EMC Greenplum DCA Switch Replacement Figure 38 Brocade 8000 Switch — Back Panel Figure 39 Brocade 8000 Switch in Greenplum DIA - Back Panel Replacing a Failed Brocade 8000 Fully-configured Switch 81 Switch Replacement Installing the Replacement Switch 1. Install the replacement switch in the rack. 2. Reconnect the cables to the replacement switch in the same layout. Refer to cable labeling. 3. Power on the switch via power supply switches in front of switch. Verify that the power supply LEDs turn green after a few seconds. 4. Connect a serial cable between the serial port (console port in Figure 38) on the new switch and your workstation and prepare to establish serial communications. 5. Use Putty to establish a connection. 6. Select Serial in Basic Options under the Session section. Figure 40 Serial Option in a Putty Session 7. Expand the connection section and select Serial. Verify the settings for the COM port are 9600 Baud, 8 data bits, and no hardware flow control. 82 Replacement of Field Replaceable Units — EMC Greenplum DCA Switch Replacement 8. Click Open to connect. 9. Press <Enter> to display the login prompt. 10. Log in using the administrative account; the logon is “admin” and the default password is “password.” 11. Change the admin, root, and factory default passwords when prompted. Enter “changeme” as the passwords. 12. Enter the ipaddrset command at the prompt. Refer to Table 9 when prompted for IP address, subnet mask, and gateway. Table 9 Brocade IP Addresses Switch Name Position in Rack IP Address/Subnet Mask/Gateway Vlan ID i-sw-1 bottom (DCA GP1000) 172.28.0.170 255.255.248.0 /172.28.4.250 199 i-sw-2 top (DCA GP1000) 172.28.0.180/ 255.255.248.0 /172.28.4.250 299 i-sw-3 bottom (DCA GP1000+1) 172.28.0.171 / 255.255.248.0 / 172.28.4.250 199 Replacing a Failed Brocade 8000 Fully-configured Switch 83 Switch Replacement Table 9 Brocade IP Addresses Switch Name Position in Rack IP Address/Subnet Mask/Gateway Vlan ID i-sw-4 top (DCA GP1000+1) 172.28.0.181 / 255.255.248.0 / 172.28.4.250 299 e-sw-1 bottom (Greenplum DIA) 172.28.2.252 / 255.255.248.0 / 172.28.4.250 199 e-sw-2 top (Greenplum DIA) 172.28.2.253 / 255.255.248.0 / 172.28.4.250 299 13. Verify the IP address was correctly set by entering the ipaddrshow command at the prompt. 14. Enter the switchname command at the command line, using the following syntax: switchname newname where ‘newname’ is the new name for the switch. Refer to Table 9 for the switch name. Note: The switch can now be accessed through SSH. 15. Disconnect your serial cable and SSH into the switch you just replaced. Refer to “How to Connect to the DCA in the Field” on page 108 for information on connecting to the switch through SSH. Refer to Table 9 for the IP address for the switch you just replaced. 16. Set the time zone according to location. By default, all switches are in the GMT time zone (0,0). For example, to set the time zone: tsTimeZone 0,0 17. Set the switch date and time, enter the date command at the command line as follows: Date MMDDhhmmYY The values represent the following: • MM is the month, valid values are 01‐12 • DD is the date, valid values are 01‐31 • hh is the hour, valid values are 00‐23 • mm is minutes, valid values are 00‐59 • YY is the year, valid values are 00‐99 18. The CEE configuration must be entered into the switch. Enter the following command: cmsh 19. Log into the switch with username ‘admin’ and “changeme” as the password. 20. Enter the following commands: cmsh write erase exit 84 Replacement of Field Replaceable Units — EMC Greenplum DCA Switch Replacement reboot Note: The switch reboots and logs you out. Log back in with username and password as entered in the previous step. cmsh config term 21. Enter the following configuration. Replace the values in BOLD with the correct Vlan ID ‐ 199 or 299 ‐ based on position of the switch from Table 9 on page 83. mac-address-table aging-time 0 no protocol spanning-tree protocol spanning-tree rstp vlan classifier rule 3 proto arp encap ethv2 vlan classifier rule 4 proto ip encap ethv2 vlan classifier group 2 add rule 3 vlan classifier group 2 add rule 4 interface Vlan 1 interface Vlan 199 description vlan 199 interface Port-channel 1 switchport switchport mode trunk switchport trunk allowed vlan add 199 no shutdown interface Port-channel 2 switchport switchport mode trunk switchport trunk allowed vlan add 199 no shutdown interface TenGigabitEthernet 0/0 switchport switchport mode access vlan classifier activate group 2 vlan 199 no shutdown spanning-tree edgeport spanning-tree edgeport bpdu-guard interface TenGigabitEthernet 0/1 switchport switchport mode access Replacing a Failed Brocade 8000 Fully-configured Switch 85 Switch Replacement vlan classifier activate group 2 vlan 199 no shutdown spanning-tree edgeport spanning-tree edgeport bpdu-guard interface TenGigabitEthernet 0/2 switchport switchport mode access vlan classifier activate group 2 vlan 199 no shutdown spanning-tree edgeport spanning-tree edgeport bpdu-guard interface TenGigabitEthernet 0/3 switchport switchport mode access vlan classifier activate group 2 vlan 199 no shutdown spanning-tree edgeport spanning-tree edgeport bpdu-guard interface TenGigabitEthernet 0/4 switchport switchport mode access vlan classifier activate group 2 vlan 199 no shutdown spanning-tree edgeport spanning-tree edgeport bpdu-guard interface TenGigabitEthernet 0/5 switchport switchport mode access vlan classifier activate group 2 vlan 199 no shutdown spanning-tree edgeport spanning-tree edgeport bpdu-guard interface TenGigabitEthernet 0/6 switchport switchport mode access vlan classifier activate group 2 vlan 199 no shutdown 86 Replacement of Field Replaceable Units — EMC Greenplum DCA Switch Replacement spanning-tree edgeport spanning-tree edgeport bpdu-guard interface TenGigabitEthernet 0/7 switchport switchport mode access vlan classifier activate group 2 vlan 199 no shutdown spanning-tree edgeport spanning-tree edgeport bpdu-guard interface TenGigabitEthernet 0/8 switchport switchport mode access vlan classifier activate group 2 vlan 199 no shutdown spanning-tree edgeport spanning-tree edgeport bpdu-guard interface TenGigabitEthernet 0/9 switchport switchport mode access vlan classifier activate group 2 vlan 199 no shutdown spanning-tree edgeport spanning-tree edgeport bpdu-guard interface TenGigabitEthernet 0/10 switchport switchport mode access vlan classifier activate group 2 vlan 199 no shutdown spanning-tree edgeport spanning-tree edgeport bpdu-guard interface TenGigabitEthernet 0/11 switchport switchport mode access vlan classifier activate group 2 vlan 199 no shutdown spanning-tree edgeport spanning-tree edgeport bpdu-guard Replacing a Failed Brocade 8000 Fully-configured Switch 87 Switch Replacement interface TenGigabitEthernet 0/12 switchport switchport mode access vlan classifier activate group 2 vlan 199 no shutdown spanning-tree edgeport spanning-tree edgeport bpdu-guard interface TenGigabitEthernet 0/13 switchport switchport mode access vlan classifier activate group 2 vlan 199 no shutdown spanning-tree edgeport spanning-tree edgeport bpdu-guard interface TenGigabitEthernet 0/14 switchport switchport mode access vlan classifier activate group 2 vlan 199 no shutdown spanning-tree edgeport spanning-tree edgeport bpdu-guard interface TenGigabitEthernet 0/15 switchport switchport mode access vlan classifier activate group 2 vlan 199 no shutdown spanning-tree edgeport spanning-tree edgeport bpdu-guard interface TenGigabitEthernet 0/16 switchport switchport mode access vlan classifier activate group 2 vlan 199 no shutdown spanning-tree edgeport spanning-tree edgeport bpdu-guard interface TenGigabitEthernet 0/17 switchport 88 Replacement of Field Replaceable Units — EMC Greenplum DCA Switch Replacement switchport mode access vlan classifier activate group 2 vlan 199 no shutdown spanning-tree edgeport spanning-tree edgeport bpdu-guard interface TenGigabitEthernet 0/18 channel-group 2 mode active type brocade no shutdown lacp timeout short interface TenGigabitEthernet 0/19 channel-group 2 mode active type brocade no shutdown lacp timeout short interface TenGigabitEthernet 0/20 channel-group 1 mode active type brocade no shutdown lacp timeout short interface TenGigabitEthernet 0/21 channel-group 1 mode active type brocade no shutdown lacp timeout short interface TenGigabitEthernet 0/22 channel-group 1 mode active type brocade no shutdown lacp timeout short interface TenGigabitEthernet 0/23 channel-group 1 mode active type brocade no shutdown lacp timeout short protocol lldp line console 0 login line vty 0 31 login end 22. Once the ports have been configured, enter the following commands to save changes and exit: Replacing a Failed Brocade 8000 Fully-configured Switch 89 Switch Replacement switch# config term switch(config)# write mem Overwrite Changes? y switch(config)# exit switch# exit Resynchronzing the Database After Replacing a Switch When one of the DCA interconnect switches fails, you should still have a Greenplum Database system up and running. There are two interconnect networks, and the initialization process makes sure that a primary and its corresponding mirror are on different networks (switches). This section does not apply during a switch failure of a Greenplum DIA. A switch failure means that half of the Greenplum segment instances go down, and all database processing of those down segments fails over to the mirrors. With a switch failure you are going to have several segment servers performing double‐duty. Users might experience slower response times. 1. After replacing the switch, SSH into the Master Server and run the following command: gprecoverseg 2. Enter Y when prompted to continue. 3. Once the gprecverseg command is completed, check the state of the ʹResynchronizationʹ process, enter the following command: gpstate -m 4. Run the following command until the status displays as synchronized. gpstate -m 5. Allow a few minutes for the synchronization. Once complete, the status displays as synchronized. This means that the primary and mirrored segments are synchronized. 6. Enter the following command to return all segments to their preferred role: gpstop -r The switch replacement is now complete. 90 Replacement of Field Replaceable Units — EMC Greenplum DCA Switch Replacement Replacing the Brocade 8000 Power Supply The Brocade 8000 has two power supplies. Disassembling any part of the power supply voids the part warranty and regulatory certifications. There are no user‐serviceable parts inside the power supply. The cooling system relies on pressurized air; do not leave either of the power supply slots empty longer than two minutes when the switch is operating. If a power supply fails, leave the power supply in the switch until it can be replaced. Maintain both power supplies in operational condition to provide redundancy. on page 91 describes the power supply status LED colors, behaviors, and actions required, if any. Table 10 Power Supply Status Led Behavior, Description, and Required Actions LED Color Description Action Required No light Power supply is not receiving power or is off. Verify that the power is on and seated and the power cord is connected to a functioning power source. Steady green Power supply is operating normally. No action is required. Steady amber (for more than five seconds) Power supply fault for one of the following reasons: Try one of the following: Power supply is switched off Power cable is disconnected Power supply has failed When the switch is first powered on the power supply status LED displays an amber light until POST has completed. Check the power cable connection Verify that the power supply is powered on Replace the power supply FRU Time Required Replacing a power supply requires less than two minutes to complete. Items Required The following items are required to replace a power supply: Replacing a Power Supply New 350W power supply Phillips‐head screwdriver #1 To replace a power supply unit in the switch: 1. To leave the switch in service while replacing a power supply, verify that the other power supply (the one not being replaced) has been powered on for at least four seconds and has a steady green LED. 2. Power off the power supply by pressing the AC power switch to the “0” symbol. See Figure 41 on page 92 for the location of the AC power switch. Replacing the Brocade 8000 Power Supply 91 Switch Replacement Figure 41 Location of the Power Supplies for the Brocade 8000 3. Unplug the power cord from the power supply that is being replaced. 4. Using a Phillips‐head screwdriver, unscrew the captive screw on the power supply. 5. Remove the power supply from the chassis by pulling the handle on the power supply out, away from the chassis. 6. Install the new power supply in the chassis. Do not force the installation. If the power supply does not slide in easily, ensure that the power supply is correctly oriented before continuing. 7. Orient the power supply as shown in Figure 42 on page 93, with the AC power switch on the left. 8. Gently push the power supply into the chassis until it is firmly seated. 9. Secure the power supply to the chassis by screwing in the captive screw using the Phillips‐head screwdriver. 10. Plug the power cord in to the power supply and power on the unit by pressing the AC power switch to the “1” symbol. 11. Verify that the LED on the new power supply displays a steady green light while the switch is operating (see on page 91). If the LED is not a steady green, ensure that the power supply is securely installed and seated properly. 92 Replacement of Field Replaceable Units — EMC Greenplum DCA Switch Replacement Figure 42 Inserting the Power Supply in the Brocade 8000 Replacing a Brocade 8000 Fan Assembly Figure 43 Fan Assembly into the Brocade 8000 Disassembling any part of the fan assembly voids the part warranty and regulatory certifications. There are no user‐serviceable parts inside the fan assembly. Because the cooling system relies on pressurized air, do not leave any of the fan assembly slots empty longer than two minutes while the switch is operating. If a fan assembly fails, leave it in the switch until it can be replaced. Maintain all three fan assemblies in operational condition to provide redundancy. Replacing the Brocade 8000 Power Supply 93 Switch Replacement describes the power supply status LED colors, behaviors, and actions required, if any. Table 11 Fan Status LED Behavior, Description, and Required Actions LED Color and Behavior Description Action Required No light Fan assembly is not receiving power. Verify that the fan FRU is seat correctly. Steady green Fan assembly is operating normally. No action is required. Steady amber (for more than five seconds) Fan fault for one of the following reasons: Verify that the fan FRU is enabled and if the fan FRU is faulty, it should be replaced. • One or more of the fans in the fan assembly has failed • The fan FRU was disabled by the user Time Required Replacing a fan assembly in the switch should required less than two minutes to complete. Items Required The following items are required to replace a fan assembly in the switch: Replacing a Switch Fan Assembly New single height fan FRU assembly Phillips‐head screwdriver #1. To replace a fan assembly in the switch: 1. With a Phillips‐head screwdriver, unscrew the captive screw on the fan assembly. 2. Pull the handle out, away from the chassis. 3. Install the new fan assembly in the chassis. 4. Orient the new fan assembly as shown in Figure 44 on page 95 with the captive screw on the right. 5. Gently push the fan assembly into the chassis until it is firmly seated. Do not force the installation. If the fan assembly does not slide in easily, ensure that it is correctly oriented before continuing. 6. Using the Phillips‐head screwdriver, secure the fan assembly to the chassis by tightening in the captive screw. 7. Verify that the fan status LED is lit (steady green) to indicate normal operation (see on page 94). 8. Optionally, if using the command line interface, display the fan status using the fanShow command from the command line. The fan status can be also be viewed using the Web Tools application. See Figure 43 on page 93 for the locations of fan assembly 1, fan assembly 2, and fan assembly 3. 94 Replacement of Field Replaceable Units — EMC Greenplum DCA Switch Replacement Figure 44 Inserting the Fan Assembly into the Brocade 8000 Replacing the Brocade 8000 Power Supply 95 Switch Replacement Replacing the AT-9924TL Switch The AT‐9924TL is a 28‐port Gigabit Ethernet switch that functions as the Admin Switch in the DCA and DIA. This procedure provides the steps for replacing a failed Admin Switch. Tools The following tools are recommended: Wrist grounding strap Phillips #2 screwdriver to loosen the blanking plate, if any. Rack‐mount screws and nuts, and a suitable screwdriver. A second person to help lift the switch into the rack. Serial cable (RJ‐45 to 9‐pin) Note: If your laptop does not have a serial port, you also need a USB‐to‐serial adapter. Removing the Failed Switch 1. Label all cables before disconnecting them from the failed switch. 2. Disconnect all cables and power leads. 3. Remove the switch from the rack. Two people are required: one person to lift the switch into the rack and attach it to the front rails, and a second person to safely support it from the rear. Installing and Configuring the AT-9924TL Switch 1. Unpack the switch. 2. Mount the switch into the rack from the front and tighten the rack‐mount screws. 3. Re‐connect the cables to the replacement switch. Refer to your cable labeling to ensure the cables are connected to the correct port. 4. Connect to the switch by connecting the serial cable from your laptop’s serial port to the RJ‐45 serial port on the far left of the switch. 5. Use Putty to establish a connection. 6. Select Serial in Basic Options under the Session section. 96 Replacement of Field Replaceable Units — EMC Greenplum DCA Switch Replacement 7. Expand the connection section and select Serial. Verify the settings for the COM port are 9600 Baud, 8 data bits, and no hardware flow control. 8. Click Open to connect. Replacing the AT-9924TL Switch 97 Switch Replacement 9. Log in with the following credentials: Username: manager Password: friend 10. Enter the following commands: set conf=none restart reboot 11. The switch will reboot. When it completes its boot, enter the username and password as above. 12. Enter the following commands. Replace the ipaddress = value with the correct IP from Table 12: enable ip add ip int=vlan1 ipaddress=172.28.0.190 mask=255.255.248.0 create config=gp.cfg set config=gp.cfg restart reboot Table 12 DCA and DIA Switch IP Addresses Switch Name Switch IP Address DCA or DIA a-sw-1 172.28.0.190 DCA (GP10, GP100, GP1000) a-sw-2 e-sw-3 DCA (GP1000+1) 172.28.4.252 13. Verify that there are no errors as the switch reboots. 98 Replacement of Field Replaceable Units — EMC Greenplum DCA DIA (DIA10, DIA100, DIA1000) 7 Cable Replacement This chapter covers the procedures for replacing cables. How to Replace Cabling............................................................................................. 100 Cable Replacement 99 Cable Replacement How to Replace Cabling This section explains how to replace the BRCD 10 GbE twin‐ax copper 1‐meter 1‐pack (BRSFP‐TX1M1P) and BRCD 10 GbE twin‐ax copper 3‐meter 1‐pack (BRSFP‐TX3M1P) cables. Note: Be sure to follow proper ESD procedures. 1. Locate server with failed twin‐ax cable. Refer to Figure 1 and Figure 2 on page 26 for a diagrams to identify the servers. 2. Press the server identification button to activate the server identification LED. 3. Locate the Brocade 1020 CNA card in the serverʹs expansion slot #3. Figure 45 Brocade Switch 4. Observe the “Link” and “Act” LEDs for each port on the card. If these LEDS are flashing a steady on/off, it indicates a failure on the attached cable. Note: The left port connects to the bottom of the Brocade switch, the right port connects to the top of the Brocade switch. Refer to cabling diagrams for more information. Figure 46 Port LEDs IMPORTANT Verify that only one port is indicating a cable failure. If both ports are indicating a failure, you should not replace cables until diagnosed further. Contact the EMC technical support for assistance. 5. Reference the cable diagrams below to determine the correct switch to remove the other end of the cable. 6. Disconnect both ends of the cable and remove the cable from its cable bundles. 7. Reconnect the new cable to the Brocade CNA card and then to the appropriate Brocade switch. 100 Replacement of Field Replaceable Units — EMC Greenplum DCA Cable Replacement 8. Verify the ʹLinkʹ LED on the Brocade CNA card turns a solid green. 9. Wrap the cable back into its bundle. 10. Refer to the following cable diagrams. 11. Follow step 25 on page 58 to step 33 on page 59 to recover the Segment Server instances that failed over as a result of the bad cable. Figure 47 Cabling from the Segment/DIA Servers to the Upper Brocade 8000 Switch - Port 1 (Left) How to Replace Cabling 101 Cable Replacement Figure 48 102 Cabling from the Segment/DIA Servers to the Upper Brocade 8000 Switch - Port 1 (Left) Replacement of Field Replaceable Units — EMC Greenplum DCA Cable Replacement Figure 49 Cabling from the Segment/DIA Servers to the Lower Brocade 8000 Switch - Port 0 (Right) How to Replace Cabling 103 Cable Replacement Figure 50 104 Cabling from the Segment/DIA Servers to the Lower Brocade 8000 Switch - Port 0 (Right) Replacement of Field Replaceable Units — EMC Greenplum DCA Cable Replacement Figure 51 Cabling from the segment/DIA servers (1 through 8) to the Allied Telesis 9924TL Switch How to Replace Cabling 105 Cable Replacement Figure 52 106 Cabling from the Segment/DIA Servers (9 through 16) to the Allied Telesis 9924TL Switch Replacement of Field Replaceable Units — EMC Greenplum DCA A Connecting to the DCA from a Workstation This appendix contains the following: How to Connect to the DCA in the Field................................................................. 108 Using SCP to Copy a File to the Greenplum Master.............................................. 112 Connecting to the DCA from a Workstation 107 Connecting to the DCA from a Workstation How to Connect to the DCA in the Field Requirements You must have the following hardware and software tools to make the connection: Workstation (for example, a laptop) that has a standard, RJ‐45 Ethernet port is required — The operator of the workstation must have the authority to manipulate the network interface to set IP address information. The workstation must have an SSH, SCP and Telnet client — The Macintosh OS includes these tools. For Windows, Putty, and WinSCP are recommended. A basic knowledge of how to operate in a Linux environment — It is helpful to have an understanding of navigating and editing files in Linux. In addition to the requirements listed above, there is information about the site that must be confirmed prior to beginning any work on a DCA: Determine whether the administration network (the AT9924TL switch or switches) has been connected to the customer network — If so, it is advisable to temporarily disconnect the customer network and the DCA administration network during service.Some service procedures include the use of DHCP from the cluster master node. Having an unanticipated DHCP server that is can be seen from the customer network can interfere with unrelated activities on the customer network. Determine whether or not the administration network IP address scheme has been changed — Customers occasionally change the IP addresses of iDRACs (an iDRAC is the remote management interface on each server) or the first network interface on each server. It is important to know both the IP addresses scheme and the subnet masks used. Without this information, it is not possible to establish a viable connection to the DCA. All service activities for the Greenplum DIA should be done by connecting to the master server of the DCA. 108 Replacement of Field Replaceable Units — EMC Greenplum DCA Connecting to the DCA from a Workstation Table 13 lists default information: Table 13 Default Network Configuration Information Host Type Physical RJ-45 Port Network Interface Name IP Address Netmask Primary Master Node Built-in Port 1 iDRAC 172.28.0.250 255.255.248.0 mdw-sp eth0 172.28.4.250 255.255.248.0 mdw-cm iDRAC 172.28.0.251 255.255.248.0 smdw-sp eth0 172.28.4.251 255.255.248.0 smdw-cm iDRAC 172.28.0.# 255.255.248.0 sdw#-sp eth0 172.28.4.# 255.255.248.0 sdw#-cm iDRAC 172.28.0.20# 255.255.248.0 etl#-sp eth0 172.28.4.20# 255.255.248.0 etl#-cm (mdw) Secondary Master Node Built-in Port 1 (smdw) Segment Nodes Built-in Port 1 (sdw#) a DIA Nodes Built-in Port 1 (etl#) Port Network Name a. Where # is the server number. For example, sdw34 is given 172.28.0.34. Note: The first built‐in port on each server is both the first network interface in the operating system (eth0) and the network interface for the iDRAC. This port has two IP addresses, but only the eth0 address can be used to copy files to or from the DCA. The iDRAC address provides out of band access to each server’s console making it unnecessary to use a physical monitor and keyboard attached to the servers themselves. If the customer has altered the addresses or netmasks, it is important to replace the information in the table above with the new addresses and netmasks so that an open address can be found for use on the engineer’s workstation and the appropriate netmask is used on that workstation. Connecting to the DCA Note: Unless otherwise specified, all connections to the scale out rack (GP1000+1) and Greenplum DIA should be done through the first DCA rack administration switch (i‐sw‐1). 1. Connect the service cable (a red, cat6 cable connected to port 23 of the AT9924TL switch at the top of the first rack) to the engineer’s workstation. 2. Assign the network interface on the workstation an IP address of 172.28.3.253 with a netmask of 255.255.248.0 and no gateway. Note: If the customer has changed the IP address scheme, work with the customer to determine an appropriate IP address and gateway. 3. Open a terminal emulation program (such as Putty). Connect through SSH to the desired server. For example, suppose you want to connect to the operating system of sdw14. Enter the IP Address of the server in the Host Name field and click Open. How to Connect to the DCA in the Field 109 Connecting to the DCA from a Workstation 4. A prompt for the password appears. Based on the desired service activity, you might need to log in as one of the user listed in Note:. Each procedure specifies which account to use. Note: The customer can change passwords. If so, obtain the current passwords from the customer prior to service activity. Table 14 110 Default User Passwords Used by Username Password Greenplum commands gpadmin changeme Operating system root commands root changeme Dell iDRAC administration root calvin Replacement of Field Replaceable Units — EMC Greenplum DCA Connecting to the DCA from a Workstation 5. Once connected to the desired server, perform whatever service is necessary. Table 15 describes the kinds of connections possible and why they might be used: Table 15 DRAC Connection Types Connection Type Connection Method iDRAC, Graphical http Description Browsing to the iDRAC address (https://172.28.0.x by default) provides a graphical interface into the systems management facility. Hardware information and status is available through web browser interface. You can open a virtual console, which emulates a KVM by clicking the Launch Virtual Console button on the main page. Note: You can also remotely connect to the iDRAC web interface. See “Accessing the iDRAC Web Interface with SSH” on page 123 for more information. iDRAC, Serial ssh The serial interface into the iDRAC is accessible by making an SSH connection to the iDRAC. For example, running the SSH command root@172.28.0.251 opens a connection to smdw’s iDRAC. This interface is a command-line interface and starts by giving a command prompt of admin1>. The following commands are helpful in this interface: • start /admin1 starts a powered off server • stop /admin1 forces a running server to stop • reset /admin1 forces a server to power cycle • console com2 connects to the server’s serial console. The user can log in to the OS from here and perform tasks even if the operating system is in single-user mode or the OS has not configured it network interfaces. Finally, the server POST can be monitored here. Operating System, network ssh Through this connection, files can be transferred and any other work that does not require the features of the console can be performed. In most cases, this is the connection that should be used. How to Connect to the DCA in the Field 111 Connecting to the DCA from a Workstation Using SCP to Copy a File to the Greenplum Master The process for copying a file from your local laptop to the Greenplum master host will depend on the scp client you are using (WinSCP, Cygwin, etc.). Regardless of the client, you want to connect using the following connection information. Table 16 Master Host Connection Information hostname 172.28.4.250 username gpadmin root password changeme (this may have been changed by the customer) copy to location on master /home/gpadmin WinSCP Example 1. Log in to the master host IP 172.28.4.250 as user gpadmin. Select SFTP as the File protocol. 112 Replacement of Field Replaceable Units — EMC Greenplum DCA Connecting to the DCA from a Workstation 2. Navigate to the directory containing the file on the LEFT window. Navigate to the desired destination on the RIGHT window. The typical destination to copy files ia /home/gpadmin. Drag the file from the LEFT window to the RIGHT window. If you are copying a file from the remote host to your laptop, drag the file from the RIGHT window to the LEFT window., 3. Click Copy. Progress of the file copy is shown. Using SCP to Copy a File to the Greenplum Master 113 Connecting to the DCA from a Workstation 114 Replacement of Field Replaceable Units — EMC Greenplum DCA B Reconfiguring iDRAC IP Address When DCA replacement servers are initially configured, their iDRACs have an IP address of 192.168.1.100. To reconfigure the network settings, perform the procedure described in “Configuring iDRAC IP Address Through HTTP”. To reconfigure the iDRAC IP address in a situation where the default IP address is not connecting or is unknown, perform the procedure described in “Configuring iDRAC IP Address if the Default IP is Unknown”. Configuring iDRAC IP Address Through HTTP ................................................... 116 Configuring iDRAC IP Address if the Default IP is Unknown............................ 120 Reconfiguring iDRAC IP Address 115 Reconfiguring iDRAC IP Address Configuring iDRAC IP Address Through HTTP When DCA and DIA replacement servers are initially configured, their iDRACs will have an IP address set to DHCP. To reconfigure these with your service laptop, perform this procedure. Note: If you are replacing a server, do not turn the server’s main power on, but do connect the power, Ethernet, and twin‐ax cables to the new server. 1. Connect the service laptop to the red or white service cable attached to port 23 or 24 of the DCA administration switch. Assign the service laptop an address of 192.168.1.200 with a netmask of 255.255.255.0 and no gateway. If the connection fails, change the service laptop IP address to 192.168.1.201 to rule out a potential IP conflict between the service laptop and replacement server. If the connection continues to fail after this change, refer to “Configuring iDRAC IP Address if the Default IP is Unknown” on page 120 for additional instructions. 2. Open a web browser and navigate to the IP Address of the new server. For example, if the new server’s IP address is 172.28.4.197, navigate to https://172.28.4.197. Figure 53 iDRAC Login Window 3. Click on Remote Access on the left and, when the settings page loads, click Network/Security on the top. 116 Replacement of Field Replaceable Units — EMC Greenplum DCA Reconfiguring iDRAC IP Address Figure 54 iDRAC Remote Access 4. Scroll down the page until the IPv4 information is shown. Set the IP address to the correct address for the server being replaced. For example, if the default IP scheme is in use, a replacement for sdw3, it should use IP address 172.28.0.3, gateway 0.0.0.0, and netmask 255.255.248.0. Configuring iDRAC IP Address Through HTTP 117 Reconfiguring iDRAC IP Address Figure 55 iDRAC IPv4 Settings 5. Scroll down to the bottom of the page and click the Apply button. After a short wait (less than 5 minutes), the DRAC will no longer respond on the 192.168.1.100 address and the current session ends. 118 Replacement of Field Replaceable Units — EMC Greenplum DCA Reconfiguring iDRAC IP Address Figure 56 iDRAC — Appling Changes 6. Reconfigure the network interface on the workstation to 172.28.7.253 with a netmask of 255.255.248.0. Once changed, you can reconnect with the new serverʹs iDRAC at the new address. Configuring iDRAC IP Address Through HTTP 119 Reconfiguring iDRAC IP Address Configuring iDRAC IP Address if the Default IP is Unknown In certain circumstances, it may be necessary to change the IP address of the iDRAC when the default IP address is not set to 192.168.1.100. This procedure should only be performed if the procudure listed in “Configuring iDRAC IP Address Through HTTP” on page 116 cannot be followed because the default IP address is not known. The following equipment is required to complete this procedure. In some data centers, this combination of equipment is referred to as a crash cart. USB Keyboard Monitor with a male, 15‐pin VGA cable To Set the iDRAC IP Address using a keyboard and monitor 1. Connect power, ethernet and twin‐ax cables to the server 2. Connect the USB keyboard to any available USB port on the server 3. Connect the monitor to the VGA port on the rear of the server. Refer to Figure 57 for the location of the VGA port on a Dell R610 master server, and Figure 58 for the location of the VGA port on a Dell R510 segment server. Figure 57 Dell R610 Master Server VGA Port Location Figure 58 Dell R510 Segment/DIA Server VGA Port Location 4. Power on the server by pressing the power button located on the front of the server. 5. While the server is booting, watch for a prompt for Remote Access Setup, and press CTRL-E: Press <CTRL-E> for Remote Access Setup within 5 sec... Note: You will only have 5 seconds to press CTRL‐E. If time lapses, reboot the server and repeat this step. 120 Replacement of Field Replaceable Units — EMC Greenplum DCA Reconfiguring iDRAC IP Address Figure 59 Press CTRL-E for Remote Access Setup 6. When prompted for the BIOS password, enter emcbios . 7. Using the directional keys, scroll down to the LAN Parameters menu item and press ENTER. Figure 60 Select LAN Parameters from the menu 8. Verify the following parameters are selected. Press the space bar to change the value of a parameter: – NIC Selection = Shared – IPv4 = Enabled – IPv4 Address Source = Static 9. Scroll to the IPv4 Address parameter and press ENTER to edit the field. Configuring iDRAC IP Address if the Default IP is Unknown 121 Reconfiguring iDRAC IP Address Figure 61 Press ENTER to edit the IPv4 Address 10. Set the IP address to the correct address for the server being replaced. For example, if the server is a replacement for sdw3, you should use the IP address 172.28.0.3. 11. Press ENTER to commit the new IP Address 12. Scroll to the Subnet Mask parameter and press ENTER to edit the field. Figure 62 Press ENTER to edit the Subnet Mask 13. Set the Subnet Mask to 255.255.248.0 and press ENTER to commit the new value. 14. Press ESC to exit and answer YES to all prompts. 15. The server will continue to boot, this procedure is complete. 122 Replacement of Field Replaceable Units — EMC Greenplum DCA C Accessing the iDRAC Web Interface with SSH The following information describes how to set up an SSH tunnel to the iDRAC web interface using Putty telnet/SSH client software. The Dell iDRAC web interface displays system information and includes a console emulator called “Virtual Console”. Using SSH to Connect to the iDRAC Web Interface .............................................. 124 Accessing the iDRAC Web Interface with SSH 123 Accessing the iDRAC Web Interface with SSH Using SSH to Connect to the iDRAC Web Interface Using SSH to connect to the iDRAC web interface typically occurs when a direct connection to the DCA admin switch is not available. To use SSH, a single connection to the primary or standby master server external interface is required. The following scenarios represent use cases for this procedure: You are connected to the customer network locally and have access to the DCA through its external interface. You are connected to the customer network remotely (Webex or ESRS) and have access to the DCA through its external interface. Do not use SSH if you can connect to the DCA through the red service cable. Also, you cannot use SSH to access to the Dell iDRAC web interface on the server through which you are connected. For example, if you are connected to the primary master server, you cannot access the Dell iDRAC web interface on the primary master server; You can access Dell iDRAC on the standby master server. 1. Open the Putty client and establish an SSH connection to the primary or standby master server. 2. Click the icon in the top‐left side of the Putty window and select Change Settings. Figure 63 Putty Client — Change Settings 3. In the Putty Reconfiguration window, go to Connection > SSH > Tunnels. 124 Replacement of Field Replaceable Units — EMC Greenplum DCA Accessing the iDRAC Web Interface with SSH Figure 64 Putty Client — SSH Tunnel Configuration 1 4. Enter the following information then click Add: • Source port: 443 • Destination: 172.28.0.#:443 where # is the server number. For example, the destination IP address for segment host sdw7 would be 172.28.0.7. 5. Enter the following information then click Add: • Source port: 5900 • Destination: 172.28.0.#:5900 where # is the server number. For example, the destination IP address for segment host sdw7 would be 172.28.0.7. Using SSH to Connect to the iDRAC Web Interface 125 Accessing the iDRAC Web Interface with SSH Figure 65 Putty Client — SSH Tunnel Configuration 2 6. Click Apply. An SSH tunnel is now available to the specified server. 7. To access the Dell iDRAC web interface, open a web browser and navigate to: https://localhost:443 The iDRAC web interface login page displays. 126 Replacement of Field Replaceable Units — EMC Greenplum DCA Accessing the iDRAC Web Interface with SSH Figure 66 iDRAC Login Window Note: See Appendix A, “Connecting to the DCA from a Workstation” for more information about how to connect to the Dell iDRAC web interface. Using SSH to Connect to the iDRAC Web Interface 127 Accessing the iDRAC Web Interface with SSH 128 Replacement of Field Replaceable Units — EMC Greenplum DCA D Using the iDRAC Serial Console Emulator Dell’s iDRAC controller includes a serial console emulator accessible that you can access with SSH. You can use the emulator to view boot information before the operating system loads. The output from the serial console emulator is consistent with the output from COM port redirection. You can establish a connection to the Dell iDRAC Serial Console Emulator locally through the admin switch, or remotely through an SSH tunnel. Using the Serial Console Emulator........................................................................... 130 Using the iDRAC Serial Console Emulator 129 Using the iDRAC Serial Console Emulator Using the Serial Console Emulator You can use the iDRAC Serial Console Emulator at any time to view console output. EMC recommends using the emulator under the following scenarios: The remote connection to the DCA is slow and causing performance issues when using the iDRAC Virtual Console. The Virtual Console is exhibiting inconsistent behavior, such as discarding keystrokes, or timing out. The Dell iDRAC Serial Console Emulator displays a text‐only output and might cause characters to display incorrectly in menu interfaces or during some sections of POST. 1. Establish an SSH connection to the service port of the server you want to access. • Local: If you are connected to the system from the red service cable, open the Putty telnet/SSH client and connect to 172.28.0.# as user root. where # is the server number. For example, the destination IP address for segment host sdw7 would be 172.28.0.7. • Remote: If you in a remote location and away from the system, establish a connection to the system (by default, this occurs on the primary master server), then enter the following command: ssh root@sdw#-sp where # is the server number. For example, the destination IP address for segment host sdw7 would be 172.28.0.7. 2. When prompted for a password, enter calvin. When the connection establishes, the following prompt displays: /admin1-> Note: After successfully connecting, you might need to press the ENTER key to refresh the screen. 3. Enter the following command to start the emulator: console com2 130 Replacement of Field Replaceable Units — EMC Greenplum DCA Using the iDRAC Serial Console Emulator Important Notes Restarting the server or the operating system does not terminate the SSH connection. You cannot connect to the iDRAC of the system onto which you are currently logged in. When connected, use the following key mappings for non‐character commands: • <ESC><0> for F10 • <ESC><!> for F11 • <ESC><@> for F12 • <ESC><R><ESC><r><ESC><R> for Ctrl‐Alt‐Del Using the Serial Console Emulator 131 Using the iDRAC Serial Console Emulator 132 Replacement of Field Replaceable Units — EMC Greenplum DCA E Greenplum DCA Part Numbers This appendix contains the part number of all field replaceable units in a DCA. The information below can be used for part ordering. Table 17 DCA FRU Part Numbers Part Number Description EMC Description 038-003-883 n/a V-MAX, SINGLE PHASE, PDP AC INTERNAL EXTENSION CORD, BLACK 038-003-884 n/a V-MAX, SINGLE PHASE, PDP AC INTERNAL EXTENSION CORD, GREY 038-003-439 n/a Single power inlet cord Option IP-57 Australia 15' 038-003-888 Service Cable - Administration Switch to Laptop ETHERNET CABLE, 71 INCHES, RED 100-580-700 Allied Telesis Administration Switch 28 Port Gigabit Ethernet Switch 100-585-000 Master Server - Standby or Primary Dell R610 Server (with HDD Drives / Power Supply) 100-585-001 Segment Server Dell R510 Server (with HDD Drives / Power Supply) 100-585-006 Segment Server - Capacity or DIA Server DCA R510 2U DENSE SEGMENT SERVER 100-885-137 n/a PDU HALF HEIGHT, W/ WIRE BAILS, AMP, T & M 100-885-138 n/a PDP, SINGLE PHASE 105-000-190 Master Server Disk Drive DELL 600GB 10K RPM SAS 2.5" DISK DRIVE IN AN 11G DISK SLED 105-000-196 Segment or DIA Server Power Supply DELL R510 750W POWER SUPPLY 105-000-199 Segment Server Disk Drive 600GB, 15K RPM, 3.5 INCHES DELL R510 SAS DISK/SLED Greenplum DCA Part Numbers 133 Greenplum DCA Part Numbers Table 17 134 DCA FRU Part Numbers Part Number Description EMC Description 105-000-201 Master Server Power Supply DELL R610 717W HIGH OUTPUT POWER SUPPLY 100-652-051 Brocade 8000 Interconnect Switch Fan MP-7500B, AP-7600B, & MP-8000B FAN FRU 100-652-568 Brocade 8000 Interconnect Switch Brocade 8000 fully configured (Fans and Powersupplies could be considered not current done today) 100-652-569 1 Meter Interconnect Cable BRCD 10GbE TWINAX COPPER 1 METER 1PACK (BRSFP-TX1M1P) 100-652-571 3 Meter Interconnect Cable BRCD 10GbE TWINAX COPPER 3 METER 1PACK (BRSFP-TX3M1P) 100-652-573 5 Meter Interconnect Cable BRCD 10GbE TWINAX COPPER 5 METER 1PACK (BRSFP-TX5M1P) 105-000-166 Brocade 8000 Interconnect Switch Power Supply ES-5832B / MP-8000B POWER SUPPLY FRU 105-000-197 Capacity Segment or DIA Server Disk Drive 2TB, 7.2K RPM, 3.5 DELL R510/R710 SATA DISK/SLED 038-003-438 n/a Single power inlet cord Option with Hubbell L6-30P connector, North America/Japan 15' 038-003-440 n/a Single power inlet cord Option IEC-309-332P6 International 15' 038-003-441 n/a Hubbell L6-30R to Russellstoll 3750DP cable 15' Replacement of Field Replaceable Units — EMC Greenplum DCA