Intel® Manager for Lustre*
Lustre Installation & Configuration
Implementing an IEEL Solution
Session 04
June 2014
1
FOR USE IN IEEL SOLUTION CLASS ONLY
Description of Lustre Installation Lab
• You will use IML Manager to deploy a Lustre file system
• Review Lustre best practices employed by IEEL
• Create a Lustre file system
• Mount Lustre v2.5 Clients
• Review IML monitoring a fully configured Lustre file system
For this lab you will need to access the IEEL Training Cluster via:
•
•
Browser (Recommended: Google Chrome v27 or Mozilla Firefox v22)
Terminal or Windows Putty Command Line Interface
FOR USE IN IEEL SOLUTION CLASS ONLY
Lustre Installation and Configuration
Lustre Training Cluster
3
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
Lustre Installation and Configuration
IEEL Training Cluster Review
Lustre Installation Requirements
IML implements a set of Lustre Best Practices during Lustre install
• This puts specific requirements against the server hardware configurations
• Install Intel® EE for Lustre* only as described in the IEEL Partner
Installation Guide
Required operating system: Red Hat* Enterprise Linux v6.5 or CentOS v6.5
Network and DNS configuration: Confirm correct network and DNS (FQDNs).
•
The management network interfaces must be properly configured and active
•
Do not configure IP addresses for the HA crossover cable interfaces (server to
target)
RAM and mass storage: Provide adequate memory and disk space
4
•
Take advantage of the IEEL Partner support and request a review by Intel HPDD
•
See “Determining Space Requirements” and “Determining Memory Requirements”
in the Lustre Operations Manual.
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
Lustre Installation and Configuration
IEEL Training Cluster Review
Lustre Installation Requirements (cont)
Server Configuration: Servers are configured in HA pairs, with a
primary and secondary server
• Storage servers should have SSH running with root login permitted.
•
Non-root users should be prevented from logging into the storage servers
• Do not install or configure Lustre, Corosync, or Pacemaker.
• Do not configure NTP on storage servers
• Do provide power control to the IML manager via either IPMI or PDU
outlets
Storage Configuration: Read “Adding storage servers” in the IEEL
Partner Installation Guide
• Provide separate Volumes for the MGT and the MDT
• Shared storage for HA on MDT, MGT, OSTs
5
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
Lustre Installation and Configuration
High Availability Requirements
IML implements High Availability as a part of Lustre Best Practices
See “Creating a new HA Lustre file system” in the IEEL Installation
Guide
• Storage servers are deployed in a high availability (HA)
configuration with shared storage.
• Servers are configured in primary and failover server pairs. When a
server becomes unavailable, Lustre services that were running on
that server are started on another server attached to the same
storage.
• To support HA failover, each HA server must be able to
automatically power-off its peer server if a failover is required.
• Powering off a faulty server is known as "node fencing”, and
ensures that a shared storage device is not mounted by more than
one server at a time.
6
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
Lustre Installation and Configuration
High Availability Requirements (cont)
IML implements High Availability as a part of Lustre Best Practices
See “Creating a new HA Lustre file system” in the IEEL Installation Guide
• Provide shared storage for HA on MDT, MGT, OSTs
• Each server of a failover pair must have access to exactly the same
LUNs as its peer. Each LUN is visible only to its two, paired failover
servers.
• To properly enforce Lustre file permissions
• The MDS must have the same UID/GID database access as the
Lustre clients
• Using LDAP, the MDS’s must be configured to check for user
account information on both nodes to ensure proper
functionality in the event of a failover.
7
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
Diagram: MDS pair
8
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
Diagram: OSS pair
9
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
Lustre Installation and Configuration
10
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
Clear IML Status
11
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
Clear IML Status
12
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
Server Configuration
13
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
Server Actions
14
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
Lustre Network Configuration
15
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
Server Actions
16
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
Volume Configuration
17
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
Power Control – Add PDU/IPMI
Note: Due to virtualized environment Power Control is a virtual demonstration
18
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
Creating a new MGT
19
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
Creating a new MGT
20
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
Creating a new MGT
21
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
Create a new File System
22
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
Create a new File System (cont)
23
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
Create a new File System (cont)
24
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
File system up and running
25
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
HA management
26
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
Advanced Settings
27
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
Installing and mounting lustre clients
28
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
Dashboard View
29
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division
Questions?
30
FOR USE IN IEEL SOLUTION CLASS ONLY
High Performance Data Division