© Copyright 2016 EMC Corporation. All rights reserved.
1
USER PERSPECTIVE OF EMERGING EMC
TECHNOLOGIES
SESSION CTDTT.30 – JIM ERDAHL – U.S. BANK
© Copyright 2016 EMC Corporation. All rights reserved.
2
U.S. BANK AND EMC
• U.S. Bank and EMC have worked together to
introduce:
• Host Read Only (HRO) Devices
• Universal Data Consistency™
• Data Protector for z Systems (zDP)
© Copyright 2016 EMC Corporation. All rights reserved.
3
Like a Kid in a Candy Store…
Who got to go to the factory and
eat off the line!
© Copyright 2016 EMC Corporation. All rights reserved.
4
AGENDA
zBoost™
–
–
–
Performance
zHPF
PAV Optimizer
VMAX V3 Beta
–
–
Hardware
MFE 8.0
GDDR 5.0 Beta
DC3 V3 Cutover
© Copyright 2016 EMC Corporation. All rights reserved.
5
zBOOST™
• No charge* non-disruptive microcode
upgrade to improve performance for
Mainframe VMAX20K and VMAX40K.
– Improves the throughput with FICON
– Provides full zHPF support
– Enhances the use of PAV’s
© Copyright 2016 EMC Corporation. All rights reserved.
*Support for zHPF is a chargeable feature on VMAX, part of the Mainframe Essentials bundle.
6
zBOOST PERFORMANCE BENEFITS (VMAX 40K)
• Improves the maximum IOPS by moving a back
end processor core to the front end for FICON
(previously known as Mainframe Performance
Accelerator - MPA)
– Increases usable front end director capacity
– Improved IOPS for FICON
– Reduced response time
– Batch run-times were improved
© Copyright 2016 EMC Corporation. All rights reserved.
7
MPA COMPARISON
© Copyright 2016 EMC Corporation. All rights reserved.
8
FICON FRONT END DIRECTOR IMPROVEMENT
© Copyright 2016 EMC Corporation. All rights reserved.
9
zHPF SUPPORT
• Verify hardware support
– D IOS,ZHPF
• We have not performed any
measurements
• Worth Mentioning
– No issues with our z13 Processors
– On z12, non-disruptive Channel Detected
Errors
– Heard that the FICON fiber needs to be clean
© Copyright 2016 EMC Corporation. All rights reserved.
10
zBOOST™ PAV OPTIMIZER OBJECTIVES
• Significantly improves performance of multi-track
zHPF I/O
• Extend parallel processing programming paradigms
into the I/O itself
• Ensure transparent implementation for ease of
exploitation
– No JCL or program changes necessary
© Copyright 2016 EMC Corporation. All rights reserved.
11
zHPF I/O OPTIMIZED WITH PAV OPTIMIZER
A
c
C
e
S
S
zHPF Channel Pgm
Read 9 tracks
z/OS
1901
Base
Device 1901
TCW
TCCB
M
e
t
h
o
d
P
A
V
DCW
READ TRACK
Count=9
IOS
O
P
T
I
M
I
Z
E
R
Complete
Tracks
4-6
19F1
Alias
19F5
Alias
Subsystem
© Copyright 2016 EMC Corporation. All rights reserved.
13
PAVO
• 64 HyperPAV’s per 192 devices-already heavily used
• Early use of the functions – Beta via Early Ship
– 16 Jobs assisted since late Oct 2015
– > 1,100 devices
Project got delayed because…….
© Copyright 2016 EMC Corporation. All rights reserved.
14
SAMPLE SCF INI PAVO PARMS:
SCF.LFC.LCODES.LIST=1234-5678-9012-3456 /* PAV OPT */
********************************************************
/* PAV OPTIMIZER - ENABLEMENT
SCF.DEV.OPTIMIZE.ENABLE=YES
SCF.DEV.OPTIMIZE.PAV=YES
/* YES/PASSIVE
*/
SCF.DEV.OPTIMIZE.SMF.RECID=203
/* SMF RECORD ID NUMBER */
/*
/* PAV OPTIMIZER - SELECTION (SITE SPECIFIC)
SCF.DEV.OPTIMIZE.PAV.STORGRP.INCLUDE.LIST=SGONE,SGTWO
SCF.DEV.OPTIMIZE.PAV.JOBPREFIX.LIST=JAERDAH
SCF.DEV.OPTIMIZE.PAV.JOBNAME.LIST=JOBNAME1,JOBNAME2
/*
/* PAV OPTIMIZER - RESOURCE UTILIZATION
SCF.DEV.OPTIMIZE.PAV.TRACK.MIN=2
SCF.DEV.OPTIMIZE.PAV.SPLIT.MAX=8
SCF.DEV.OPTIMIZE.PAV.SPLIT.MAX.READ=4
SCF.DEV.OPTIMIZE.PAV.SPLIT.MAX.WRITE=8
SCF.DEV.OPTIMIZE.PAV.QUIPOINT.GLOBAL=5000
SCF.DEV.OPTIMIZE.PAV.QUIPOINT.LCU.PCT=75
SCF.DEV.OPTIMIZE.PAV.QUIPOINT.DEVICE=8
Define what will be
optimized
As provided
Jim will change this data, if new options provided by Art
© Copyright 2016 EMC Corporation. All rights reserved.
15
SELECTION CRITERIA FOR BATCH JOB OPTIMIZATION
• Mission critical Application
• A Lot of zHPF I/O (SMF Type 42)
• Significant Run Time Reduction
• Job is in the critical path
• Under MBOS* influence (larger buffers)
© Copyright 2016 EMC Corporation. All rights reserved.
*Mainview Batch Optimizer from BMC
16
PAVO RESULTS
Percent Runtime Reduction
60.0
50.0
40.0
30.0
20.0
Percent Runtime Reduction
10.0
0.0
-10.0
Note: These are development jobs, so the data tested with varies greatly.
© Copyright 2016 EMC Corporation. All rights reserved.
17
WHAT’S NEXT (MAY STILL IN THE FUTURE BY EMCW?)
• We have engaged EMC Resources
• We need to better understand how to use the SMF
data
• Have requested enhancements
– Selection by Data Set Name
– Need Passive and Active Mode in parallel
© Copyright 2016 EMC Corporation. All rights reserved.
18
© Copyright 2016 EMC Corporation. All rights reserved.
19
VMAX V3 BETA VALIDATION
• Hardware – Been running for years (MR)
• Mainframe specific microcode
• Mainframe Enabler
– MFE Version 8.0
• Geographically Dispersed Disaster Restart
–
GDDR Version 5.0
The objective is to validate functions, not performance.
© Copyright 2016 EMC Corporation. All rights reserved.
20
INITIAL BETA CONFIGURATION
.
z13
3 LPARS
RA00
RB00
R900
DC1
DC2
SRDF/A
VMAX3
© Copyright 2016 EMC Corporation. All rights reserved.
• VMAX 200K
• 4TB
• 8 FICON
VMAX3
21
VMAX V3 BETA
• The Beta validation is in progress. This is what we have
participated with:
–
–
–
–
–
–
–
–
–
–
–
I/O Driver provided by EMC and with our software
SRDF/A with MSC and MCM
TF Mirror Clone Emulation
SnapVX
Batch zDP
Host Read Only
ISPF Interface for zDP
SRDF/S
ConGrp
Autoswap
Unisphere
© Copyright 2016 EMC Corporation. All rights reserved.
22
BETA VALIDATION PROCESS
• Education – Train the trainers
• At each phase, delivery included:
–
–
–
–
–
Microcode
MFE 8.0 Software
New/updates to manuals (w/o messages)
Validation Script
Validation JCL
• Enhanced Validation
© Copyright 2016 EMC Corporation. All rights reserved.
23
LETS DRILL DOWN
• SnapVX
• zDP
• Host Read Only
© Copyright 2016 EMC Corporation. All rights reserved.
24
SNAPV METHOD
• Historical TimeFinder technologies
– Need a target device at the time of the Copy
Copy to target
Source Volume
Target Volume
Copy to target
Source Volume
© Copyright 2016 EMC Corporation. All rights reserved.
Target Volume
This slide was originally prepared by Justin Bastin, EMC
25
TIMEFINDER SNAPVX
• Built on Thin provisioning
– Data stored in thin pools (SRP)
• Volume level only
• Supports up to 256 ‘target-less’
snapshots per volume
• Single architecture supporting:
– TF/Mirror (via Clone Emulation)
– TF/Clone
– TF/SNAP
– SnapVX
© Copyright 2016 EMC Corporation. All rights reserved.
This slide was originally prepared by Justin Bastin, EMC
Storage
Resource
Pool (SRP)
Production
Volume
Snapshot
Snapshot
Linked
Target
Snapshot
26
TIMEFINDER SNAPVX
• New SnapVX commands
– CREATE – Create snapshot structure of source with unique
name
– ACTIVATE – Obtain point it time
– LINK/UNLINK – Associate/disassociate PiT snapshot to
target volume
– QUERY – Displays information on the snapshot
– RENAME – Change name of snapshot
– TERMINATE – End snapshot once no longer linked
© Copyright 2016 EMC Corporation. All rights reserved.
27
TIMEFINDER SNAPVX– POINTER-BASED SNAPS
Snapshot
(up to 256)
Source Device
(TDEV)
10 A.M.
CREATE & ACTIVATE
Target Device(s)
(TDEV)
LINK / UNLINK
TERMINATE
12 Noon
Host volume
Snapshot
Pointer
Data
structure
Storage
Resource
Pool
© Copyright 2016 EMC Corporation. All rights reserved.
This slide was originally prepared by Justin Bastin, EMC
28
zDP USES SNAPVX
• Data Protector for z Systems (zDP) delivers the
capability to recover from logical data corruption
with minimal data loss.
• Yes, it was conceived in a bar…
• But, professionally designed…...
© Copyright 2016 EMC Corporation. All rights reserved.
29
zDP - HOW DOES IT WORK?
• Built on top of SnapVX
• Maintains Consistency of data across volumes and VMAX
V3’s, using either ECA or SRDF
• Creates up to 256 Snap Sets every 10 minutes
– (42.5 hours)
• Retain Snap Sets
• Terminate Snap Sets
• EMC has a tool to size your SRP using ChangeTracker
© Copyright 2016 EMC Corporation. All rights reserved.
30
zDP VALIDATION
• First - Performed the validation as requested from EMC
with two volumes
• Second - Enhanced validation was with:
– 94 volumes (MOD 3, 9, 27, 54, & EAV’s)
– 10 minute cycle time
– Ran I/O Driver process generating about 200 writes per second
• Results
– Ran for more than week
– Used less than 34GB of the SRP
© Copyright 2016 EMC Corporation. All rights reserved.
31
THE zDP PROCESS
• Define the Versioned Data Group (VDG)
• Add the source volumes to the group
• Define the Target Set (TGT)
• Add the target devices
• Start the zDP process
• Celebrate – that was easy
© Copyright 2016 EMC Corporation. All rights reserved.
32
zDP BATCH JCL
//STEPA
EXEC PGM=EIPINIT,REGION=0M
//STEPLIB
DD DISP=SHR,DSN=SYS2.EMC.MFE800.LINKLIB
//SYSPRINT DD SYSOUT=*
//SYSUDUMP DD SYSOUT=*
//SCF$EMCL DD DUMMY ---> YOUR EMCSCF ADDRESS SPACE
Statement1
Statement2
….
Statement(n)
/*
© Copyright 2016 EMC Corporation. All rights reserved.
33
zDP DEFINE VERSIONED DATA GROUP
GLOBAL MAX_RC(4)
DEFINE VDG VDGR900A,
CYCLE_TIME(10,0),CYCLE_OVERFLOW(NEXT),
CONSISTENT(YES),TIMEOUT(30),
TERM_POLICY(OLDEST),
SRP_WARN%(80),
MAX_SNAPSETS(255),
SAVED_SNAPSETS(1,3),
Save 1 Snapset for SnapVX process
PRESERVED_COPY_LIMIT(003),
LOG_OPT(SCF),
SMFREC(204,VOLUMES),
EXIT(NONE),
MAXRC(4)
MODIFY VDG VDGR900A,ADD,SYMDEV(FD2C,00A4-00AF)
MODIFY VDG VDGR900A,ADD,SYMDEV(FD2C,00B0-00BE)
MODIFY VDG VDGR900A,ADD,SYMDEV(FD2C,046C-048B)
© Copyright 2016 EMC Corporation. All rights reserved.
34
zDP DEFINE TARGET GROUP
GLOBAL MAX_RC(4)
DEFINE TARGET_SET TGTR900A
MODIFY TGT TGTR900A,ADD,SYMDEV(FD2C,06E0-06EB)
MODIFY TGT TGTR900A,ADD,SYMDEV(FD2C,06EC-06FA)
MODIFY TGT TGTR900A,ADD,SYMDEV(FD2C,0AA8-0AC7)
© Copyright 2016 EMC Corporation. All rights reserved.
35
zDP QUERY COMMANDS
Versioned Data Group Query
QUERY
QUERY
QUERY
QUERY
VDG
VDG
VDG
VDG
VDGR900A,STATUS
VDGR900A,DEVICE
VDGR900A,SNAPSET
VDGR900A,SNAPSET,DETAIL
Target Query
QUERY TGT TGTR900A,STATUS
QUERY TGT TGTR900A,DEVICE
QUERY TGT TGTR900A,STATUS,DEVICE
© Copyright 2016 EMC Corporation. All rights reserved.
36
zDP START COMMAND
F EMCSCF,ZDP START VDGR900
14.41.36 STC23778 SCF0740I ZDP START VDGR900A
14.41.36 STC23778 SCF0741I ZDP START command accepted
14.41.36 STC23778 SCF0746I ZDP VDG VDGR900A Started
14.41.36 STC23778 EIP0200I *** EMC zDP - V8.0.0 (000) - Friday, February 26, 2016 ***
14.41.39 STC23778 EIP0201I VDG VDGR900A, Beginning cycle
1, Snapset VDGR900A.......160571441S00001
14.41.40 STC23778 EIP0217I VDG VDGR900A, Devices validated for consistency, via SRDF/A
14.41.43 STC23778 EIP0204I VDG VDGR900A, Snapset VDGR900A.......160571441S00001 created
14.41.45 STC23778 EIP0202I VDG VDGR900A, Completed cycle
1, next cycle scheduled for 14:51:39
14.41.53 STC23778 SCF1301I MSC - TASK TIMER
14.46.53 STC23778 SCF1301I MSC - TASK TIMER
14.51.39 STC23778 EIP0201I VDG VDGR900A, Beginning cycle
2, Snapset VDGR900A.......160571451C00002
14.51.40 STC23778 EIP0217I VDG VDGR900A, Devices validated for consistency, via SRDF/A
14.51.44 STC23778 EIP0204I VDG VDGR900A, Snapset VDGR900A.......160571451C00002 created
14.51.46 STC23778 EIP0202I VDG VDGR900A, Completed cycle
2, next cycle scheduled for 15:01:39
© Copyright 2016 EMC Corporation. All rights reserved.
37
LINK A SNAP SET
LINK VDG(VDGR900A),SNAPSET(160571501C00003) TGT(TGTR900A)
EIP0001I
EMCP001I LINK
*** EMC zDP - V8.0.0 (000) - SCF V8.0.0 (000) ***
07:30:47
02/28/2016
VDG(VDGR900A),SNAPSET(160571501C00003) TGT(TGTR900A)
EIP0053I SYMM FD2C/0001967-01562, Linking SNAPSET VDGR900A.......160571501C00003
EIP0034I LINK command completed
EIP0002I All control statements processed, highest RC 00
© Copyright 2016 EMC Corporation. All rights reserved.
38
KEEP A SNAP SET
PERSISTENT SET,VDG(VDGR900A),SNAPSET(160571451C00002)
EIP0001I
*** EMC zDP - V8.0.0 (000) - SCF V8.0.0 (000) ***
06:44:48
02/27/2016
EMCP001I PERSISTENT SET,VDG(VDGR900A),SNAPSET(160571451C00002)
EIP0060I SYMM FD2C/0001967-01562, PERSISTENT SET for SNAPSET VDGR900A.......160571451C00002
EIP0034I PERSISTENT command completed
EIP0002I All control statements processed, highest RC 00
© Copyright 2016 EMC Corporation. All rights reserved.
39
zDP QUERY COMMAND OF SNAPSETS
EIP0001I
*** EMC zDP - V8.0.0 (000) - SCF V8.0.0 (000) ***
EMCP001I QUERY VDG VDGR900A,SNAPSET
EIP0035I
EIP0023I
EIP0024I
EIP0025I
EIP0026I
07:31:09
02/28/2016
Page
1
Snapset Query for VDG VDGR900A
SYMM 0001967-01562, Microcode level 5977_0799, Type VMAX200K
Gatekeeper FD2C, Device Count:
59
SRP ID/Name: 0001/SRP_1, Reserved Capacity: 10%
Total Capacity: 3359M, Total Allocated:
16M, Snap Allocated:
487
EIP0036I
EIP0036I
EIP0036I
CREATE
SOURCE_TRACKS EXPIRATION
SNAPSET_NAME
STATE DATE
TIME
CHANGED UNIQUE DATE
TIME
____________________________ _____ ___________________ ______________ ___________________
EIP0039I
EIP0039I
EIP0039I
………..
EIP0039I
EIP0039I
VDGR900A.......160571441S00001 ACT-S 02/26/2016 14:41:41
VDGR900A.......160571451C00002 ACT-P 02/26/2016 14:51:41
VDGR900A.......160571501C00003 ACT
02/26/2016 15:01:40
13485
13477
13164
VDGR900A.......160590721C00245 ACT
VDGR900A.......160571501C00003 LNK
83
52
13164
53
02/28/2016 07:21:42
02/28/2016 07:30:54
79 02/29/2016 14:41:40
53
53
EIP0034I QUERY command completed
© Copyright 2016 EMC Corporation. All rights reserved.
40
ISPF INTERFACE
© Copyright 2016 EMC Corporation. All rights reserved.
41
SNAPSET QUERY
© Copyright 2016 EMC Corporation. All rights reserved.
42
LESSONS LEARNED
• All volumes in a Snap Set must be in the same state
– SRDF/A
– ECA
• Target volume can not be smaller than the source
– The define of Target Group works, but…….
– LINK command will verify sizes, then fail
• I prefer batch setup over ISPF (I’m a CSECT guy)
• At this time, GDDR does not play with zDP
© Copyright 2016 EMC Corporation. All rights reserved.
43
HOST READ ONLY (HRO)
• Host Read Only causes a device to reject write I/Os.
– Simple SCF INI Definition with UCB Addresses
SCF.DEV.ATTR.HRO.INCLUDE.LIST=0D40-0D4F,0DC0-0DCF
• F SCFTASK,INI,REFRESH
• Protection with prejudice: Such as ABEND S413
© Copyright 2016 EMC Corporation. All rights reserved.
44
HOST READ ONLY DIAGRAM
Sysplex A
Sysplex B
Write I/O
Write I/O
Data Sets
© Copyright 2016 EMC Corporation. All rights reserved.
45
HOST READ ONLY USE CASE
• Issue
– With COBOL V5, load modules are in object format
– (This requires use of PDS/E’s)
– We promote code using shared DASD volumes
• Solution
– We allocate the PDS/E with the SMS Dataclass attribute of
“Guarantee Synchronous Write” on a HRO volume
– CAUTION: The CHECK macro does not guarantee that the data
has been synchronized to DASD, use the SYNCDEV.
• Google: “Why You Want to Use Partitioned Data Set Extended (PDSE)”
– Automation refreshes the PDSE address space on the Read
Only system(s)
© Copyright 2016 EMC Corporation. All rights reserved.
46
GDDR V5.0 VALIDATION – 2 SITE
• Still using two VMAX V3
• Much like the MFE 8.0 Validation
• Software libraries delivered in XMIT format
• Converted our GDDR Config 3 site to 2-site with
Autoswap
• Several Planned Autoswaps
• Performed an Un-Planned Autoswap
© Copyright 2016 EMC Corporation. All rights reserved.
47
GDDR 5.0 BETA CONFIGURATION
4 LPARS
RA00- DC1 C-System
RB00- DC2 C-System
RC00- DC3 C-System
R900- Managed System
IBM z13
DC1
VMAX SE & DLm
S
SRDF/S S
3
DC2
VMAX V3 & DLm
DC3
VMAX V3 & DLm
© Copyright 2016 EMC Corporation. All rights reserved.
R900 Uses Subchannel Sets
SS2 to DC1
SS0 to DC2
SS3 to DC3
48
GDDR 5.0 CONVERSTION NOTES
• To convert, copy GDDR V4.1 backup into V5.0
• New RACF Rules
• Additions to IKJTSOxx
• E05TFDEV and E04SRDFA members
• Use SETPROG LPA commands to refresh GDDRXG1A
• Not able to mix Timefinder environments
– All TF Mirror/clone or All SnapV / SnapVX
(with throttling, est. 19 days to convert our DLm VMAX)
Brett wants to change the wording here
© Copyright 2016 EMC Corporation. All rights reserved.
49
DC3 VMAX V3 CUTOVER PROCESS
Prepare:
• Converted DLm VMAX V2 from Timefinder to SNAPV
Copy all the data
Dynamic QOS reduced run time from 19 days to 7 ½
• Updated MFE to 8.0 and GDDR to 5.0
GA Base code released on March 30, 2016
• Stage V3 Hardware & Pray that 100 cables are
correct
• Generated over ??? Jobs.
© Copyright 2016 EMC Corporation. All rights reserved.
50
DC3 VMAX V3 CUTOVER PROCESS
Execution:
• Stopped SRDF/A and deleted all definitions
• Converted GDDR to 2-site w/Autoswap
• Switch over the cables to the V3’s
• Define SRDF/A and push data from DC1
• Initialize volumes with ICKDSF
© Copyright 2016 EMC Corporation. All rights reserved.
51
DC3 VMAX V3 CUTOVER PROCESS
Execution (Continued):
• Monitored progress with PGMITRKA (from Lam
Hairston)
• Activate MSC
• Convert GDDR back to 3-site w/Autoswap
• …..more to come after Monday (4/25)
© Copyright 2016 EMC Corporation. All rights reserved.
52
DC3 VMAX V3 VALIDATION
• Activated 10 day CBU
• Brought up 13 systems, z/OS 2.1 & z/OS 2.2
• Using EMC I/O Driver ?,???,??? IOPS
• …..more to come after Friday (4/28)
© Copyright 2016 EMC Corporation. All rights reserved.
53
BETTER MAKE A DENTIST APPOINTMENT
Thank You for letting me share my
trip through the Candy Store and
then through the Candy Factory
© Copyright 2016 EMC Corporation. All rights reserved.
54
WANT TO WIN A BB8 DROID? FOLLOW & WIN!
• Follow @EMCStorage or
@EMCProtectData while at
EMC World
• 2 Winners will be chosen daily
• Monday May 2 to
Thursday May 5
• All winners will be notified
through Twitter Direct Message
ABBREVIATED RULES
FOLLOW ME AND WIN EMC WORLD 2016 TWITTER SWEEPSTAKES ABBREVIATED RULES: NO PURCHASE NECESSARY. NOT OPEN TO THE GENERAL PUBLIC. Only open to individuals: [a] 21-years or older; [b] attending EMC World
2016 in Las Vegas, NV during May 2-5, 2016; [c] not residing in an Excluded Territory defined below; and, [d] with a personal Twitter account. ■ To enter, follow @EMCStorage or @EMCProtectData Twitter handle 8:00:00 am thru
5:30:00 pm on May 2-4, and 8:00:00 am thru 2:30:00 pm on May 5. All times are Pacific Time. New followers only may participate. Entries valid for each day’s drawing held after entry is received. One entry per person. ■ Two (2)
winners randomly selected daily from all entries will each receive one (1) Sphero BB8 App Enabled Droid (ARV $149.95). Total ARV of all prizes is $1,199.60. ■ You can only win one prize. Odds of winning depend upon number of
entries received prior to each drawing. You have not yet won. ■ IF YOUR COMPANY POLICIES OR APPLICABLE LAW PROHIBIT YOU FROM ACCEPTING THE PRIZE, YOU ARE INELIGIBLE. Employees, officials, or internally contracted
vendors of any government, government-affiliated company or organization, and employees of EMC Corp. and its affiliates are ineligible. ■ VOID IN PUERTO RICO, AND OTHER USA TERRITORIES (EXCLUDING D.C.), QUEBEC,
ARGENTINA, CHILE, PERU, AND WHERE PROHIBITED (collectively, “Excluded Territory”). ■ Actual prize may vary from prize as pictured. Prizes intended for USA market; may not be supported outside USA. ■ Other rules, exceptions,
and limitations apply. Subject to Official Rules posted at http://thecoreblog.emc.com/followandwinsweepstakes/. See www.emc.com for Privacy Policy. ■ If you do not agree with the Official Rules, do not submit an entry. ■
Sweepstakes not associated with Twitter Inc. or prize manufacturer. ■ Sponsored by EMC Corp, 176 South St., Hopkinton, MA 01748, U.S.A.
© Copyright 2016 EMC Corporation. All rights reserved.
55
© Copyright 2016 EMC Corporation. All rights reserved.
56