Transit Station FDRMOVE a solution for z/OS volume consolidation © Copyright 2007, Innovation Data Processing. All rights reserved. What is FDRMOVE™? An easy to use, extremely fast, ultimately reliable, automated solution for non-disruptive or minimallydisruptive volume consolidation and data set relocation. Complements FDRPAS non-disruptive volume level migration Drastically reduces or eliminates downtime FDRMOVE includes FDRPAS © Copyright 2007, Innovation Data Processing. All rights reserved. What is FDRPAS™? Moves disk volumes to new devices Swaps I/O operations while volumes are still in use! Putting the volume on a new device Handling updates in real time Transparent to the system and it’s users After the FDRPAS migration has completed, access to PRD001 (by applications & user) is switched to the new unit address. © Copyright 2007, Innovation Data Processing. All rights reserved. FDRPAS™? FDRPAS ISPF Panels © Copyright 2007, Innovation Data Processing. All rights reserved. FDRPAS™? FDRPAS ISPF Panels © Copyright 2007, Innovation Data Processing. All rights reserved. FDRPAS™? FDRPAS SWAP JCL © Copyright 2007, Innovation Data Processing. All rights reserved. FDRPAS™? FDRPAS MONITOR JCL © Copyright 2007, Innovation Data Processing. All rights reserved. FDRPAS™ Summary Moves disk volumes to new devices, Volume Migration Swaps I/O operations while volumes are still in use is NON-DISRUPTIVE! Can be invoked/used by FDRMOVE Included in FDRMOVE © Copyright 2007, Innovation Data Processing. All rights reserved. FDRMOVE™ Key Features Automated movement of data Unattended operation Support for PS, PO, VSAM, DB2… etc. data sets Support SMS and NON-SMS Flexible data set selection And more….. © Copyright 2007, Innovation Data Processing. All rights reserved. How does FDRMOVE™ Work? Determines state of selected data sets Automatically migrates inactive data sets Allocating data sets to new volumes Copying data with normal or INSTANT I/O Recataloging data sets to the new volumes Continually scanning for more data sets to become inactive… © Copyright 2007, Innovation Data Processing. All rights reserved. FDRMOVE™ has three simple functions Three simple functions SIMMOVE – identify, plan & validate MOVE - high performance EXCP I/O FASTMOVE - using INSTANT I/O (and FDRPAS) SIMMOVE Designates volumes as either… Source Target Transit Online Source Volume © Copyright 2007, Innovation Data Processing. All rights reserved. Online Target Volume Offline Transit Station MOVE FASTMOVE Using Simulation •Validate • JCL • Control statements •Determine • # of output vols (mv DSets) • Source to Tgt relationships • Identify • Catalogs • All selected data sets • Currently active data sets •Jobs using them. © Copyright 2007, Innovation Data Processing. All rights reserved. … … … … … … … … … … Source … Using Simulation -UNABLE TO MOVE A CATALOG VOL=SYSLB2 DSN=CATALOG.PMASTER -UNABLE TO MOVE A CATALOG VOL=SYSLB2 DSN=CATALOG.PMASTER.CATINDEX ……….. FOR MOVING DSN=SYSP9740.SLSJRN11 FOR ACTIVE DSN=SYSP9740.SLSCDS 1 JOBS(HSC) FOR ACTIVE DSN=SYS3.STROBE.LOAD 8 JOBS (XCFAS, ,LLA,XCFAS,LLA,…. FOR ACTIVE DSN=DSN710.BSDS01 1 JOBS(DSN1MSTR) FOR ACTIVE DSN=DSN710.LOGCOPY2.DS03 1 JOBS(DSN1MSTR) FOR ACTIVE DSN=DSN710.LOGCOPY2.DS02 1 JOBS(DSN1MSTR) FOR ACTIVE DSN=DSN710.LOGCOPY2.DS01 1 JOBS(DSN1MSTR) FOR ACTIVE DSN=DSN710.LOGCOPY1.DS03 1 JOBS(DSN1MSTR) FOR ACTIVE DSN=DSN710.LOGCOPY1.DS02 1 JOBS(DSN1MSTR) FOR ACTIVE DSN=DSN710.LOGCOPY1.DS01 1 JOBS(DSN1MSTR) FOR MOVING DSN=DB2CPUE.CPY.COPYDDN.DSN8D71P.DSN8S71C FOR MOVING DSN=DB2CPUE.DSNDBC.DSN8D71P.XDSPTXT1.J0001.A001 FOR MOVING DSN=DB2CPUE.DSNDBC.DSN8D71A.EEMPPROJ.I0001.A001 ……….. © Copyright 2007, Innovation Data Processing. All rights reserved. Using Pre defined Reports 1. To list all volumes with VTOC’s over xx% full to insure that as you consolidate volumes that there will be enough space. NOTE: FDRMOVE supports expanding the VTOC on active volumes. 2. To identify any volumes without an indexed VTOC or the indexed VTOC is disabled. This can cause performance issues if IXVTOC is not enabled. 3. To identify all volumes that have ICF catalogs. These volumes should be moved with FDRPAS. 4. To identify all datasets that are not cataloged or not cataloged to the correct volume. Very important before FDRMOVE is run to consolidate volumes. 5. Identify if there are any VVDS errors. The error conditions reported are missing VVR/NVR, multiple VVRs/NVRs, extent mismatch, and orphaned VVR/NVR. 6. To identify multi-volume datasets and the number of volumes they reside on. 7. To identify the SYSRES and IODF volume(s). You will need to update the address before the next IPL. 8. Volumes that contain the Active Page, Swap and LINKLIST datasets. 9. To list datasets that are marked as unmovable or have a DSORG of undefined. 10. To insure that all the source volumes have no remaining datasets to migrate, use the SIMMOVE TYPE=DSF,VTOCEMPTY=CHECK option. The job stream for these migration jobs can be downloaded from the JCL library with Member names starting with MOVREPxx. © Copyright 2007, Innovation Data Processing. All rights reserved. Consolidation Techniques #1 With FDRPAS & FDRMOVE 3390-3’s 3390-9 FDRPAS FDRMOVE © Copyright 2007, Innovation Data Processing. All rights reserved. Consolidation Techniques #2 All With FDRMOVE F jobname,STATUS 3390-3’s (similar info available using the FDRMOVE ISPF panel 3390-9 ------------------ FDRMOVE PLUG & SWAP DATA SET MOVE ---------- Row 1 of 19 COMMAND ===> SCROLL ===> PAGE Display DSN ===> YES Jobname ===> * Refresh ===> 0 -- MOVE STATUS REPORT FOR JOB MOVE013 AT 15:01:22 -DATASETS: --------NUMBER OF VOLUMES----------MOVED ACTIVE AWAITING TRANSIT MOVING TO TRANSIT IN TRANSIT STATION -------- ---------------------- ----------------- -----------------70 32 0 1 2 VOL=SH20C0 MOVING TO TRANSIT IBM76421 TO EMC00547 28 DATASETS TO MOVE FDRMOVE VOL=SH20C3 IN TRANSIT STATION EMC00547 -- EMC00547 1 DATASETS TO MOVE ACTIVE DATASETS FOR VOLUME SH20C3 NUMBER JOBS JOBNAMES HOLDING ENQUEUE ------------------------------------- ----------- ---------------------------DB2.WORKFILE.VSH20C3.PS.A0001 1 (JOB5) VOL=SH20E0 IN TRANSIT STATION EMC00547 -- EMC00547 3 DATASETS TO MOVE ACTIVE DATASETS FOR VOLUME SH20E0 NUMBER JOBS JOBNAMES HOLDING ENQUEUE ------------------------------------- ----------- ---------------------------DB2.PAYROLL.VSH20E0.PO.A0002 1 (CICS101) DB2.PAYROLL.VSH20E0.VSAM.CLUSTER 2 (CICS101) DB2.DSNDBC.DSNDB06.DSNKKX02.I0001.A001 2 (CICS101),(DB2BATCH) • Consolidate hundreds of volumes • Relocate thousands of datasets • Many different Target volumes • All in just minutes. © Copyright 2007, Innovation Data Processing. All rights reserved. Understanding Selection and Location Input - Source Selection Volume or Storage Group… ALLDSN (excludes VTOC, VIX, VVDS) CATDSN w/ Data Set Name / Mask Data Set Name / Mask (PAYROLL.**) Output - Target Selection Volume List - NVOL=(VOL121, VOL4*… New Storage Group Existing Storage Group © Copyright 2007, Innovation Data Processing. All rights reserved. Consolidation Techniques #3 … consolidate volumes w/FASTMOVE The bulk of a site’s data sets i.e. inactive files… use “MOVE” Time sensitive apps & large files i.e. active files use… ”FASTMOVE” System volumes, catalog volumes… and SWAP one volume w/FDRPAS then consolidate more w/FDRMOVE Benefit… Volumes containing selected files are non-disruptively positioned for “INSTANT” hardware replication, by using FDRPAS technology to move these to the target system as where they enjoy the faster, more economical benefits of the new storage system. © Copyright 2007, Innovation Data Processing. All rights reserved. “FASTMOVE”… Critical active files Pre-position volumes for “INSTANT” hardware replication Source …… …… …… …… …… Benefit…. faster, more economical performance of the new storage system © Copyright 2007, Innovation Data Processing. All rights reserved. Target …….. Transit Station …… …… FASTMOVE – 3 Phases Understanding Transit Station Transit Volumes are temporary storage for FASTMOVE “Offline” volumes, same storage system as Target Applications continue without interference Swap Back Source volumes return to original storage system Frees Transit Station for reuse © Copyright 2007, Innovation Data Processing. All rights reserved. Phase - 1 … Non-disruptively SWAPS Volumes Target Target Source …… …… …… …… …… Invoking FDRPAS to SWAP volumes w/active data sets to “Transit Volumes” © Copyright 2007, Innovation Data Processing. All rights reserved. …….. Transit Station …… …… Phase - 2 … Consolidates volumes w/ INSTANT IO SourceSource ………… ………… ………… ………… ………… Employing FDRINSTANT I/O to copy data © Copyright 2007, Innovation Data Processing. All rights reserved. Target Target …….. …….. Transit Transit Station Statin …… …… …… …… Step by Step Consolidate Volumes Addressing Active Datasets 1. 2. 3. SIMMOVE- validate Start MONITOR jobs Start…“FASTMOVE” a. Invokes FDRPAS 4. 5. STATUS – “FDR188 Ready Msg” “bounce” application 6. *Audit w/- VTOCEMPTY © Copyright 2007, Innovation Data Processing. All rights reserved. What does FASTMOVE™ do? Invoke FDRPAS to swap source volume to transit station Auto-generates FDRPAS jobs for active volumes Monitors the use of data sets Automatically migrates inactive data sets Copying data with INSTANT I/O Recataloging datasets to new volumes Scanning for more inactive data sets … every 2 seconds Removes volumes from transit stations Returns volumes to source storage system when done © Copyright 2007, Innovation Data Processing. All rights reserved. Transit Station Tying it all together… Monitor progress F jobname,STATUS (similar info available using the FDRMOVE ISPF panel ------------------ FDRMOVE PLUG & SWAP DATA SET MOVE ---------- Row 1 of 19 COMMAND ===> SCROLL ===> PAGE Display DSN ===> YES Jobname ===> * Refresh ===> 0 -- MOVE STATUS REPORT FOR JOB MOVE013 AT 15:01:22 -DATASETS: --------NUMBER OF VOLUMES----------MOVED ACTIVE AWAITING TRANSIT MOVING TO TRANSIT IN TRANSIT STATION -------- ---------------------- ----------------- -----------------70 32 0 1 2 VOL=SH20C0 MOVING TO TRANSIT IBM76421 TO EMC00547 28 DATASETS TO MOVE VOL=SH20C3 IN TRANSIT STATION EMC00547 -- EMC00547 1 DATASETS TO MOVE ACTIVE DATASETS FOR VOLUME SH20C3 NUMBER JOBS JOBNAMES HOLDING ENQUEUE ------------------------------------- ----------- ---------------------------DB2.WORKFILE.VSH20C3.PS.A0001 1 (JOB5) VOL=SH20E0 IN TRANSIT STATION EMC00547 -- EMC00547 3 DATASETS TO MOVE ACTIVE DATASETS FOR VOLUME SH20E0 NUMBER JOBS JOBNAMES HOLDING ENQUEUE ------------------------------------- ----------- ---------------------------DB2.PAYROLL.VSH20E0.PO.A0002 1 (CICS101) DB2.PAYROLL.VSH20E0.VSAM.CLUSTER 2 (CICS101) DB2.DSNDBC.DSNDB06.DSNKKX02.I0001.A001 2 (CICS101),(DB2BATCH) All volumes in TransitStation Active Datasets on volume Jobs holding datasets © Copyright 2007, Innovation Data Processing. All rights reserved. SUMMARY FDRMOVE w/FDRPAS Move most all datasets with no disruption Hundreds in minutes w/high performance IO Active datasets move w/minimal disruption 1TB/min with INSTANT Source volumes can remain in transit station until applications release files. © Copyright 2007, Innovation Data Processing. All rights reserved. FDRMOVE Includes FDRPAS For internal use with FASTMOVE and for direct use on volumes that taken cannot be taken down or do not become inactive for a few moments. FDRINITV Allows you to quickly and easily create a new VTOC on one or more target volumes in the new subsystem. EXPANDVTOC The EXPANDVTOC function allows you to dynamically expand the VTOC on any volume. © Copyright 2007, Innovation Data Processing. All rights reserved. Transit Station FDRMOVE with FDRPAS a solution for z/OS volume consolidation © Copyright 2007, Innovation Data Processing. All rights reserved.