IMS Connect and IMS ODBM: an early
look
Jim Martin
Fundi Software
5-Aug-2010
Session 7858
Agenda
•
•
•
•
Overview of open database
Systems-perspective of Open Database
Tools that can be used with Open Database
Futures
2
Open Database Environment
z/OS
LPAR A
IMS
ODBM
Distributed
S
C
I
WebSphere
S
O
A
J
T
C
C
A
P
1.5
PC
LPAR B
CTL
IMS DB
IMS
XCF
I
P
O
D
B
A
S
C
P
I
O
D
B
A
PC
CTL
IMS DB
TCP/IP
LPAR C
JDBC
TCP/IP
IMS
IMS Connect
S
DLI
Roll Your Own
TCP/IP
T
C
P
I
P
S
C
C
I
O
D
B
A
PC
CTL
IMS DB
I
3
Protocol difference
• IMS Connect has always used the IRM protocol
• Now supports DRDA – an open standards based protocol
for distributed database access
•
•
•
•
Defines request flows
Defines Object:Data structure (DDM)
Extensible
Controlled by the Open Group
4
Standards-based tools
can analyze the
communcation
exchange
Key points
• Differentiator
•
•
•
•
Standards-based
Open access from distributed platforms
Two-phase commit
With or without WAS
• Impact
• Open DB requires CSL + IMS Connect
• New class of workload through IMS and IMS Connect
10
Challenges
• Managing and configuring new address spaces
• Understanding, debugging, and tuning DRDA requests
• New class of IMS application programmers (hopefully!)
11
IMS Connect Extensions
• Improves the manageability of IMS Connect
• IMS Connect Extensions enhancements for Open
Database include:
• Event collection
• Routing
• Monitoring of ODBM throughput in GUI or ISPF
12
Use routing to improve parallelism and
redundancy
1000msg/s
Messages
ALIAS+
PSBNAME
CEX converts a single
ALIAS+PSBNAME to
multiple candidate
ODBM address
spaces and databases
4x250msg/s
IMS Connect
ODBM A
ALIAS
ALIAS
ALIAS
ALIAS
ODBM B
14
14
Open database access
Overall request characteristics
IMS Connect
ODBM
IMS
Extensions
Journals
Framing for ODBM performance
IMS Log
Input and output for ODBM
15
Response times over 2 seconds!
"WebSphere Application Server waits 2 seconds
for a response from IMS. Contact IMS support."
WAS
support staff
WebSphere
Application
Server (WAS)
The problem is somewhere in here:
a reporting "black hole" between
the two product support teams
IMS
Connect
ODBM
"IMS responds
in a millisecond."
IMS
support staff
IMS
IMS
Connect
Extensions
IMS log
Event journal
Tracks DRDA
flow
IMS
Problem
Investigator
IMS
Performance
Analyzer
Reports separate
response times
for IMS Connect
and IMS
IMS Problem Investigator
• The first interactive log analysis tool for IMS
• Used in dozens of Global 2000 enterprises in over 15
countries
• Actively developed product: significant enhancements
being released continuously
• Full detailed support for CEX ODBM event records
• Includes Code Points and DDM Objects
17
IMS PI and Open Database
•
•
•
•
•
Open database requests are captured in the CEX journal
IMS PI can format the requests
Interprets standard DDM objects
Interprets IMS-specific extensions
Allows you to connect DRDA requests to data IMS log and
monitor data, OMEGAMON ATF…
18
Initiation
File Menu Edit Mode Navigate Filter Time Labels Options Help
——————————————————————————————————————————————————————————————————————————————
IMSPI
CEX000.QADATA.REDBOOK.DRDAT111.ICON.D1003 Record 00000001 More: < >
Command ===>
Scroll ===> CSR
Forwards / Backwards . . 00.00.00.000100
Time of Day . . 16.46.22.845746
Code Description
Date 2010-03-31 Wednesday Time (LOCAL)
/ ---- ------------------------------------------------------ ---------------A000 IMS Connect Extensions Control Information
13.26.14.140845
A05B DRDA 1041 EXCSAT-Exchange Server Attributes
13.46.43.550577
A05B DRDA 106D ACCSEC-Access Security
13.46.43.550630
A05C DRDA 1443 EXCSATRD-Server Attributes Reply Data
13.46.43.550655
A04A WRITE Socket
13.46.43.550715
A05B DRDA 106E SECCHK-Security Check
13.46.44.165876
A063 ODBM Security Exit called
13.46.44.166018
A064 ODBM Security Exit returned
13.46.44.166131
A05C DRDA 1219 SECCHKRM-Security Check Reply Message
13.46.44.166155
A04A WRITE Socket
13.46.44.166264
A05B DRDA 2001 ACCRDB-Access RDB
13.46.44.794057
A05D ODBM begin Allocate PSB (APSB) Program=AUTPSB11
13.46.44.794080
A061 ODBM Routing Exit called
13.46.44.794090
A062 ODBM Routing Exit returned
13.46.44.794258
A069 Message sent to ODBM
13.46.44.794711
A06A Message received from ODBM
13.46.45.067997
A05E ODBM end Allocate PSB (DPSB) Program=AUTPSB11
13.46.45.068131
19
Open database query
File Menu Edit Mode Navigate Filter Time Labels Options Help
——————————————————————————————————————————————————————————————————————————————
IMSPI
CEX000.QADATA.REDBOOK.DRDAT111.ICON.D1003 Record 00000057 More: < >
Command ===>
Scroll ===> CSR
Forwards / Backwards . . 00.00.00.000100
Time of Day . . 16.46.22.845746
Code Description
Date 2010-03-31 Wednesday Time (LOCAL)
/ ---- ------------------------------------------------------ ---------------A048 Trigger Event for ODBMMSG
13.46.47.193554
A05B DRDA 200C OPNQRY-Open Query
13.46.48.120747
A05B DRDA CC05 DLIFUNC-DL/I function
13.46.48.120837
A05B DRDA CC01 INAIB-AIB data
13.46.48.120890
A05B DRDA CC04 RTRVFLD-Field client wants to retrieve data 13.46.48.120943
A05B DRDA CC04 RTRVFLD-Field client wants to retrieve data 13.46.48.121013
A05B DRDA CC06 SSALIST-List of segment search argument
13.46.48.121066
A069 Message sent to ODBM
13.46.48.121224
A06A Message received from ODBM
13.46.48.124238
A05C DRDA 2205 OPNQRYRM-Open Query Complete
13.46.48.124345
A04A WRITE Socket
13.46.48.124514
A048 Trigger Event for ODBMMSG
13.46.48.124552
A05B DRDA 200C OPNQRY-Open Query
13.46.49.009514
A05B DRDA CC05 DLIFUNC-DL/I function
13.46.49.009586
A05B DRDA CC01 INAIB-AIB data
13.46.49.009637
A05B DRDA CC04 RTRVFLD-Field client wants to retrieve data 13.46.49.010758
A05B DRDA CC04 RTRVFLD-Field client wants to retrieve data 13.46.49.010828
20
Elapsed times
File Menu Edit Mode Navigate Filter Time Labels Options Help
——————————————————————————————————————————————————————————————————————————————
IMSPI
CEX000.QADATA.REDBOOK.DRDAT111.ICON.D1003 Record 00000001 More: < >
Command ===>
Scroll ===> CSR
Forwards / Backwards . . 00.00.00.000100
Time of Day . . 16.46.22.845746
Code Description
Date 2010-03-31 Wednesday Time (Elapsed)
/ ---- ------------------------------------------------------ ---------------A000 IMS Connect Extensions Control Information
13.26.14.140845
A05B DRDA 1041 EXCSAT-Exchange Server Attributes
20.29.409732
A05B DRDA 106D ACCSEC-Access Security
0.000052
A05C DRDA 1443 EXCSATRD-Server Attributes Reply Data
0.000024
A04A WRITE Socket
0.000060
A05B DRDA 106E SECCHK-Security Check
0.615160
A063 ODBM Security Exit called
0.000142
A064 ODBM Security Exit returned
0.000113
A05C DRDA 1219 SECCHKRM-Security Check Reply Message
0.000023
A04A WRITE Socket
0.000109
A05B DRDA 2001 ACCRDB-Access RDB
0.627793
A05D ODBM begin Allocate PSB (APSB) Program=AUTPSB11
0.000022
A061 ODBM Routing Exit called
0.000010
A062 ODBM Routing Exit returned
0.000168
A069 Message sent to ODBM
0.000452
A06A Message received from ODBM
0.273286
A05E ODBM end Allocate PSB (DPSB) Program=AUTPSB11
0.000133
21
“Standard” DDM
File Menu Format Help
———————————————————————————————————————————————————————————————————————————————
IMSPI
CEX000.QADATA.REDBOOK.DRDAT111.ICON.D Record 00000021 Line 00000019
Command ===>
Scroll ===> CSR
Form
===>
+
Use Form in Filter
Format ===> FORM
+001D Type....... 01
RQSCRR..... 0001
+0020
+0020
Object..... 2001 ACCRDB-Access RDB
Length..... +60
CP......... 2001
+0024
+0024
+0028
Object..... 2110 RDBNAM-Relational Database Name
Length..... +17
CP......... 2110
Data....... 'AUTPSB11.ODB1'
+0035
+0035
Object..... 210F RDBACCCL-RDB Access Manager Class
Length..... +6
CP......... 210F
Data....... 2407
+003B
+003B
+003F
Object..... 112E PRDID-Product-specific Identifier
Length..... +20
CP......... 112E
Data....... 'IMS OPEN DB V1.0'
+004F
+004F
+0053
Object..... 002F TYPDEFNAM-Data Type Definition Name
Length..... +13
CP......... 002F
Data....... 'QTDSQL370'
22
Sequence in detail
File Menu Format Help
———————————————————————————————————————————————————————————————————————————————
IMSPI
CEX000.QADATA.REDBOOK.DRDAT111.ICON.D Record 00000035 Line 00000019
Command ===>
Scroll ===> CSR
Form
===>
+
Use Form in Filter
Format ===> FORM
+001D Type....... 01
RQSCRR..... 0001
+0020
+0020
Object..... 200C OPNQRY-Open Query
Length..... +37
CP......... 200C
+0024
+0024
Object..... 2141 MAXBLKEXT-Maximum Number of Extra Blocks
Length..... +6
CP......... 2141
Data....... 0000
+002A
+002A
Object..... C907 PCBNAME-PCB name
Length..... +11
CP......... C907
Data....... 'EMPLPCB'
+0035
+0035
Object..... 2114 QRYBLKSZ-Query Block Size
Length..... +8
CP......... 2114
Data....... 00008000
+003D Object..... 2156 QRYROWSET-Query Rowset Size
+003D Length..... +8
CP......... 2156
Data....... 00000001
********************************* End of data *********************************
23
Details of input and output
File Menu Format Help
———————————————————————————————————————————————————————————————————————————————
IMSPI
CEX000.QADATA.REDBOOK.DRDAT111.ICON.D Record 00000050 Line 00000019
Command ===>
Scroll ===> CSR
Form
===>
+
Use Form in Filter
Format ===> FORM
+001D Type....... 03
RQSCRR..... 0001
+0020
+0020
Object..... CC06 SSALIST-List of segment search argument
Length..... +55
CP......... CC06
+0024
+0024
Object..... C905 SSACOUNT-Number of segment search arguments
Length..... +6
CP......... C905
Data....... 0002
+002A
+002A
+002E
Object..... C906 SSA-Segment search argument
Length..... +32
CP......... C906
Data....... 'EMPL
*D(EMPNO
GE
)'
+004A Object..... C906 SSA-Segment search argument
+004A Length..... +13
CP......... C906
+004E Data....... 'EMPLINFO '
********************************* End of data *********************************
24
Solving problems
• Session errors: these are conditions that generate distinct
error. For example, specifying the wrong alias name, trying
to access a stopped PSB.
• Performance problems: IMS provides an output but
processing time is slow.
• Unexpected responses: the client receives information
from IMS but it is not the feedback that the client was
expecting.
25
Filtering
File Menu View Help
——————————————————————————————————————————————————————————————————————————————
IMSPI
Filter
Row 1 of 1 More: < >
Command ===>
Scroll ===> CSR
Filter . . . . .
+
Description . . . New Log Record Filter
Activate Tracking
/ Log Code + Exc Description
CON A047
Session Error
Level 1
Conditions No
Form
+ REXX
-----------------------------------------------------------------------------******************************* Bottom of data ********************************
File Menu Edit Mode Navigate Filter Time Labels Options Help
——————————————————————————————————————————————————————————————————————————————
IMSPI
CEX000.QADATA.REDBOOK.ERR01.ICON.D100331
Record 00000027 More: < >
Command ===>
Scroll ===> CSR
Forwards / Backwards . . 00.00.00.000100
Time of Day . . 16.46.22.845746
Code Description
Date 2010-03-31 Wednesday Time (LOCAL)
/ ---- ------------------------------------------------------ ---------------A047 Session Error
11.54.55.710442
A047 Session Error
12.03.02.490039
A047 Session Error
12.32.09.670281
******************************** Bottom of Data *******************************
26
Details of error
File Menu Format Help
———————————————————————————————————————————————————————————————————————————————
IMSPI
CEX000.QADATA.REDBOOK.ERR01.ICON.D100 Record 00000027 Line 00000016
Command ===>
Scroll ===> CSR
Form
===>
+
Use Form in Filter
Format ===> FORM
+001A CERE_47_VAR_MSG.... 134 byte message area
+0000 C8E6E2D2 F2F8F7F5 E640D5D6 40D6C4C2
*HWSK2875W NO ODB*
+0010 D440C9E2 40C1E5C1 C9D3C1C2 D3C540C6
*M IS AVAILABLE F*
+0020 D6D940D4 C5E2E2C1 C7C540D9 D6E4E3C9
*OR MESSAGE ROUTI*
+0030 D5C75E40 C37ED6C4 C2F3C3F0 F4F16B40
*NG; C=ODB3C041, *
+0040 C9D4E2C1 7ED3C1D3 C16B40D7 7EF4F8F8
*IMSA=LALA, P=488*
+0050 F5F54040 406B40C9 D4E2C1F1 7E404040
*55
, IMSA1=
*
+0060 406B40D6 C4C2D47E 40404040 40404040
* , ODBM=
*
+0070 6B40D97E C9D4E2C1 D5C6D5C4 6B40D47E
*, R=IMSANFND, M=*
+0080 D4D9C3E5 0000
*MRCV..
*
+00A0 CERE_47_VAR_SESRSN......... 'WRITE
'
+00A8 CERE_47_VAR_TOKEN.......... 0000000000000000
********************************* End of data *********************************
27
OMEGAMON ATF
• Application-level accounting
• Identify DLI call times and CPU utilization
• Use with IMS PI filtering and tracking to proactively identify
problems
• Resolve problems by ‘tracking’ from ATF records to all
other available records (in the IMS log, DB2, etc…)
28
Combining ATF with Open DB
File Menu Edit Mode Navigate Filter Time Labels Options Help
──────────────────────────────────────────────────────────────────────────────
BROWSE
CEX000.QADATA.REDBOOK.DRDAT111.ICON.D1003 Record 00000308 More: < >
Command ===>
Scroll ===> CSR
Forwards / Backwards . . 00.00.00.000100
Time of Day . . 16.46.22.845746
Code Description
Date 2010-03-31 Wednesday Time (LOCAL)
/ ---- ------------------------------------------------------ ---------------A049 READ Socket
13.46.47.095038
A05B DRDA CC06 SSALIST-List of segment search argument
13.46.47.095045
A0AA ODBM Trace: Message sent to ODBM
13.46.47.095985
A069 Message sent to ODBM
13.46.47.096016
06
OSAM IWAIT start TranCode=ODBA02CD Region=0003
13.46.47.142891
20
Database Open Database=EMPDB2 Region=0003
13.46.47.143647
06
OSAM IWAIT start TranCode=ODBA02CD Region=0003
13.46.47.181506
20
Database Open Database=AUTODB Region=0003
13.46.47.182252
06
OSAM IWAIT start TranCode=ODBA02CD Region=0003
13.46.47.191442
01
DLI GHU Database=EMPLDB2 SC=' ' Elapse=0.095875
13.46.47.096570
B021 DLI Database Trace Database=EMPLDB2 Func=GHU
13.46.47.192378
A0AA ODBM Trace: Message received from ODBM
13.46.47.192881
A06A Message received from ODBM
13.46.47.192909
A05C DRDA 2205 OPNQRYRM-Open Query Complete
13.46.47.193186
A04A WRITE Socket
13.46.47.193515
A048 Trigger Event for ODBMMSG
13.46.47.193554
A03C Prepare READ Socket
13.46.48.120636
29
IMS Performance Analyzer
Disk or tape:
• IMS PA provides
performance
reports
• Proactive and
reactive tool
• Help identify
problems
• Meet SLAs
• Plan and
optimize capacity
IMS PA
ISPF dialog
SLDS (or OLDS)
IMS Log records
Generates
& submits
JCL
IMS Connect Extensions
journal data sets
Report/extract
request
with input file
ddnames
IMS Connect records
Reports
IMS Monitor data sets
IMS Monitor records
Batch job:
report/extract
request
OMEGAMON
TRF Extractor data sets
Specified
input files
Extracts
Transaction
Index
30
IMS Configuration Manager
• IMS Configuration Manager is a rebranding of IMS
Parameter Manager
• Represents the introduction of significant new features and
a refocus of the product
• Focus changes from managing IMS parameters to
managing IMS resources
• Retains most parameter management functionality
• Adds ability to edit, browse, and install IMS resources
• Leverages DRD
31
Open database
• Now: helps you set up ODBM and IMS Connect address
space
• Future requirement: provides a control web interface
where you can manage your IMS environment
32
Future suggestions
• Improved reporting in IMS PA
• ODBM End to End reporting
• More flexible forms of tracking in IMS PI
• Better address-space management and GUI-based
administration (ICM)
33
Conclusions
•
•
•
•
•
Open database is a significant enhancement to IMS
Simplifies application development for IMS
Creates challenges for system administration
IMS Tools are evolving to help address these challenges
Your thoughts?
34
Literature
• Upcoming IMS Open Database Redbook
• IMS Application Programming API
• Technical Standard: DRDA, Version 4, Volume 1 and V3
35
More information
• IBM DB2 and IMS Tools website:
http://www.ibm.com/software/data/db2imstools/
• Jim Martin, US Representative, Fundi Software:
jim_martin@fundi.com.au
36