Session 8 - First Line Troubleshooting This session covers the following topics – Exaquantum Support Tools, including • Tag Configuration Viewer • Cross Reference Tool • OPC Server Viewer and Data Recovery Tool • LiveXplore • System Event Viewer • System Information Gathering Tool • Network Diagnostic Tool • History Data Checker • System Configuration Tool This session also looks at measuring the performance of the system using the Exaquantum Performance Counter. M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 1 Troubleshooting Overview Most of the time the system runs as expected Sometimes things may not Exaquantum provides a number of support tools to aid troubleshooting Microsoft windows operating systems also provide tools which can be used M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 2 Exaquantum Developer Tools Folder M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 3 Problems That May Occur Tag values not as expected Live values but no history Some tags ok but others using the same template are not Tag configuration not as expected M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 4 Problems That May Occur User does not have expected privileges Failure to equalise but Data OK No events being logged Poor performance M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 5 Trouble Shooting Example - Data Not As Expected There are a number of reasons why the value of a tag could be wrong: – Server Time different from Client Time – Time Zone incorrect – Communication with OPC Server lost Live data but no history – Raw history interval set to none – Disk containing SQL database full – History Data SQL Database file full M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 6 Trouble Shooting Example - Data Not As Expected - Continued Reference Data out of date Tag/Function Block configuration out of date Data is returned by some requests others fail M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 7 Displaying Live And History Values Tag Editor only shows latest value For Live and Historical values you can – use Exaquantum/Explorer – use Exaquantum Excel Add-In – use LiveXplore M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 8 Displaying Live And History Values Use Exaquantum/Explorer – This involves creating documents – May itself be at fault – May not be installed on the server Use Exaquantum Excel Add-In – Again this may be the cause of the problem – May not be installed on the server M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 9 Displaying Live And History Values Continued Use LiveXplore – Easy drag/drop configuration of live, history snapshot and history trending – No drawing or third party constraints – Available on client and server M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 10 LiveXplore Multiple Windows Support Trend Select Item by clicking Snapshot Live Save Configuration M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Export Data Day 3 Slide No. 11 LiveXplore - Trend Example M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 12 LiveXplore Live Example Maximum Number of Rows to display New Rows appear as Data updates M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 13 LiveXplore with Data Selector showing Descriptions and Quality M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 14 Viewing The Configuration Of Tags Some problems can be due to the configuration The Admin Tools provide a topical view of the data The Admin Tools do not provide a view of all the properties of individual tags on a single screen If configuration is thought to be a problem then the Tag Configuration Viewer will be useful M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 15 Tag Configuration Viewer Provides the ability to – View the complete configuration details of a tag or tags – List Tags not built to the current version of the Templates – List Function Blocks not built to the current version of the Templates – List Tags where the Raw History specification does not match the OPC communication settings – List all the Locked Tags M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 16 Tag Configuration Viewer Continued – List information about tag Short Cuts – List all Calculated tags with bad scripts – View Short Cuts for which the under lying tags have been deleted – View Tags which have been set offline M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 17 Tag Configuration Viewer User Interface Select Server Define Report Save Contents to a File Print Report M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 18 Configuring The Tag Configuration Viewer Drop Down List of supported reports Use Drag and Drop from Data Selector to Configure M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 19 Configuration Viewer Drop Down Menu M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 20 Tag Viewer Option The Tag Configuration Viewer displays the following – Name – Internal ID – Data and Tag Type – Template Name and Version – Function Block Name and Version – Description – Engineering Range and Units – OPC Server, Period, Deadband and ItemID – Aggregation Types and Periods – Raw History Interval – Script M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 21 Tag Configuration Viewer Example M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 22 Example Showing Inactive Browser And Selected Tags Windows M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 23 Function Block Version As List View M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 24 Function Block Version Per Item View M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 25 Example CSV File Loaded Into Microsoft Excel M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 26 Excel Showing The Exaquantum Add-In Ribbon M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 27 Tracking Template And Tag References Tags are referenced by Calculation Tags and Shortcuts Tag and Function Block Templates will be used a number of times Problems can arise due to a change in configuration of a referenced tag or due to a change in a template It is therefore necessary to know – what tags are used in a calculation and in shortcuts – which tags are built using a particular template The Exaquantum Cross Reference Tool provides this level of information M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 28 Example Cross Reference Report Results Search Criteria M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 29 Defining The Search Criteria Select Search Type – FB Template – Tag Template – Calculations – Shortcuts – Calculations and Shortcuts Select Target – Drag from Browser Select Path – Not required for Templates – Drag from Browser M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 30 Setting A Calculation Search Criteria Drag to set search path Drag tags or enter wildcards M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 31 Example Showing Tags In Calculations M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 32 The File Menu The File menu allows you to – Open an existing search – Start with a new search – Save a search to a file – Save a report to a text file – Print a report – Select the Server to use M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 33 The Edit Menu The Edit menu allows you to – Add a new search criteria – Edit an existing search criteria – Delete a search criteria – Copy the results to the clipboard – Delete all search criteria – Clear report M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 34 Exaquantum Consistency Tool This tool is useful when either RTDB or Historical items are not being updated. Runs four tests to check system consistency – Items which should be stored in history but are not – Historical information which cannot be accessed – Maximum OPC notification rate exceeded – Maximum number of OPC groups exceeded Indicates pass/fail not what was the cause M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 35 Exaquantum Database Consistency Tool - Example M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 36 Tracking Changes To The Configuration Database Exaquantum provides an audit trail of all Configuration Database changes Provides both overview and detail views Provides a search facility to display changes over a particular period – useful when problems have occurred since a particular time To read the audit trail use the RevHistory utility M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 37 Revision History Tool M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 38 Obtaining Details of Change Select Option from Details menu Or Click on the Icons M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 39 Revision History Support Tool Showing An Active Details Icon Tag Details Icon becomes active Select Tag entry in grid M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 40 Function Block Tag Details M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 41 Expression Viewer M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 42 Shortcut Details M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 43 Selecting Times For Search M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 44 Revision History Tool Showing Search Results M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 45 Search By Item-Id M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 46 OPC Values Not Updating As Expected Many of the tools already mentioned may be helpful Sometimes even if the configuration is correct data may still not update Communications with OPC server may be at fault The OPC Server Viewer and Data Recovery and OPC Data Viewer tools can help here The applications are called OPC Server Viewer Data Recovery and OPCDataViewer and reside in the Developer Tools folder like the other tools M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 47 OPC Server Viewer and Data Recovery Tool M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 48 OPC Server Viewer and Data Recovery Tool Continued M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 49 OPC Data Viewer M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 50 Exaquantum Behaviour When OPC Communication Fails Exaquantum OPC Client will attempt to reconnect on failure By Default when communication with OPC is lost – All values will go to 0 – Quality will be set to BAD – Secondary Quality will be set to OPC Error Override defaults via the following registry keys – OPCErrorUseOPCTime – OPCErrorNotification – OPCErrorNotificationQuality M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 51 Exaquantum System Event Viewer Displays messages that are generated when significant events occur within Exaquantum The event messages are stored within the Exaquantum database They may be viewed for a selected time range for individual or selected categories In a multi server Exaquantum configuration any configured server can be selected M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 55 Exaquantum System Event Viewer One message is written for each event Event messages have their own archive group By default, the Viewer will show – all categories of event messages – for the past hour – starting with the most recent message Start and end dates/times can be changed. M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 56 Exaquantum System Event Viewer Double clicking on any message will display more detail The contents of the list can be saved as a CSV file for use in other packages or applications. There are six categories of event messages – System – Write – Archive Operations – Tag Generation – Namespace Audit Trail – Recalculation M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 57 Exaquantum System Event Viewer User Interface M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 58 Exaquantum System Event Viewer Details Example M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 59 Monitoring Network Connection Exaquantum is Client/Server system The network between Client and Server is an obvious problem area Exaquantum contains tools which allow this to be tested On the Client executed from the Server Manager (see next slide) On the Server executed directly from the Developer Tools folder M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 60 Exaquantum Server Manager Start the Network Test Tool On the client by clicking M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 61 Network Test showing a Successful Connection M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 62 Network Test Tool Showing a Call Back Failure M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 63 Network Test tool Showing a Connection Failure M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 64 System Information Gathering Tool If you need to escalate a problem to product support it is quite common for support to require certain information To make this information gathering easy Exaquantum provides a tool – The System Information Gathering tool This tool is located in a subfolder of the Developer Tools folder To run the application, navigate to the folder and double click on the PMCDumpWiz icon (see next slide) M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 65 System Information Gathering Tool M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 66 Log Save Wizard Start Screen M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 67 Log Save Wizard Output Location M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 69 Log Save Confirmation Screen M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 70 The Windows Event Viewer Displays information logged by Processes, Services and the operating system Kernel Different classes of events can be logged – Information • Significant events that happen infrequently - normal successful completion – Warning • Possible future failure such as low disk space – Error • Significant error such as loss of data or functionality M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 72 Displaying Path From An Internal ID Raw and historical item data are indexed by internal ID The configuration database maps IDs to actual paths Normally applications specify the Name and this is then converted into an ID The Event Viewer displays items using an internal ID IDtoPath provides the reverse operation M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 73 Example Event Detail Showing ID ID of calculation causing the error M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 74 IDtoPath Tool Example M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 75 Configuring The System Parameters Exaquantum has a number of system parameters Some of these have already been discussed in other sessions Many of these are customisable on a system by system basis These parameters are viewed and modified using the System Configuration tool Exaquantum must be stopped to allow modifications to take place M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 76 The System Configuration Tool User Interface M037 Issue 19 Copyright © Yokogawa Electric Corporation 27th October 2015 Day 3 Slide No. 77
