Data Collection Introduction Name / job role What company are you with How much experience do you have using Webtrends Create a Word document for your notes .. Agenda Data Collection Architecture & Workflow Architecture & Workflow 1 2 DCSID Domains to be tracked SDC IP address Persistent Cookie Page parsed for tags Tagged website JavaScript Tag web servers DCSID + dcs.gif + parameters 4 3 dcs.gif SDC Cookie Data Collection Data Sources Data Sources Before you can create a profile and generate reports, you need to have a configured Data Source. Configuring a Data Source tells Webtrends where to find the data it analyzes for reports. Data Sources connect to SDC log files, uniquely identified with a DCSID. The DCSID is then used to map the log files to the website(s). Workshop CREATING A DATA SOURCE Workshop: Creating a Data Source Creating a Data Source enables a ‘Link’ to Webtrends Tag Builder, that can be used to create the baseline JavaScript tag. Action Select: Administration > Application Settings > Data Sources - New Select: Web: SmartSource Data Files Name: Whatever Path: C:\Log Files\whatever.log page 3 Smart Source Data Collector SDC is a specialized Web server. It receives HTTP requests from Web clients, processes the requests, and appropriately responds to the Web clients. Each SDC is identified by a unique DCSID alphanumeric string. If you have multiple domains it is recommended to have a separate SDC for each domain. To run SDC version 7.5a or higher, you need to configure a site map file (webtrendssites.lst) that contains the DCSID for each of your data sources. The site map file allows you to track visitors across multiple domains using first-party cookies. It also allows you to analyze traffic for all your domains using the account roll-up data source. Workshop INSTALLATION OF SDC Workshop: Installation of SDC Action Install SDC: C:\Webtrends\Software\sdc-windows.exe Accept default values / pathways Select: First Time Installation Copy & Paste: DCSID Set Time Zone: GMT + IIS Manger: Restart websites Services: Restart WWW Website: Open / Refresh www.whatever.com dcsbusy: C:\Program Files(x86)\Webtrends\SmartSource Data\sdc\weblog Workshop: Installation of SDC Installing the SDC stops the services for the websites. To restart the services: Open: IIS manager by clicking on the icon located in the status bar Expand: The Web Server options Workshop: Installation of SDC Restart the websites, by selecting and clicking on Start located in the Actions pane. Next Restart the WWW Publishing service, by clicking on the Services icon located in the status bar webtrendssites.lst (OnPremise) dcs.audit (OnPremise) May-14-2010 18:07:50: #### The following invalid hit was discarded due to DCS ID not found in sitemap file: Client IP: 127.0.0.1 (Mozilla/5.0 (Windows; U; Windows NT 5.2; en-GB; rv:1.9.2.3) Gecko/20100401 Firefox/3.6.3 (.NET CLR 3.5.30729)) URI: GET /dcsoyajcc100004fusr708zy6_9h7g/dcs.gif?&dcsdat=1273856870758&dcssip= www.whatever.com&dcsuri=/index.html&dcsref=http://www.whatever.com/&WT.c o_f=23abaa9152bd0549e281273450121123&WT.vtid=23abaa9152bd0549e281 273450121123&WT.vtvs=1273856866051&WT.tz=1&WT.bh=18&WT.ul=enGB&WT.cd=24&WT.sr=1280x800&WT.jo=No&WT.ti=Main%20Landing%20Page &WT.js=Yes&WT.jv=1.8&WT.ct=unknown&WT.bs=1280x613&WT.fv=10.0&WT.sl v=Unknown&WT.tv=8.6.2&WT.dl=0&WT.ssl=0&WT.es=www.whatever.com/index .html&WT.vt_f_tlh=1273856866 HTTP/1.1 whatever.com Data Collection Tag Builder v4 Tag Builder Tag Builder Tag Builder The Webtrends Tag Builder creates the required files that are used to track your visitor behaviour. Tag Builder generates the following files: readme.txt contains a description of the tag files as well as the same tag deployment instructions shown in this Help file. webtrends.html contains the JavaScript code. webtrends.js is the JavaScript include file referenced in webtrends.html. tbconfig.xml contains the information you need to upgrade an existing tag using Tag Builder. Tag Builder To deploy the tag: Save the webtrends.js file in a common JavaScript location on your web server. Edit the path referenced in webtrends.html so that it points to the actual location of webtrends.js Paste the contents of webtrends.html on every page in your web site. To avoid logging hits to pages that do not load completely, and to ensure best performance, paste this code just before the </body> tag at the bottom of your web page. Workshop JAVASCRIPT TAG V9 Workshop: Creating Javascript Tag Actions Go to: Application Settings Select: Whatever Data Source Click: Build Tag (Tracking Code) Enter: Required settings Click: Build Tag Workshop: Creating Javascript Tag Action Download Tag: Save in C:\Temp Extract: Right mouse click Rename: web.js Open: webtrends.html View: the source code webtrends.html webtrends.js webtrends.js Method Description dcsGetMeta Reads a meta tag name and returns its content. dcsAdSearch Scans page for links containing ad click query parameters (specified in adclickparam property) and populates Query Parameter for ad view (WT.ad). dcsDownload Download links click event handler. dcsOffsite Offsite links click event handler. dcsMultiTrack Helper method for globally available dcsMultiTrack function. dcsDebug Creates popup window with data collection URL components. Workshop DEPLOYING JAVASCRIPT TAG Workshop: Deploying Javascript Tag Action Open: Whatever.com in Expression Expand: scripts folder Copy: web.js from C:\Temp View: source code for webtrends.html Copy: source code from webtrends.html Paste: the </body> Basetag.html page Workshop TESTING DEPLOYMENT Workshop: Testing Deployment Actions Firebug: Firefox plugin HttpFox: Firefox plugin WASP: Firefox plugin http://wasp.immeria.net HTTP Watch: IE and Firefox http://www.httpwatch.com Fiddler 2 or 4 Observe Point: Firefox / Chrome plugin javascript:dcsDebug() basetag 8.5+ page 13 Workshop CONFIGURING SITE MAP Workshop: Configuring Site Map To configure an SDC site map: Open: Webtrendssites.lst file located: C:\Program Files(x86)\Webtrends\SmartSource Data Collector\sdc\cfg directory. Replace: dcs5w0txb10000wocrvqy1nqm_6n1p with the DSCID used for the rest of the site. dcsoyajcc100004fusr708zy6_9h7g Data Collection Tag Builder: v9 tag Event Tracking v9 Event Tracking Use the Off-Site Links check box to track all the links on your site that go to other sites. If you want to identify some links that use a different domain as on-site links, type a commaseparated list of domain names in the Track these domains as on-site text box. For example, if you want to track off-site links from the product site yourcompany.com, and you enable off-site link tracking, you can ensure that links to your branding site continue to be tracked as on-site links by typing yourbrand.com in the text box. Off-site links are hyperlinks whose URL resolves to an off-site domain. Event Tracking The check box inserts an onclick event handler function named dcsOffsite. The handler is bound to the document body. When a mouse click occurs on the page, the handler is called. The handler receives an event object as an argument. If the event object meets the criteria above, then its contents are passed as parameters to dcsMultiTrack. By default, query parameters are removed from the off-site link to reduce the number of unique URLs. To include query parameters in the off-site link, set trimoffsiteparams=false in Webtrends constructor function in webtrends.js. An event specific identifier is passed via the WT.dl=24 parameter Event Tracking Onsite domain field contains: www.whatever.com Page contains the following hyperlink: <a href="http://www.offsitedomain.com/some_page">Offsite Link</a> Clicking the link generates the following parameters: DCS.dcssip www.offsitedomain.com DCS.dcsuri /some_page WT.ti=Offsite: www.offsitedomain/some_page WT.dl=24 Event Tracking The download file types field contains: xls Onsite domain field contains: www.whatever.com Page contains the following hyperlink: <a href="smartsource.xls">SmartSource Spreadsheet</a> Clicking the link generates the following parameters: DCS.dcssip www.whatever.com DCS.dcsuri /smartsource.xls WT.ti Download: SmartSource Spreadsheet WT.dl 20 Event Tracking Onsite domain field contains: www.whatever.com Page contains the following hyperlink: <a href=“/page.aspx#TopOfPage">Go to top</a> Clicking the link generates the following parameters: DCS.dcssip www.whatever.com DCS.dcsuri /page.aspx#TopOfPage WT.ti Anchor:#TopOfPage WT.dl 21 Event Tracking <form name="Post_Colour" action="FormButton.aspx" method=post> <input type=text name="colour" value="blue"> <input type=submit value="Submit"> </form> Corresponding dcsMultiTrack parameters: DCS.dcsuri /FormButton.aspx WT.ti "FormButton:" + title WT.dl 27 WT.nv Enclosing element id or classname (if present) Event Tracking mailto: protocol <a href="mailto:feedback@whatever.com?subject='Feedback'">Email</a> Clicking the link generates the following parameters: DCS.dcsuri mailto:feedback@whatever.com.com?subject=Feedback WT.ti mailTo:feedback WT.dl 23 Event Tracking javascript: protocol <a href="javascript:alert('Message')">Alert</a> Clicking the link generates the following parameters: DCS.dcsuri javascript:alert('Good%20Morning') WT.ti javascript:Alert Greeting WT.dl 22 Event Tracking <area shape="poly" coords="18,0, ... 27,0" href="americas_on.gif?region=Americas" onmouseover="ci('worldmap', 'americas_on.gif')"> </map> Clicking the Americas region of the image map generates the following parameters: DCS.dcssip www.whatever.com DCS.dcsuri /EventTracking/americas_on.gif DCS.dcsqry ?region=Americas WT.ti ImageMap:worldmap_map WT.dl 30 Event Tracking An Ad View occurs when a visitor views a page containing an ad. An ad is a link or graphic that contains an Ad Click parameter in the query portion of the URL. Enabling this setting causes the tag to scan all links on a page, looking for the Ad Click parameter specified in the accompanying text box. The text box must contain a query parameter used to denote Ad Click links. If a matching link is found (case insensitive), its Ad Click parameter value is extracted and assigned to the Ad View parameter (WT.ad). If more than one Ad Click link is found, each value is appended to the Ad View parameter (delimited by semi-colon). This work is performed by a function named dcsAdSearch. Event Tracking Suppose you are using the default Ad Click parameter: WT.ac Suppose you have a page with the following Ad Click links: <a href="http://advendor.com/process_click?WT.ac=image_link_car"> <img src="car_ad.gif"></a> <a href="http://advendor.com/process_click?WT.ac=image_link_house"> <img src="house_ad.gif"></a> <a href="http://advendor.com/process_click?WT.ac=image_link_boat"> <img src="boat_ad.gif"></a> The Ad View parameter generated from the page load would be: WT.ad=image_link_car;image_link_house;image_link_boat Workshop EVENT TRACKING Workshop: Event Tracking Action page 23 Create and Implement: javascript tag to track events Name: webtrends_events.js Check: the correct parameter values are passed Data Collection Link Tracking Link Tracking The modified javascript tag leverages <div id> tags to report either at an individual link or <table> level. The tag values are associated with the Webtrends WT.nv Workshop LINK TRACKING Workshop: Link Tracking The LinkT.html page on the Whatever.com website contains a number of links that can be tracked using the Tag Builder. Create and implement a JavaScript Tag that tracks these links. Name the JavaScript Tag: Webtrends_link_tracking.js Ensure that the correct parameters associated with the events have been successfully logged in the SDC. Data Collection Webtrends Meta Tags Meta Tags The JavaScript tag supports the use of HTML META tags as a means of extending the collected data. By adding supported META tags to your Web pages, you can capture meta-data describing your Web content. The tag takes advantage of Web browsers support of the Document Object Model (DOM) to capture the meta-data. When found, the meta-data is added to the SDC hits in the form of Webtrends query parameters. These query parameters are then used by Webtrends during the analysis process. Meta Tags <head> <title>Page Title</title> <!-- Webtrends Added --> <meta name="Webtrends Meta Tag" content="Value"> <!-- Webtrends Added --> </head> <body> <!-- Webtrends Added --> Webtrends Base JavaScript Tag <!-- Webtrends Added --> </body> Meta Tags Webtrends reserved query parameters require an upper case name space, either WT or DCS, and the type identifier in lower case. The following name spaces are reserved for Webtrends: WT.i_ Used for product integrations with Webtrends partners. WT.z_ Used by Webtrends Professional Services for customer integrations. Meta Tags Recognized by Webtrends and used to auto-configure certain features WT Parameter Name WT Parameter Content Group: WT.cg_n WT.cg_s Marketing Campaign: WT.mc_id Traffic Source: WT.tsrc Advertising Impression: WT.ad Advertising Click: WT.ac Scenario Analysis: WT.si_n WT.si_x or WT.si_p Page Title: WT.ti Search Engine: WT.srch=1 Meta Tags Recognized by Webtrends and used to auto-configure certain features WT Parameter Name WT Parameter Web Client: WT.tz WT.bh WT.ul WT.cd WT.sr WT.jo WT.jv WT.ct WT.hp Product: WT.pn_sku WT.pc Transactional: WT.tx_u WT.tx_s WT.tx_cartid Invoice: WT.tx_i WT.tx_id WT.tx_it Segment: WT.seg_x WT.pn_id WT.pn_ma WT.js WT.pn_gr Meta Tags Recognized by Webtrends and used in custom reports: You can add custom values to the passed query string using: DCSext.w_custom_identifier = <value> <meta name=“DCSext.w_parks” content=“park_Walibi”> <meta name=“DCSext.w_sub3” content=“Menswear”> Tags can be found in: Documentation Centre / Webtrendstraining.net Workshop META TAGS Workshop: Meta Tags Category Content Groups page 43 OnSite Advertising page 44 Workshop: Meta Tags Scenario Analysis The scenario definition contains 5 steps: Step 1 - Products Step 2 - Account Details Step 3 - Basket Step 4 - Order Placed Step 5 - Invoice Data Collection dcsMultiTrack() dcsMultiTrack () dcsMultiTrack function lets you log virtual page views to the SmartSource Data Collector (SDC) servers for nearly all types of events. dcsMultiTrack is a way to program a Web site page so that data captured using the dcsMultiTrack functions and parameters are logged: Flash events such as start, finish, progress, and clicks within a Flash application Ajax interactions Downloads of files that can not be tagged, such as pdf’s Form completion Any event that launches JavaScript dcsMultiTrack () To invoke the dcsMultiTrack function to report a virtual page view to the Smart Source Data Collector, use the following syntax: dcsMultiTrack('parameter1', 'value1', 'parameter2', 'value2'); An example a regular page link with dcsMultiTrack(): <a href=http://www.domain.com/folder/page.html onclick="dcsMultiTrack( ‘DCS.dcssip', 'www.domain.com', 'DCS.dcsuri', '/folder/otherpage.html', 'WT.ti', 'My Page Title', 'WT.dl', ‘24');">Page of Interest</a> Workshop DOWNLOAD LINKS Workshop: Download Links Whatever.com wishes to track a specific HTML link, a downloadable file, on their website. Action Open: Expression > dcsmultitrack > Downloads.html View: Code for dcsMulTrack.pdf download Modify: The code to include the following: Event: onclick Function: dcsMultiTrack DCS.dcsuri: /downloads/dcsMultiTrack.pdf WT.ti: dcsMultiTrack%Document WT.dl: 20 Open: HttpFox to check the correct parameters are passed in the Query String. Workshop OFFSITE LINKS Workshop: Offsite Links Whatever.com wishes to track clicks on an offsite link. Action Open: Expression > dcsmultitrack > OffsiteLink.html View: Code for offsite link .. Line 104 Modify: The code to include the following: Event: onclick DCS.dcssip: www.wherever.com DCS.dcsuri: / WT.ti: Home%20Page WT.dl: 24 Open: HttpFox to check the correct parameters are passed in the Query String. Workshop FORMS Workshop: Forms Whatever.com wishes to track progression of a visitor through a registration form. Action Open: Expression > dcsmultitrack > Forms.html View: Code for dcsMulTrack.pdf download Modify: The code to include the following: Event: onclick DCS.dcsuri: Form Field value WT.ti: Form Field value WT.dl: 27 Open: HttpFox to check the correct parameters are passed in the Query String. Workshop: Forms Modify the code to track the following: Scenario Step Path WT tag Value 1 Forms.html WT.si_n WT.si_x Registration 1 2 First Name Field WT.si_n WT.si_x Registration 2 3 Last Name Field WT.si_n WT.si_x Registration 3 4 Email Field WT.si_n WT.si_x Registration 4 dcsMultiTrack () For complex web sites that enforce separation of logic and presentation, you can use the Document Object Model (DOM) method to implement the dcsMultiTrack function. Can also use: getElementByTag Data Collection Tag Builder: v10 tag Tag Builder: v10 tag Traditional JavaScript Files: Launched from inline "blocking" HTML Keeps the page from completely loading until the JavaScript executes Impacts to user experience and potential for undercounting visitors Asynchronous JavaScript Files: Non-blocking, can load from anywhere on the page Faster tracking code load times for your web pages due to improved browser execution Enhanced data collection & accuracy Elimination of tracking errors from dependencies when the JavaScript hasn't fully loaded Tag Builder: v10 tag Social Analytics Features Built-In: Uniquely track Facebook social widget interactions, Facebook App tracking, referrals, & click-through campaign sessions. It's a single click to add this into the tag. Tag Builder: v10 tag Powerful plugin architecture allows for the easy addition of new tracking capabilities without modifying the JavaScript: •Webtrends Plugins: Webtrends Heatmaps Facebook Webtrends Ads •Webtrends Developer Community Plugins*: Cross-Channel Visit/Visitor Matching Twitter YouTube Google+ HTML Apps •*Not officially supported by Webtrends Technical Support Tag Builder: v10 tag Compact & Minimizes to Small Footprint Bandwidth limited devices can download the tag with very little data transfer Support for Mobile Website Spaces Optimized to minimize well using Google Closure Compiler ** The min tag doesn’t support Heatmaps Tag Builder: v10 tag Additional Enhancements: Selector-based event tracking "Transform" events and page load tap points Webtrends Tag Builder Webtrends Tag Builder v10 Additional Enhancements: •Selector-based event tracking •"Transform" events and page load tap points •Webtrends Tag Builder Data Collection Upgrading to v10 tag Upgrading to v10 tag You can place the v10 tag anywhere on the page. Since the tag is loaded asynchronously, it does not block page rendering in any way. You can place the tag in the <head> section or anywhere within the <body> section with minimal impact on page rendering times. In addition, the tag runs in the background, so there is minimal impact on user experience after the page has loaded. <!-- START OF SmartSource Data Collector TAG v10.x.0 --> <!-- Copyright (c) 2013 Webtrends Inc. All rights reserved. --> <script type="text/javascript" src="/scripts/webtrends.load.js"></script> Upgrading to v10 tag Upgrading is a 4 step process: Transform Configuration Settings Migrate Customizations Change HTML Markup Test Before you begin, you'll need to have: Complete copies of a v9 and v10 tag (ideally, the two .zip files from Tag Builder). Ability to edit HTML and JavaScript Access to a web server, so you can test pages Workshop JAVASCRIPT TAG V10 Workshop: Javascript Tag v10 In this exercise you’ll create and deploy a Javascript Tag v10: Create the tag in Tag Builder Deploy & test on: www.whatever.com/tag builder/upgrade.html Data Collection REST API REST API The Data Extraction API conforms to the REST (Representational State Transfer) architectural style, using the HTTP protocol and a URI to access resources. Integrates with Excel without coding, client software, or installed driver--you need only your Webtrends credentials to get data Returns the entire data set for a trend in response to a single URI (for example, trending a week by hours) Is profile and account independent, so you can list multiple profiles by changing the profile name in the URI REST API There are two main ways of creating the REST request: Analytics 10: via the “Share” option when viewing a report from within the Webtrends Analytics 9 Insight user interface. REST Generator: is an application that helps you rapidly create a request for profile or report data. Data Collection Summary Summary Thank you for your time..