data collection - Webtrends Training (EMEA)

Data Collection
Introduction
 Name / job role
 What company are you with
 How much experience do you have using Webtrends
 Create a Word document for your notes ..
Agenda
Data Collection
Architecture & Workflow
Architecture & Workflow
1
2
DCSID
Domains to be tracked
SDC IP address
Persistent Cookie
Page parsed for tags
Tagged website
JavaScript Tag
web servers
DCSID + dcs.gif + parameters
4
3
dcs.gif
SDC Cookie
Data Collection
Data Sources
Data Sources
Before you can create a profile and generate reports, you need to have a
configured Data Source. Configuring a Data Source tells Webtrends where
to find the data it analyzes for reports.
Data Sources connect to SDC log files, uniquely identified with a DCSID.
The DCSID is then used to map the log files to the website(s).
Workshop
CREATING A DATA SOURCE
Workshop: Creating a Data Source
Creating a Data Source enables a ‘Link’ to Webtrends Tag Builder,
that can be used to create the baseline JavaScript tag.
Action
Select:
Administration > Application Settings > Data Sources - New
Select:
Web: SmartSource Data Files
Name:
Whatever
Path:
C:\Log Files\whatever.log
page 3
Smart Source Data Collector
 SDC is a specialized Web server. It receives HTTP requests from Web
clients, processes the requests, and appropriately responds to the Web
clients.
 Each SDC is identified by a unique DCSID alphanumeric string. If you have
multiple domains it is recommended to have a separate SDC for each
domain.
 To run SDC version 7.5a or higher, you need to configure a site map file
(webtrendssites.lst) that contains the DCSID for each of your data sources.
 The site map file allows you to track visitors across multiple domains using
first-party cookies. It also allows you to analyze traffic for all your domains
using the account roll-up data source.
Workshop
INSTALLATION OF SDC
Workshop: Installation of SDC
Action
Install SDC:
C:\Webtrends\Software\sdc-windows.exe
Accept default values / pathways
Select:
First Time Installation
Copy & Paste:
DCSID
Set Time Zone:
GMT +
IIS Manger:
Restart websites
Services:
Restart WWW
Website:
Open / Refresh www.whatever.com
dcsbusy:
C:\Program Files(x86)\Webtrends\SmartSource Data\sdc\weblog
Workshop: Installation of SDC
Installing the SDC stops the services for the websites. To restart the services:
 Open:
IIS manager by clicking on the icon located in the status bar
 Expand: The Web Server options
Workshop: Installation of SDC
 Restart the websites, by selecting and clicking on Start located
in the Actions pane.
 Next Restart the WWW Publishing service, by clicking on the
Services icon located in the status bar
webtrendssites.lst (OnPremise)
dcs.audit (OnPremise)
May-14-2010 18:07:50: ####
The following invalid hit was discarded due to DCS ID not found in sitemap file:
Client IP: 127.0.0.1 (Mozilla/5.0 (Windows; U; Windows NT 5.2; en-GB;
rv:1.9.2.3) Gecko/20100401 Firefox/3.6.3 (.NET CLR 3.5.30729))
URI: GET
/dcsoyajcc100004fusr708zy6_9h7g/dcs.gif?&dcsdat=1273856870758&dcssip=
www.whatever.com&dcsuri=/index.html&dcsref=http://www.whatever.com/&WT.c
o_f=23abaa9152bd0549e281273450121123&WT.vtid=23abaa9152bd0549e281
273450121123&WT.vtvs=1273856866051&WT.tz=1&WT.bh=18&WT.ul=enGB&WT.cd=24&WT.sr=1280x800&WT.jo=No&WT.ti=Main%20Landing%20Page
&WT.js=Yes&WT.jv=1.8&WT.ct=unknown&WT.bs=1280x613&WT.fv=10.0&WT.sl
v=Unknown&WT.tv=8.6.2&WT.dl=0&WT.ssl=0&WT.es=www.whatever.com/index
.html&WT.vt_f_tlh=1273856866 HTTP/1.1
whatever.com
Data Collection
Tag Builder v4
Tag Builder
Tag Builder
Tag Builder
The Webtrends Tag Builder creates the required files that are used to track
your visitor behaviour.
Tag Builder generates the following files:
 readme.txt contains a description of the tag files as well as the same tag
deployment instructions shown in this Help file.
 webtrends.html contains the JavaScript code.
 webtrends.js is the JavaScript include file referenced in webtrends.html.
 tbconfig.xml contains the information you need to upgrade an existing tag
using Tag Builder.
Tag Builder
To deploy the tag:
 Save the webtrends.js file in a common JavaScript location on your
web server.
 Edit the path referenced in webtrends.html so that it points to the
actual location of webtrends.js
 Paste the contents of webtrends.html on every page in your web
site. To avoid logging hits to pages that do not load completely, and
to ensure best performance, paste this code just before the
</body> tag at the bottom of your web page.
Workshop
JAVASCRIPT TAG V9
Workshop: Creating Javascript Tag
Actions
Go to:
Application Settings
Select:
Whatever Data Source
Click:
Build Tag (Tracking Code)
Enter:
Required settings
Click:
Build Tag
Workshop: Creating Javascript Tag
Action
Download Tag:
Save in C:\Temp
Extract:
Right mouse click
Rename:
web.js
Open:
webtrends.html
View:
the source code
webtrends.html
webtrends.js
webtrends.js
Method
Description
dcsGetMeta
Reads a meta tag name and returns its content.
dcsAdSearch
Scans page for links containing ad click query parameters (specified in
adclickparam property) and populates Query Parameter for ad view
(WT.ad).
dcsDownload
Download links click event handler.
dcsOffsite
Offsite links click event handler.
dcsMultiTrack
Helper method for globally available dcsMultiTrack function.
dcsDebug
Creates popup window with data collection URL components.
Workshop
DEPLOYING JAVASCRIPT TAG
Workshop: Deploying Javascript Tag
Action
Open:
Whatever.com in Expression
Expand:
scripts folder
Copy:
web.js from C:\Temp
View:
source code for webtrends.html
Copy:
source code from webtrends.html
Paste:
the </body> Basetag.html page
Workshop
TESTING DEPLOYMENT
Workshop: Testing Deployment
Actions
Firebug:
Firefox plugin
HttpFox:
Firefox plugin
WASP:
Firefox plugin
http://wasp.immeria.net
HTTP Watch:
IE and Firefox
http://www.httpwatch.com
Fiddler 2 or 4
Observe Point:
Firefox / Chrome plugin
javascript:dcsDebug()
basetag 8.5+
page 13
Workshop
CONFIGURING SITE MAP
Workshop: Configuring Site Map
To configure an SDC site map:
 Open: Webtrendssites.lst file located:
 C:\Program Files(x86)\Webtrends\SmartSource Data
Collector\sdc\cfg directory.
 Replace: dcs5w0txb10000wocrvqy1nqm_6n1p with the DSCID used
for the rest of the site.
dcsoyajcc100004fusr708zy6_9h7g
Data Collection
Tag Builder: v9 tag
Event Tracking v9
Event Tracking



Use the Off-Site Links check box to track all the
links on your site that go to other sites. If you
want to identify some links that use a different
domain as on-site links, type a commaseparated list of domain names in the Track
these domains as on-site text box.
For example, if you want to track off-site links
from the product site yourcompany.com, and
you enable off-site link tracking, you can
ensure that links to your branding site continue
to be tracked as on-site links by typing
yourbrand.com in the text box.
Off-site links are hyperlinks whose URL resolves
to an off-site domain.
Event Tracking

The check box inserts an onclick event handler
function named dcsOffsite. The handler is
bound to the document body. When a mouse
click occurs on the page, the handler is called.
The handler receives an event object as an
argument. If the event object meets the
criteria above, then its contents are passed as
parameters to dcsMultiTrack.

By default, query parameters are removed
from the off-site link to reduce the number of
unique URLs. To include query parameters in
the off-site link, set trimoffsiteparams=false in
Webtrends constructor function in
webtrends.js.

An event specific identifier is passed via the
WT.dl=24 parameter
Event Tracking
Onsite domain field contains:
www.whatever.com
Page contains the following hyperlink:
<a href="http://www.offsitedomain.com/some_page">Offsite Link</a>
Clicking the link generates the following parameters:
 DCS.dcssip www.offsitedomain.com
 DCS.dcsuri /some_page
 WT.ti=Offsite: www.offsitedomain/some_page
 WT.dl=24
Event Tracking
The download file types field contains:
xls
Onsite domain field contains:
www.whatever.com
Page contains the following hyperlink:
<a href="smartsource.xls">SmartSource Spreadsheet</a>
Clicking the link generates the following parameters:
 DCS.dcssip www.whatever.com
 DCS.dcsuri /smartsource.xls
 WT.ti
Download: SmartSource Spreadsheet
 WT.dl
20
Event Tracking
Onsite domain field contains:
www.whatever.com
Page contains the following hyperlink:
<a href=“/page.aspx#TopOfPage">Go to top</a>
Clicking the link generates the following parameters:

DCS.dcssip www.whatever.com

DCS.dcsuri /page.aspx#TopOfPage

WT.ti
Anchor:#TopOfPage

WT.dl
21
Event Tracking
<form name="Post_Colour" action="FormButton.aspx" method=post>
<input type=text name="colour" value="blue">
<input type=submit value="Submit">
</form>
Corresponding dcsMultiTrack parameters:

DCS.dcsuri
/FormButton.aspx

WT.ti
"FormButton:" + title

WT.dl
27

WT.nv
Enclosing element id or classname (if present)
Event Tracking
mailto: protocol
<a href="mailto:feedback@whatever.com?subject='Feedback'">Email</a>
Clicking the link generates the following parameters:
 DCS.dcsuri mailto:feedback@whatever.com.com?subject=Feedback
 WT.ti
mailTo:feedback
 WT.dl
23
Event Tracking
javascript: protocol
<a href="javascript:alert('Message')">Alert</a>
Clicking the link generates the following parameters:
 DCS.dcsuri javascript:alert('Good%20Morning')
 WT.ti
javascript:Alert Greeting
 WT.dl
22
Event Tracking
<area shape="poly" coords="18,0, ... 27,0"
href="americas_on.gif?region=Americas" onmouseover="ci('worldmap',
'americas_on.gif')">
</map>
Clicking the Americas region of the image map generates the following
parameters:

DCS.dcssip www.whatever.com

DCS.dcsuri /EventTracking/americas_on.gif

DCS.dcsqry ?region=Americas

WT.ti
ImageMap:worldmap_map

WT.dl
30
Event Tracking

An Ad View occurs when a visitor views a page containing an ad. An ad is a link or
graphic that contains an Ad Click parameter in the query portion of the URL.

Enabling this setting causes the tag to scan all links on a page, looking for the Ad
Click parameter specified in the accompanying text box. The text box must contain
a query parameter used to denote Ad Click links. If a matching link is found (case
insensitive), its Ad Click parameter value is extracted and assigned to the Ad View
parameter (WT.ad). If more than one Ad Click link is found, each value is appended
to the Ad View parameter (delimited by semi-colon). This work is performed by a
function named dcsAdSearch.
Event Tracking
Suppose you are using the default Ad Click parameter: WT.ac
Suppose you have a page with the following Ad Click links:
<a href="http://advendor.com/process_click?WT.ac=image_link_car">
<img src="car_ad.gif"></a>
<a
href="http://advendor.com/process_click?WT.ac=image_link_house">
<img src="house_ad.gif"></a>
<a href="http://advendor.com/process_click?WT.ac=image_link_boat">
<img src="boat_ad.gif"></a>
The Ad View parameter generated from the page load would be:
WT.ad=image_link_car;image_link_house;image_link_boat
Workshop
EVENT TRACKING
Workshop: Event Tracking
Action
page 23
Create and
Implement:
javascript tag to track events
Name:
webtrends_events.js
Check:
the correct parameter values are
passed
Data Collection
Link Tracking
Link Tracking
The modified javascript tag leverages <div id> tags to report either at an
individual link or <table> level.
 The tag values are associated with the Webtrends WT.nv
Workshop
LINK TRACKING
Workshop: Link Tracking
The LinkT.html page on the Whatever.com website contains a number of
links that can be tracked using the Tag Builder.
 Create and implement a JavaScript Tag that tracks these links.
 Name the JavaScript Tag: Webtrends_link_tracking.js
 Ensure that the correct parameters associated with the events
have been successfully logged in the SDC.
Data Collection
Webtrends Meta Tags
Meta Tags
 The JavaScript tag supports the use of HTML META tags as a means of
extending the collected data. By adding supported META tags to your Web
pages, you can capture meta-data describing your Web content.
 The tag takes advantage of Web browsers support of the Document Object
Model (DOM) to capture the meta-data.
 When found, the meta-data is added to the SDC hits in the form of
Webtrends query parameters. These query parameters are then used by
Webtrends during the analysis process.
Meta Tags
<head>
<title>Page Title</title>
<!-- Webtrends Added -->
<meta name="Webtrends Meta Tag" content="Value">
<!-- Webtrends Added -->
</head>
<body>
<!-- Webtrends Added -->
Webtrends Base JavaScript Tag
<!-- Webtrends Added -->
</body>
Meta Tags
Webtrends reserved query parameters require an upper case name
space, either WT or DCS, and the type identifier in lower case.
The following name spaces are reserved for Webtrends:
WT.i_
 Used for product integrations with Webtrends partners.
WT.z_
 Used by Webtrends Professional Services for customer integrations.
Meta Tags
Recognized by Webtrends and used to auto-configure certain features
WT Parameter Name
WT Parameter
Content Group:
WT.cg_n WT.cg_s
Marketing Campaign:
WT.mc_id
Traffic Source:
WT.tsrc
Advertising Impression:
WT.ad
Advertising Click:
WT.ac
Scenario Analysis:
WT.si_n WT.si_x or WT.si_p
Page Title:
WT.ti
Search Engine:
WT.srch=1
Meta Tags
Recognized by Webtrends and used to auto-configure certain features
WT Parameter Name
WT Parameter
Web Client:
WT.tz WT.bh WT.ul WT.cd WT.sr WT.jo
WT.jv WT.ct WT.hp
Product:
WT.pn_sku
WT.pc
Transactional:
WT.tx_u
WT.tx_s
WT.tx_cartid
Invoice:
WT.tx_i
WT.tx_id
WT.tx_it
Segment:
WT.seg_x
WT.pn_id
WT.pn_ma
WT.js
WT.pn_gr
Meta Tags
Recognized by Webtrends and used in custom reports:
You can add custom values to the passed query string using:
DCSext.w_custom_identifier = <value>
<meta name=“DCSext.w_parks” content=“park_Walibi”>
<meta name=“DCSext.w_sub3” content=“Menswear”>
Tags can be found in: Documentation Centre / Webtrendstraining.net
Workshop
META TAGS
Workshop: Meta Tags
Category
Content Groups
page 43
OnSite Advertising
page 44
Workshop: Meta Tags
 Scenario Analysis
 The scenario definition contains 5 steps:
 Step 1 - Products
 Step 2 - Account Details
 Step 3 - Basket
 Step 4 - Order Placed
 Step 5 - Invoice
Data Collection
dcsMultiTrack()
dcsMultiTrack ()
dcsMultiTrack function lets you log virtual page views to the SmartSource
Data Collector (SDC) servers for nearly all types of events. dcsMultiTrack
is a way to program a Web site page so that data captured using the
dcsMultiTrack functions and parameters are logged:
 Flash events such as start, finish, progress, and clicks within a Flash
application
 Ajax interactions
 Downloads of files that can not be tagged, such as pdf’s
 Form completion
 Any event that launches JavaScript
dcsMultiTrack ()
To invoke the dcsMultiTrack function to report a virtual page view to the
Smart Source Data Collector, use the following syntax:
dcsMultiTrack('parameter1', 'value1', 'parameter2', 'value2');
An example a regular page link with dcsMultiTrack():
<a href=http://www.domain.com/folder/page.html
onclick="dcsMultiTrack(
‘DCS.dcssip', 'www.domain.com',
'DCS.dcsuri', '/folder/otherpage.html',
'WT.ti', 'My Page Title',
'WT.dl', ‘24');">Page of Interest</a>
Workshop
DOWNLOAD LINKS
Workshop: Download Links
Whatever.com wishes to track a specific HTML link, a downloadable file, on
their website.
Action
Open:
Expression > dcsmultitrack > Downloads.html
View:
Code for dcsMulTrack.pdf download
Modify:
The code to include the following:
Event:
onclick
Function:
dcsMultiTrack
DCS.dcsuri: /downloads/dcsMultiTrack.pdf
WT.ti:
dcsMultiTrack%Document
WT.dl:
20
Open:
HttpFox to check the correct parameters are passed in the Query String.
Workshop
OFFSITE LINKS
Workshop: Offsite Links
Whatever.com wishes to track clicks on an offsite link.
Action
Open:
Expression > dcsmultitrack > OffsiteLink.html
View:
Code for offsite link .. Line 104
Modify:
The code to include the following:
Event:
onclick
DCS.dcssip: www.wherever.com
DCS.dcsuri: /
WT.ti:
Home%20Page
WT.dl:
24
Open:
HttpFox to check the correct parameters are passed in the Query String.
Workshop
FORMS
Workshop: Forms
Whatever.com wishes to track progression of a visitor through a registration
form.
Action
Open:
Expression > dcsmultitrack > Forms.html
View:
Code for dcsMulTrack.pdf download
Modify:
The code to include the following:
Event:
onclick
DCS.dcsuri: Form Field value
WT.ti:
Form Field value
WT.dl:
27
Open:
HttpFox to check the correct parameters are passed in the Query String.
Workshop: Forms
Modify the code to track the following:
Scenario Step
Path
WT tag
Value
1
Forms.html
WT.si_n
WT.si_x
Registration
1
2
First Name Field
WT.si_n
WT.si_x
Registration
2
3
Last Name Field
WT.si_n
WT.si_x
Registration
3
4
Email Field
WT.si_n
WT.si_x
Registration
4
dcsMultiTrack ()
For complex web sites that enforce separation of logic and presentation, you
can use the Document Object Model (DOM) method to implement the
dcsMultiTrack function.
Can also use: getElementByTag
Data Collection
Tag Builder: v10 tag
Tag Builder: v10 tag
Traditional JavaScript Files:
Launched from inline "blocking" HTML
Keeps the page from completely loading until the JavaScript executes
Impacts to user experience and potential for undercounting visitors
Asynchronous JavaScript Files:
Non-blocking, can load from anywhere on the page
Faster tracking code load times for your web pages due to improved
browser execution
Enhanced data collection & accuracy
Elimination of tracking errors from dependencies when the JavaScript
hasn't fully loaded
Tag Builder: v10 tag
Social Analytics Features Built-In:
Uniquely track Facebook social widget interactions, Facebook App
tracking, referrals, & click-through campaign sessions.
It's a single click to add this into the tag.
Tag Builder: v10 tag
Powerful plugin architecture allows for the easy addition of new tracking
capabilities without modifying the JavaScript:
•Webtrends Plugins:
 Webtrends Heatmaps
 Facebook
 Webtrends Ads
•Webtrends Developer Community Plugins*:
 Cross-Channel Visit/Visitor Matching
 Twitter
 YouTube
 Google+
 HTML Apps
•*Not officially supported by Webtrends Technical Support
Tag Builder: v10 tag
Compact & Minimizes to Small Footprint
 Bandwidth limited devices can download the tag with very little data
transfer
 Support for Mobile Website Spaces
 Optimized to minimize well using Google Closure Compiler
 ** The min tag doesn’t support Heatmaps
Tag Builder: v10 tag
Additional Enhancements:
 Selector-based event tracking
 "Transform" events and page load tap points
 Webtrends Tag Builder
Webtrends Tag Builder v10
Additional Enhancements:
•Selector-based event tracking
•"Transform" events and page load tap points
•Webtrends Tag Builder
Data Collection
Upgrading to v10 tag
Upgrading to v10 tag
You can place the v10 tag anywhere on the page. Since the tag is loaded
asynchronously, it does not block page rendering in any way. You can place
the tag in the <head> section or anywhere within the <body> section with
minimal impact on page rendering times. In addition, the tag runs in the
background, so there is minimal impact on user experience after the page has
loaded.
<!-- START OF SmartSource Data Collector TAG v10.x.0 -->
<!-- Copyright (c) 2013 Webtrends Inc. All rights reserved. -->
<script type="text/javascript" src="/scripts/webtrends.load.js"></script>
Upgrading to v10 tag
Upgrading is a 4 step process:
 Transform Configuration Settings
 Migrate Customizations
 Change HTML Markup
 Test
Before you begin, you'll need to have:
 Complete copies of a v9 and v10 tag (ideally, the two .zip files from
Tag Builder).
 Ability to edit HTML and JavaScript
 Access to a web server, so you can test pages
Workshop
JAVASCRIPT TAG V10
Workshop: Javascript Tag v10
In this exercise you’ll create and deploy a Javascript Tag v10:
 Create the tag in Tag Builder
 Deploy & test on: www.whatever.com/tag builder/upgrade.html
Data Collection
REST API
REST API
 The Data Extraction API conforms to the REST (Representational State
Transfer) architectural style, using the HTTP protocol and a URI to
access resources.
 Integrates with Excel without coding, client software, or installed
driver--you need only your Webtrends credentials to get data
 Returns the entire data set for a trend in response to a single URI
(for example, trending a week by hours)
 Is profile and account independent, so you can list multiple
profiles by changing the profile name in the URI
REST API
There are two main ways of creating the REST request:
 Analytics 10: via the “Share” option when viewing a report
from within the Webtrends Analytics 9 Insight user interface.
 REST Generator: is an application that helps you rapidly create
a request for profile or report data.
Data Collection
Summary
Summary
Thank you for your time..