Batch Tracking Reports for Vista Sections - Confluence

advertisement

Batch Tracking Reports for Vista Sections

Technical Documentation

Introduction

The Batch Tracking reports were developed to reduce user effort in mass-producing tracking reports at the end of the semester. Although these reports were developed for

Simmons College, the programs are generic enough to work with any institution. And,

UMassOnline may be interested in the report that shows usage patterns. It is called

STEP 3g: Login Count by Day of Week for One Institution.

Many questions about individual reports can be answered in the User Documentation.

The most likely user issue will be a discrepancy between the batch report and the Vista report. Known discrepancies are listed in the User Documentation. That should be the first place to start if the user identifies an issue with the reports. The important thing to remember is that the reports accurately reflect what is in the tracking tables in the Vista database. We could not precisely duplicate the reports because we were not able to get the SQL calls from Blackboard.

Run Time Issues

Some of the reports can run for an extended period (up to 5 hours or more for half of the data). Run times are noted in the User Documentation. It is suggested that the Dev system be used with data refreshed from the production system at the appropriate point.

It is also OK to run the reports against the production database, but make special arrangements with the DBA to run the longer reports. As of Spring 2009, the reports are developed for both the Vista V4 Dev and V4 Prod systems. For reports that run a long time, contact Frank Lomanno and ask him to suspend the process that kills long-running

Cognos jobs. It runs around 9:00 or 9:30 PM daily. (It's not necessary if jobs won't be running at this time.) You may also need to split some of the jobs into two parts because of run time or file size.

File Type Issues

Most reports can be produced in PDF, HTML, Excel Single Sheet, or CSV format. The one exception is that Cross-tab reports cannot be produced in CSV format. Therefore

Excel 2000 Single Sheet format must be used. Remember that Excel has a ~65,000 line limit, so you may need to break the reports up if they will exceed the line length for Excel.

Running the Reports

You must first run a report that identifies the sections to consider, followed by a report identifying the Demo Students within those sections. Once you have that data, it must be manually inserted in the Cognos reports. (Sorry, an enhancement request for a prompt option has been sent to Cognos.) The detailed instructions follow. All programs can be found in the Cognos directory: Public Folders > UMOL Vista4 Reports >

UMOL Reports System Level > Vista Tracking Reports - run against V4 Dev

- 1 - June 18, 2009

STEP 0: Copy Vista Prod data to Vista Dev if needed.

STEP 1: Obtain a list of the Learning Context IDs for the active courses for the institution and semester. This is an important step because it helps limit the run time for the tracking reports. If you want data from multiple institutions or semesters in one "Step 3" report, then you can concatenate the results together from multiple runs of this report. a.

Run the Cognos report: STEP 1: Select Potentially Active Sections.

Save results as an Excel 2000 Single Sheet file or CSV.

b.

Open the Excel or CSV file. (If you use a CSV file, you can separate the fields by clicking on Data -> Text to Columns .) c.

You may need to change the data type for the Learning Context ID so that you can read the integer (Format-> Cells; change to data type category of "number" with zero decimal places). d.

Make sure the Excel File is sorted by Course Activity Status and

LCID (last two columns). e.

Highlight the LCIDs that are still flagged as "possibly active". Copy and paste them to an empty MS-Word document. f.

Change the table of data to a comma separated string as follows:

- highlight the "table"

- perform the following: Table -> Convert -> Table to Text

- remove any header information

- perform a global change from "^p" to ","

(change paragraph symbol to a comma)

- remove trailing commas g.

Save this data in an MS-Word file.

It will be copied into filters for the reports in Step 3 to limit the

output to just the "possibly active" sections for the specified

institution and semester.

Run time: 2.5 hours for Fall 2008 (897 sections; 597 potentially active)

STEP 2: Identify Demo Students for the specified sections. Tracking activity for these students will be eliminated in reports that filter out demo student activity.

(This is kludgy, but it is done this way to avoid a call to the RPT_Person table in the Step 3 reports. Reports that call the RPT_Person table run for more than 48 hours!) a.

Run the Cognos report: STEP 2: Find Demo Students.

Save results as an Excel 2000 Single Sheet file or CSV. b.

Open the Excel or CSV file. (If you use a CSV file, you should open it directly from Excel and separate fields by clicking on Data -> Text to Columns . Make sure the Wizard uses "Delimited" file type.) c.

You may need to change the data type for the Person ID so that you can read the integer (Format-> Cells; change to data type category of

"number" with zero decimal places). The Person ID is called "ID" and

- 2 - June 18, 2009

is found in the last column of the report. d.

Highlight the Person ID column (last column). Copy and paste it into an empty MS-Word document. e.

Change the table of data to a comma separated string as follows:

- highlight the "table"

- perform the following: Table -> Convert -> Table to Text

- remove any header information

- perform a global change from "^p" to ","

(change paragraph symbol to a comma)

- remove trailing commas f.

Save this data in an MS-Word file. It will be copied into filters for the reports in Step 3 to limit the output to non-demo students for the specified institution and semester.

Run time: 3 minutes for Fall 2008 (597 potentially active sections)

STEP 3: Open up each "Step 3" report in Report Studio. Reports can be found in the following Cognos folder:

Public Folders > UMOL Vista4 Reports > UMOL Reports System

Level>Vista Tracking Reports - run against V4 Dev

Find the Filter that selects the sections:

[ lmdev00].[RPT_TRACKING].[LEARNING_CONTEXT_ID] in (604364127071,604364167071…)

Put the data saved in STEP 1 into that filter between the parentheses.

Find the Filter that selects out the Demo Students:

[lmdev00].[RPT_TRACKING].[PERSON_ID] not in (604364145071,604364185071….)

Put the data saved in STEP 2 into that filter between the parentheses.

Do not get the lists mixed up! ;-)

Run the reports single stream. I think the performance will be better as some of the Oracle work doesn't have to be redone from report to report. (If truly pressed for time, you can run Steps 3a-3f single stream at the same time you are running Steps 3g-3h single stream.)

Cognos will prompt for the file type, etc. I suggest using "Advanced

Options". Select the options to Save the report and send it by email . Once you check these options, then you can check multiple file formats on the left side. This means the report only has to be run once to produce multiple file types. You can also queue up reports to run later, which is handy to stagger them overnight. Just leave enough time between them so they aren't running at the same time.

You will be prompted for various data – usually the Start and End dates/times and sometimes the Rank Cutoff. One report requires you to enter a Learning

Context ID number for the institution. That number can be found in a list at the end of the report.

- 3 - June 18, 2009

Programming Tips

There is no question that this approach is a programming kludge and a scheduling headache. Rather than design for ease of programming, it was designed to minimize run time and I/O by accessing as few tables as possible in each query. The first two steps provide the list of sections to use and the demo students to eliminate. This information is hardcoded in the filter of each report. Without this hardcoded information, each report would run for over 24 hours – if it ever finished.

Before making any modifications, or even poking around, please make a copy of the report(s) in your "My Folders" area.

If you need to modify the report for any reason, note that most reports use "Tabular

Models". Make sure you understand Tabular Models before making any modifications.

The File Usage report uses a package that has embedded SQL. Refer to the Entity

Relationship Model for the SQL.

There are several areas that were not fully dealt with. These may be areas to look at for future enhancements.

1.

The File Usage report more closely matched the Vista report by including

Auditors as well as Students. Other reports may benefit also from including auditors.

2.

All reports summarize by LCID. Apparently actions taken when in a group are attributed to the Group's Learning Context ID rather than the Section's LCID. So group statistics may (or may not) account for some of the discrepancies. A quick fix would be to provide group actions on separate report pages and let Simmons add them together to get the total. A nicer, but more costly option would be to combine them with the section statistics, though anything done like this in Cognos is cumbersome.

- 4 - June 18, 2009

Institution Name

Institution Learning Context IDs

Learning Context ID

Bunker Hill Community College

Emmanuel College

Massachusetts College of Art and Design

7214274

5083347

38397566

Massachusetts College of Liberal Arts

Massachusetts College of Pharmacy and Health Sciences

Quinsigamond Community College

Salem State College

Simmons College

UMass Amherst

UMass Boston

UMass Dartmouth

UMass Lowell

UMass Worcester

UMassOnline

UMOL Sample

UMOL Testing

1777396

38397510

2099140

2228634

35155870

26190

26226

26298

26262

26334

27970

706303282011

998628362161

UMOL Training

Wentworth Institute of Technology

Westfield State College

Westfield State College TEMP

2154814

3183489

35589104

884709970271

Wheelock College 43243898

Can't find an institution?

If the institution has been created since December 2008, it is likely not on this list. You can create a new list using TOAD or Cognos. The SQL code is:

select * from learning_context where type_code = 'Institution'

- 5 - June 18, 2009

Download