Search and Analysis

Matthew Carbone

Project: Internet Searches

Internet Search Project

T his project included four separate Internet searches

– indicated by the prefix 1-4 with between 7-10 searches each. The search categories are financial and LMS as indicated.

T he search criteria used for the financial category focused on financial aspects regarding online education and training including

Learning Management Systems (LMS). The LMS category focused on Learning Management Systems both vendor and articles of interest regarding Learning Management Systems.

T his project was a challenge in finding appropriate search results especially within the finance aspects. In the first financial search at the beginning of the course, it was harder to determine future needs that might help or support a future group project. Keeping my eyes open to new information concerning financial and learning management systems is helpful and I gained a lot by completing this project. The Internet provides the opportunity to gain new insights.

I hope you enjoy visiting some of the websites below as much as I did. 

Financial Management in Online Course Design and Implementation

Summer 2005@NYU

1 of 39

Matthew Carbone


Internet Search #1

–

Financial Aspects:

1.1 (Financial)

Type: Financial concepts

Keywords: ROI online education training

LMS

Search engine: http://www.educause.edu

Comments: I liked this article because it discusses the issue of the “soft” intangible value of educational investments. ROI in a traditional sense is measured based on concrete objectives although assumptions may be highly subjective. The author describes VOI as elements defined by Gartner research - in short it has five measurable elements; business process innovation, cultivation, collaboration, competencies, and leadership.

Value on Investment in Higher Education

September 2, 2003

Donald M. Norris

ECAR

Article URL: http://www.educause.edu/ir/library/pdf/ERB0318.pdf

Website: http://www.educause.edu

” A great deal of attention is being paid to the value of information technology itself and to the value of the IT investments that higher education has made.

Value on investment is a benchmark that embraces the intangible value of information technology initiatives as well as tangible measures, such as return on investment. As higher education faces greater demands for accountability, increased demands for new student services, and new competition in a declining economy, strategies for coping should consider both tangible and intangible outcomes. This research bulletin describes how to assess the value of information technology investments and how to leverage those investments to deal with today's higher education environment.”


Summer 2005@NYU

2 of 39

Matthew Carbone


1.2 (Financial)

Type:

Keywords:

Financial Break-even on-line calculator (graph), Tool

ROI, CBT, WBT

Break-Even Analysis

2001

Prof. Jos

é A. Rosa

Weatherhead School of Management at

Case Western Reserve University

Article URL: http://connection.cwru.edu/mbac424/breakeven/Bre akEven.html

Website: http://connection.cwru.edu

”A glossary of terms used by businesses when talking about the concepts involved in break-even analysis.

”

Search engine: http://scholar.google.com

Comments: I selected this interactive web form based on following ideas. a) It was financial and the terms related to our readings. b) It has clear definitions of financial terms. c) It produces graphs and reports from minimal data entry. D) It could double verify some financial information – for triangulation in projects as a secondary source.


Summer 2005@NYU

3 of 39

Matthew Carbone


1.3 (Financial)

Type: Finance Corporate

Keywords: How to calculate e-learning elearning


Comments: I selected this article since I am on the Corporate side of the house. I liked the way the author brought together the financial ROI aspect along with Kirkpatrick’s educational approach. I believe in the end you need to know about the budget/financial, educational/quality and time consideration/constraints in project decision making.

Calculating the Return on Investment

(ROI) of Corporate e-Learning

2004

Dr. Karen Anderson, PHD

Dr. Gary Woodill, ED.D

Operitel Corporation

Article URL: http://www.learnflex.com/pdf/ROI.pdf

Website: http://www.learnflex.com

Abstract:

”The document begins by defining the Return on

Investment for organizational training and follows with a discussion of how the deployment and implementation of on-line training system affects the

ROI of a typical organization. “


Summer 2005@NYU

4 of 39

Matthew Carbone


1.4 (Financial)


Keywords: measuring ROI elearning elearning

Search engine: http://a9.com

Comments: This article looks at Corporate training and formulates the value of training. It has a good checklist to help determine tangible/intangible ROI considerations. It does not take into consideration the risk of the person leaving the Corporation after training but looks at the positive impact of training by reducing turnover. Looking at the positive impact when trying to sell online learning to the Corporation - is a good thing.

This article also discusses a formulation for calculating training's value this includes a formula that takes total benefits of training dollars multiplied by 100 divided by the total training program for a percentage ROI value.

E-Learning 1.0 Many Happy Returns:

Calculating E-Learning ROI

June 2001

By John Setaro

Article URL: http://www.learningcircuits.org/2001/jun2001/elearn.

html

Website: http://www.learningcircuits.org

Abstract:

”E-learning may be the wave that carries the future of corporate training. But if that wave is ever to crest, corporations must be able to determine a financial return on their investment. Only if early adopters can truly demonstrate an ROI in dollar figures will e-learning wash over corporate culture and change its landscape.

“


Summer 2005@NYU

5 of 39

Matthew Carbone


1.5 (Financial)

Type:

Keywords:

Finance Corporate measuring ROI elearning elearning


Comments: This article brings out some important points about the new demands for accountability, during slow economic times, knowing the financial impact in all business areas allows the business to set proprieties and get the most ROI. I found the article’s key concepts of cost-benefit analysis very interesting with reference to comparing the life of the training effort

– 3-5 years, comparing alternative delivery options – face to face with online, size of audience, seat time – how long will students spend in their seats or in front of the computer in training, along with associated cost factors.

Beyond Kirkpatrick: Measuring the

Financial Returns of e-Learning

2002-2004 by Kevin Kruse

Article URL: http://www.e-learningguru.com/articles/art5_1.htm

Website: http://www.e-learningguru.com

Abstract:

”The classic evaluation model developed by Donald

Kirkpatrick looks at four levels: student reaction, knowledge transfer, behavioral change, and business results (Kirkpatrick, 1975). Critics of

Kirkpatrick model say that it doesn't take the business impact far enough and that the final step in any training program should be a "fifth level" of evaluation -- financial return. This ultimate evaluation determines the financial return on investment (ROI) of the training program.”


Summer 2005@NYU

6 of 39

Matthew Carbone


1.6 (Financial)

Type: Finance Calculator


Search engine: e-Learning Centre.UK http://www.elearningcentre.co.uk/eclipse/

Resources/costs.htm

Comments: Just one more tool in my toolbox; since this Internet search for financial sites was one of the first I needed to do - I was looking for answers, possible solutions, insights and concepts for future group projects.

Estimating return on investment for a web based training course

2000

William Horton Consulting Inc.

Excel URL: http://www.designingwbt.com/content/roi/WBTROI9

5.xls

Website: http://www.designingwbt.com

Abstract:

”Estimating costs of training projects is a black art only slightly more precise than reading tealeaves or bird entrails. These spreadsheets offer a framework —or just a framework for a framework— for estimating costs."


Summer 2005@NYU

7 of 39

Matthew Carbone


1.7 (Financial)


Keywords: e-learning ROI

Search engine: http://www.search.com

Comments: In my quest for the definitive answer on ROI, I selected this site. It is a great article for beginners with a checklist

– questions to consider and a process to follow - a place to get started. It has links with abstracts and defines ROI, total benefits and costs.

This article dates back to 2002 - some of the links are broken. I still found the main article informative on my journey for ROI information.

How do I measure return on investment

(ROI) for my learning program?

April 5, 2002

Marcia L. Conner

Article URL: http://learnativity.com/roi-learning.html

Website: http://learnativity.com

Abstract:

”The problem is that nobody is quite sure what the appropriate metrics are for measuring ROI for learning. Is it student throughput or time to mastery? Is it dropout rates or full-time equivalents returned to the workforce? One thing is certain: many smart people are completely befuddled by the topic.

” This mini-primer will get you started examining the right metrics for your organization.

”


Summer 2005@NYU

8 of 39

Matthew Carbone


1.8 (Financial)

Type: e-Learning Portal



Resources/costs.htm

Comments: I liked this article because it considers the cost effectiveness of face-to-face learning with on-line learning. The cost matrix template on page 7 is a line-by-line comparison of both the online and face-to-face environments this could be useful as a starting point for this type of evaluation. I like the fact that the article mentioned the use of standards in the cost matrix and that it is “consistent with the basic

Instructional Systems Design (ISD) model for training (Beckschi & Doty, 2000). Each stage of the ISD model (Analyze, Design, Develop,

Implement, and Evaluate) ” This is similar in approach to the project life cycle methodology used in software development.

Evaluating the Cost Effectiveness of

Online and Face-to-Face Instruction

Sharon Jeffcoat Bartley

Jennifer H. Golek

Article URL: http://www.ifets.info/journals/7_4/16.pdf

Website: http://www.ifets.info/journals

Abstract:

”Online instruction is gaining an increasing presence due to the benefits associated with it, ability to consolidate education and training across geographical and time constraints, and many that online education and training is cost efficient. This paper provides a relatively concise history of online learning, and a discussion of issues to be faced by the professional who intends the education and training environment online in response to the current academic environments. It presents a cost matrix tool by which the costs of online education and training tabulated and/or compared with the costs of the traditional education and training medium.”


Summer 2005@NYU

9 of 39

Matthew Carbone


1.9 (Financial)




Resources/costs.htm

Comments: This article builds on the four

Kirkpatrick levels - it discusses a methodology that generates a scorecard for that particular program. The scorecard measures performance, representing both qualitative and quantitative data at different periods and from various sources. I found this article valuable in its list of common cost savings and helpful along side more traditional financial aspects.

ROI Best Practices

October 2003

Jack J. Phillips, Ph.D.

Article URL: http://www.clomedia.com/content/templates/clo_fairf ield.asp?articleid=275

Website: http://www.clomedia.com

Abstract:

”For years, there has been debate about the appropriateness of return on investment (ROI) as a measurement tool for learning and development

(L&D). Today, the debate has shifted to the ways in which ROI can be integrated into other measurement processes. Much of the use of ROI has come from pressure from senior executives requesting value and, in some cases, outright demands for ROI for certain programs —or face the consequences of budget cuts. These requirements have led the L&D function to face reality: ROI is an issue that will not go away."


Summer 2005@NYU

10 of 39

Matthew Carbone


1.10 (Financial)


Keywords: "e-Learning costs"

Search engine: www.Yahoo.com

Comments: I found this article’s point on benefit cost ratio interesting in its approach to

ROI. I found the performance metrics interestingly tied to job related or core company competitiveness a well-designed concept. I can visualize and identify real value in terms of this article’s granular approach to costs and the value added to an organization in favor of online learning.

Performance-Based ROI

2003

Karl M. Kapp and Nancy Vasta

Article URL: http://www.karlkapp.com/ROI.pdf

Website: http://www.karlkapp.com

Abstract:

”The e-learning industry has responded with various

ROI calculation methods that focus on delivery cost savings of e-learning vs. traditional instructor led training. While this approach is adequate for a quick and dirty ROI, it ignores what clients are most interested in… the benefits of improving employee performance.”


Summer 2005@NYU

11 of 39

Matthew Carbone


Internet Search #2 - Learning Management Systems (LMS):

2.1 (LMS)

Type:

Keywords:

LMS

Lotus

Search engine: http://www.google.com

Comments: My company uses IBM Lotus Notes for e-mail, Domino for our Intranet and other

Lotus products for collaboration. Lotus has had a Learning suite for a while this is a newer version supporting newer standards to fight the competition. IBM/Lotus products can get inexpensive. If you are already an IBM/Lotus shop then it may be worth evaluating. It would not be my first choice - as a web developer I do not view IBM/Lotus as an innovative company.

IBM Lotus Learning Management System

URL: http://www.lotus.com/lotus/offering6.nsf/wdocs/hom epage

Website: http://www.lotus.com

Abstract:

”

Manage All Your Training Activities From a

Single Platform.

Do you need an easy way to manage classroom-based and e-learning resources, courseware, and events? Is tracking and reporting on student activities becoming more timeconsuming and complex? The new IBM Lotus

Learning Management System can streamline your entire organization's training programs, saving time and money. This powerful new learning management solution can make training convenient and efficient for you and your users.”


Summer 2005@NYU

12 of 39

Matthew Carbone


2.2 (LMS)

Type:

Keywords:

LMS

LMS


Comments: I picked this site as an alternative to mainstream vendors. They list AOL and

Verizon as clients. Technically their products are

Microsoft Certified, but I could not any whitepapers on customizable aspects of their product and support for developers. I found their website poor so I would probably not consider their products, for example, I tried to view a demo and had to fill-out a form; it allowed me to put in dummy data. The form did not even validate a valid email address. This is my first impression



- it might count against them if I had to evaluate their product.

Learn.com

URL: http://www.learn.com/learncenter.asp?id=178410

Website: http://www.learn.com

Abstract:

”LearnCenter is the industry leading e-learning and

Human Capital Development

Management platform which empowers any organization to integrate training and reporting flawlessly. LearnCenter delivers the ability to launch, manage, track, and assess enterprise-wide e-learning, both in the classroom and online. LearnCenter creates a cost effective, high quality training environment designed to specifically meet the unique needs of any organization.”


Summer 2005@NYU

13 of 39

Matthew Carbone


2.3 (LMS)

Type: ERP/LMS/LCMS

Keywords: SAP LMS


Comments: I picked this site since my company is currently implementing SAP as our

LMS/LCMS. I look forward to a tour and a test drive from my fellow IT associates working on the implementation. I am also hope to apply my

NYU Instructional Design knowledge to create courses for Intranet content managers using the

SAP LMS. The SAP LMS will help my company benefit from integration with Human Resource

SAP modules - this will save time and effort and allow for the possibility global e-learning within my organization.

mySAP ERP HCM: SAP Learning

Solution

Article URL: http://www.sap.com/usa/solutions/businesssuite/erp/hcm/learningsolution.aspx

Website: http://www.sap.com/usa/index.aspx

Abstract:

” SAP Learning Solution is the only enterprise solution that integrates back-office ERP functionality with both learning management system (LMS) and learning content management system (LCMS) functionality in a single offering. It provides an enterprise learning platform capable of managing and integrating business and learning processes -- and supporting both e-learning and classroom training, as well as synchronous and asynchronous collaboration. It is fully integrated with mySAP ERP, and includes content authoring, content management, and learning management functionality, as well as a learning portal. “


Summer 2005@NYU

14 of 39

Matthew Carbone


2.4 (LMS)

Type: LMS

Keywords: Blackboard


Comments: I picked this site since my NYU group did extensive analysis on the Blackboard

“BB” platform. I was impressed with

Blackboard’s product line and number of features as well as the standards supported.

According to the Blackboard website - it has taken seven years to develop Blackboard. I did not find BB as the “end all” of LMS systems. It is a great common base for facility and trainers to concentrate on content and sharing, for example, sharing learning objects and templates. BB can integrate with other products like Centra for a price.

Blackboard, Inc

URL: http://www.blackboard.com/products/academic/inde x.htm

Website: http://www.blackboard.com

Abstract:

”Blackboard's Professional and Educational

Services are the key to the successful adoption and optimum performance of the Blackboard Academic

Suite™ and the Blackboard Commerce

Suite™. We offer a wide array of services to enable your success with Blackboard, including technical consulting, training, hosting, support and hardware solutions.”


Summer 2005@NYU

15 of 39

Matthew Carbone


2.5 (LMS)

Type:

Keywords:

LMS

LMS

Search engine: http://www.nytimes.com

Comments: I picked this site as an alternative to the mainstream LMS vendors. They appear to have some big clients, for example, Toyota,

Lexis as well as AOL. I found AOL as a client on another small vendor’s site as well; AOL is using this LMS for Sales and Marketing. As a first impression, I found the company’s website poor.

If they need to ask me to fill-out a form before I can view a Flash demo - without privacy policy on their website – this does not make a good first impression for an evaluation.



e-Learning Solutions

Article URL: http://www.vuepointcorp.com/lms_lcms.php

Website: http://www.vuepointcorp.com/lms_lcms.php

Abstract:

”

Learning Management Systems (LMS) manage essential learning activity such as registration, scheduling, reporting etc. Learning Content

Management Systems (LCMS) manage learning content.

Vuepoint enables clients to manage both of these inter-related activities from a single platform via the

Vuepoint Learning System (VLS). The advantage is greater effectiveness and reduced cost of ownership.”


Summer 2005@NYU

16 of 39

Matthew Carbone


2.6 (LMS)




Resources/costs.htm

Comments: I picked this site as another alternative to the mainstream LMS vendors. I was not impressed with this vendor from a technical standpoint. Their d emos were “not friend ly” and did not allow for positive reinforcement in a first pass evaluation. From a developer’s standpoint, they appear to use

Microsoft’s older ASP technology vs. .NET technology. Demos did not show what an

Instructor or faculty would need to know to create courseware. 

SumTotal Enterprise Suite™

Excel URL: http://www.sumtotalsystems.com/products/stlms.ht

ml

Website: http://www.sumtotalsystems.com

Abstract:

” TotalLMS is an enterprise-wide, globally scalable application for managing learners, content, and resources. Organizations can centrally prescribe personalized training to individuals, while segmenting functionality and data based on organizational structures such as location, department, or customer. TotalLMS provides unparalleled levels of functionality and support for any blend of delivery environment: self-paced Web, live interactive Web, instructor-led courses, on-thejob training, seminars, mentoring and written documentation.”


Summer 2005@NYU

17 of 39

Matthew Carbone


2.7 (LMS)

Type:

Keywords:

LMS

LMS

Search engine: http://www.Macromedia.com

Comments: This company has an impressive list of customers, for example, DaimlerChrysler,

Stanford University, Gartner, Adobe, IBM (they have their own LMS – this tells you something about theirs), Intel, Sun and others. Support for integration with several mainstream LMS systems, for example, SAP and Macromedia

Breeze. Also works with PowerPoint for ease of use. DigitalThink's e-briefings are a possible quick, easy, and low-cost solution for Sarbanes-

Oxley compliance. My first impression of their website was great they even offered me a demo of their product without asking me to fill out an email! 

Learning Management Systems through

Instructional Design

Article URL: http://www.digitalthink.com/dtfs/products_services/

Website: http://www.digitalthink.com/

Abstract:

”

Our e-learning products and services are designed to accommodate any need, schedule, budget or environment - from 100% outsourced development to working in tandem with your internal teams, from the most basic courseware to immersive simulation training, and from stand-alone content delivery to integration with your learning management system or enterprise application.”


Summer 2005@NYU

18 of 39

Matthew Carbone


2.8 (LMS)

Type: LMS

Keywords: LMS

Search engine: http://www.macromedia.com

Comments: I found

Pathlore’s website very well organized with a good search engine - to find support information. They offer case studies and a Webinar series that support industry standards, for example, certification and regulatory compliance (e.g. HIPAA, OSHA, ISO

9000, JCAHO, and FDA).

Their LMS is called: XLMS

™ support includes the following:



Web services technology



Multiple languages



Features WebEx for collaborative delivery

 “XLMX™ Developer Zone”



Host training at their University@

Pathlore.

Pathlore specializes in industry standards and compliances giving this company an edge.

Learning Management System 6.5

URL: http://www.pathlore.com/index.asp

Website: http://www.pathlore.com

Abstract:

”Pathlore provides the most widely adopted learning management solution in the world. Millions of users in over 1,000 organizations rely on Pathlore’s learning-management offerings to drive their business performance. Whether your company’s success depends on developing and retaining employees, getting sales channels up to speed quickly on new products, increasing quality and customer satisfaction, or reducing the costs associated with regulatory compliance, Pathlore learning management solutions ensure that you achieve the maximum return on your investment in people.”


Summer 2005@NYU

19 of 39

Matthew Carbone


2.9 (LMS)

Type:

Keywords:

LMS

LMS


Comments: What does Oracle know about e- learning? Oracle purchased PeopleSoft to compete in this space against other ERP companies like SAP. According to CIO

Magazine 1 Oracle will support PeopleSoft until

2013 – migrating to a new Oracle/Peoplesoft joint platform.

Oracle LMS supports Compliance and is integrated with other Oracle systems that include the recruitment process, employee selfservice and Human Resource system modules.

Oracle Inc Learning Management System

Article URL: http://www.oracle.com/applications/human_resourc es/learning.html

Website: http://www.oracle.com

Abstract:

”Oracle Learning Management is an enterprise learning management system (LMS) that provides a complete, scalable, and open infrastructure that lets organizations manage, deliver, and track training participation in online or classroom-based environments. Learners interact with content, instructors, and peers at their own pace while facilitating the need for widely dispersed staff to be trained in a consistent fashion. Managers can automate key business flows - from order processing to training delivery; from performance appraisals to training assessments. Turn learning into a business advantage with Oracle Learning

Management.

”

1 http://www.cio.com.au/index.php/id;1401490287;fp;2;fpid;2


Summer 2005@NYU

20 of 39

Matthew Carbone


2.10 (LMS)




Resources/costs.htm

Comments: The WBT Product appears to be mainly an LMS that works with other tools, for example, Dreamweaver, Flash, Authorware. I have seen articles on Macromedia’s site discussing WBT - this is positive. I was able to view, screen captures of their “WBT Author” product - my first gut reaction was that it might not be a friendly web environment and more of a homegrown system. “WBT manager” claims to be the “world's first AICC-Certified Learning

Management System”.

WBT Manager

Article URL: http://www.ielearning.com/

Website: http://www.ielearning.com/

Abstract:

”

WBT Manager , has a rapidly growing reputation as one of the world's most reliable, best supported, user friendly and easy to implement Learning

Management Systems.”


Summer 2005@NYU

21 of 39

Matthew Carbone


Internet Search #3

–

Financial Aspects:

3.1 (Financial)

Type:

Keywords:

Financial concepts e-learning, Business Model, economic aspects

Search engine: http://ideas.repec.org/

Comments: I found this article interesting - a

German University discussing sustainable business models for E-

Learning. I found “figure

1” to be interesting with “Manware” – administrators and “OrgWare” – upper management policies and bureaucracies. The article discusses a revenue model, profit maximization that includes activity, asset, and market models. This article was part of a sub conference on E-Learning in 2004.

Business Models for E-Learning

October, 2003

Gabriela Hoppe, Prof. Dr. Michael H. Breitner

Article URL: http://www.wiwi.unihannover.de/fbwiwi/forschung/diskussionspapiere/d p-287.pdf

Abstract:

” E-learning strategies have to address economical, pedagogical and technological goals. For ensuring pedagogical and technological quality, different theories and models for e learning already exist, e. g. the Essen Learning Model (ELM). But there is a lack of theories and models ensuring economical quality in terms of marketable and sustainable products. This paper presents a framework for elearning business models. Its advantage is its suitability for products designed for computer based training (CBT) as well as for web based (WBT) or mobile based training (MBT).

”


Summer 2005@NYU

22 of 39

Matthew Carbone


3.2 (Financial)

Universities Discover E-Learning

Paul Harris

2004

Article URL: http://www.learningcircuits.org/2001/may2001/harris

.html

Website: http://www.learningcircuits.org

Type:

Keywords: e-learning, financial aspects

ROI, CBT, WBT

Abstract:

”

As if the e-learning market wasn't already crowded with aspiring new entrants, America's colleges and universities are joining in droves. How will their presence reshape the landscape for buyers and developers of e-learning technologies?


Colleges and universities are in such a scramble to join the e-learning market that it's impossible to predict what will happen next.

Comments: According to this article, Stanford

University has discovered a new supply chain of knowledge.

I found it interesting that universities might be joining big business or are they big business already. This article discusses the use of branding for e-Learning and indicates that it does not automatically translate that content will be of higher quality.

According to this article, “Universities are moving in a variety of directions.” They mention our own, New York University among other schools setting up for-profit subsidiaries to exploit new markets.

Consider this: Nearly 47 percent of U.S. colleges offered some form of distance learning last year, making an estimated 54,000 university-level courses available online. According to analysts at

International Data Corporation, almost 90 percent of

US colleges will offer e-learning by the end of 2004.

IDC predicts that spending on distance learning technology by colleges and universities will grow at a 20 percent compound annual rate, from less than

US$300 million in 1999 to US$744 million in 2004.

In addition, investment in distance learning will reach a whopping US$2.2 billion in 2004, up from

US$900 million in 1999. “


Summer 2005@NYU

23 of 39

Matthew Carbone


3.3 (Financial)



Search engine: http://www.elearningcentre.co.uk

Comments: I found this article to be great for ideas on our group project. It had a nice outline of steps and measurements. It discusses five steps: 1) Gathering assumptions and baseline data, 2) Design and implementation costs 3)

Delivery costs 4) Administration and

Maintenance Costs and 5) Comparisons. In this example, they compared costs of instructor vs. technology driven - asynchronous content. I found this article useful as a possible starting point – a model for other types of e-learning comparisons that translate into savings.

Measuring the Total Cost of e-Learning

Kevin Kruse

2002

Article URL: http://www.e-learningguru.com/articles/art5_2.htm

Website: http://www.e-learningguru.com

Abstract:

”The first step in cost-benefit analysis is simply to measure all of the direct and indirect costs involved in the design, development, delivery, and maintenance of the program. Because different industries have different ways of doing business, this process calls for some careful examination of how your organization goes about its daily work activities. So often, time is money. If you can more efficiently train employees then the time saved can be used for productive work. More work time is then translated into a financial benefit.”


Summer 2005@NYU

24 of 39

Matthew Carbone


3.4 (Financial)

Type: e-Learning



Comments: I found the e-Learning Suite to have a lot of interesting information on the financial aspects of e-learning. Some of the articles in this project are located on this site. I found this site a very helpful when I first started to search for information on the financial aspects of online learning. What I like best is it has a library specific to “Costs, benefits and ROI of elearning ”.

This site is from the United Kingdom – so far, I have not found anything in Euros.

e-Learning Centre

UK e-Learning website

Website: http://www.elearningcentre.co.uk/eclipse/Resources/costs.htm

Abstract:

”This page provides links to resources that look at the costs (set up, development, delivery etc), the benefits of introducing e-learning and at the return on investment (ROI). Listed in order of entry with most recent first.”


Summer 2005@NYU

25 of 39

Matthew Carbone


3.5 (Financial)

Type: Finance info

Keywords: ROI

Search engine: http://www.elearningcentre.co.uk/eclipse/

Resources/costs.htm

Comments: I enjoyed the article it offers a great seven-step outline and brings out interesting tips for corporations, for example, ROI benefits and audits as well as potential for ROI vs. the cost of doing business. This webpage also has many interesting sidebars on ROI, for example, ROI

Classic and ROI Crystal Ball .

Why doesn't your ROI add up? You do the MATH

Christopher Koch,

Darwin magazine, March 2002

Article URL: http://www.darwinmag.com/read/030102/roi.html

Website: http://www.darwinmag.com

Abstract:

"Y2K and the e-commerce gold rush made ROI analysis little more than an empty formality at most companies. Now ROI is back. We give you seven tips to see if your method measures up."


Summer 2005@NYU

26 of 39

Matthew Carbone


3.6 (Financial)

On-line ROI Savings Calculator

Type:

Keywords: e-Learning

– online calculator measuring ROI elearning elearning


Resources/costs.htm

Comments: I liked this online e-learning savings calculator for prototyping numbers. It helps in some cases to use triangulation - different methods to compare results

– that is my main reason for considered this site.

URL: http://www.syntrio.com/savings/

Training company

Website: http://www.syntrio.com

Abstract:

” Congratulations on your interest in e-learning as a strategy for reducing the costs and improving the effectiveness of your training and development efforts. Please answer the following questions about your corporate learning needs. We will generate an

ROI analysis based on your inputs.”


Summer 2005@NYU

27 of 39

Matthew Carbone


3.7 (Financial)

Metrics & ROI

Jack Phillips, Ed Trolley, and Jay Cross discuss the ROI of eLearning. 9/2000

Type:

Keywords:

Financial measuring ROI elearning elearning


Resources/costs.htm

Comments: I enjoyed this article it had some valuable insights, for example, they consider

“ROI is relative”. The article brings out an interesting point about “where you stand depends upon where you sit

.” In the article, they compare CEO, Line Manager, Training/HR, and the Worker/Learner. You can tell they had fun writing this article - when they discuss,

“Scientific rigor: The Baloney Detection Kit”. The article also goes on to discuss eLearning and

Cost-effectiveness.

Note: Not all links on the page work

Article URL: http://www.internettime.com/itimegroup/metrics.htm

Website: http://www.internettime.com

Abstract:

” eLearning infrastructure decisions are climbing up the corporate ladder. A few years ago, eLearning was pigeonholed as a cheaper, faster way to train employees. By default, eLearning decisions fell to the director of training or HR.”


Summer 2005@NYU

28 of 39

Matthew Carbone


3.8 (Financial)

ROI & Costs

This work is licensed under a Creative Commons

License

Article URL: http://www.elearnspace.org/evaluating/roi.htm

Website: http://www.elearnspace.org

Type: e-Learning ROI

Keywords: The ROI of e-Learning


Comments: I found some interesting information on the elearnspace website. In this case, ROI and Costs are the focus of this web page with links covering various areas of ROI.

”E-Learning Analytics” By Josh Bersin was link and a good article on the concept of analytics, he discusses, for example,

Abstract:

”When e-learning first gained momentum, many colleges and university established separate forprofit entities to capitalize on this new market. For many higher education institutions, the vision of elearning was glittering with dollar signs. Many corporations eagerly embraced e-learning as a means to reduce costs and increase profitability...million dollar projects were initiated.

Somewhere in the last several years, however, a significant shift has occurred. For-profit schools closed their doors and dismal corporate results

(ROI) placed greater scrutiny on e-learning projects.

Many managers and administrators now demand a cost/benefit evaluation of e-learning before implementation.”  How much did something cost?

 What were the components of the cost?

 Who took or completed a learning offering?

 What can we do to improve it?

In his article, he has a chart that breaks down audience by “analytics needs”; I found this concept to be interesting.


Summer 2005@NYU

29 of 39

Matthew Carbone


Internet Search #4 - Learning Management Systems (LMS):

4.1 (LMS)

Type:

Keywords:

LMS e-learning cost benefit approach


Comments: The author of this article discusses the evolution from older e-Learning environments posing them as islands and somewhat non-social for student learning.

Compared to today’s e-learning environments that use virtual learning environments as being more social allows for group collaboration and sharing, the use of existing knowledge interchange to aid in the expansion of knowledge and enhancing the base of learning material.

A Critical Analysis of the Evolution of E-

Learning

Drew Wesley

2002

Article URL: http://www.aace.org/dl/files/IJEL/IJEL1441.pdf

Abstract:


Summer 2005@NYU

30 of 39

Matthew Carbone


4.2 (LMS)

Explaining E-Learning to Executives

Darin Hartley

September 13, 2002

Article URL: http://www.learningcircuits.org/2002/sep2002/hartle y.html

Website: http://www.learnflex.com

Abstract:

”Getting management's support for e-learning is tough. This excerpt from Darin Hartley's book,

Selling E-Learning, outlines the major elements you'll need to construct a winning business case for your e-learning initiatives.


Keywords: How to calculate e-learning elearning


Comments: I liked this article because I can identify with the processes outlined in order to get buy-in/approval from Corporate management. E-Learning is a hot topic with sales, marketing, supply chain having the need with Information Technology implementing

Learning Management Systems to support the business goals and objectives.

The processes outlined in this article discuss cost-benefit and ROI approaches for the selection of appropriate e-learning courseware for development, analysis, and requests for resources among other topics.

Before we examine each element of a business case, consider the format in which you will present your business case. You could present it on a

Website, micro CDs, or digicards

(see.www.caemedia.com). You are pitching elearning.right?”

“


Summer 2005@NYU

31 of 39

Matthew Carbone


4.3 (LMS)

Type:

Keywords: e-Learning e-Learning


Comments: This article brings out some interesting aspects of the LMS vendor community. It discusses the concept of ASP as a possible solution – one vendor is offering their

LMS free - if you subscribe to their content. The term “utility ” pricing model is mentioned and the author referrers to LMS’ as commodities – when

I think of a commodities

– the first word that comes to mind i s “refrigerator”.

This article also discusses vendor patent litigation trends in the learning technology space; litigators prey on smaller vendors that make a profit on their courseware but cannot afford to fight.

The LMS Rollercoaster: Falling Prices,

Rising ASPs and BPOs, Powerful

Analytics and Integration, and oh yeah,

Patent Litigation

Posted by Sam Adkins at June 21, 2004

Article URL: http://www.internettime.com/lcmt/archives/001433.h

tml

Blog site: http://www.internettime.com

Abstract:

” Related to the price competition and the commoditization of LMS technology is the rapid increase of ASP-based solutions. These usually

“pay-as-you-go” pricing models have tended to appeal primarily to smaller businesses. Now this utility-based pricing model is appealing to the larger companies. With all the enterprise vendors now preaching ‘on demand” (a euphemism for pay-asyou-go), the pressure is increasing on vendors that sell behind the firewall solutions. They depend on multiple-year "lock-ins" and that 18% annual maintenance fee for cash flow and revenue visibility. In the On Demand model, customers can opt for a monthly service and can cancel at any time. It will be hard for many vendors to move to a utilitybased pricing model.”


Summer 2005@NYU

32 of 39

Matthew Carbone


4.4 (LMS)

1999 Online Learning Project

Report to the Vice-Chancellor's Advisory Committee

(VCAC) (March 2000)

Article URL: http://www.latrobe.edu.au/adu/pdf/1999_Online.pdf

Website: http://www.latrobe.edu.au

Type: LMS Comparisons

Keywords: Learning Management

System

Search engine: http://www.dogpile.com/

Comments: This article captures what appears to be a major collaborative effort back in 1999.

This university is located in Melbourne Australia

– it is also nice to know what that side of the world thinks of e-Learning. The article discusses various perceptions based on four LMS systems mainly, instructor workload and technical staff support issues.

I thought the name of “Web Course in a Box

(MadDuck)” was cool and students may have fun with this name. This article compared four

LMS systems in this article and WebCT was the one recommended. I selected this article as a potential conceptual model for a possible group study.

Abstract:

”In November 1998, the VCAC (VCAC 98/53) resolved to ask the Academic Development Unit

(ADU) to convene a working group to review online teaching/learning software packages, in order to make recommendations to Information

Technology Services concerning two packages for use in 1999. The working group was to be composed of representatives from Information

Technology Services (ITS), the 'Multimedia Centre'

(COMET) and all faculties.”


Summer 2005@NYU

33 of 39

Matthew Carbone


4.5 (LMS)

Report For A Focused Evaluation Visit

North Dakota University

April 5 and 6, 2004

Article URL: http://www.nduso.org/HLC.final.2.pdf

Website: http://www.nduso.org

Type: LMS Article – Higher Ed.


Systems LMS

Search engine: http://www.dogpile.com

Comments: I found this article very interesting in looking at ways to save on costs ways to synergize implementations statewide. I also found their approach to be more like a business and focused on savings. I would suspect to help keep the cost of tuition lower. They created challenges and were able to meet five with others to address over time. I can see why they have challenges – supporting four (4) different

LMS systems across eleven (11) colleges and universities.

Abstract:

” The e-Learning programs of the North Dakota

University System campuses have experienced significant growth since April 2001. From two (2) online programs in 2001 to the present 53 online undergraduate and graduate degrees, the e-

Learning programs of the North Dakota University

System are experiencing over 7,000 enrollments per term. Enrollment Data for Spring 2004

With increased diligence, the University System along with other levels of state government are being asked to find ways in which to consolidate and/or collaborate for more efficient use of limited resources. With the implementation of a state-wide

(government and higher education) computing system, higher education is positioning itself to respond and to seek new ways to collaborate.”


Summer 2005@NYU

34 of 39

Matthew Carbone


4.6 (LMS)

Type: LMS Article


Systems LMS


Comments:

I found this article’s approach to be very abstract and extremely interesting. I also found this article to be interesting in light of how

I have seen comparisons of

LMS’s - that use weighted averages - a more statically based approach. In this article, they compared fourteen

(14) LMS systems. I think their approach would be good as a first pass

– especially if you need to compare many LMS’s as in this article. The statistical approach can then focus on a higher level of details and granularity in order to make a final recommendation. Using both approaches also depends on how much time you have to do your project. 

Towards a Pattern Language for Learning

Management Systems

Avgeriou, P., Papasalouros, A., Retalis, S., &

Skordalakis, M. (2003).

Article URL: http://ifets.ieee.org/periodical/6-2/2.html

Website: http://ifets.ieee.org

Abstract:

”Learning Management Systems are sophisticated web-based applications that are being engineered today in increasing numbers by numerous institutions and companies that want to get involved in e-learning either for providing services to third parties, or for educating and training their own people. Even though the construction of such systems has been taking place for many years, they are still designed and developed from scratch. The reason is that experience from previous Learning

Management Systems, is not codified or documented, resulting in forcing the development teams to ‘re-invent the wheel’. This paper presents an approach of recording design experience in the form of design patterns for Learning Management

Systems and aims at developing a pattern language for these systems.

..”


Summer 2005@NYU

35 of 39

Matthew Carbone


4.7 (LMS)

Type: LMS - Open Source Article


Systems LMS


Comments: I think the focus on e-learning needs to be student centered in offering a great learning experience within an organization. I think Open Source is a great and will keep the

LMS competition on their feet. There is now a trend that Open Source will be “branded” by the traditional proprietary software companies, for example, Red Hat® Enterprise Linux®.

Corporations that want to use Open Source can pay for service and support for operational reasons. What happened to student discounts?

Open source word processors are currently not in the workforce. What will the student use when the get a real job is a very important issue as well?

Why Is Open Source Important For

Education?

June 29 th 2005

Author: Francis Raven, EDC Center for Media &

Community

Article URL: http://educationaltechnology.ca/couros/321#

Website: http://educationaltechnology.ca

Abstract:

”Free and Open Source Software is important because it can help NPO’s and CBO’s stop spending valuable resources, which could and should be directed elsewhere, on software.

Proprietary software, software produced and marketed with restrictions on its use, is never really owned by the organizations that use it. For example, an NPO generally cannot legally give its workers copies of proprietary software to use at home. Schools cannot send their students home with the software they use at school, and students aren’t allowed to copy proprietary software to share with friends. Free and Open Source software renders these kinds of concerns a complete nonis sue. It’s really a very simple and elegant solution to an artificially created problem.”


Summer 2005@NYU

36 of 39

Matthew Carbone


4.8 (LMS)

Type: LMS - Open Source Article


Systems LMS


Comments: I found the author crying for creative space. Thinking in terms of student centered learning and their learning experience I liked this article. In some cases, organizations think “standards” and “policy”. SCORM, XML, &

RSS to the re scue… as long as you can stay with some standard then you might find a political breakthrough or loophole to use new technology. One argument I have in response to the article’s “Principles foreign to most LMS

(or functions LMS' need to acquire to respond to reality) ” - is who will support a system with all these open standards and what will it cost to keep it running in reality? Using on new tools that complement an LMS is fine as long as you go through evaluations and pilots to ensure success.

Learning Management Systems:

The wrong place to start learning

November 22, 2004

George Siemens

Article URL: http://www.elearnspace.org/Articles/lms.htm

Website: http://www.elearnspace.org

Abstract:

”Learning Management Systems (LMS) are often viewed as being the starting point (or critical component) of any e-learning or blended learning program. This perspective is valid from a management and control standpoint, but antithetical to the way in which most people learn today.”


Summer 2005@NYU

37 of 39

Matthew Carbone


4.9 (LMS)

Type: LMS – Integration Tools


Systems LMS

Search engine: http://www.macromedia.com

Comments: : I have been a big fan of animation a few years back I purchased the Future Splash

Animator the predecessor to Macromedia’s product Flash. Today’s Flash has grown into a scaleable enterprise solution as well as being fun to use for web applications as well as e-

Learning. It supports open standards, for example XML and SCORM allowing it to be a flexible tool. Flash is for mainly for developers but other tools, for example, Macromedia

Captivate allows non-technical people to create e-Learning modules in Flash format for a scalable solution. Macromedia has just announced the Flash Platform that includes Flex a powerful backend solution.

Macromedia’s Complete e-Learning

Solution

Vendor site

E-Learning URL: http://www.macromedia.com/resources/elearning/

Website: http://www.macromedia.com

Abstract:

”Breeze 5 and Macromedia’s content authoring tools allow you to rapidly create, manage, deploy and track highly engaging high-impact online training everyone can access instantly. All content you’ve created in any Macromedia authoring tool can be managed, deployed and tracked in the

Breeze system, as well as AICC-compliant content created in other tools.”


Summer 2005@NYU

38 of 39

Matthew Carbone


4.10 (LMS)

Type: LMS – Integration Tools


Systems LMS

Search engine: http://www.oldaily.com/ via email subscription

Comments: I discovered this product via an article from “Stephen’s Web” -- OLDaily’s. It had a link to a discussion that used Articulate

Presenter that I found to be a very exciting tool.

Articulate Presenter is similar to Macromedia’s

Breeze and has a fresh look and feel named

“Halo” and an intuitive interface. For a single designer Articulate is cost effective and integrates with PowerPoint making it very easy for Instructors to produce Flash compatible flash files and post to LMS sites via File Transfer

Protocol

– FTP for student learning courseware.

Articulate also has a product QuizMaker that makes it easy to produce Quizzes and surveys that work with LMS systems via SCORM or their own Knowledge Portal.

Articulate

Makers of various LMS Integration Tools

Product Demo URL: http://www.articulate.com/demos.html

Website: http://www.articulate.com

” Articulate is the global leader in rapid e-learning.

Thousands of corporate, government and academic customers in more than 50 countries use our powerful, intuitive technologies to train and communicate rapidly, widely and effectively.”


Summer 2005@NYU

39 of 39

Search and Analysis

Internet Search Project

Value on Investment in Higher Education

Break-Even Analysis

Calculating the Return on Investment

(ROI) of Corporate e-Learning

E-Learning 1.0 Many Happy Returns:

Calculating E-Learning ROI

Beyond Kirkpatrick: Measuring the

Financial Returns of e-Learning

Estimating return on investment for a web based training course

How do I measure return on investment

(ROI) for my learning program?

Evaluating the Cost Effectiveness of

Online and Face-to-Face Instruction

ROI Best Practices

Performance-Based ROI

IBM Lotus Learning Management System

Learn.com

mySAP ERP HCM: SAP Learning

Solution

Blackboard, Inc

e-Learning Solutions

SumTotal Enterprise Suite™

Learning Management Systems through

Instructional Design

Learning Management System 6.5

Oracle Inc Learning Management System

WBT Manager

Business Models for E-Learning

Universities Discover E-Learning

Measuring the Total Cost of e-Learning

e-Learning Centre

Why doesn't your ROI add up? You do the MATH

On-line ROI Savings Calculator

Metrics & ROI

ROI & Costs

A Critical Analysis of the Evolution of E-

Learning

Explaining E-Learning to Executives

Darin Hartley

The LMS Rollercoaster: Falling Prices,

Rising ASPs and BPOs, Powerful

Analytics and Integration, and oh yeah,

Patent Litigation

1999 Online Learning Project

Report For A Focused Evaluation Visit

Towards a Pattern Language for Learning

Management Systems

Why Is Open Source Important For

Education?

Learning Management Systems:

The wrong place to start learning

Macromedia’s Complete e-Learning

Solution

Articulate

Related documents

Add this document to collection(s)

Add this document to saved

Suggest us how to improve StudyLib