Detailed Assessment Report 2011

advertisement
Detailed Assessment Report
As of: 3/05/2013 11:23 AM EST
2011-2012 Computer Information Systems BS
(Includes those Action Plans with Budget Amounts marked One-Time, Recurring, No
Request.)
Mission / Purpose
The Computer Information Systems department creates and maintains a technologically
enriched learning environment that through quality student-centered instruction, research
and service produces information technology entrepreneurs and professionals capable of
succeeding in a competitive global environment.
Goals
G 1:Goals as reported in the Budget Papers
1. To effectively and efficiently handle student enrollment. Pay special emphasis on
"services" including student advisement. Strive to improve retention and recruitment. 2. To
have the state-of-the-art computing facilities in COBA and to improve the upkeep of COBA
labs. 3. To provide tutoring services in CIS and to initiate a new program for video recording
student presentations. 4. To use the state-of-the-art technologies in the classroom and to
use our Web presence http://www.cobanetwork.com and http://cis.cobanetwork.com
effectively and efficiently. 5. To establish a Center of Excellence in International Business
partly funded through a US Department of Education grant.
Student Learning Outcomes/Objectives, with Any Associations and
Related Measures, Targets, Findings, and Action Plans
SLO 1:Demonstrate Proficiency in Application Software.
Applications Software-Each student will be able to demonstrate proficiency in the use of
word- processing, presentation development and management, spreadsheet, and database
software programs to solve business related problems. This is a Criterion-referenced
Outcome. (CIS 205, CIS 206)
Relevant Associations:
Strategic Plan Associations:
Alabama State University
2 To ensure the academic integrity of the University.
4 To enhance the public's perception of the University and thus increase
external support
7 To improve programs and services that will contribute to the development of
wholesome student life
Related Measures:
M 1:Measure for Objective 1
ASSESSMENT PLAN/REPORT: OUTCOME #1 FOR COMPUTER
INFORMATION SYSTEMS (CIS) UNDERGRADUATE (Instructional Degree
Program) (Degree Level) September 2009 - August 2010 (Assessment Period
Covered) Intended Educational (Student) Learning Outcome #1 (repeated from
Linkage Page): Outcome #1: Applications Software-Each student will be able
demonstrate proficiency in the use of word-processing, presentation development
and management, spreadsheet, and database software programs to solve
business related problems. This is a Criterion-referenced Outcome. (CIS 205, CIS
206) How many Means of Assessment are proposed for this Outcome? _ 2 _ First
Means of Assessment for Outcome #1: 1.1-1. State Means of Assessment and
Describe Data Collection Plan: Using an online Skills Assessment Manager, each
student must satisfactorily complete assigned tasks within each application
software program simulation (i.e. MS Word, PowerPoint, EXCEL and ACCESS).
Student performances are automatically archived and reported individually to the
student and instructor. Student performance reports for one academic year will be
collected and analyzed to determine the success levels of this student-centered
teaching and learning activity. 1.1-2. Define Criteria for Success: Each student
must complete accurately 70% of the assigned skills/tasks contained in each
simulation. Consequently, the criteria for success for this outcome is to require a
minimum of 70% of all students within any 12 month data collection period to
accurately complete 70% of the assigned tasks. After data collection, at the end of
the Assessment Period, you will complete blocks 1.1-3 and 1.1-4. 1.1-3. Describe
Data Collected, Data Analysis, and Whether Criteria for Success Were Met: The
College uses an on-line assessment tool for measuring students' performance
within MS Word and Excel. During 2010-11 AY, 368 students completed the Word
assessment while 320 students completed the Excel assessment. The average
scores of the students were as follows: 77.9 for Word and 68.2% for Excel. 276
(76%) students scored above 70 in the Word assessment while 160 (50%)
students scored above 70 in the Excel assessment. 1.1-4. Describe How
Assessment Results Were Used to Improve Instructional Program: The syllabus
for CIS 205 was modified to increase the coverage of Excel. An advanced module
of Excel has also been introduced in CIS 206-Business Programming Languages.
We expect to see an improvement in the 2011-2012 AY. Second Means of
Assessment for Outcome #1: 1.2-1. State Means of Assessment and Describe
Data Collection Plan: A five-point Rating Scale will be developed that indexes
observable student performance on assigned tasks. Upper-course level (300-400)
faculty will use the Rating Scale to indicate their global observation of students'
skills in using the application software programs to accomplish assigned tasks.
This rating will be conducted for every 300-400 level class taught during the Fall
and Spring semester. 1.2-2. Define Criteria for Success: An average score of 3.0
or higher will be the criterion for success. After data collection, at the end of the
Assessment Period, you will complete blocks 1.2-3 and 1.2-4. 1.2-3. Describe
Data Collected, Data Analysis, and Whether Criteria for Success Were Met: Every
student (a total of 586) enrolled in 300-400 level classes were assessed by the
faculty on their knowledge, skills, and abilities in the use of Word and Excel. A 5point Likert scale was used (1-Not Proficient and 5-Very Proficient). The results
were: Excel 3.60(Average) [1.2 was the low and 5.0 was the high] Word 3.95
(Average) [1.8 was the low and 5.0 was the high] 1.2-4. Describe How
Assessment Results Were Used to Improve Instructional Program: There was an
improvement in scores compared to the scores reported in 2009-2010. Excel
modules in CIS 206 and CIS 331 have had some impact on Excel scores. You
may add more Means of Assessment by copying blocks 1.2.1- through 1.2-4.
Source of Evidence: Evaluations
Target:
Each student must complete accurately 70% of the assigned skills/tasks contained in each
simulation. Consequently, the criteria for success for this outcome is to require a minimum of
70% of all students within any 12 month data collection period to accurately complete 70% of
the assigned tasks.
Findings (2011-2012) - Target: Met
The College uses an on-line assessment tool for measuring students' performance within
MS Word and Excel. During 2011-12 AY, 521 students completed the Word assessment
while 653 students completed the Excel assessment. The average scores of the students
were as follows: 70.3 for Word and 75 for Excel.
SLO 2:Demonstrate Proficiency in Programming
Programming-Each student will be able to use VISUAL BASIC, COBOL, JAVA and C# (Csharp) programming languages without assistance to design and develop small-to-mid-size
programs to solve business related problems to include website design and development.
Sufficient VISUAL BASIC, COBOL, JAVA and C# (C-sharp) programming skills will require
LOGICAL PRACTICE, i.e., good variable names, good use of computational units,
appropriate commenting strategies, etc. This is a Criterion-referenced Outcome. (CIS 206,
CIS 302, CIS 304, CIS 309, CIS 319, CIS 461)
Relevant Associations:
Strategic Plan Associations:
Alabama State University
2 To ensure the academic integrity of the University.
4 To enhance the public's perception of the University and thus increase
external support
7 To improve programs and services that will contribute to the development of
wholesome student life
Related Measures:
M 2:Outcome #2
ASSESSMENT PLAN / REPORT: OUTCOME #2 FOR COMPUTER
INFORMATION SYSTEMS (CIS) UNDERGRADUATE (Instructional Degree
Program) (Degree Level) September 2009 - August 2010 (Assessment Period
Covered) Intended Educational (Student) Learning Outcome #2 (repeated from
Linkage Page): Outcome #2: : Programming-Each student will be able to use
VISUAL BASIC, COBOL, JAVA and C# (C-sharp) programming languages without
assistance to design and develop small-to-mid-size programs to solve business
related problems to include website design and development. Sufficient VISUAL
BASIC, COBOL, JAVA and C# (C-sharp) programming skills will require LOGICAL
PRACTICE, i.e., good variable names, good use of computational units,
appropriate commenting strategies, etc. This is a Criterion-referenced Objective.
(CIS 302, CIS 304, CIS 309, CIS 404, CIS 461) How many Means of Assessment
are proposed for this Outcome? _ 2 _ First Means of Assessment for Outcome #2:
2.1-1. State Means of Assessment and Describe Data Collection Plan: All
programming classes will involve hands-on testing. The results of the hands-on
test will be a means of assessment. 2.1-2. Define Criteria for Success: An average
score of 70% in the hands-on test will be the criteria for success. After data
collection, at the end of the Assessment Period, you will complete blocks 2.1-3 and
2.1-4. 2.1-3. Describe Data Collected, Data Analysis, and Whether Criteria for
Success Were Met: The data for all hands-on tests conducted in various classes
were analyzed. The average score of all students on hands-on tests was 78.572.
The hands-on exam components for the programming classes were at least 50%
of the final grade (classes analyzed were CIS 302, CIS304, CIS320, CIS404,
CIS415). 2.1-4. Describe How Assessment Results Were Used to Improve
Instructional Program: We will continue with the practice of testing students'
knowledge through hands-on testing. The weightage of hands-on test on the final
grade will be increased. Six of our students are working with the Alabama
Department of Transportation for a 12-month internship program. We have got
positive feedback on the performance of the students. Second Means of
Assessment for Outcome #2: 2.2-1. State Means of Assessment and Describe
Data Collection Plan: Prior to graduation, all CIS Majors will be required to take the
State of Alabama programmers test. 2.2-2. Define Criteria for Success: 40% of all
COBA CIS majors taking the State of Alabama Programmer's Test will score in the
top band. After data collection, at the end of the Assessment Period, you will
complete blocks 2.2-3 and 2.2-4. 2.2-3. Describe Data Collected, Data Analysis,
and Whether Criteria for Success Were Met: The state of Alabama did away with
the programmers test. Students are placed on the register based on their
educational qualifications. 2.2-4. Describe How Assessment Results Were Used to
Improve Instructional Program: You may add more Means of Assessment by
copying blocks 2.2-1 through 2.2-4.
Source of Evidence: Evaluations
Target:
An average score of 70% in the hands-on test will be the criteria for success.
Findings (2011-2012) - Target: Met
The data for all hands-on tests conducted in various classes were analyzed. The average
score of all students on hands-on tests was 75.572. The hands-on exam components for the
programming classes were at least 50% of the final grade (classes analyzed were CIS 302,
CIS304, and CIS461). Although the targets were met, we need more improvements.
SLO 3:Demonstrate Proficiency in Systems A&D
System Analysis and Design-Each student will be able to use appropriately system design
notations and apply system design strategies and processes to design, plan, and implement
practical and theoretical information systems. This is a Criterion-referenced Outcome. (CIS
329, CIS 331, CIS 404, CIS 410, CIS 415)
Relevant Associations:
Strategic Plan Associations:
Alabama State University
2 To ensure the academic integrity of the University.
4 To enhance the public's perception of the University and thus increase
external support
7 To improve programs and services that will contribute to the development of
wholesome student life
Related Measures:
M 3:Outcome #3
ASSESSMENT PLAN / REPORT: OUTCOME #3 FOR COMPUTER
INFORMATION SYSTEMS (CIS) UNDERGRADUATE (Instructional Degree
Program) (Degree Level) September 2009 - August 2010 (Assessment Period
Covered) Intended Educational (Student) Learning Outcome #3 (repeated from
Linkage Page): Outcome #3: System Analysis and Design-Each student will be
able to use appropriately system design notations and apply system design
strategies and processes to design, plan, and implement practical and theoretical
information systems. This is Criterion-referenced Objective. (CIS 329, CIS 331,
CIS 404, CIS 410, CIS 415) How many Means of Assessment are proposed for
this Outcome? _1 _ First Means of Assessment for Outcome #3: 3.1-1. State
Means of Assessment and Describe Data Collection Plan: Each student, working
in a group and using modern programming tools, will develop a practical feasibility
study and design a "real-world" project that satisfy the criteria for meeting a small
business objective. 3.1-2. Define Criteria for Success: Client feedback that the
small business objective has been satisfied. After data collection, at the end of the
Assessment Period, you will complete blocks 3.1-3 and 3.1-4. 3.1-3. Describe
Data Collected, Data Analysis, and Whether Criteria for Success Were Met: During
Fall 2010, fourteen (14) students worked on and completed feasibility studies for
the following four projects: COBA (Printing Room), ASU Tennis Court(Players,
Coaches, and Schedules), Eyecare System (Doctor's Office) and PALS (People
Against A Littered State). During Spring 2011, twelve (12) students worked on and
completed feasibility studies for the following four projects: ASU Continuing
Education (Wesite), Uncle Bob Storage, Walmart (Recruitment) and Verizon
Wireless (Insurance for Phones). We received positive and satisfactory feedback
for all the projects from managers of the businesses. A feedback from one of the
client is produced below: Dr. Chun, I am one of the IT Managers at the Department
of Transportation and have the opportunity to be a part of the staff that manage
our IT Student Intern Program that works with some of the local universities. As
you are aware, we selected a student project for the senior-level IT students at
ASU in order to give them the opportunity to gain "real work" experience. This
project gave them countless opportunities to enforce some of their classroom
learning as well as a chance to experience working on a real IT project. During this
assignment, the students perform analysis, develop programming specs, create
reports, developed online panels that included adding, updating, deleting, and
inquiring on data, developed databases, data conversion, meet with end users,
and finally made a presentation to show the project to the users. I would like to
congratulate your students Courtney Williams, Joseph Harris, Renaldo Johnson,
Denys Alyeksyeyev, and Chris Harris on an outstanding presentation. It was very
professional. They dressed professionally and they did an exceptional job
presenting the project. I just want you and your staff to know that these students
not only did an excellent job representing themselves, but your university as well.
You and the ASU CIS Department should be very proud of producing these
outstanding students. 3.1-4. Describe How Assessment Results Were Used to
Improve Instructional Program: We will continue to encourage students to develop
projects for local firms. Second Means of Assessment for Outcome #3: 3.2-1.
State Means of Assessment and Describe Data Collection Plan: 3.2-2. Define
Criteria for Success: After data collection, at the end of the Assessment Period,
you will complete blocks 3.2-3 and 3.2-4. 3.2-3. Describe Data Collected, Data
Analysis, and Whether Criteria for Success Were Met: 3.2-4. Describe How
Assessment Results Were Used to Improve Instructional Program: You may add
more Means of Assessment by copying blocks 3.2-1 through 3.2-4.
Source of Evidence: Evaluations
Target:
Client feedback that the small business objective has been satisfied.
Findings (2011-2012) - Target: Met
The followings were the projects completed by the class. Fall 2011: ASU Developing Student
IS Card Systems for the improvement of service ASU Help Desk Systems for Students
Feasibility Study for Conversion from Excel to Oracle Database Spring 2012: Alabama
Department of Correction (ADOC) Time checking in/out system COBA Student Organization
web site development Home Depot Inventory Management Database. All the groups
submitted letters from their clients stating that the system project met their requirements.
SLO 4:Demonstrate Proficiency in Data Networking
Data Networking-Each student will be able to apply appropriately knowledge of data
networking equipment, protocols, software and security to successfully configure router and
routing protocols, create router access list and manage CISCO IOS Software, This is a
Criterion-referenced Outcome.. (CIS 310)
Relevant Associations:
Strategic Plan Associations:
Alabama State University
2 To ensure the academic integrity of the University.
4 To enhance the public's perception of the University and thus increase
external support
7 To improve programs and services that will contribute to the development of
wholesome student life
Related Measures:
M 4:Outcome #4
ASSESSMENT PLAN / REPORT: OUTCOME #4 FOR COMPUTER
INFORMATION SYSTEMS (CIS) UNDERGRADUATE (Instructional Degree
Program) (Degree Level) September 2009 - August 2010 (Assessment Period
Covered) Intended Educational (Student) Learning Outcome #4 (repeated from
Linkage Page): Outcome 4: Data Networking-Each student will be able to apply
appropriately knowledge of data networking equipment, protocols, software and
security to successfully configure router and routing protocols, create router
access list and manage CISCO IOS Software, This is a Criterion-referenced
Outcome.. (CIS 310) How many Means of Assessment are proposed for this
Outcome? _ 1 _ First Means of Assessment for Outcome #4: 4.1-1. State Means
of Assessment and Describe Data Collection Plan: 1. Through online testing on
modules developed by CISCO-the worldwide leader in networking. 4.1-2. Define
Criteria for Success: 80% of the students will score greater than 70% in the tests
designed by CISCO. Students are awarded a Certification of Completion if they
score over 70% in each of the eleven modules. They earn a Letter of Achievement
if they score over 80% in each of the 11 modules. After data collection, at the end
of the Assessment Period, you will complete blocks 4.1-3 and 4.1-4. 4.1-3.
Describe Data Collected, Data Analysis, and Whether Criteria for Success Were
Met: The course CIS 310 was offered in Fall 2010 semester. Thirtyone (31)
students took the course, 21 of them (scored 70% or above) received Cisco's
Certificate of Course Completion and 16 of them (scored 80% or above) were also
eligible for Letter of Achievement. The average score made on the course's
comprehensive Final Exam was 67.32. The Criteria for Success were met. 4.1-4.
Describe How Assessment Results Were Used to Improve Instructional Program:
Although our students performed very well in the theory portion, we were unable to
expose them to hands-on training on routers/switches. Current plans are to
introduce hands-on component in the courses during the 2011-2012 cycle. Second
Means of Assessment for Outcome #4: 4.2-1. State Means of Assessment and
Describe Data Collection Plan: 4.2-2. Define Criteria for Success: After data
collection, at the end of the Assessment Period, you will complete blocks 4.2-3 and
4.2-4. 4.2-3. Describe Data Collected, Data Analysis, and Whether Criteria for
Success Were Met: 4.2-4. Describe How Assessment Results Were Used to
Improve Instructional Program: You may add more Means of Assessment by
copying blocks 4.2-1 through 4.2-4.
Source of Evidence: Evaluations
Target:
80% of the students will score greater than 70% in the tests designed by CISCO. Students
are awarded a Certification of Completion if they score over 70% in each of the eleven
modules. They earn a Letter of Achievement if they score over 80% in each of the 11
modules.
Findings (2011-2012) - Target: Met
The course CIS 310 was offered in Fall 2011 and Spring 2012 semester. During Fall 2011,
13 students took the course, 9 of them (scored 70% or above) received Cisco's Certificate of
Course Completion and 4 of them (scored 80% or above) were also eligible for Letter of
Achievement. The average score made on the course's comprehensive Final Exam was
72.2. During Spring 2012, 23 students took the course, 17 of them (scored 70% or above)
received Cisco's Certificate of Course Completion and 13 of them (scored 80% or above)
were also eligible for Letter of Achievement. The average score made on the course's
comprehensive Final Exam was 74.2. The Criteria for Success were met.
SLO 5:Demonstrate Core Business Knowledge
CORE Business Knowledge-Each student will be able to apply basic skills in accounting,
finance, economics, management and marketing in solving business related problems.
Effective interpersonal communications skills (verbal and non-verbal) are paramount within
this student-centered learning outcome. (ACT 214/215, CIS205/206,
ECO201/202/251/252/331, FIN 321, MGT 204/255/304/321/324/422/462 and MKT 321)
Relevant Associations:
Strategic Plan Associations:
Alabama State University
2 To ensure the academic integrity of the University.
4 To enhance the public's perception of the University and thus increase
external support
7 To improve programs and services that will contribute to the development of
wholesome student life
Related Measures:
M 5:Outcome #5
ASSESSMENT PLAN / REPORT: OUTCOME #5 FOR COMPUTER
INFORMATION SYSTEMS (CIS) UNDERGRADUATE (Instructional Degree
Program) (Degree Level) September 2009 - August 2010 (Assessment Period
Covered) Intended Educational (Student) Learning Outcome #5 (repeated from
Linkage Page): Outcome #5: CORE Business Knowledge-Each student will be
able to apply basic knowledge and skills in accounting, finance, economics,
management, marketing and information technology to solve basic business
related problems. Effective interpersonal communications skills (verbal and nonverbal) are paramount with this student-centered outcome. (ACT 214/215, CIS
205/206, ECO 201/202/251/252/331,FIN 321, MGT 204/255/304/321/324/422/462
and MKT 321. How many Means of Assessment are proposed for this Outcome? _
1 _ First Means of Assessment for Outcome #5: 5.1-1. State Means of
Assessment and Describe Data Collection Plan: All graduating seniors must enroll
in and satisfactorily complete the COBA CAPSTONE course, MGT 462. The MGT
462 grade distribution sheets for each academic will be collected and analyzed to
determine the level of success of the student-centered teaching and learning
activity. 5.1-2. Define Criteria for Success: A minimum of 70% of all MGT 462
enrolled students for the given observation period must satisfactorily complete this
course. After data collection, at the end of the Assessment Period, you will
complete blocks 5.1-3 and 5.1-4. 5.1-3. Describe Data Collected, Data Analysis,
and Whether Criteria for Success Were Met: Nine CIS students passed the course
with a B grade while 13 CIS students received a grade of C. One student got a D
and he is repeating the class.. The criteria for success were met. 5.1-4. Describe
How Assessment Results Were Used to Improve Instructional Program: We have
entered into an agreement with Bell Microproducts- a Fortune 1000 company. All
students in MGT 462 now make their final presentations in the offices of Bell
Microproducts in the presence of senior executives. The feedbacks from the
executives have been very positive. At times, they have also suggested weak
areas where the students need to improve. Second Means of Assessment for
Outcome #5: 5.2-1. State Means of Assessment and Describe Data Collection
Plan: The students' score in the Peregrine Assessment Test will be another level
of observation. 5.2-2. Define Criteria for Success: Success will be met if the mean
score of our students is 140. After data collection, at the end of the Assessment
Period, you will complete blocks 5.2-3 and 5.2-4. 5.2-3. Describe Data Collected,
Data Analysis, and Whether Criteria for Success Were Met: The results of the
Peregrine Outcome Assessment Test in Business are attached. The criterion for
success was an average score of 40. The average score during the cycle was
43.07, a score that was higher than our internal target. 5.2-4. Describe How
Assessment Results Were Used to Improve Instructional Program: We achieved a
substantial improvement during the year. We would like the average on the MFT
exam to exceed 140 in the next cycle. You may add more Means of Assessment
by copying blocks 5.2-1 through 5.2-4 Section Last First Name Status Max Acad
Plan Grade In 01 E CISBS B 02 E CISBS B 02 E CISBS B 02 E CISBS B 02 E
CISBS B 01 E CISBS B 01 E CISBS B 01 E CISBS B 02 E CISBS B 01 E CISBS
C 02 E CISBS C 02 E CISBS C 01 E CISBS C 01 E CISBS C 01 E CISBS C 01 E
CISBS C 01 E CISBS C 02 E CISBS C 02 E CISBS C 02 E CISBS C 01 E CISBS
C 01 E CISBS C 02 E CISBS C Results of the Peregrine Outcome Assessment
Exam ACCOUNTING BUSINESS ETHICS BUSINESS FINANCE BUSINESS
INTEGRATION AND STRATEGIC MANAGEMENT BUSINESS LEADERSHIP
GLOBAL DIMENSIONS OF BUSINESS INFORMATION MANAGEMENT
SYSTEMS LEGAL ENVIRONMENT OF BUSINESS MANAGEMENT MARKETING
QUANTITATIVE RESEARCH TECHNIQUES AND STATISTICS FINAL SCORE
Count Category 46.21 45.73 45.63 42.23 44.56 49.81 55.63 50.49 48.16 30.58
32.72 44.33 103 ALL 46.62 46.36 46.75 43.38 44.68 51.43 54.03 52.34 47.66
31.43 31.43 44.76 77 Others 45.00 43.85 42.31 38.85 44.23 45.00 60.38 45.00
49.62 28.08 36.54 43.07 26 CIS Score Interpretation 80-100 Very High 70-79 High
60-69 Above Average 40-59 Average 30-39 Below Average 20-29 Low 0-19 Very
Low None of the CIS students scored higher than 60. The highest score for a CIS
student was 58.3 Eight of our students were in the Below Average Category
Source of Evidence: Evaluations
Target:
Objectives Targets Written and Oral Communications skills are measured in four courses
(MGT 204, MGT 321, MKT 321 and MGT 400). They also measured in all sections and in all
semesters. Our internal target is a median score of 3.0. Quantitative Skills are measured in
three courses (ECO 202, FIN 321, and MGT 422). They also measured in all sections and in
all semesters. Our internal target is a median score of 3.0. IT Skills are measured in three
courses (CIS 206, CIS 329, and MGT 400). They also measured in all sections and in all
semesters. Our internal target is a median score of 3.0. Professional Development Skills are
measured in five courses (MGT 201, MGT 321, MKT 321, FIN 321, and MGT 422). They
also measured in all sections and in all semesters. Our internal target is a median score of
3.0. CPC Content Knowledge is measured in twenty specific courses. They also measured
in all sections and in all semesters. Our internal target are a median pre-test score 50 and a
median post-test score of 80. Peregrine CPC Outbound test is a requirement for graduation.
This test is administered to all graduating seniors in the capstone class- MGT 462. Our
internal target are a mean score of 50 and mean scores on individual areas to be higher than
the national average.
Findings (2011-2012) - Target: Met
The learning outcomes for the CORE Business Knowledge are detailed below: Objective 1:
Students will be able to demonstrate an understanding and mastery of the written and oral
communication skills required in business. Objective 2: Students will be able to demonstrate
an understanding and mastery of the quantitative skills required in business. Objective 3:
Students will be able to demonstrate an understanding and mastery of the information
technology skills required in business. Objective 4: Students will be able to demonstrate the
professional development and critical thinking skills required in business. Objective 5:
Students will be able to demonstrate an understanding and mastery of core
business/curriculum content (subject matter) required in business. Objectives one through
three also aligns well with Alabama State University's Quality Enhancement Plan (QEP) (a
requirement of SACS-COC) which is "Enhancing the Culture of Learning Through Literacy in
the First-Year Experience". For information on the University's QEP please visit
http://www.alasu.edu/about-asu/accreditation/qep/index.aspx. Internal learning outcomes
assessment information and data Outcomes (Objectives) one through four for the
undergraduate Core Business Knowledge are measured through the rubrics focused on
communication skills, information technology skills, quantitative skills, and professional
development. To measure the fifth objective, pre- and post-tests are used which are
administered in all the courses including the CPC courses. For centralized data collection
and data analysis, internal assessment data (rubrics and the course pre- and post-test
scores) are enter on web-based systems that was developed in-house
(coba.alasu.edu/testscores and coba.alasu.edu/rubrics). External learning outcomes
assessment information and data The College uses the ETS Proficiency Profile test as one
of the external assessment data. All COBA students are administered this test in MGT 201
to measure their competencies in four key areas (critical thinking, reading, writing and
mathematics). The College also uses the Peregrine Academic Services' (Peregrine)
Common Professional Component (CPC) outbound exam for external data analysis and
benchmarking with other universities. The Peregrine CPC outbound exam covers the
following areas: accounting, business ethics, business finance, economics, information
management systems, global dimensions, leadership, legal environment of business,
management, marketing, quantitative techniques, and strategic management. Formative and
Summative learning outcomes assessment information and data The ETS proficiency test
scores is a formative assessment data which is being used to help design specialized
instruction for students who do not meet the minimum expectations. The ETS Proficiency
Profile scores will also be measured at graduation to identify gaps and improve teaching and
learning for the program. The Peregrine exam is the most important summative learning
assessment information and data. Formative Assessment The College uses the ETS
Proficiency Profile as one of the Formative data and analysis. This test was administered to
330 students. The average scores are shown in Table 4.2. Table 1.0 ETS Proficiency Profile
Results Fall 2010-Fall 2012 Every student enrolled in MGT 201 is administered this test.
CORE Business Knowledge Objectives 1-4 were assessed using rubrics for written
communication skills, oral communications skills, quantitative skills, IT skills, and
Professional Development skills. Figure 1.1 through 1.5 shows the results for three
semesters The college used the median score for all internal data analysis to target the 50th
percentile. Figure 1.1 Objective 1.1. Written Communication Skills- Rubric Median Scores
Fall 2011, Spring 2012, and Fall 2012 Figure 1.2 Objective 1.2. Oral Communication SkillsRubric Median Scores Fall 2011,Spring 2012, and Fall 2012 Figure 1.3 Objective 2.
Quantitative Skills- Rubric Median Scores Fall 2011,Spring 2012, and Fall 2012 Figure 1.4
Objective 3. IT Skills- Rubric Median Scores Fall 2011,Spring 2012, and Fall 2012 Figure 1.5
Objective 4. Professional Development Skills- Rubric Median Scores Fall 2011, Spring 2012,
and Fall 2012 Objective 5 of the Core Business Knowledge was measured through pre and
post test scores. The results for all CPC courses are shown in Figure 1.6. Figure 1.6
Objective 5. CPC Content Pre-test and Post-test Scores- Overall Median Scores Fall 2011,
Spring 2012, and Fall 2012 Figure 1.7 presents the Peregrine CPC exam results (mean and
lower and upper standard deviation scores) for seven administrations. Figure 1.7 Peregrine
Common Performance Component Outbound Exam Results Fall 2010-Fall 2012 Figure 1.8
and Table 1.1 show the mean scores for the eight common professional components. Figure
1.9 shows the CPC scores for the Spring 2012 administration bench marked with all schools
(traditional) that are using the Peregrine assessment in their program. Figure 1.8 Peregrine
Common Performance Component Results Fall 2010-Fall 2012 Table 1.1 Peregrine
Common Performance Component Results Fall 2010-Fall 2012 Figure 1.9 Benchmarking
Data - Spring 2012 for Peregrine CPC Outbound Exam (Traditional) Comparative
Information and Data Targets/Performance Improvements Results Written and Oral
Communications skills are measured in four courses (MGT 204, MGT 321, MKT 321 and
MGT 400). They also measured in all sections and in all semesters. Our internal target is a
median score of 3.0. Written communication skills continue to be a focus area in COBA. We
have instituted writing in all courses that will be graded by an instructor that has specialized
training. A special topic course (MGT 203) has been made a requirement for students who
are deficient in reading and writing skills as measured by the ETS PP. The oral
communication skills met the target in all the three semesters. For written communication
skills, the target was met in only one semester. Our requirement of one oral presentation in
all courses has had the desired impact. Quantitative Skills are measured in three courses
(ECO 202, FIN 321, and MGT 422). They also measured in all sections and in all semesters.
Our internal target is a median score of 3.0. The new course MGT 201 has a module on
Quantitative skills. All students are required to take the course. The target was met in all the
three semesters. We are wary of our internal analysis as the data is not corroborated by the
Peregrine and the ETS PP results. IT Skills are measured in three courses (CIS 206, CIS
329, and MGT 400). They also measured in all sections and in all semesters. Our internal
target is a median score of 3.0. We have introduced SPSS in the curriculum which was
impacting our scores. The target was met in all the three semesters. This fact has been
corroborated by our external stakeholders. Professional Development Skills are measured in
five courses (MGT 201, MGT 321, MKT 321, FIN 321, and MGT 422). They also measured
in all sections and in all semesters. Our internal target is a median score of 3.0. The college
enforces a very strict dress code policy. Tardiness has been reduced by the successful
implementation of the RFID attendance system that also tracks the time. The target was met
in all the three semesters. The dress code requirements is being emulated by other colleges
in our university. CPC Content Knowledge is measured in twenty specific courses. They also
measured in all sections and in all semesters. Our internal target are a median pre-test score
50 and a median post-test score of 80. Faculty have been advised to review their post tests
and the teaching methodology to improve the performance of the students. The pre-test
target was met in all the semesters. We did achieve the post test target for a total of 23
courses (total courses analyzed were 60). Peregrine CPC Outbound test is a requirement for
graduation. This test is administered to all graduating seniors in the capstone class- MGT
462. Our internal target are a mean score of 50 and mean scores on individual areas to be
higher than the national average. We have shared the data with all faculty and we are
working toward improving scores on Accounting, Finance, and Marketing. Our two recent
Ph.D. hires in Marketing will also have an impact on the marketing scores. We do not teach
to the test. We did not meet the targets for the mean scores during any of the semesters.
The upper standard deviation scores suggest that the score of 50 is approximately the 85
percentile for our students. As regards the benchmarks, we did score higher than the
national averages on Business Integration and Global Dimensions of Business. Our results
are close to the national averages on Information System Management, Ethics, and
Leadership. The following changes to the educational process have been made after
reviewing results on a regular basis. Objective 1: Communication Skills · To address this
issue, faculty instituted writing across the curriculum with a minimum of two writing
assignments in each course. Additionally, an instructor in Business Administration
Department was hired with graduate level training in technical writing to teach a special
topics course (MGT 203) in writing to assist student in improving writing skills. A second
course (MGT 201) focused on the communications learning objectives was created to
improve student performance. · Another consideration is that there has been turnover in the
faculty teaching these courses and there may need to be additional training to ensure the
use of the rubric is consistent across the faculty members. Objective 2: Quantitative Skills ·
To level off performance and address student readiness basic quantitative skills were
included in the MGT 201 course. · Tutors (Graduate Assistants) have been made available
to assist students with their homework and class assignments. · Software such as Aleks
have also been used to improve the quantitative skills. Objective 3: Information Technology
Skills · The CIS faculty are encouraged to keep the technology at the cutting edge. We have
introduced software such as Articulate (audio recording of Power Point presentations),
Camtasia (developing online tutorials and documentation), Wix (developing flash based web
pages), Prezi (developing cloud based presentations) and a module on SPSS. All courses in
the College of Business are web enhanced through use of Blackboard. All CIS classes are
taught in computer labs in support of our "More Coaching, Less Teaching" approach.
Objective 4: Professional Development · To improve student understanding a five week
module on PD was incorporated in MGT 201 · The COBA dress code is being strictly
enforced. · RFID attendance has reduced the incidence of tardiness. Students scanning 10
minutes late are marked late and the RFID system disables itself after 20 minutes. Objective
5: CPC Content Knowledge · More use of less expensive e-text. An informal survey
indicated that the students did not read or purchase the text which hindered their
performance. · Copies of the required text books have been made available in the reference
section of the library. The students can check out these books for use within the library. ·
Incorporation of Connect product offered with McGraw-Hill textbooks, in many courses. This
system provides students with immediate feedback and allows faculty to assign and grade
more homework. · The requirements and methods of assessment were overhauled for the
capstone course - MGT 462, Business Policies
Download