University of North Carolina Wilmington Educational Program Assessment Plan and Report Assessment Plan for 2009 – 2010 Cameron School of Business Primary Contact Name/Info: Becky Porterfield, AoL Director, Cameron School of Business Program Outcome UNCW Strategic Goal BSBA PO 1: A minor in Information Technology was proposed as a joint program between the ISOM and Computer Science Departments. The intent is to meet the requests of surveyed student and community persons to allow a minor in technology to enhance their major. The taking of extra classes in information technology without recognition on the transcripts was not seen as sufficient recognition. UNCW Strategic Goal 1. Tools Implementation Summary of Findings Actions Taken Measured outcome will be student credit hours generated and also number of minors completed in information technology. The Registrar’s Office collects this information and reports are available through the Report Writing system in mySeaport. The surveys showed a strong interest among students wanting a minor in information technology to enhance their degree. The ISOM and Computer Sciences created a proposal (which has since been accepted by General Administration) to offer a minor in Information Technology. We have not implemented the minor yet because of budgetary restrictions and offering the minor requires additional faculty. Said faculty lines are not yet available. MBA Program Goals PO 1: MBA teams conducted Learning Alliance and Practicum projects for 30 regional organizations (including non-profits). UNCW Strategic Goal: I & V Faculty & client assessment of oral and written reports. Survey conducted Fall 10 to assess satisfaction and likelihood to repeat/recommend. Vince Howe, MBA Director Clients were very satisfied with value added reports. Only key recommendation was to shorten cycle between Learning Alliance Environmental Analysis project and Growth & Profit Project. Working with MBA faculty and SBTDC counselors to accelerate Growth & Profit project process. PO2: Princeton Review Best Business Schools Award. UNCW Strategic Goal: I Independent survey of current students to assess experience. Princeton Review, MBA Director coordinator student survey implementation. Highly rated on access to faculty and overall learning experience. None necessary. 1. Survey of Orientation Events on Career Development 2. Survey Firms Attending Meet the Firms 3. Number of Firms Recruiting on Campus 4. Student Exit surveys 5. Informal dialogue with Advisory Board Placement of students MSA Director; Survey data; informal data collected talking to students, faculty, advisory board and recruiters Student response indicated lack of knowledge to make career track decisions (audit, tax, systems) uncomfortable with networking at social events Placement in the Charlotte area was declining. MSA Program Goals PO 1: To provide effective career development and placement opportunities for all students. Students will be supported in their placement activities through access to accounting firm personnel (at the local, regional, and national/international firm levels) and industry personnel through the UNCW career placement center, placement events, and through other oncampus UNCW Strategic Goal 1 1. Accounting Career Day (set up panels on Audit, Tax, Industry) 2. Revised topics presented during Orientation a. One day is devoted to developing career skills (including networking) b. One day is devoted to developing academic skill c. Added session with former graduates of the program 3. Revised schedule for Meet the Firms to make the event less stressful to students and firms Added another MSCSIS Program PO 1: Increase dialogue between industry and MS CSIS program . Wilmington IT Exchange and Conference and Career Day Dr. Tom Janicki; number of industry people, faculty and students who attend events Events are popular with industry, faculty, and students all actively participating Invited keynote speaker to give the annual WITX conference more of a focal point. IT Breakfast Series Dr. Tom Janicki; number of breakfast meetings and attendance data Breakfast event typically gets 20 people in attendance regardless of topic Modify topics to include suggestions from Industry Advisory Board New web site Dr. Tom Janicki; number of visitors to web site There are a modest number of external visitors to web site Exploring the use of Google AdWords to increase traffic (visitors) to web site Summary of Findings Actions Taken UNCW Goal 5 PO2: Provide learning opportunities for faculty UNCW Goal 2 PO3: Improve student recruitment UNCW Goal 1 Student Learning Outcome UNCW-wide Learning Goal CSB Undergraduate BSBA UNCW Learning Goal SLO1: Our students will be able to integrate discipline- Tools a. Content Knowledge Sixty question multiple Implementation Required for all students registered in MGT 455 class Appendix A Based on AACSB recommendation , the CSB specific knowledge across functional areas and utilize leadership and team skills to accomplish group tasks. choice assessment representing five key areas each for 13 business core classes. UNCW Goal 1 b. Integration Method: Rubric use d in MGT 455 capstone class by faculty member to assess functional integration c. Team Building Method: Rubric used in MGT 455 course by students that assess each team member in their project team groups d. Leadership Method: Rubric used in MGT 455 by all students to assess the leadership skills of their team leaders in their project teams. (capstone strategy course required for all BSBA students). Administered every semester on-line. Each department reviews its set of questions relevant to its business core class for student learning improvement and makes changes as needed. faculty voted in fall 2010 to require a student to make at least 60% on the assessment to be able to pre-register for MGT 455. Additionally some questions have been changed; syllabi and course content material have been changed to improve student learning in MKT340, FIN335, ECN221, ACG203, BLA361 and QMM 280 based on the data. Every semester MGT 455 is offered including summer for all students in course. Management faculty review data for improvements. The management faculty met, reviewed data and concluded: Students rate leadership and teamwork with higher performance— professors have rated integration and oral communication performance as mid-range. The Department consider ed changes 1)standardize peer evaluation (tied to grades) to show differentiation of student performance, 2)considered curricular or pedagogical improvements: 1 hour strategy lab (for integration)—long-term Every semester in MGT 455 class (capstone strategy course). Management faculty review data for improvements. A very semester in MGT 455 class (capstone strategy course). Management faculty review data for improvements. solution or 1 hours class along with 455 (to run simulation and collect rubric data from a captive audience) SLO2: Our students will demonstrate critical thinking and problem solving skills through problem identification, analysis and synthesis of data, evaluation of alternatives, and defense of a solution. UNCW Goal 1 a. Problem Solving Method: At the end of the semester in the Production Management course (POM 370), a non-graded problem is added to assess problem solving. Using a problem solving rubric, a faculty member who does not teach the course, assesses the ability to problem solve for each student. b. Critical Thinking Method: At the end of the semester in the Production Management course (POM 370), a non-graded problem is added to assess problem solving. Using a critical thinking rubric, a faculty member who does not teach the course, assesses the ability to problem solve for each student. SLO3: Our students will be able to conceptualize a complex issue into a a.Written Communication Method: The CSB subscribes to ETS’s written communication instrument Assessment is conducted every semester POM 370 is taught from a sample of student work. The AOL committee reviews the work and passes it to the curriculum committee as needed. Appendix B The AOL committee determined the rubric method was not sustainable for both problem solving and critical thinking and converted the method to a multiple choice, non-graded method. This was implemented in spring 2009. To date insufficient data has been collected for changes. Appendix C The curriculum committee developed a sub-committee to investigate potential areas for writing Assessment is conducted every semester POM 370 is taught from a sample of student work. The AOL committee reviews the work and passes it to the curriculum committee as needed. The ETS written assessment is administered in each concentration’s capstone course or in lieu of a coherent written statement and oral presentation, demonstrated with the effective use of technology. for assessing writing ability within the CSB. UNCW Goal 1 b.Oral Communication/Technology Use Method: All faculty in the MGT 455 CSB capstone course (strategy course) use a rubric (encompassing components of oral communication and the use of technology) to assess individuals as they present in their project teams for the semester. SLO4: Our students will understand the importance of social responsibility, diversity, ethics and legal a. Ethics, Social Responsibility, and Diversity Method: This assessment is conducted by utilizing questions directly related to capstone course a designated course within the concentration every semester to all students in each class. Double majors need only take it in one of their capstone classes. Results are reviewed by the AOL committee and passed on to the CSB curriculum committee for actions. improvements. The committee determined through statistical analysis that ETS was not effective. The curriculum committee determined to assess the extent “of the writing problem”. In spring 2009 a survey on writing effectiveness was given to the faculty and in fall 2010 focus groups are being conducted with students. Based on these results a new method of assessment will be developed. This assessment is conducted every semester MGT 455 is offered by all faculty teaching a class to all students. The management faculty review the data for recommended actions. See SLO1 actions by Management Department Appendix D This assessment is conducted every semester and is evaluated by the Insufficient data was being gathered on the dimensions of ethics, social responsibility, and diversity. This assessment is included in the content knowledge of issues. UNCW Goal 3 these three areas from the content knowledge assessment conducted for students registered in MGT 455. The assessment instrument is required for all students and is online. a. Legal Issues Method: This assessment is conducted by utilizing questions directly related to the legal environment (BLA 361) from the content knowledge assessment conducted for students registered in MGT 455. The assessment instrument is required for all students and is online. SLO5: Our students will demonstrate an understanding of global business practices that embraces the opportunities of multicultural, diverse environments, as they relate to local, national and global operations. UNCW Goal 4 Undergraduate BA Economics SLO1: Our students will understand key economic curriculum committee. SLO1. The assessment instrument will be changed to include more extensive assessment of these qualities and will be included in the 60% requirement for preregistration in MGT 455. This assessment is conducted every semester and is evaluated by the international business committee. The BLA faculty have changed some of the questions as a result of this analysis. Method: This assessment is conducted by utilizing questions directly related to international business (INB 300 course) from the content knowledge assessment conducted for students registered in MGT 455. The assessment instrument is required for all students and is online. This assessment is conducted every semester and is evaluated by the international business committee Appendix E The IB committee has reviewed the data and is now in the process of evaluating a potential capstone course for IB majors as a result of this information. The IB committee is presently satisfied with the results. Methods: Ten multiple choice questions will be Administration: ECN 321 is offered in the fall semester No data received No actions. principles and models. UNCW Goal 1 SLO2: Our students will be able to analyze and interpret quantitative data. UNCW Goal 1 SLO3: Our students will be able to conceptualize a complex issue into a coherent written statement and oral presentation, demonstrated with the effective use of technology. UNCW Goal 1 GRADUATE PROGRAMS MSA Program SLO1: Our graduates will have the skills necessary for critical thinking, professional research, and continuous learning. imbedded in the BA in Economics capstone classes in ECN 321 and ECN 322 theory courses for assessment of economic principles and models. and ECN 322 is offered in the spring semester. The questions will be nongraded items in the final exam. Review of the assessment and associated changes to curriculum will be conducted by the economics faculty. Methods: Five multiple choice questions will be imbedded in the BA in Economics ECN377 and ECN 422 classes for assessment of data analysis and interpretation. Administration: ECN 3377 is offered in the fall semester and ECN 422 is offered in the spring semester. The questions will be nongraded items imbedded in the final exam. Review of the assessment and associated changes to curriculum will be conducted by the economics faculty. Administration: ETS for economics is administered in the ECN 422 course. Results are reviewed by the economics faculty for actions. No data received No actions. No data received No actions. Administration: The rubric is used by faculty to evaluate all students in a class exercise. This course is offered each spring. Results Appendix F Method: The CSB subscribes to ETS’s written communication instrument for assessing writing ability within the CSB. A: Critical Thinking Method: A critical thinking rubric is used in the MSA 518 Risk Based Auditing course. are reviewed by the MSA faculty committee. UNCW Goal 1 SLO2: Our graduates will demonstrate a global perspective of business and accounting practices. B: Professional Research Method: A rubric is used to assess a case analysis conducted by students in the MSA 500 Financial Accounting Research and Theory course. Administration: This course is offered each fall, and the assessment is conducted on all students by the faculty member. Results are reviewed by the MSA faculty committee. C: Continuous Learning Method: Assessment is conducted by both indirect and direct measures. Students complete and exit survey when leaving the program. The pass rate for the CPA exam is assessed. Additionally all students are required to participate in continuous learning activities such as BAP, IMA, etc. Hours of attendance are logged and monitored. Administration: This assessment is administered and evaluated by the MSA director and reported each spring. Results are reviewed by the MSA faculty committee. Method: An online assessment of multiple choice questions developed by the faculty is used for assessment Administration: To be administered in the MSA 500 Financial Accounting Research and Theory course each fall semester to all students. Appendix G Method: Rubrics for Administration: Student Appendix H UNCW Goal 1 SLO3: Our graduates will have leadership and team building skills. leadership and teamwork are used. peer assessment is used by all students for the term project in MSA 516 Systems Assurance course offered each fall. A: Ethics Method: Online multiple choice assessments are used. Administration: The assessment is conducted in the MSA 500 Financial Accounting Research and Theory course each fall to all students. UNCW Goal 1 SLO4: Our graduates will recognize the importance of social responsibility and making ethical business decisions. Appendix I B: Social Responsibility UNCW Goal 3 SLO5: Our graduates will have effective communication skills and strong interpersonal skills. Method: Method: Assessment is conducted by both indirect and direct measures. Students complete and exit survey when leaving the program. The pass rate for the CPA exam is assessed. Additionally all students are required to participate in continuous learning activities such as BAP, IMA, etc. Hours of attendance are logged and monitored. A: Communication— Written Method: The CSB subscribes to ETS’s written communication instrument Administration: This assessment is administered and evaluated by the MSA director and reported each spring. Results are reviewed by the MSA faculty committee for action Appendix J Administration: ETS is conducted in the MSA 530 Management Decisions and UNCW Goal 1 for assessing writing ability within the CSB. B: Communication- Oral Method: A rubric is used to assess practicum presentations by all students. IMBA SLO1: Analyze the global implications of multinational decisions and demonstrate a critical awareness of complex, incomplete or contradictory information. Method: Rubrics developed for each learning goal are used to assess student learning UNCW Goal 1, 4 SLO2: Synthesize information relating to global business management issues, events and cases. Method: Rubrics developed for each learning goal are used to assess student learning Control course to all students. It is conducted each spring and results are reviewed by the MSA committee for actions. Administration: The assessment is conducted by faculty teaching the two practicum classes MSA 534 and 535 and is reviewed by the MSA faculty committee for action. Administration: At the end of the core classes (ending for all institutions late January), sample work is taken from courses in marketing, finance, and strategy and core teaching faculty assess the sample work against the rubrics. In the summer core teaching meeting faculty from all institutions discuss results and make curriculum changes. Administration: At the end of the core classes (ending for all institutions late January), sample work is taken from courses in Fall 2010, first year for all partner schools to send data. Data anticipated spring, 2011 Fall 2010, first year for all partner schools to send data. Data anticipated spring, 2011 UNCW Goal 1, 4 SLO3: Evaluate conceptual outcomes and practical approaches to complex situations within organizational contexts where affected by global issues. Method: Rubrics developed for each learning goal are used to assess student learning UNCW Goal 1, 4 SLO4: Apply problem solving techniques with autonomy, judgment and originality. Method: Rubrics developed for each learning goal are used to assess student learning UNCW Goal 1, 4 SLO5: Demonstrate critical evaluation of perspectives Method: Rubrics developed for each learning goal are marketing, finance, and strategy and core teaching faculty assess the sample work against the rubrics. In the summer core teaching meeting faculty from all institutions discuss results and make curriculum changes. Administration: At the end of the core classes (ending for all institutions late January), sample work is taken from courses in HRM, marketing, strategy and finance, and core teaching faculty assess the sample work against the rubrics. In the summer core teaching meeting faculty from all institutions discuss results and make curriculum changes. Administration: At the end of the core classes (ending for all institutions late January), sample work is taken from courses in HRM, finance, and strategy, and core teaching faculty assess the sample work against the rubrics. In the summer core teaching meeting faculty from all institutions discuss results and make curriculum changes. Administration: At the end of the core classes (ending Fall 2010, first year for all partner schools to send data. Data anticipated spring, 2011 Fall 2010, first year for all partner schools to send data. Data anticipated spring, 2011 Fall 2010, first year for all partner schools to send of leadership, clarify tasks, demonstrate commitment, negotiate and delegate in groups where the members have different cultural and educational backgrounds. used to assess student learning UNCW Goal 1, 4 SLO6: Work and lead in a way that respects the cultural diversity of multinational and multilanguage groups. Method: Rubrics developed for each learning goal are used to assess student learning UNCW Goal 1, 3, 4 SLO7: Manage information related to business management in a global context and act autonomously. UNCW Goal 1, 4 Method: Rubrics developed for each learning goal are used to assess student learning for all institutions late January), sample work is taken from courses in HRM, marketing, finance, and strategy, and core teaching faculty assess the sample work against the rubrics. In the summer core teaching meeting faculty from all institutions discuss results and make curriculum changes. Administration: At the end of the core classes (ending for all institutions late January), sample work is taken from courses in HRM, marketing, finance, and strategy, and core teaching faculty assess the sample work against the rubrics. In the summer core teaching meeting faculty from all institutions discuss results and make curriculum changes. Administration: At the end of the core classes (ending for all institutions late January), sample work is taken from courses in marketing, finance, and strategy, and core teaching faculty assess the sample work against the rubrics. In the summer core teaching meeting faculty from all institutions discuss results data. Data anticipated spring, 2011 Fall 2010, first year for all partner schools to send data. Data anticipated spring, 2011 Fall 2010, first year for all partner schools to send data. Data anticipated spring, 2011 SLO8: Solve problems and communicate original solutions at a professional level (both written and spoken) in matters related to business management in a global context. Method: Rubrics developed for each learning goal are used to assess student learning UNCW Goal 1, 4 SLO9: Operate in the complex and unpredictable context, as the global economy and exercise initiative and personal responsibility at professional level. Method: Rubrics developed for each learning goal are used to assess student learning UNCW Goal 1, 4 SLO10: Be precise and effective in applying procedures, models and techniques. UNCW Goal 1, 4 Method: Rubrics developed for each learning goal are used to assess student learning and make curriculum changes. Administration: At the end of the core classes (ending for all institutions late January), sample work is taken from courses in HRM, marketing, finance, and strategy, and core teaching faculty assess the sample work against the rubrics. In the summer core teaching meeting faculty from all institutions discuss results and make curriculum changes. Administration: At the end of the core classes (ending for all institutions late January), sample work is taken from the strategy course and core teaching faculty assess the sample work against the rubrics. In the summer core teaching meeting faculty from all institutions discuss results and make curriculum changes. Administration: At the end of the core classes (ending for all institutions late January), sample work is taken from courses in finance and strategy, and core teaching faculty assess the sample work against the rubrics. In the summer core Fall 2010, first year for all partner schools to send data. Data anticipated spring, 2011 Fall 2010, first year for all partner schools to send data. Data anticipated spring, 2011 Fall 2010, first year for all partner schools to send data. Data anticipated spring, 2011 SLO11: Identify the key success factors for the management of international projects and apply these principles to the analysis of a complex business situation. Method: Rubrics developed for each learning goal are used to assess student learning UNCW Goal 1, 4 MBA Program SLO1: Our graduates will understand the importance of ethics, corporate social responsibility and the need to reflect that understanding in their actions and decisions. UNCW Goal 3 teaching meeting faculty from all institutions discuss results and make curriculum changes. Administration: At the end of the core classes (ending for all institutions late January), sample work is taken from courses in HRM, marketing, finance, and strategy, and core teaching faculty assess the sample work against the rubrics. In the summer core teaching meeting faculty from all institutions discuss results and make curriculum changes. Fall 2010, first year for all partner schools to send data. Data anticipated spring, 2011 A: Ethics Method: A rubric is used to evaluate write-ups on critical incidents written by all students. Administration: This Appendix K assessment is conducted by faculty in MBA 556— Executive Challenge on all students each spring and in MBA 541 Marketing Decision Making in Summer 1 each year. Results are reviewed and changes made by the MBA Committee. B: Social Responsibility Method: a rubric is used to evaluate write-ups on critical incidents written by all students. Administration: This assessment is conducted by faculty in MBA 556— Executive challenge on all students each spring each year. Results are reviewed and changes made by the MBA Committee. All data being used in comprehensive program review to be completed in Fall 2010. SLO2: Our graduates will have the leadership and team-building skills necessary to lead organizations in a dynamic environment, i.e. can act as change agents. A: Teamwork and Leadership Method: A scaled peer evaluation form is used on both dimensions for assessment. UNCW Goal 1 Appendix L All data being used in comprehensive program review to be completed in Fall 2010. Appendix M All data being used in comprehensive program review to be completed in Fall 2010. Administration: All learning alliance teams conduct this assessment in the MBA 553 Learning Alliance Integration projects. All students participate. The assessment is conducted each fall and the results are reviewed and changes made by the MBA committee. B: Change Method: A rubric is used to assess a course exercise focused on understanding change. SLO3: Our graduates will have the necessary oral and written communication skills to effectively interact with their stakeholders. UNCW Goal 1 Administration: A faculty member reviews the change exercises against the rubric for all students in the MBA 555 Leading Organizational Change course. Data is collected each fall and is reviewed by the MBA Committee for recommended changes to the curriculum. A: Oral Communication Method: A rubric is used to assess student presentations and additionally peer assessment is reviewed on relevant item assessments on Learning Alliances. Administration: Faculty members in MBA 553 Learning Alliance Integration use the rubric to assess all student presentations. This is conducted upon completion of the Learning Alliance and is generally done in the fall semester. Results are reviewed and changes made by the MBA Committee. B: Written Communication Method: ETS Criterion online essay assessment is used. SLO4: Our graduates will be able to apply knowledge in unfamiliar and dynamic circumstances through a conceptual understanding of relevant disciplines. Administration: This assessment is conducted every spring with students in the MBA 556 Executive Challenge course. Results are reviewed and changes made by the MBA Committee. A: Critical Thinking and Decision Making Method: Rubrics are used to assess both critical thinking and decision making. UNCW Goal 1 Appendix N Administration: Practicum projects (MBA 557 Industry Practicum) and MBA 556 Executive Challenge critical incident write-ups are evaluated against the rubrics by faculty members. These assessments are conducted each spring. Results are reviewed and changes made by the MBA Committee. B: Integration Method: A rubric is used for integration. Administration: Practicum projects (MBA 557 Industry Practicum) and MBA 556 Executive Challenge critical All data being used in comprehensive program review to be completed in Fall 2010. incident write-ups are evaluated against the rubrics by faculty members. These assessments are conducted each spring. Results are reviewed and changes made by the MBA Committee. SLO5: Our graduates will have the capacity to adapt and innovate to solve problems, to cope with unforeseen events, and to manage in unpredictable environments. Method: a rubric is used for integration. Administration: Practicum projects (MBA 557 Industry Practicum) and MBA 556 Executive challenge critical incidents write-ups are evaluated against the rubrics by faculty members. These assessments are conducted each spring. Results are reviewed and changes made by the MBA Committee. Appendix O All data being used in comprehensive program review to be completed in Fall 2010. Method: Rubric used for assessment. Administration: Project conducted in MBA 541 Marketing Decision Making is used for assessment by the faculty member. Assessment is conducted in Summer 1 session each year. Results are reviewed and changes made by the MBA Committee. Appendix P All data being used in comprehensive program review to be completed in Fall 2010. UNCW Goal 1 SLO6: Our graduates will demonstrate an understanding of global business practices that embrace the opportunities of multicultural, diverse environments, as they relate to local, national and global operations. UNCW Goal 3,4 MSCSIS Program SLO1: Graduates will be able to formulate and solve problems using advanced mathematics and numerical methods, and computer information systems-based techniques. Method: Multiple choice questions were developed to assess content knowledge. Administration: Questions are administered to all students in CSC/MIS 532 Network Services Administration each spring by a faculty member. The MSCSIS faculty committee reviews the data and initiates any changes. Appendix Q Method: Multiple choice questions were developed to assess content knowledge. Administration: Questions are administered to all students in CSC/MIS 534 Information Security Management each spring by a faculty member. The MSCSIS faculty committee reviews the data and initiates any changes. Appendix R Method: Multiple-choice questions were developed to assess content knowledge. Administration: Questions are administered in CSC/MIS 550 and 565, Software Engineering and Analysis, Modeling, and Design courses, respectively by each faculty member in all semesters in which either course is offered. The assessment is taken by all students. The MSCSIS faculty committee reviews the data and initiates any changes. Appendix S UNCW Goal 1 SLO2: Graduates will demonstrate knowledge of ethics and professionalism, and understand contemporary issues such as green computing, data security, privacy, and compliance with regulations. UNCW Goal 3 SLO3: Graduates will be able to complete analysis and design of business processes employing the latest information technology techniques, including the unified process model. UNCW Goal 1 SLO4: :Graduates will be able to apply science and business principles to analyze and interpret data, using analytic and computer-based techniques. UNCW Goal 1 Method: Multiple-choice questions were developed to assess content knowledge. SLO5: Graduates will demonstrate effective communication through written and oral presentations. A: Written Communication Method: A capstone assessment survey was developed for all projects for evaluation, including thesis. UNCW Goal 1 Administration: Questions are administered in CSC 555 Data Management Systems course each fall by a faculty member to all students. The MSCSIS faculty committee reviews the data and initiates any changes. Administration: The faculty team evaluates the work using the assessment survey to determine if effective written communication was evident. This is conducted when the major culminating project for the degree is completed. The MSCSIS faculty committee reviews the data and initiates any changes B: Oral Communication Method: Oral communication rubric is used for assessment. Administration: The rubric is administered in CSC/MIS 550 and 565, Software Engineering and Analysis, Modeling, and Design courses, respectively by each faculty member in all semesters in which either course is offered on a major project. The MSCSIS faculty committee reviews the data Appendix T SLO6: Graduates will be exposed to a variety of advanced technology communications tools, such as Web conferencing, wikis, and social networking software. UNCW Goal 1 Method: Multiple-choice questions were developed to assess content knowledge. and initiates any changes. Administration: Assessment is administered by faculty member in the CSC 544 Network Programming course every fall semester to all students. The MSCSIS faculty committee reviews the data and initiates any changes During a review of AOL results from Fall 2008 (see MSCSIS Committee meeting minutes for April 24, 2009), the MSCSIS faculty committee recommended that the results of the content knowledge assessments be reviewed by respective faculty who taught core courses to get their feedback on the results of the content knowledge assessments. While most instructors found the results of the content knowledge assessments to be acceptable, the instructor for the CSC 544 course, part of learning goal 6 – advanced technology communication, found that students performed relatively poor on question 4 Appendix U The committee/faculty member decided that more emphasis needed to be placed on distributed computing concepts, including expanded course coverage and additional programming assignments for client/server computing, web services (n-tier programming) and grid computing. Changes to syllabus for CSC 544 – Network Programming, Fall 2009 have been made to reflect more emphasis on distributed programming. Two additional days of lecture were devoted to grid computing and web services and two additional labs were added. Appendix A: BSBA SLO1 Findings A: Content Knowledge Content-Knowledge Assessment Results as of October 2010 B. Integration Integration Assessment Results as of October 2010 C. Team Building Teamwork Assessment Results as of October 2010 D. Leadership Leadership Assessment Results as of October 2010 Teamwork Assessment Results as of October 2010 Appendix B: BSBA SLO 2 Findings A. Problem Solving Assessment Results as of October 2010 B. Critical Thinking Assessment Results as of October 2010 Appendix C: BSBA SLO3 Findings A. Written Communication Assessment Results as of October 2010 B. Oral Communication Assessment Results as of October 2010 Appendix D: BSBA SLO4 Findings A. Ethics Assessment Results as of October 2010 Social Responsibility/Diversity Assessment Results as of October 2010 The AOL Plan called for social responsibility to be captured in the content knowledge multiple choice assessments. However, no business core courses reflected social responsibility in their questions. January 2010 AOL meetings are focusing discussion on how to effectively capture assessment on this critical issue. During the January 15, 2010 AOL meeting, multiple options were ‘brainstormed’. The focus of the January 22, 2010 meeting will be to gain closure on assessment for social responsibility and diversity. B. Legal Issues Assessment Results as of October 2010 Appendix E: BSBA SLO5 Findings Global Business Assessment Results as of October 2010 Appendix F: MSA SLO1 Findings A. Critical Thinking Assessment Results Criterion Understanding the Issue Formulates Clear and Concise Perspective Considering Tradeoffs Identify and Evaluate ALL important evidence offered Score Spring 2008 (N=20) Spring 2009 (N=20) 0 0.0% 0.0% 2 15.0% 10.0% 4 85.0% 90.0% 0 0.0% 0.0% 2 50.0% 50.0% 4 50.0% 50.0% 0 5.0% 0.0% 2 85.0% 85.0% 4 10.0% 15.0% B. Professional Research Assessment Results Criteria Fall 2008 Avg. (N=12) Spring 2010 Avg. (N=12) Researcher(s) identified the critical technical issues presented by the case. 4.00 5.00 Researcher(s) employed appropriate strategies to identify and access relevant authoritative and professional literature bearing on the technical issues presented by the case. 3.75 4.92 Researcher(s) correctly interpreted and applied relevant authoritative and professional literature and identified alternatives consistent with generally accepted accounting principles and other governing authorities. 3.25 4.83 Researcher(s) identified and expressed resolutions to the primary issues raised in the case. 3.50 4.83 Researcher(s) supported the above resolutions by reference to appropriate authoritative and professional literature and provided appropriate documentation and attribution. 3.25 4.42 Researcher(s) prepared a professional quality document evidencing both a solid command of the mechanical aspects of technical writing, and the ability to communicate complex constructs in a clear, concise manner. 3.33 5.00 C. Continuous Learning Assessment Results Exit Survey Results, July 2009 Average (N = 48) 1. I was encouraged and taught how to learn new material and find information on my own. 4.15 2. I was encouraged to participate in professional society activities and events. (Beta Alpha Psi) 4.06 3. I became aware that to stay current in today’s world, I must continue my education by attending short courses, workshops, seminars, conferences and/or graduate school. 3.98 4. The curriculum has increased my ability to access information from a variety of sources. 4 5. The curriculum has increased my ability to read critically and assess the quality of information available 4 6. The curriculum has increased my ability to analyze new content by breaking it down, asking key questions, comparing and contrasting, 4.08 7. I plan to write the CPA exam (or have already started). 4.48 8. I plan to write other professional exams (CMA, CFE, etc) 2.5 9. I plan to join the AICPA or other professional societies. 4.17 Another measure of continuous learning was Beta Alpha Psi attendance. For the 14 technical meetings during the 2007-2008 academic year, on average 5.36 MSA students attended each meeting (high of 12 and a low of 1). This constitutes 22.39% of the average attendance for each meeting (23.93 students). Six MSA students were inducted into BAP. This constitutes 24% of all new student inductees (25 students). Appendix G: MSA SLO2 Findings Knowledge Assessment, September 2009 Update MSA 534 & 535 Results Summer I 2008 Knowledge Summer I 2009 Score Knowledge Score (N = 49) (N = 51) Mean 67% 63% Median 65% 69% Maximum 88% 100% Minimum 52% 2% Appendix H: MSA SLO3 Findings Leadership Assessment Results as of October 2010 Teamwork Assessment Results as of October 2010 Appendix I: MSA SLO4 Findings A. Ethics Assessment Results, Summer 2009 Summer 2008 Summer 2009 Ethics Score Ethics Score (N = 49) (N = 51) Mean 61% 62% Median 50% 43% Maximum 100% 100% Minimum 25% 39% B. Social Responsibility Assessment Results, July 2009 Appendix J: MSA SLO5 Findings A. Written Communication Assessment Results, Spring 2009 B. Oral Communication Assessment Results, Summer 2009 Appendix K: MBA SLO1 Findings A. Ethics Assessment Results, Spring 2009 B. Corporate and Social Responsibility Assessment Results, Spring 2009 Appendix L: MBA SLO2 Findings A. Leadership Assessment Results, Fall 2009 Rating Scale: 1 = poor performance level; 2 = below expected performance level; 3 = met expected performance level; 4 = exceeded expected performance level; 5 = superior performance level Teamwork Assessment Results, Fall 2009 Rating Scale: 1 = poor performance level; 2 = below expected performance level; 3 = met expected performance level; 4 = exceeded expected performance level; 5 = superior performance level B. Change Assessment Results, Fall 2009 Student Fall 2007 Performance* rating 1 4 Fall 2008 Fall 2009 Performance* Performance* rating rating 4 2 2 2 4 2 3 2 2 0 4 4 2 2 5 4 4 2 6 4 2 2 7 4 2 2 8 2 2 2 9 2 2 4 10 4 4 2 11 4 2 4 12 2 4 4 13 2 2 2 14 2 2 2 15 2 4 2 16 2 2 4 17 2 4 2 18 4 4 2 19 2 2 2 20 2 4 2 21 2 2 4 22 4 2 4 23 2 2 4 24 2 2 2 25 4 2 4 26 2 4 2 27 4 2 4 28 4 2 2 29 2 2 4 30 0 2 2 31 2 4 2 32 2 4 4 33 2 4 2 34 2 0 35 2 2 36 2 2 37 4 4 38 2 2 39 4 4 40 4 2 41 2 2 Appendix M: MBA SLO3 Findings A. Oral Communication Assessment Results, Fall 2008 B. Written Communication Assessment Results, Spring 2010 Appendix N: MBA SLO4 Findings A. Critical Thinking Assessment Results, Spring 2010 B. Integration Assessment Results, Spring 2010 Appendix O: MBA SLO5 Findings Problem Solving Assessment Results, Spring 2010 Appendix P: MBA SLO6 Findings Valuing Diversity Assessment Results, Spring 2009 Appendix Q: MSCSIS SLO1 Findings Content Knowledge Assessment Results, Spring 2009 CSC 532 Content Knowledge Assessment--Spring 2009 (N = 1) Question and Answers 1 Is the following true or false? f(n) = O(g(n)) implies g(n) = O(f(n)) Avg. % Correct 0.0 a TRUE b FALSE 2 Is the following true or false? 100.0 f(n) = O(g(n)) implies g(n) = Ω(f(n)) a TRUE b FALSE 3 What is the O() complexity for the following function. Give your answer as a function of n. float PiPower(n) { int i = 1; float prod = 3.14; while (i < n) { prod = prod * prod; i = 2 * i; } return (prod); } a O(n) 100.0 b O(n^2) c O(n^3) d O(log n) 4 What is the O() complexity for the following segment of program which multiplies two matrices a and b (resident in 2-d arrays) to find the result matric in c. Assume that the assignment statement takes constant time. 100.0 int i = 0, j = 0, k = 0; float a[n][n], b[n][n], c[n][n]; for (i = 0; i < n; i++) for (j = 0; j < n; j++) for (k = 0; k < n; k++) c[i, j] = c[i, j] + a[i, k] * b[k, j]; a O(n) b O(n^2) c O(n^3) d O(log n) 5 The two most common algorithms (Prim and Kruskal Algorithms) to solve Minimum Spanning Tree problem belong to which of the following class of techniques. a Dynamic Programming 100.0 b Divide and Conquer c Greedy 6 Which of the following characterizes the applicability of Dynamic Programming technique to solve problems? 100.0 a Solution of the problem is always composed of the solution of two almost equal sized sub problems b Solution of the problem uses solution of sub-problems which have been solved earlier. c Problem can be formulated by a set of linear inequality constraints and the objective is to optimize a linear function. 7 Write a recurrence for the running time T(n) of f(n), and solve that recurrence. Assume that addition can be done in constant time. def f(n): if n == 1: return 1 else: return f(n - 1) + f(n - 1) a T(n) = T(n - 1) + T(n - 1) + Θ(1) b T(n) = T(n - 1) + Θ(1) c T(n) = T(n - 1) 0.0 d T(n) = Θ(1) 8 Decide whether you think the following statement is true or false. 0.0 In a flow network which has maximum flow from node s to node t the flow across any s-t cut (no matter which cut is considered) is the same. a TRUE b FALSE 9 Which of the following characterizes the applicability of Linear Programming technique to solve problems? 100.0 a Solution of the problem is always composed of the solution of two almost equal sized sub problems b Solution of the problem uses solution of sub-problems which have been solved earlier. c Problem can be formulated by a set of linear inequality constraints and the objective is to optimize a linear function. 10 Decide whether you think the following statement is true or false. Let G be a flow network, with a source s and a sink t, and a positive integer capacity c(e) on every edge e. If f is a maximum flow in G, then f saturates every edge out of s with flow (i.e. for all edges e out of s, we have f(e) = c(e) ). 0.0 a TRUE b FALSE Average Correct 60.0 Appendix R: MSCSIS SLO2 Findings Ethics Assessment Results, Spring 2009 Questions and Answers 1. Identifying, assessing, and reducing risk to an acceptable level and maintaining the achieved level is referred to as _________. a. Risk planning b. Risk management c. Security management d. Operations management 2. What are the three fundamental principles (AIC triad) that serve as a security program’s objectives? a. Confidentiality, ignorance and Authenticity b. Collision, Integrity and Availability c. Confidentiality, Integrity and Availability d. Consistency, Integrity and Authorization 3. The steps of an access control model should follow which logical flow? a. Identification, authorization, authentication, accountability Correct Responses (N = 9) Percentage Correct 8 88.9% 6 66.7% 6 66.7% b. Authorization, authentication, accountability, identification c. Identification, authentication, authorization, accountability d. Identification, accountability, authentication, authorization 4. What is the new program/standard that evaluates the computer security in the United States? a. TCSEC b. Common criteria c. National security standards d. ITSEC 5. Which of the following items is Not considered a preventive physical control? a. Fencing b. Access logs c. Security guards d. Security dogs 6. A function that takes a variable-length string and creates a fixed-length value is called ______. a. One-way hash b. Digital signature c. PKI d. Encryption 7. When considering an IT system Development life-cycle, security should be: a. Mostly considered during the initiation phase 3 33.3% 9 100.0% 9 100.0% 9 100.0% b. Mostly considered during the development phase c. Treated as an integral part of the overall system design d. Add once the design is completed 8. Preparing for a damaging event before it takes place in order to minimize loss and ensure that the business continues to operate is the definition of ________? a. Business impact analysis b. Business continuity planning c. Recovery planning d. Emergency response 9. A hospital is trying to select a facility backup option. They want to ensure no downtime and extremely focused on contingency planning and testing capability through the year. Which of the following alternatives would serve the hospital best? a. Warm site b. Hot site c. Reciprocal agreement d. Redundant site 10. Which of the following is the science of studying and breaking encryption algorithms and cryptosystem? a. Cryptography b. Encryption c. Monoalphabetic substitution d. Cryptoanalysis 9 100.0% 4 44.4% 9 100.0% Total 72 80.0% Appendix S: MSCSIS SLO3 Findings Content Knowledge Assessment Results, Spring 2010 1) Questions and Answers Fall 09 Percentage Correct (N=13) Spring 10 Percentage Correct (N=6) In general, academics and professionals read research literature for all but one of the following reasons. 69.23% 67% 38.46% 17% 100.00% 83% a) Gain breadth of understanding across many areas. b) Gain depth of understanding in specific areas. c) Gain understanding of what has been done. d) Gain understanding of what cannot be done. 2) Which of these questions is least important in assessing research articles? a) What is the contribution or significance of the paper? b) What problem is being investigated? c) What is the primary research area of the author(s)? d) What kind of paper is it? 3) To which scientist is the origin of separation of concerns principle normally attributed? a) Barry Boehm b) Fred Brooks c) E. W. Dijkstra d) D. L. Parnas 4) Which of the following is not a fundamental AOSD concept a) Advice b) Component c) Join point d) Weaving 5) A meta-model is: a) A model that describes other models. b) A description of the four levels of the UML. c) An instance of a correct model. d) Any analysis of a model from a specific perspective. 6) Software testing shows all of the following, except: a) The presence of faults. b) The absence of faults. c) Test effectiveness. d) Test efficiency. 92.31% 83% 100.00% 100% 46.15% 100% 7) It is difficult to find all the bugs in large complex software because: a) The software testers may not know what to do. b) The tools may be inappropriate for the testing tasks. c) Exhaustive testing is not possible. d) Testing is expensive. 8) Validation is: a) Determining if developers are building a software artefact according to user requirements. b) Determining if developers are building a software artefact according to industry standards. c) Determining if developers are building a software artefact according to its specification. d) Making sure users know what they want. 9) A test oracle is: a) A list of expected and actual results. b) A list of prefix values, input, postfix values and expected output. c) The description of the purpose of a set of tests. d) The set of predicted results for a set of tests. 10) Identify the concept that is not fundamental to model-driven software development. a) Metamodeling b) UML c) Diagrams 92.31% 100% 38.46% 50% 53.85% 83% 30.77% 33% d) Model transformations Total 66.15% 72% Appendix T: MSCSIS SLO4 Findings Content Knowledge Assessment Results, Fall 2008 MIS 555 Content Knowledge Assessment--Fall 2008 (N = 7) Question & Answers Response Percentage 1. The main purpose of referential integrity constraints in a relational database is to: Maintain data quality 57% 2. Structured Query Language is a(n): All of the above 57% 3. A foreign key must: Refer to a valid value in the referenced table 43% 4. As compared to other data structures, Balanced Trees are used in relational databases because they: Reduce physical data access 86% 5. Data fragmentation is helpful in what type of system? Online transaction processing (OLTP) 100% 6. The "I" in the ACID transaction requirements stands for: Independent 7. One purpose of an SQL view is to: 100% Control user access to data 100% 8. Transaction collisions without loss of data integrity are accomplished with: Locks 100% 9. Relational databases were created to: Reduce program-data dependence 57% 10. Clustered indexes perform especially well on: Range conditions in the where clause 71% Appendix U: MSCSIS SLO5 Findings Written Communication Assessment Results, Fall 2009 Oral Communication Assessment Results Fall 2009 Spring 2009 Appendix V: MSCSIS Goal 6 Findings Content Knowledge Assessment Results, Fall 2009 Question & Answers Fall 2008 % Correct (N=13) Fall 2009 % Correct (N=2) 1. The main difference between TCP and UDP is: TCP is connection-oriented and UDP is connectionless 69% 100% 92% 50% 2. World Wide Web technologies include: All of the above 3. When developing a network application, the primary programming interface is: Sockets 92% 100% 62% 100% 92% 100% 100% 100% 100% 100% 92% 100% 92% 50% 4. Examples of distributed computing/programming paradigms include: All of the above 5. Which of the following are social networking sites: All of the above 6. Wireshark is an example of: Network Sniffer 7. ARP refers to: Address Resolution Protocol 8. DNS refers to: Domain Name System 9. Network security technologies include: All of the above 10. Database management systems used for web programming include: All of the above 92% 100%