University of North Carolina Wilmington Educational Program Assessment Plan and Report Assessment Plan for 2012-2013 Cameron School of Business Primary Contact Name/Info: Becky Porterfield, AoL Director, Cameron School of Business Degree: Master of Science in Computer Science and Information Systems MSCSIS Program Outcomes Program Outcome Tools UNCW Strategic Goal PO 1: Increase dialogue Wilmington IT Exchange between industry and MS and Conference CSIS program. UNCW Goal 5 Implementation Summary of Findings Dr. Tom Janicki; number of industry people, faculty and students who attend events Spring 2013 event had approximately 400 attendees: students, industry professionals, faculty. Breakout sessions and panels also support PO2. Supports PO3 through broad awareness marketing. Fall 2013 event had more than 25 employers inverviewing. Approximately 30 graduate students attended. Approximately 20 CSIS alumni attended. Spring 2013 group of graduate and undergraduate students attended their first event. New contacts made with DOD and FBI. IT Career Day Dr. Tom Janicki, other faculty Cyber Defense Competition Dr. Ulku Yaylacicegi, Dr. Ron Vetter, faculty and IT Professionals Actions Taken Panel topics are adjusted each year to maintain currency. Post-event meetings to adjust operational issues. New speakers and special guests each year. Continue to promote the event, with the goal of increasing industry and student involvement. Continue involvement making operational changes. Offer independent study credit to students. PO2: Provide learning Cape Fear .Net Developer Group Meeting space on campus through Dr. Janicki, IT professionals arrange meetings Day trip to Raleigh to do site visits at Whole day trip where students spend time at one of these companies: AT&T and EMC. Spring trip to NC State Engineering Career Fair Graduate Student Association in CSIS organized a trip to the NC State Career Fair. Alumni Reunion One early evening of Business Week, we hosted a social event in honor of MSCSIS alumni, and invited faculty, students, alumni, and employers. Business Week Sessions specifically for MSCSIS students by MSCSIS Alumni Three MSCSIS alumni returned to campus to be on a panel of MSCSIS alumni, and relate their work experience. Companies: ATMC, AT&T. Dr. Tom Janicki; number IT Breakfast Series This fills a professional organization gap in the Wilmington area. Venue for faculty and professionals to interact and share knowledge. Employers enjoy working with students.Students see a real-world work environment. At least one job offer and at least one internship offer were a result of this trip. In addition, we now have contacts into IBM and EMC that we didn’t have before About 40 attendees. Approximately 10 alumni, 5 employer representatives, and 15 students and 10 faculty attended. All were very pleased with the event. At least 30 attendees. Good networking opportunities for current students. Approximately 2 breakfast Continue supporting this professional group through meeting space and attendance of faculty and students. Continue to make the trip. Expand the pool of companies that students can visit. Candidates include Credit Suisse, Fidelity, IBM, AT&T, SAS and Red Hat. Develop the new contacts at IBM and EMC, and continue to support the GSA in making this trip in the Fall and Spring. More formally invite employers to this event in Spring 2014. Continue to develop Business Week sessions that are specifically of interest to MSCSIS students. Invite alumni from other companies. Continue to offer new opportunities for faculty of breakfast meetings and attendance data UNCW Goal 2 PO3: Improve student recruitment UNCW Goal 1 Cyber Defense Competition Dr. Ulku Yaylacicegi, Dr. Ron Vetter, faculty and IT Professionals Cape Fear .Net Developer Group Meeting space on campus through Dr. Janicki, IT professionals arrange meetings Faculty training Faculty arrange their own, funding support from ISOM and CSB New web site content; web site analytics Dr. Douglas Kline, Dr. Tom Janicki, other faculty Social media: LinkedIn, Facebook Dr. Douglas Kline, Mrs. Karen Barnhill meetings each semester. Faculty and professionals share knowledge and keep current with fastchanging technologies. Bi-weekly meetings of students with industry professionals guestspeaking. Faculty learn real-world challenges. A valuable learning opportunity for faculty. At least 4 IS faculty traveled for multi-day technical training. New knowledge integrates well into the classroom. Web site content does not address concerns of prospective students. Web traffic has been stable over 2 years. Social media usage is increasing among potential applicants topics each year. Continue and increase involvement in this event. Continue supporting this professional group through meeting space and attendance of faculty and students. Continue to financially support technical training trips. Seek new sources of funds for training. Implement “landing pages” more focused towards specialized areas such as Security. Provide links from capstone documents to main site. Improve calls-to-action. More clearly explain application process. Establish LinkedIn and Facebook presences. Adopt LinkedIn for internal processes such as event announcement. Use Google Adwords and reports Dr. Douglas Kline, Mrs. Karen Barnhill Graduate School applications reports Graduate School Mobile-friendly web content Mobile-friendly versions of targeted marketing pages: FAQ, YouTube Video, Top Ten Reasons, and targeted topic pages More specific ad groups targeting students interested in advanced study in: Security, Mobile Development, Biometrics, and Natural Language Processing. Target specific advertising through Adwords The current Adwords budget is too small to have a measurable effect, but shows anecdotal promise. Applicants hear about graduate programs from 1) the web; 2) word-ofmouth Bounce rate for these landing pages dropped from 95% to about 40%. LinkedIn for public announcements: awards, publications, etc. Increase adword budget, have focused landing pages, target major metro regions one direct flight from Wilmington. Increased social media usage. Increase alumni word-of-mouth through social media. Continue to develop and promote mobile friendly web content. More traffic at lower cost. Grant of $4400 received from Sloan Foundation for advertising. Continue to improve Ad Copy, Keywords, Landing pages, and lead followthrough. No trends in scores were apparent over time. However, correct answers to the recurrence question of the assessment were very Special attention will be given to writing and solving recurrences for running time in the Computer Algorithms course. MSCSIS Student Learning Outcomes MSCSIS Program SLO1: Graduates will be able to formulate and solve problems using advanced mathematics and numerical methods, and computer information Method: Multiple choice questions were developed to assess content knowledge. Administration: Questions are administered to all students in CSC/MIS 532 Design and Analysis of Algorithms at the end of their program. The systems-based techniques. MSCSIS faculty committee reviews the data and initiates any changes. low. UNCW Goal 1 SLO2: Graduates will demonstrate knowledge of ethics and professionalism, and understand contemporary issues such as green computing, data security, privacy, and compliance with regulations. UNCW Goal 3 Method: Multiple choice questions were developed to assess content knowledge. Administration: Questions are administered to all students in CSC/MIS 534 Information Security Management at the end of their program. The MSCSIS faculty committee reviews the data and initiates any changes. No trends were identified in assessment scores across time. However, questions regarding cryptoanalysis were low. The textbook and instructor for MIS 534 will change in the Spring. Dr. Cummings will be teaching the course in Spring 2013, and will cover cryptoanalysis. SLO3: Graduates will be able to complete analysis and design of business processes employing the latest information technology techniques, including the unified process model. UNCW Goal 1 Method: Multiple-choice questions were developed to assess content knowledge. Scores did not change in a patterned way over time. However, a particular question regarding project management’s role in system development scored very low. Additional emphasis will be placed on the role of project management in the system development process, in the MIS550 course. SLO4: Graduates will be able to apply science and business principles to analyze and interpret data, using analytic and computer-based techniques. Method: Multiple-choice questions were developed to assess content knowledge. Administration: Questions are administered in CSC/MIS 550 and 565, Software Engineering and Analysis, Modeling, and Design courses, respectively at the end of their program. The MSCSIS faculty committee reviews the data and initiates any changes. Administration: Questions are administered in CSC 555 Data Management Systems at the end of their program. The MSCSIS faculty committee reviews the data and No obvious trends over time were apparent. However, correct responses to the question regarding Clustered indexes were very low. Additional readings on clustered indexes will be assigned in the MIS555 class. UNCW Goal 1 SLO5: Graduates will demonstrate effective communication through written and oral presentations. UNCW Goal 1 SLO6: Graduates will be exposed to a variety of advanced technology communications tools, such as Web conferencing, wikis, and social networking software. UNCW Goal 1 initiates any changes. A: Written Communication Method: A capstone assessment survey was developed for all projects for evaluation, including thesis. Method: Multiple-choice questions were developed to assess content knowledge. Administration: The faculty team evaluates the work using the assessment survey to determine if effective written communication was evident. This is conducted when the major culminating project for the degree is completed. The MSCSIS faculty committee reviews the data and initiates any changes Administration: Assessment is administered by faculty member in the CSC 544 Network Programming course every fall semester to all students. The MSCSIS faculty committee reviews the data and initiates any changes Question 7 of the overall capstone evaluation form is the only communication question on the rubric. No obvious trends appear in the data. However, anecdotal evidence suggests oral communication skills can be improved. More granular assessment questions will be added to measure oral and written components. Extracurricular communication skills sessions will be delivered prior to Career Night. Rubric scores showed no clear trend over time. However, the scores are generally very high, with many questions scoring 100%. A new set of questions should be developed that will more accurately assess this student learning outcome. Appendix A: MSCSIS Program Goals Information Systems / MS Computer Science Information Systems Advisory Board Meeting Tuesday, September 21, 2010 Madeline Suite 5:15 to 7:30 p.m. Agenda (Key Items) 1. Update on success of WITX Conference 2. Introduction of Guests / Business and Student 3. Career Day (November 16, 2010) Update, seek speakers, interview tables 4. Breakouts to seek input from the advisory board as we start our 5 year review of the MS CSIS program. Information below is intended as background materials in advance of the meeting. Review of MS CSIS Program Overview of Program: The Information Systems & Operations Management department from the Cameron School of Business and the Computer Science department from the College of Arts and Sciences began the Master of Science in Computer Science and Information Systems in Fall 2005. The MSCSIS is an intensive graduate program aimed at preparing the student to take on leadership roles in the development and implementation of computer and information systems. The curriculum requires 36 semester hours. There are six required core courses providing a mix of theoretical underpinning, technical skills and information technology perspectives. Students can choose elective courses to provide opportunity for additional study in a variety of areas. The program culminates with a capstone experience that can be an integrative project or a thesis. Experienced professionals and undergraduates from both disciplines will enable significant classroom sharing of real world and theoretical knowledge. Core Course Topics: MIS 534. Information Security Management Security Architecture and Models Telecommunications and Network Security Business Continuity Planning and Disaster Recovery Physical Security, including securing network devices Authentication, authorization, and accounting Implementing firewall technologies, intrusion prevention and VPN Cryptographic systems MIS 555. Database Management Systems Structured Query Language Data Modeling Indexing & Balanced Trees Transaction Management DB Management (Hardware, Backup, Recovery, Maintenance, etc.) MIS 565. Analysis, Modeling and Design System development methodologies including the cycle and iterative design models: development phases including system selection and planning, analysis, logical design, physical design, implementation and maintenance Techniques for requirements, determination, collection and organization Team organization and communication; interviewing, presentation, design and delivery; group dynamics and leadership. Project feasibility assessment and risk analysis Design reviews and structured walkthroughs Human computer interaction (HCI) Software and system quality metrics Software package evaluation and acquisition, open source, managing, external relationships and procurement. Currency in the field of Information Technology Enhanced presentations/writing skills CSC 532. Design and Analysis of Algorithms I Design of efficient computer algorithms. Algorithms for sorting, searching, pattern matching, and polynomial arithmetic, cryptography. The study of greedy algorithms, graph algorithms. CSC 544. Network Programming TCP/IP Protocols: SMTP, HTTP, ARP, TCP, UDP, IP, DNS, ICMP, DHCP, SNMP Implementation of network and distributed programming concepts Client/server application programming Networking programming interfaces (specifically raw sockets and socket APIs) Hands on experience with network components (significant laboratory component) CSC 550. Software Engineering Reading, critiquing and summarizing research literature (4-8 weeks) Software architecture and design UML modeling and the UML metamodel Aspect-oriented software engineering Model-driven software development Elective Courses Offered: MIS 513. (MBA 513) Information Analysis and Management CSC 515. (415) Artificial Intelligence. CSC 517. Symbolic Artificial Intelligence CSC 520. Digital Image Processing CSC 421/521. Computer Gaming CSC 537. (437) Parallel Computing CSC 546. (446) Grid Computing MIS 560. Data Mining MIS 567. Software Architecture and Development Practices POM 572. Project Management MIS 575. E-Strategies and Implementation CSC 577. Pattern Recognition MIS 587. (CSC 587) Systems Simulation CSC 591. (MIS 591) Directed Independent Study CSC 592. (MIS 592) Topics in Computing CSC 594. (MIS 594) Research Project CSC 595. (MIS 595) Research Seminar CSC 598. (MIS 598) Internship CSC 599. (MIS 599) Thesis Capstone Experience: Option 1 - Research Project This option requires at least 36 semester hours of graduate credit, with three credit hours for the project (CSC 594 or MIS 594). Under this option, the student is required to complete a three hour research project under the direction of a graduate advisory committee. This project could involve the development of software, work on a project (potentially part of a team), independent research, or some other scholarly pursuit. The outcome includes a technical paper written by the student and an oral defense acceptable to the student's advisory committee. In the oral defense, the student is responsible for the domain of the research project as well as the program coursework. Option 2 - Thesis This option requires at least 36 semester hours of graduate credit, with six credit hours for the thesis (CSC 599 or MIS 599). Each student must present and defend a thesis, based on original research, acceptable to the student's advisory committee, prior to graduation. In the oral defense, the student is responsible for the domain of the research effort as well as the program coursework. The thesis defense is open to the public. List of Capstone/Thesis Completed: Seiken Higashionna, Constructing a 3D morphable face from a single picture by establishing a correspondence from 2D active appearance model parameters, July 16, 2010 Maz Boddoohi, An Evaluation of Software Architectures, May 3, 2010 Christopher Cotton, Rez-o-lution: Ticket Management System, April 30, 2010 Matthew Ratliff, Active Appearance Models for Affect Recognition using Facial Expressions, April 23, 2010 Parker Moran, Advancement of Academic Research Computing at UNCW, April 16, 2010 Jerry Martin, Suppressing Independent Loops in Packing/Unpacking Loop Nests to Reduce Message Size for Message-Passing Code, April 14, 2010 Maurice Benson,Using 3D Video Game Scenarios and Artificial Neural Networks to Classify Brain States for a Brain Computer Interface, March 30, 2010 Camilo Alvarez, iTour: A System for Self-Guided Virtual Campus Tours of UNCW, December 8, 2009 Matt Boykin, Utilization of Automation to Deliver Historical Economic Data to Customers through the Use of Web Technologies, December 3, 2009 Matt Hernandez, Determining Improvements to IT Systems through Business Service Management while Calculating, Through Time Savings (or Fractional Employee Reduction), the Business Value of IT Investments, December 1, 2009 Matt Mascherin, Venture Business Plan for E-Commerce Business, December 1, 2009 Robert Harrison, A Low-Cost Tele-Operated Robotic Platform, November 30, 2009 Casey Tucker, GNU Radio and the USRP as a Solution for Remote Emergency Monitoring, November 11, 2009 Royce Nobles, Evaluation of Spelling Correction and Concept-based Searching Models in a Data Entry Application, June 25, 2009 Sarah Peck, Analysis and Implementation of an Assurance of Learning System for the Cameron School of Business, May 13, 2009 Justin Denning, A Quantitative Analysis of SQL Server 2008 Constructs, May 1, 2009 Kevin Matthews, Development and Evaluation of an Adaptive Grading/Learning System (AGLS), December 11, 2008 Steve Sutton, Cipher-N -- a Secure, Web-based Document Exchange Service, December 8, 2008 William Shipman, CommunityTips.org: A system for Anonymous Tipping, October 30, 2008 Max Rupplin, DDAS: Distributed Data Analysis System, June 13, 2008 Josh Tobey, Utilizing Web Technologies to Provide Historical Data Relative to the Economic Health of Southeastern North Carolina, May 8, 2008 James G. Huff, An Applicable Approach to Signal Analysis and Peak Detection, May 7, 2008 Ryan Renninger, Analysis and Implementation of a Financial Budgeting System in a Corporate Environment, April 25, 2008 Allen Rawls, A Systematic Approach for Improving Predicted Arrival Time Using Historical Data in Absence of Schedule Reliability, April 16, 2008 Daniel Rayburn-Reeves, Disambiguating Human Spoken Diary Entries Using Context Information, April 4, 2008 Shaun Border, Communication Between Outlook Mobile Services and Mobile Devices, November 19, 2007 Alisha Oliver, Exploring Methods to Justify Projects with Intangible Benefits, November 14, 2007 Eric Harris, Extending GridNexus and JXPL to Support the Visual Assembly of Web Services, July 12, 2007 Ryan Wilkins, Neurocognitive Inspired Hierachical Face Recognition System, May 10, 2007 Chris Holtsford, A Solution for Community Development, May 2, 2007 Employers of Graduates: American Eagle Chicago IL Deloitte Touche Atlanta GA GE-Hitachi Nuclear Energy Wilmington NC New Hanover Regional Medical Wilmington NC Corning Wilmington NC ATMC Shalotte NC PPD Wilmington NC Safe Data Inc Wallace NC VisionAir Wilmington NC United Advisors Wilmington NC The Coastal Companies Holden Beach NC Health Care Software Farmingdale NJ Triumph Interactive Wilmington NC W. T. Cox Subscriptions Wilmington NC Grant Thornton Raleigh NC TranS1 Wilmington NC AT&T Charlotte NC UNCW Wilmington NC Pricewaterhouse Coopers Washington DC Specialty Soft Wilmington NC Cape Fear Community College Wilmington NC 94% of graduates have positions within their field or are attending graduate school (1 graduate in PhD program) within 2 months of graduation. Average Starting Salary: $54,545 Review of MS CSIS Program BREAKOUTS Breakout sessions organized into the following groups: Core Curriculum: 1. Review the core course topic lists. 2. Is there anything missing? 3. Are the topics relevant today? Selection of Electives: 1. Review the electives offered. 2. Are there any elective courses that are missing? 3. Are the courses relevant today? 4. How should we assess the value of our programs? Service Learning / Community Involvement / Project Theses 1. Internships are strongly encouraged in the program. 2. What can we do to get more students placed? 3. How should internships be assessed? 4. Review the projects/theses completed. 5. Are the projects relevant today? 6. How do we involve the community / mentor relationship Appendix B: MSCSIS SLO1 Findings Content Knowledge Assessment Results, Spring2009 – Spring 2013 CSC 532 Spring 2009 Percent Correct Fall Spring 2011 2012 Spring 2011 Fall 2012 Spring 2013 Is the following true or false? f(n) = O(g(n)) Implies g(n) = O(f(n)) 0% 50% 50% 42% 25% 50% Is the following true or false? f(n) = O(g(n)) implies g(n) = Ω(f(n)) 100% 25% 50% 33% 75% 50% 100% 62% 50% 50% 50% 17% 100% 75% 75% 75% 75% 100% 100% 100% 75% 42% 100% 67% What is the O() complexity for the following function. Give your answer as a function of n. What is the O() complexity for the followng segment of program which multiplies two matrices a and b (resident in 2-d arrays) to find the result matric in c. The two most common algorithms (Prim and Kruskal Algorithms) to solve Minimum Spanning Tree problem belong to which of the following class of techniques. Which of the following characterizes the applicability of Dynamic Programming Techniques to solve problems? 100% 75% 100% 75% 100% 50% Write a recurrence for the running time T(n) of f(n), and solve that recurrence. Assume that addition can be done in constant time. 0% 50% 75% 25% 50% 17% Decide whether you think the following statement is true or false. In a flow network which has maximum flow from node s to node t the flow across any s-t cut (no matter which cut is considered) is the same. 0% 50% 50% 67% 50% 50% 100% 88% 100% 92% 100% 100% 0% 60% 1 62% 64% 8 100% 73% 4 83% 58% 12 75% 70% 4 83% 58% 6 Which of the following characterizes the applicability of Linear Programming Technique to solve problems? Decide whether you think the following statement is true or false. Let G be a flow market, with a source s and a sink t, and a positive integer capacity c(e) on every edge e. If it is a maximum flow in G, then f saturates every edge out of s with flow (I.e. for all edges e out of s, we have f(e)=c(e) ). overall N CSC532 Computer Algorithms Assessment Scores 73% 60% 64% 70% 58% 58% Spring 2009Spring 2011 Fall 2011 Spring 2012 Fall 2012 Spring 2013 Appendix C: MSCSIS SLO2 Findings Ethics/ MIS534 Assessment Results, Spring 2009-Spring 2013 Spring 2009 Spring 2010 Spring 2011 Identifying, assessing, and reducing risk to an acceptable level and maintaining the achieved level is referred to as _________. 89% 100% 92% 100% 100% 100% 100% What are the three fundamental principles (AIC triad) that serve as a security program’s objectives? 67% 100% 96% 75% 92% 100% 83% The steps of an access control model should follow which logical flow? 67% 60% 71% 75% 67% 100% 83% What is the new program/standard that evaluates the computer security in the United States? 33% 60% 33% 25% 33% 50% 17% Which of the following items is Not considered a preventive physical control? 100% 80% 92% 75% 83% 100% 100% A function that takes a variable-length string and creates a fixed-length value is called ______. 100% 80% 58% 100% 75% 75% 100% When considering an IT system Development life-cycle, security should be: 100% 80% 88% 100% 92% 100% 100% Preparing for a damaging event before it takes place in order to minimize loss and ensure that the business continues to operate is the definition of _______? 100% 100% 96% 100% 83% 100% 67% A hospital is trying to select a facility backup option. They want to ensure no downtime and extremely focused on contingency planning and testing capability through the year. Which of the following alternatives would serve the hospital best? 44% 60% 21% 75% 25% 25% 17% 100% 80% 80% 80% 50% 70% 50% 78% 17% 67% 25% 78% 83% 75% Which of the following is the science of studying and breaking encryption algorithms and cryptosystem? Average N 9 5 24 Fall 2011 4 Spring 2012 12 Fall 2012 4 Spring 2013 6 MIS534 Information Assurance Assessment Scores 80% 80% 78% 78% 75% 70% 67% Spring 2009 Spring 2010 Spring 2011 Fall 2011 Spring 2012 Fall 2012 Spring 2013 Appendix D: MSCSIS SLO3 Findings Content Knowledge Assessment Results, Fall 2009 – Spring 2013 Fall 2009 Spring 2010 Spring 2011 Fall 2011 Spring 2012 Fall 2012 Spring 2013 In general, academics and professionals read research literature for all but one of the following reasons. 69% 67% 80% 75% 92% 50% 50% Which of these questions is least important in assessing research articles? 38% 17% 60% 50% 33% 50% 83% To which scientist is the origin of separation of concerns principle normally attributed? 100% 83% 60% 50% 75% 100% 33% 92% 83% 100% 75% 67% 100% 50% 100% 100% 80% 100% 92% 100% 83% Software testing shows all of the following, except: 46% 100% 40% 100% 75% 75% 33% It is difficult to find all the bugs in large complex software because: 92% 100% 60% 100% 83% 50% 50% Validation is: 38% 50% 20% 25% 50% 0% 67% A test oracle is: 54% 83% 60% 100% 17% 25% 50% 31% 66% 13 33% 72% 6 20% 58% 5 25% 70% 4 17% 60% 12 25% 58% 4 33% 53% 6 Which of the following is not a fundamental AOSD concept A meta-model is: Identify the concept that is not fundamental to model-driven software development. Average N CSC550 SW Engineering Assessment Scores 66% 72% 70% 58% 60% 58% 53% Fall 2009 Spring 2010Spring 2011 Fall 2011 Spring 2012 Fall 2012 Spring 2013 Appendix E: MSCSIS SLO4 Findings Content Knowledge Assessment Results, MIS 555, Fall 2010 Fall 2008 Fall 2010 Fall 2011 Spring Fall 2012 2012 Spring 2013 1. The main purpose of referential integrity constraints in a relational database is to: 57% 54% 100% 50% 50% 83% 2. Structured Query Language is a(n): 57% 77% 50% 67% 100% 50% 3. A foreign key must be: 43% 54% 50% 67% 25% 33% 4. As compared to other data structures, Balanced Trees are used in relational databases because they: 86% 100% 50% 50% 100% 17% 5. Data fragmentation is helpful in what type of system? 100% 69% 50% 42% 25% 0% 6. The "I" in the ACID transaction requirements stands for: 100% 100% 75% 50% 50% 67% 7. One purpose of an SQL view is to: 100% 85% 100% 83% 100% 83% 100% 100% 100% 75% 100% 33% 9. Relational databases were created to: 57% 38% 100% 33% 50% 33% 10. Clustered indexes perform especially well on: 71% 77% 62% 74% 100% 78% 8% 53% 50% 65% 33% 43% 12 4 6 8. Transaction collisions without loss of data integrity are accomplished with: average N 7 13 4 MIS555 Relational Database Assessment Scores 77% 74% 78% 65% 53% 43% Fall 2008 Fall 2010 Fall 2011 Spring 2012 Fall 2012 Spring 2013 Appendix F: MSCSIS SLO5 Findings 1. Written Communication Assessment Results, Spring 2011 Average Capstone Assessments 4.25 4.21 4.04 3.88 3.94 3.79 3.59 2007 2008 2009 2010 2011 2012 2013 2007 2008 2009 2010 2011 2012 2013 Select and Narrow Topic for Research or Projects 4.3 4.2 4.3 4.0 4.0 3.9 3.7 Use Computer Lit Skills/Info Databases for Research 4.2 3.7 4.2 4.0 3.8 3.9 3.8 Category Independently Read CS and IS Papers 4.1 3.5 4.1 3.9 3.8 3.8 3.5 Apply Concepts, Principles, and Theories 4.4 4.4 4.3 4.3 4.3 4.0 3.6 Critically Analyze, Evaluate Project or Thesis Results 4.1 4.1 4.3 4.0 3.9 3.7 3.5 Assess Conclusions and Implications of Research or Project 4.4 4.2 4.4 4.0 4.0 3.7 3.6 Present Research/Proj. Findings (Clear, Coherent, Succinct) 4.3 4.0 4.1 4.0 4.1 3.9 3.6 Evaluate Work of Others Objectively and Fairly 3.8 3.8 4.0 3.8 3.8 3.7 3.3 Analyze Bus. User's Needs/Develop Solution 4.3 4.2 4.3 3.3 3.9 3.7 3.5 Combine CS/IS Learning for Research or Bus. Opportunities 4.2 4.2 4.5 3.5 3.8 3.7 3.6 2. Oral Communication Assessment Results Fall 2010 MIS 565 Oral Communication Assessment 5.00 4.57 4.42 4.50 3.90 3.86 4.00 3.42 3.43 3.24 2.71 3.00 2.42 2.76 2.17 2.00 Fall 2008 Fall 2009 Fall 2010 1.00 0.00 Technical Knowledge Spring 2009 Presentation Materials Presentation Style Presenter Presence Appendix G: MSCSIS Goal 6 Findings Content Knowledge Assessment Results, Fall 2010 Fall 2008 Fall 2009 Fall 2010 Fall 2011 Spring Fall 2012 2012 Spring 2013 1. The main difference between TCP and UDP is: 69% 100% 87% 100% 83% 100% 83% 2. World Wide Web technologies include: 92% 50% 100% 100% 92% 100% 67% 3. When developing a network application, the primary programming interface is: 92% 100% 87% 100% 83% 75% 50% 4. Examples of distributed computing/programming paradigms include: 62% 100% 47% 75% 67% 75% 50% 5. Which of the following are social networking sites: 92% 100% 93% 100% 100% 100% 100% 6. Wireshark is an example of: 100% 100% 100% 100% 100% 100% 100% 7. ARP refers to: 100% 100% 93% 75% 100% 100% 83% 8. DNS refers to: 92% 100% 87% 100% 83% 100% 100% 9. Network security technologies include: 92% 50% 73% 100% 83% 75% 67% 10. Database management systems used for web programming include: 92% 100% 93% 100% 100% 100% 100% 88% 90% 86% 95% 89% 93% 80% 13 2 15 4 12 4 6 CSC544 Network Programming Assessment Scores 95% 93% 88% 90% 89% 86% 80% Fall 2008 Fall 2009 Fall 2010 Fall 2011 Spring 2012 Fall 2012 Spring 2013