www.AEFIS.com | 877-674-3122
Copyright © 2013 Untra Academic Management Solutions, LLC. All rights reserved.
Copyright © 2012 AEFIS, LLC. All rights reserved.
Drexel University PAR Orientation
April 12, 2013
Copyright © 2013 Untra Academic Management Solutions, LLC. All rights reserved.
How do we measure student learning?
Copyright © 2013 Untra Academic Management Solutions, LLC. All rights reserved.
Who should take part in academic assessment?
Faculty, students, administrators, alumni, industry?
All stakeholders! Many sources of information that need to
be collected from and delivered to many stakeholders…
Students
Faculty
Copyright © 2013 Untra Academic Management Solutions, LLC. All rights reserved.
Administrators
Alumni
What is AEFIS?
Web-based assessment management solution for:
►Quality assurance processes
►Accreditation documentation generation
►Transparent reporting across institution
Academic Evaluation, Feedback
and Intervention System – AEFIS
Copyright © 2013 Untra Academic Management Solutions, LLC. All rights reserved.
What does AEFIS do?
AEFIS Core System
–
–
–
Web based portal for all assessment activity by all user groups (role based permissions)
User Specific Dashboards with Action Items and Access to System Functions
Integration with Academic Management Systems through automated data import,
validation and processing
Student Learning Outcomes, Performance Criteria and Rubrics Management
–
–
–
Develop Performance Criteria and Rubrics for SLOs at various institutional levels
Create equivalences to measure assessment once and report to multiple outcomes
Development and Approval Process, History and more…
Program Design and Alignment Management
–
–
–
Document Program Design and engage stakeholders in processes
Map SLOs and Program Educational Objectives to courses
Development and Approval Process, History and more…
Direct & Embedded Assessment Measures Management
–
–
–
Create and manage outcomes based direct assessment measures and embed them into
the curriculum
Set goals for student performance in a program
Document Intervention Plans to ensure continuous improvement
Copyright © 2013 Untra Academic Management Solutions, LLC. All rights reserved.
What does AEFIS do?
► Course Syllabus Management
–
Centralized access to Syllabus History, Notes, Recommendations, Objectives, Outcomes
Mapping, Approval Process and more…
Meeting Minutes and Accreditation Document Management
–
Create and manage meeting minutes to maintain an accessible, context based
document repository for assessment and accreditation information and more…
Student and Faculty Course Evaluations and Survey Management
–
–
Student Surveys, Faculty Surveys, Mid-Program Examinations, Senior Exit Survey, Alumni
Surveys, Employer Surveys and more…
Invitation/Reminder Messaging, Raffle Management and more…
Assessment and Accreditation Reporting
–
–
–
Generate reports for assessment planning and accreditation documentation
Dashboard graphic and data reports based on user roles
Export reports to PDF and Microsoft Excel
Copyright © 2013 Untra Academic Management Solutions, LLC. All rights reserved.
AEFIS Program Design & Alignment
…alignment of OUTCOMES and MISSIONS across entire institution.
AEFIS Outcomes Based Assessment Management
University Level
Drexel
Student
Univ.
Outcomes
Learning Priorities
Unit Level
UnitCollege/
Outcomes
School Outcomes
Program Level
Department/
Program
Outcomes
Program Outcomes
External Level
1
ABET
External
Outcomes
AACSB
Unit Curriculum
Measure ONCE,
but
report
to
ALL
constituents
Prog.
Curriculum
Example: CoAS
Example: Chemistry
Example: American
Univ. Curriculum
(DSLP)
Univ. Mission
Unit Mission
Graduates
of the College
of Arts & Sciences will
Assessment
demonstrate
the ability to
Coordinators
pursue excellence
in
research and scholarship.
& Educational
Communicate
scientific
Experiences
ideas effectively using
scientifically relevant
Program Mission
language.
2
Chemical
Society
Middle
States
Students should be able to present
information in a clear and organized
manner, write well-organized and
concise reports in a scientifically
appropriate style, and use
technology such as poster
preparation software,
word-processing, chemical structure
drawing programs, and
computerized
presentations in their
communication.
Program Outcome to be Assessed:
Communicate scientific ideas effectively
using scientifically
Performance Criteria
relevant language.
Example:Institutional
Communication
Employ an
understanding
Assessment
Officers
of audience, purpose and
context to communicate
effectively in a range of
situations using
appropriate media
1ABET
– Accreditation Board for Engineering and Technology
– Association of Advance Collegiate Schools of Business
2AACSB
Copyright © 2013 Untra Academic Management Solutions, LLC. All rights reserved.
Program Managers
Copyright © 2013 Untra Academic Management Solutions, LLC. All rights reserved.
AEFIS Syllabus Approach
…collection of diverse academic knowledge displayed as a course portal.
Program
Courses
Learning Outcomes
Performance Criteria
Rubrics
Planned Assessments
Meeting Minutes &
Documentation
Assessment Team Notes
Faculty Meeting Notes
Course
Syllabus
Previous Course Syllabi
Course Objectives
Student Information /
Assessment Results
Faculty Notes
Administrative
Recommendations
Instructional Decision
Support System
Incoming Student /
Course Profile
Course Rationale &
History Profile
Eval Results Notes &
Recommendations
Course Evaluations &
Research Surveys
Research Survey Data
Student Feedback
Faculty Feedback
Alumni Feedback
Instructional Decision Support System (IDSS) Implementation
–
–
–
Evaluation Results Notes and Recommendation (ERNR)
Course Rationale and History Profile (CRHP)
Incoming Student/Course Profile (ISCP)
Copyright © 2013 Untra Academic Management Solutions, LLC. All rights reserved.
Active AEFIS
Research/Development
AEFIS Implementation
…evolutionary not revolutionary.
Survey Tools
Design and deploy custom surveys
Course Evaluation Tools
Automate custom evaluations and manage results
Syllabi Repository
Develop course objectives for indirect assessment
Academic Program Management
Design academic programs and manage student learning outcomes
Direct Assessment Measures Management
Plan and document embedded assessments and manage direct assessment results
Copyright © 2013 Untra Academic Management Solutions, LLC. All rights reserved.
Level 1
Level 2
Level 3
Level 4














AEFIS Implementation
…integration with existing systems.
Self Study & Reports
Reporting of data as MS Excel, Adobe PDF
LMS
AMS
Learning
Management
Systems
Academic
Management
Systems
i.e. Banner,
PeopleSoft,
In house system
etc.
Solution Platform
Authentication Accounts
LDAP, Shibboleth, NetID Login Account
Copyright © 2013 Untra Academic Management Solutions, LLC. All rights reserved.
i.e. Blackboard
Moodle
etc.
Drexel AEFIS Activities
Weekly AEFIS Management Meetings
Wednesdays at 4:00 PM, Drexel University Main Building
An AEFIS Team member will meet with the institutional assessment office weekly to discuss priorities and current activities. In
an effort to better serve the Drexel community, all functionality requests and concerns should be carbon copied (CC) to
the institutional assessment office (Steve DiPietro) throughout the week for procedural handling in a timely fashion. In
addition to the SharePoint site repository, these meetings will shape the Monthly Steering Committee Meeting agendas.
Monthly Steering Committee Meetings
2nd Wednesday of the Month at 11:00 AM, Drexel University Locations
These monthly meetings bring together AEFIS administrators across campus with institutional administrators and AEFIS Team
members to discuss activities throughout the university. The agendas for these meetings are formulated by democratic
suggestions on the SharePoint site.
NEW! Monthly AEFIS Workshops
4th Monday of the Month at 11AM, Korman 013
The newly proposed Monthly AEFIS Workshops will provide designated times and locations for AEFIS users to have questions
answered regarding system functionality. All users will be welcome for general training or specific training (announced in
advance). Assessment administrators are strongly encouraged to attend and to use these sessions to support special
projects or training of new personnel.
Copyright © 2013 Untra Academic Management Solutions, LLC. All rights reserved.
AEFIS Login
Copyright © 2013 AEFIS, LLC. All rights reserved.
My AEFIS Dashboard – Faculty View
John Faculty
My Action Items
Upon logging into AEFIS you will arrive at My
Dashboard with Action Items or quick links to your
assessment activities:
- Surveys
- Syllabi to Review
- Course Evaluations
- Planned Assessments
My Syllabi
AEFIS maintains a historical record of your syllabus
development over time. Access your syllabi quickly
on My Dashboard or select the Course Syllabi menu
for more.
My Student Course Evaluations
AEFIS automates indirect assessment data
collection through Student Course Evolutions. Quick
statistics regarding student participation is
available on My Dashboard with links to view
detailed data and comments.
Copyright © 2013 AEFIS, LLC. All rights reserved.
Your Course Portal – Syllabus (Course Section) Management
Copyright © 2013 AEFIS, LLC. All rights reserved.
Your Course Portal – Student Course Evaluation Results
Copyright © 2013 AEFIS, LLC. All rights reserved.
Your Course Portal – Student Course Evaluation Results
Copyright © 2013 AEFIS, LLC. All rights reserved.
Program Design – Mapping Courses to Performance Criteria
Copyright © 2013 AEFIS, LLC. All rights reserved.
Performance Criteria and Rubrics
Copyright © 2013 AEFIS, LLC. All rights reserved.
Your Course Portal – Direct Assessment
Sample Student
Sample Student
Sample Student
Sample Student
Sample Student
Sample Student
Sample Student
Sample Student
Sample Student
Copyright © 2013 AEFIS, LLC. All rights reserved.
Your Course Portal – Direct Assessment
Copyright © 2013 AEFIS, LLC. All rights reserved.
Contact Us
► Mustafa Sualp, President
msualp@aefis.com
+1- 877-674-3122 ext. 2001
► Morgan Kato, Customer Relations Manager
mkato@aefis.com
+1- 877-674-3122 ext. 2033
► Caitlin Meehan, Operations Coordinator
cmeehan@aefis.com
+1- 877-674-3122 ext. 2032
Please visit our website to learn more at www.AEFIS.com
Academic Evaluation, Feedback
and Intervention System – AEFIS
Copyright © 2013 Untra Academic Management Solutions, LLC. All rights reserved.