Best Practice Checklist for Choosing and Working with 3rd Party Vendors Academic institutions work with many vendors. These vendors can provide software such as LMS, plagiarism, portfolio, dashboard, and accessibility software, just to name a few. Vendors can provide services such as course development, instructional design, tutoring, support to go with an LMS, and textbooks. And some vendors could be providing a combination of services and software. The contracts can be fairly small with some vendors, a yearly contract of $500 or a multi-year contract of $100,000 or more. Depending on the type of service provided, the size of the contract, and the RFP rules in your state or within your institution, questions may change. The goal of this checklist is to provide an overview of everything that you should take into consideration. For some smaller vendors you may decide some items are not applicable and, perhaps, for larger contracts you will add more details under some of the guidelines. Completion Action Institutional Checklist Notes Yes No N/A Decision: Vendor or Internal? The time period when an institution is determining they have a need, but will they fill it internally or bring in a 3rd party vendor. (Buy or Build) 1. What is the motivation to make a change? Possible reasons to change: it’s not working for your students, faculty or the intended audience; your IT is making system wide changes and this product won’t move over; better products are available (quality or quantity). If you don’t understand your motivation for growth, you can’t properly assess product success. 2. Identify stakeholders: users, supporting roles, affected departments, other campuses, etc. 3. What criteria should be considered when investigating solutions? Possible criteria may include: a) Technical: All tech criteria, including CMS needs, operating system, and communication speed needs (does it only work with high speed internet). Can the current institutional technology support the product? b) Institution: What are your goals for the product? Who is the audience? c) People: Who do you have on-campus? Do you need complete support, i.e. help desk, server, or will you have people to cover this? Who will be implementing this and in charge of updates, training, etc? d) Vendor decision: Can a vendor provide any of the above more efficiently and effectively than you can do so yourself? 1 WICHE Cooperative for Educational Technologies (WCET) wcet.wiche.edu 303.541.0231 This work by WCET is licensed under Creative Commons Contact wcetinfo@wiche.edu for information about WCET’s Connect, Learn, and Advance agenda, and how to join WCET. AUGUST 2013 e) Open Source: Is open source an option? a. Can the institution support open source? b. Open source may be free, but may require more on-site personnel needs than a vendor. Is IT ready to embrace the open source needs and potentially expand? c. May need to internally compare vendor versus open source and talk to purchasing. 4. What is the desired return on investment? Will you need to track ROI? If so, do you personally have a way to do so? a) Retention & persistence gains, i.e. tuition gains greater than costs b) Improved student grades, i.e. stronger student academics is worth the investment c) Least cost alternative, i.e. the cost to build 24x7 tutoring is 4x when measured in actual tutoring hours used 5. When deciding on a vendor it is important to take everything into consideration. For example, the relationship with 3rd party vendors is considered a contractual arrangement if content is created and delivered, faculty are provided, and some other issues.... This is a federal regulation that requires notification if <25% of the curriculum is delivered and APPROVAL if 25-50% is delivered by the vendor. Anything over 50% might not be eligible for Title IV. Make sure you have worked with your accrediting agency and reviewed their guidelines if considering a vendor to provide content and/or do teaching. 6. Helpful Tools: http://www.weighteddecision.com/ http://www.wcet.wiche.edu/wcet/docs/resources/GuideforPlanningCommLMS%20CIG110410.pdf If Vendor: Accreditation, RFP Thoughts? The institution had determined they are moving forward to investigate third party vendors. Now what? 1. Accreditation Thoughts: Institutions may need regulatory approval for some relationships. For example, the Higher Learning Commission provides the attached Substantive Change form that must be submitted when an institution is ready to enter into an arrangement where academic activities may be a shared arrangement, such as the LMS providing pre-built courses or recruiting faculty. (Please see the HLC Substantive Change Form for Contractual Arrangements) Please note: if an institutions is outsourcing complete programs this is not really a comprehensive enough checklist. That institutions needs to think ahead about accreditation, how the vendor is representing the school and more. They should definitely read the “Going the Distance” article referenced under sources by 2 WICHE Cooperative for Educational Technologies (WCET) wcet.wiche.edu 303.541.0231 This work by WCET is licensed under Creative Commons Contact wcetinfo@wiche.edu for information about WCET’s Connect, Learn, and Advance agenda, and how to join WCET. AUGUST 2013 Susan E. Metros and Joan Falkenberg Getman. 2. Regulatory Considerations: a. State Authorization b. Misrepresentation (if the vendor is providing information to students) c. FERPA for student privacy. 3. Considerations needs to be taken when scoping to help make decision of moving forward and when drafting the RFP to assure correct language. What information needs to be gathered ahead of time and what should wait until actual RFP process? 4. Procurement/Purchasing. Determine the contract rules and bidding laws in your state and within your institution. a) Prior to RFP one can often do a request for information (RFI), which can help you determine if you’ll do an RFP and what it would look like. This can help determine what services you want or how to negotiate for them. a. This would add to process length b. Check with Purchasing to assure this is possible. b) Check with your Procurement/Purchasing department to determine at what cost you must bid out for services (RFP process). Be careful of deadlines and the approval process. Your RFP document can become an impediment to your needs. c) Follow institutional process for RFP; be sure to include every service you would like to consider and state that you will look at one to all the services (meaning they price each separately and then as a bundle, if that is appropriate). d) Clearly state in the RFP the institutional and state rules/laws on contract length and others that would affect the contract for services. e) Follow the boilerplates if available for RFPs and Vendors. Check State contracting prices as this may apply. f) Contract Considerations: a. Consider a minimum period of time that the vendor must give notice if they are discontinuing service. b. Consider clause that allows for the requisite approvals to be acquired by accreditors or state agencies. c. Make sure you don't HAVE to take the lowest bidder unless it meets all your minimum 3 WICHE Cooperative for Educational Technologies (WCET) wcet.wiche.edu 303.541.0231 This work by WCET is licensed under Creative Commons Contact wcetinfo@wiche.edu for information about WCET’s Connect, Learn, and Advance agenda, and how to join WCET. AUGUST 2013 criteria, which means you need really good minimum criteria. d. Do you want to be listed as an institutional partner on the vendor's website?? There have been a few recent situations where the institution has left the vendor but the vendor continues to market the institution as a "partner." e. Regarding state authorization, the institution (not the vendor) is responsible for seeking approval in other states. f. If this is a vendor that is helping to define students: Define recruitment expectations. If the vendor identifies students, the institution should still maintain the responsibility of determining whether students are eligible to be enrolled. How are vendors compensated for recruiting students and for advising students as retention consultants? 3 Institutional Legal Office a) Have the institutional legal office review the RFP for accuracy before releasing the RFP. b) Allow TIME for attorney review. If your school attorney is on retainer, it may take extra time for a review. c) Have the legal office participate on the contract negotiation team and have the legal office sign off that the terms of the contract are appropriate and meet the institutional/state rules and laws. The Search: Finding the Right Vendor! The institution has determined they are moving forward to investigate third party vendors to meet this need. Now what? 1. Gather invested parties into a focus group: This process is going to be different depending on the institution. Depending on the type of technology, maybe only a VP and IT needs to be involved, in others you’ll need a committee complete with members of faculty, student resources, IT, etc. Who needs to be on your committee/focus group? 2. Make sure everyone understands the needs, goals, and the reasons you chose to not to perform this task internally. 3. Create a rubric for the team to use when looking at the companies. The rubric should be based on your needs and goals of the product. Another institution might use a product for a reason that is not important to you. Or, another institution might dislike a product for a reason that again, is not important to you. 4. Set a timeline for the search. 5. If needed, write and release the RFP based on the timeline. If RFP is needed: An institution may have an RFP process for obtaining the product or service. Develop 4 WICHE Cooperative for Educational Technologies (WCET) wcet.wiche.edu 303.541.0231 This work by WCET is licensed under Creative Commons Contact wcetinfo@wiche.edu for information about WCET’s Connect, Learn, and Advance agenda, and how to join WCET. AUGUST 2013 the RFP to meet not only the institutional needs for the product or service but include the information required for meeting contract terms required by Procurement. 6. If an RFP is not needed: Determine and compare top companies. Talk to peers (such as the WCET membership!) and get their recommendations. 7. Interview other clients of the vendors and even visit. Ask the people using it, not just the project administrator. 8. Test the products, if possible. Contract Time: Before decisions are made and contracts are signed, make sure you have a realistic picture of the contract terms and the Implementation needs: 1. Map out the budget impact (short and long term). 2. Reconfirm all conversations you have in pre-buying and post-buying of a product. When you do contract with a vendor do not feel “bad” about asking them to be accountable. 3. If your institution plans to develop an internal infrastructure for the product or service be sure to consider contract length and the ability to phase out of the contract. 4. Have legal review, does evaluation group need to continue conversation with processing... keep all applicable institutional groups in the conversation with procurement. Implementation and Post Implementation: You’ve completed training. The technical component is working. Now what? Don’t forget about the following important actions. Ideally the main campus contact for the implementation continues on as the main contact to work on return on investment (ROI) and any ongoing issues. 1. Personnel Impact (short and long term): Have you set aside the resources to implement a solution (including time, budget, and management)? Someone will have to work with the company to: a) Schedule training, both initial and ongoing, b) Assure that they are following all logo and communication procedures set by your institution, c) Facilitate the work with IT, etc. 2. Institutional and Vendor Roles regarding Compliance with State and Federal Regs a) Terms of the vendor contract should stipulate that the vendor is responsible being informed on all state and federal laws and regulations pertaining to state authorization, student privacy, intellectual property, accessibility, and others. The contract should stipulate that the vendor is liable for full 5 WICHE Cooperative for Educational Technologies (WCET) wcet.wiche.edu 303.541.0231 This work by WCET is licensed under Creative Commons Contact wcetinfo@wiche.edu for information about WCET’s Connect, Learn, and Advance agenda, and how to join WCET. AUGUST 2013 compliance with all such laws and regulations. Make sure it is clear who’s responsible for what. 3. Marketing (Initial and Ongoing): How will you market the solution so students, faculty, staff are aware of the availability and know how to benefit from it? Software, products, items are not used just because they are purchased. Be aware of communication procedures for the audience with whom you are working. You’ll need: a) Ongoing marketing. Since people forget, you need to have regular communications. This could include: through the company, within your ongoing faculty and/or student orientations, email communications, etc. b) Set expectations. Expectations of what everyone will gain from a service are the most important if you want to lead to successful use. c) Ongoing training. Once isn’t enough, training has to be ongoing. If you truly got a tool to support students or solve a problem, then it only works if it’s always made clear to new and old students, faculty, advisors, or whoever is the audience for that tool. 3. How will you integrate student support into existing campus technology solutions? Make sure these options are clear ahead of time and approved by IT. 4. Measuring ROI: How you measure return on investment is going to change depending on the type of product. These are some examples that might be applicable: a) Cost Tutoring Example: A very small improvement in the percentage of students retained can pay for the costs of a new product through tuition gains. Suppose you begin with 1,000 students and 10% of them (100 students) use tutoring. Studies show that an average of 10 to 15 more students pass each term with tutoring, so the ROI average is 9 times the investment. b) Student Improvement Examples: i. GPA ii. Grades iii. Persistence 5. Set up continuing communication regarding product and training with the company. 6 WICHE Cooperative for Educational Technologies (WCET) wcet.wiche.edu 303.541.0231 This work by WCET is licensed under Creative Commons Contact wcetinfo@wiche.edu for information about WCET’s Connect, Learn, and Advance agenda, and how to join WCET. AUGUST 2013 Must Read Sources If Going Through This Process: Metros, S. E. & Falkenberg Getman, J. (2012). Going the Distance: Outsourcing Online Education. Game Changers HLC. (November, 2011). Substantive Change Application. (November, 2012). Development of Vendor Partnerships to Support Online Programs. 7 WICHE Cooperative for Educational Technologies (WCET) wcet.wiche.edu 303.541.0231 This work by WCET is licensed under Creative Commons Contact wcetinfo@wiche.edu for information about WCET’s Connect, Learn, and Advance agenda, and how to join WCET. AUGUST 2013