50 of your students are in 10 different locations from July 1 – July 30, each with different supervisors… You’d like each student’s supervisor to evaluate him or her on July 15 using your program’s “Mid-point feedback” assessment form. How do you do it?
If you’re running a clerkship, residency, fellowship, internship, externship, preceptorship, or other work experience program, you’ve probably found collecting in-training evaluations and assessments to be a challenging task.
Online survey systems like SurveyMonkey and Qualtrics do a great job of collecting forms, but they don’t tie to your schedule – which means you have to manually send out forms when you need them. If you’re using paper forms or electronic documents this problem can be even worse. To add to the problem, all of the data you collect needs to be indexed and sorted by person, by experience, and by location, which often means you spend a lot of time generating reports or you make do with sub-standard reports.
Webeval is designed to solve these problems. It makes in-training evaluation and assessment an easy, successful process.
Workflows designed for in-training evaluation and assessment
The best time to collect feedback is immediately after performing or observing a training experience. Using WebEval on the one45 mobile app, your faculty, staff and learners can initiate and complete timely, high quality assessments on any device, anywhere, while the feedback is fresh in their minds.
Available for free for WebEval users, the one45 mobile app for Apple iOS and Android can help boost your evaluation completion rates and gather richer workplace-based assessment data.
Schedule-based evaluation “scenarios”
The schedule is the heart of the in-training evaluation process. With a good schedule, you’ll know who is doing what, where, and with whom. Webeval uses this information to configure multiple evaluation scenarios. The following scenarios are some of the most commonly used:
- Instructor completes an assessment mid-way through a student’s experience
- Student completes an end-of-experience survey about his experience
- Student evaluates his instructor at the end of an experience
Webeval also supports multiple assessor scenarios, like 360 reviews and 2-tier workflows.
Your program’s assessment and evaluation forms
Create and use your program’s custom assessment and evaluation forms with the form-builder tool. You can create and edit common question types as well as advanced rubrics with robust Likert scales. Each form you create will be attached to an evaluation scenario.
Automated data collection
This is where the magic happens! With your program’s schedule in place and your evaluation scenarios configured, the system automatically sends out your evaluation forms and tracks them for you. It will know, for example, that end-of-experience forms are due to go out on July 31, and will pair up the right people to receive the right forms for this process.
Automatic login links and more
Your instructors and students are busy people who shouldn’t have to memorize login information or spend extra time figuring out who they are supposed to evaluate. Webeval lowers the friction required for these people to get their data to you. In system generated emails, auto-login links are provided to each evaluation form. Evaluator/evaluatee matching tasks can be automatically sent to administrators and the main interface for completing tasks is doesn’t usually require any user training.
Mission Critical Reports and Alerts
Triggers for low scores
You can define thresholds on your forms so that if a response falls below the threshold, you’ll be notified immediately. A record of the ensuing conversation can also be stored in the system for use in remediation.
Timely feedback to students
Getting feedback results to your students in a timely fashion is often a key accreditation requirement. In Webeval, you can set feedback rules to, for example, instantly send a student the results of her mid-point evaluation as soon as it is completed, and ask her to comment on whether or not she agrees with the assessment.
Comprehensive on-demand reports
In addition to setting up automatic alerts for low scores, you can generate a comprehensive set of reports for your regular reporting needs. You can report individually and longitudinally across evaluation forms, people (instructors and learners), experiences, experience types, graduation and program years, and all sorts of other categories.
Manage the balancing act
Gathering the data you need to run your program is always a balancing act between getting the data you’d like, getting the minimum data you need, and the effort required to collect that data. one45’s implementation experts each have over 6 years of experience setting up customers to manage these competing priorities. We will help you get the data that makes the most sense for you, in the easiest way possible.
Standardize across departments
With a complex training program like a residency or clerkship, different departments need to collaborate in order to deliver the entire training program. Your program may take external learners from another program, or you might send your learners to another program. Webeval is designed for these multi-departmental environments, and our staff will help you make sure this process requires the least amount of effort for you. They’ll help you configure schedule-linking tools, form sharing tools, and data sharing tools so that each program only has to do its part to get you the data you need, without duplicating effort.
Make changes confidently
Periodically, you may change a particular approach to managing your assessment and evaluation process. You may be introducing a new evaluation form, a new feedback process, or a new set of experiences. You can count on our staff to be there to make sure you get the results you want at the end of the change.