Last spring, the National League for Nursing (NLN) Assessment Services Division reached out to nursing students who shifted from onsite to remote proctoring and asked for their feedback. From prior to the pandemic through the shift to remote proctoring, we asked about the test administration process, challenges, and students' desire for future proctoring practices.
Before March 2020, schools would communicate the details for testing to their students via a website or hard copy communications. When most institutions closed their doors and extended spring breaks to transition to remote, communication lines regarding testing went dark. Testing was paused, from entrance exams through NCLEX exams, and while testing companies scurried, students were faced with the unknown. When testing was back in business in May 2020, the landscape had changed. The NLN transitioned to our exams being administered through remote, one-on-one proctoring in a web conference setting. Later in the summer, a second option was made available to students: record and review test administration with an artificial intelligence proctor. The lingering question was, How did this shift affect examinees? Was there an increase in test anxiety that impacted performance? Despite new approaches, from registration, exam purchase, hardware, and software requirements, only 44 percent believed the shift had increased their test anxiety.
SURVEY REPONSES
Of the 502 respondents to our student perception survey, 65 percent told us they were satisfied or very satisfied with their overall remote proctoring experience. Reported factors that contributed to this positive experience were ease of computer setup, availability of test appointments, rescheduling a test appointment, and wait time for proctors to start the exam.
Examinees reported favorable test administrations as well. The NLN created a guide for examinees, hoping they would be prepared for the verification process upon arrival, completing and submitting the exam for scoring, and quickly viewing their assessment reports. Our respondents indicated the guide met expectations, and consistently, 80 percent or higher were satisfied or very satisfied in all areas mentioned. Most concerning for the NLN was the availability of assistance during the exam. Those in one-on-one sessions still had immediate access. For those in record and review, the NLN arranged for an instant chat option in the testing interface. Overall, 70 percent of respondents indicated they had access to assistance when needed.
We wanted to know whether examinees thought the test administration was fair. Ninety-four percent believed their remote proctor setting was secure, and 91 percent believed their proctor was honest and ethical. Most importantly, we wanted to know if students felt the proctoring environment negatively impacted their final test scores; 71 percent responded no.
CHALLENGES
The most prominent challenge reported was related to whiteboards versus scratch paper. Although the National Council of States Boards of Nursing had transitioned to whiteboards, most testing centers had not. Students were prompted to use a digital whiteboard without a secure collection and disposal system for scratch paper in a remote location. Most found this time-consuming and cumbersome.
A second challenge was the need to debunk social media. With examinees having time to look at reviews for universal proctoring options and finding posts from individuals who had negative remote proctoring experiences, several respondents told us they were concerned their test administration would be a "disaster," "horrific," and "unsatisfactory." Despite blogs and postings read on the Internet, that was not their experience.
One major challenge we face is the need to address Americans with Disabilities Act accommodations. Extended time and screen readers can be managed through software changes and situating examinees apart from others, but service animals versus pets present a new consideration. There have been many occurrences in recorded videos of animals coming and going from the room, jumping on the surface in the camera view. Watching any unexpected behavior, like passing questions/answers on notes tucked in a leash or doggy sweater, became a new concern.
Medically needed restroom breaks in remote settings are also a cause for concern. Currently, we recommend individuals with such needs test with a proctor who is better able to monitor the situation. We will also work closely with our one-on-one vendor to assist in vetting certain situations.
In the future, the NLN will continue to offer examinees one-on-one remote proctoring and onsite test administration for our preadmission (PAX) and Nursing Accelerated Challenge Exams (NACE). As students return to campus in the fall, most will resume onsite testing, but for those who have appreciated transitioning exam registration and administration to a remote option, we will do so, knowing students positively regard the remote experience.