Developing an Exam System that Increases Test Safety and Provides Partial Scoring in Multiple Choice Tests

Within the scope of the project, it is aimed to develop an online exam system that allows the use of multiple choice test items with varying options and scoring with correct answer method based on elimination in online unattended exams. The contribution of these interventions made in item type and scoring method to test safety and determination of learning deficiencies were evaluated. It has been observed that there is no statistically significant relationship between the scores of the students in the test consisting of multiple choice questions with varying options and the order of taking the exam. Although there was a high correlation between scoring with the correct answer method based on elimination and scoring according to the 1-0 method, more information could be obtained about the students in the correct answer method based on elimination. The scores that students get from an item are scored between -4 and +4, and scores close to -4 show that students' misconceptions increase, and scores close to +4 show that students' partial knowledge increases. According to this scoring, feedback maps were prepared showing the scores the students got from each item. In the system developed within the scope of the project (www.binbirtest.net), there are 249 students and 35 teacher users. It has been seen that the effect of test security violations can be reduced by the correct answer and distractors consisting of different combinations for each student, and by sharing the questions and answers in multiple-choice tests with varying options. The feedback map not only informs the students about the situation of the individual students but also informs the teachers about the whole group and the nature of each question in the test. Usability tests have shown that different types of users do not experience significant difficulties even when using the system for the first time. It is thought that the feedback map may contribute to the elimination of learning deficiencies and misconceptions, especially in the context of the COVID-19 outbreak.