Adaptive Quiz: CAT (Computer-Adaptive Testing) implementation for Moodle
Maintained by
Vitaly Potenko, Adam Franco
Create tests that efficiently measure users' abilities by adapting the questions difficulty to the estimation of user's ability.
Comments
Comments are no longer open for new posts. Existing comments remain available to read.
I also have a question: to create an adaptive quiz , do I have to create different categories of questions with different levels of difficultie? or do I have to create only one bank with all the questions combining different levels of difficultie?
Thank you veru much.
BW
FC
Let me first introduce myself: khalid KABCHI doctoral student of Mohamed first university. Morocco
In the context of scientific research, via the experimentation of the pedagogical contributions of adaptive testing in the assessments of learner achievements. To do this I opted for the use of Plugin Adaptive Quiz.
But unfortunately, I have a problem relaive to the display of the images of the questions for the pupils (On the other hand in edition mode the images are displayed without any problem).
I want to inform you that I use:
Moodle 3.10.9 (Build: 20220117)
mod_adaptivequiz 2.1.2 / mod_adaptivequiz: 2022040100
Please help me solve this problem which is blocking all my research.
However, the good news is that some big changes in the plugin are going to come in the new year. More specifically, the plugin will provide an interface to inject different implementations of CAT algorithm. This will allow developers for implementing other algorithms to get used by the plugin. Your suggested modification may be such implementation, but you'll have to provide the PHP code either yourself or with the help of some PHP developer.
this is a great work
i need to do one modification
can i stop the process of stopping the quiz when the student answer wrong answers many times
i need the student to answer wrong 3 times then he go to the next level of difficulty and so on
how can this happen
Yes, it has been fixed recently for the master branch in the plugin's GitHub repository. The master branch means the latest plugin's version for the latest Moodle release (4.0 as of now). This branch contains some unreleased features for the plugin and basically is a release candidate as it's not properly tested yet, it's checked only by basic automated tests.
However, the new version of the plugin is expected to be released at the end of November or at the beginning of December (for all supported Moodle versions). And it will contain the fix you mentioned as well ;)
we really need this plugin for our school. We are worried that teachers will find it difficult if they have to make image links one by one when creating questions for adaptive quizzes instead of directly inserting images like in a normal quiz on Moodle.
We are waiting for a fix for the missing image.
We really appreciate the efforts of the developers of this plugin.
Thank you very much.
Just to let you know, the master branch of the plugin on GitHub will now contain the dev version of the plugin. It means it'll contain some changes which aren't released yet here on moodle.org, but will be included in the nearest future release of the plugin. This is similar to how Moodle's core master branch works.
For example, right now the master branch of the plugin already contains activity completion feature (if the relevant setting is applied, an adaptive quiz is marked completed by Moodle for a user if the user has completed at least one attempt at this quiz). Feel free to download the dev version if you'd like to see what not-yet-released features it has and try them!
Please, note, the maturity of the dev version of the plugin will be marked as 'alpha' or 'beta', it means it may still contain some bugs. Use it on the production sites at your own risk or better do not use such versions there at all! The better option would be to always try the dev version on some testing instance of Moodle.
The README page for the dev version specifically will be updated soon to list the yet-unreleased features it has.
Thanks everyone who uses this plugin and shares their experience here!
Regards
Vitaly
One other related feature to consider is the "total number of possible questions". We set that in the settings but when taking the test, the test taker never really knows how many questions remain before the test will stop (in the event the algorithm hasn't reached the pre-set error percentage).
At any rate, I think these changes will give administrators more options to turn on/off, as needed for their test circumstances. Thanks for maintaining and improving this plugin.
I've also had a thought on time the limitation discussed above. To make it less intrusive we could introduce a setting for a quiz instance like "estimated time to complete". The attempts report then will assess whether this time has been exceeded by a student, and output some flag for the attempt to the teacher just to let them be aware of that. Perhaps, this would make sense, let me, please, know what you think if you're interested in that!
However, once the Covid-19 pandemic closed down our classrooms, we had to offer the test entirely online where it was unmonitored. Although the instructions at the start of the test said to do it within an hour, there was no way to enforce that requirement. The best we could do was to randomly check the results page to see the amount of time used. If it was excessive, we might remove the score and have the person take the test again, reminding them to adhere to the total time limit. Ultimately, since we used the plugin as a placement test for an English language program, it was essentially a "low stakes" test. If someone seemed to be misplaced in one of our program levels, the teacher could ask to have him/her moved up or down.
I suppose you could use Zoom, Teams, or some other video conferencing program to monitor the test taker while s/he is taking the test online, especially if this is a higher stakes test and you don't have large numbers of test takers to monitor. It wasn't a viable option for us since the test was administered to large numbers of students each term. They'd still need to complete the test in order get an as accurate score as possible.
As I explained above, the work around I initially used was to put the mp3 and image files in a separate folder on the server, and then t link to them in each question. That worked. My "test bank" was at the system level because we offered the placement test to 12 locations in 11 different countries so any changes to the questions could be done in one central location. You may want to try that with one of your questions to see if it works.
Many years later, I opted to put the "test bank" at the course level for one of our test locations. I then uploaded the audio and images files in each question directly to Moodle and to my surprise, they showed (and played) so I have now done the same for the other training locations. It means that any changes to questions must be done for each of the 12 locations. That's a bit of a pain. But from a "best practice" perspective, we are no longer linking to files in a separate folder. Ideally, a developer should be able to figure out why the image and audio files don't work when the test bank is at the system. As for your issue, I don't have much to add other than to share my experience with this issue. If you've moved the test bank to the "course" level, you may want to try to re-upload the image and audio files.
By the way, I also downloaded the test bank as an xml file and would "find and replace" to make many of the major changes. Our test had over 400 questions so it was insane trying to make changes to individual questions from within the plugin itself.
HTH
Dave