Adaptive Quiz: CAT (Computer-Adaptive Testing) implementation for Moodle
Maintained by
Vitaly Potenko, Adam Franco
Create tests that efficiently measure users' abilities by adapting the questions difficulty to the estimation of user's ability.
Comments
Comments are no longer open for new posts. Existing comments remain available to read.
Is this plugin will work on moodle 5.0?
If you travel across the comments here you'll find some similar to yours with some replies. To sum up, currently this is not available, and there are no immediate plans for this.
In general, it's a debatable question how to approach this in adaptive testing, as it's different in its nature compared to regular quizzes. You're welcome to outline your vision on this here if you want to, or even raise this question in Moodle forums to have some valuable input there.
Thank you for your interest to the plugin.
1. Indeed, there's a plan to extend the student's feedback (optionally, controlled by a per-instance setting), perhaps, questions overview could be there as well. The bad news is it's not planned for the nearest release.
2. I've made a quick check, and it seems like historically the adaptive quiz plugin doesn't respect any question categories (say, 'question pools') outside the current instance's course. I need to look into it a bit deeper and perform some testing to make sure the system context's questions can work no different from the course context's if you just add the system context to the instance's pool options. But I'm quite optimistic about this one to be added to the plugin pretty soon.
Thank you much for your suggestions, it's always welcome!
We have been using CAT quiz for almost a year now and there are 2 main issues, I would like to ask about.
1. Is there plan to implement a feature, that student can see own mistakes at the end of the quiz?
2. Is it possible to implement a feature, that questions for CAT quiz are connected to Moodle System QB? We are not happy that we need to create copies of questions and put them into Levels under the quiz. We have frequent changes in company procedures and, therefore, we need to correct questions in the System and then go to CAT questions, find them there and also correct them there. This is time consuming and inefficient to us. Would it be possible to link CAT questions to the System QB?
Not sure what particular tags you mean, but have you visited this - https://docs.moodle.org/403/en/Tags
Like in the screenshot at the bottom there, you should see a field to add tags when editing a question. Basically, adding a tag to a question is pure Moodle, the adaptive quiz activity then just uses those tags added to questions.
We're patiently waiting for the next release whenever it happens
Thanks for the support and striving for making the plugin better.
The feature you're requesting is actually what's planned in the nearest release. However, as for the release itself, I'm not quite sure when it's going to come. There are some accompanying features/improvements planned which need more testing, but currently I'm struggling with my schedule a bit. Stay tuned though, I hope it'll not take too much to release. Thank you!
Thanks for your support of the plugin - it's a great tool that helps us a lot!
I have a very small question or maybe even a request. In the activity Settings, you can enter quiz Description using a text editor, but Attempt Feedback is just a text box. Is this easily fixable or could this perhaps be added?
We would like to highlight some information and add clickable links to the students' next steps. I think it should be quite handy.
Have a great day!
That's a frequntly requested feature, however, I'd like you to share your opinion on the following:
- how do you see the scenario when the user was timed-out - what should ther ability measure be given they haven't answered a certain amount of questions at all because the quiz has ended not when supposed by the algorithm? Would such ability measure be precise for the user? With that regard, the adaptive quiz differs from the default quiz - you cannot estimate the ability precisely if you just cut out several questions from the quiz for any reason. What's s your vision on this? Thanks!
Happy to announce, that version 2.4.0 does (which initially was for Moodle 4.4) officially support Moodle 4.5. It successfully passed automated and manual tests under 4.5. Happy Moodle'ing!
To P P: hi,
1. you cannot incorporate the default quiz's timer, as it's not something pluggable. As a developer one basically has to replicate that entire timer functionality in the adaptive quiz plugin. Moreover, you must consider the CAT's specifics. For example, what's the desired behavior when the time ends and the student has progressed, say, just 75% of the quiz? How to handle that unfinished assessment correctly?
2. I don't think just knowing whether the student got 'right' or 'wrong' on certain questions is something the CAT is all about. However, I may be wrong, and, perhaps, this is worth discussing on the forum with the much wider audience there. I keep watching the forum, so, if some well-shaped requests arise from there they all will be considered for sure.
Thanks again for your ideas and comments on the plugin!
Thank you for the response.
1. The timer would be super useful as one of the purposes of CAT is to allow for a much "shorter" exam because students are tested on their ability. The timer for what I would need it for would be invaluable, but I obviously cannot force you to do it. I will just ask that you make it an option you can turn on or off. The basic module quiz has a timer, can we just incororate that one?
2. So for reporting, I am not looking for anything crazy, the basic moodle reporting will be OK i.e. student take a quiz and at the end instead they can view what they got right or wrong. Ideally, I would like to see specifics about the questions i.e. what subject area/topic they got right so they can study that more, but I know that isn't a simple ask. FOr example" let's say they are taking a test on european history, the student is consistently getting capital cities wrong, the reeport would explain that.
Thanks again for the response.