Questionable problem bank counting

Site Operators
1

Hey all,

with the soon to be available Verawood version and the planned removal of legacy libraries (per Legacy Content Libraries v1 Overview — Latest documentation) we’ve decided to move our questions (problems) to the new Beta libraries.

There seems to be a mistake in the way the questions are counted in the UI of the user. The steps required to reproduce the issue:

  1. Create a course
  2. Create a new library
  3. Create new components of type Problem
  4. In the course create a section->subsection->unit
  5. Add a Problem Bank component
  6. Add the problem components from the library to the components of the inserted Problem Bank component

At this point the interface should look close to this:

image
image621×987 53.6 KB

I have selected it so that users will see just 1 of the 3 questions I chose for this Problem Bank.

  1. Here you should configure the section to be graded and go into grading settings of the course so that everything aligns however I assume that for the issue I’m describing this is irrelevant so skipping the steps
  2. Publish the course
  3. Sign up for the course and go in as a regular user

There is actually only 1/3 questions shown to the user HOWEVER in both the
A) Sidebar

image
image1477×729 39.3 KB

and after we choose and submit any answer in the question in the
B) Progress Page

image
image993×950 95.8 KB

The progress and question values are wrong and based on the total number of objects in the library.

After expanding the detailed grade of the Subsection the user is also presented with his score for all elements in the library… (assumed as the count matches).

image
image925×104 5.39 KB

Is there some configuration step I am missing or is it an actual error in the platform’s business logic?

THIS is NOT the case with legacy libraries. The counts and list of scores in expandable subsection lists are correct. Thanks in advance for any help

2

Hi @jakubkl, thanks for the detailed report. This is definitely a bug, but it seems to be the same thing discussed in “Grading issue with Problem Bank (Beta) – total score calculated based on library size instead of display count”, which should have been fixed back in April and which has been backported to Ulmo.

Can you please check exactly which version of Open edX you’re using, and whether or not it has this specific fix?

3

Hey @braden thank you for a quick answer. My instance was on ulmo.2 (tutor 21.0.4) and I didn’t realize this was already in motion yet even available as I never really bothered to check the diff between ulmo.3.

Updated to tutor 21.0.7, built new images with code pulled from the release/ulmo.3 tags and everything seems to be working now :slight_smile: Thanks a lot again, I wouldn’t think to look for this in the PRs