Codejail timeout advanced setting?

Hello everyone, I’d like to see about adding an “Advanced Setting” so that @staff can change the default timeouts for the codejail. Currently the codejail timeouts after 3 seconds, which sometimes causes HTML format errors that prevent students from completing their assignments. This problem did not occur when the codejail timeouts were 5 seconds.

To be clear, these courses are hosted on edx, so as far as I know it’s not possible for @staff to change the timeouts manually in the django config. By “Advanced Setting”, I mean one of these:

Suggestions or thoughts?

Hello there! Thanks for raising this issue.

My main concern is why the course staff should know about codejail timeouts. As I see it, it’s the operator who sets these configurations:thinking:

Hi Maria, thanks for responding,

My main concern is why the course staff should know about codejail timeouts.

I agree they shouldn’t have to worry about this stuff, but from what I can tell, this timeout parameter is chosen in a way that is one-size-fits-all… In any event some courses import larger grading libraries to do some heavy lifting for evaluating symbolic expressions.

For these courses, we’re looking at the possibility of having to optimize the grading code to avoid the HTML formatting issue that people on reddit have complained about:

https://www.reddit.com/r/edX/comments/xipyvx/html_error/

As I see it, it’s the operator who sets these configurations:thinking:

Right… I’ve done quite a bit of searching and what I’ve concluded is that there are optimizations that could be made with both codejail and the grading library … it’s just that, they haven’t been because, I suppose it simply hasn’t been necessary yet?


Even the Grading Library Demonstration Course is timing out now:

Maybe it’s time to start optimizing.