In the half hour since I posted, I may have answered my own question.
There is already an issue open in the codejail repo for this exact issue:
codejail issue 162
It also seems that tutor doesn’t support codejail:
tutor references disabling codejail as a default
What I don’t know though, is if codejail is completely unsupported or I just need to do some additional setup. Does anyone know?