Thanks for the push @antoviaque. I am sharing the email I sent to Axim as-is here. As I didn’t ask for consideration for a specific model or a company’s models, I don’t feel there is anything in the email that should be considered private. I also didn’t want to spend time paraphrasing the same things suitable for the discussion format here. So, apologies if someone feels some social contract is broken.
Now the email:
Hi,
I ask the following models to be added to the list of “approved models” under the Open edX’s AI Contribution Policy
- Qwen 3.6
- DeepSeek V4 Pro & Flash
- Google Gemma 4 family of models
- Zed’s Zeta family
They are released as “open weights” and some variants of them can be hosted by consumer hardware like laptops with 64GB of RAM and run using tools like LM Studio, Llama.cpp, Ollama ..etc., They are also hosted by 3rd party inference providers like OpenRouter or could be hosted on the cloud by teams that look to save on inference costs. Adding these to the official policy would be in line with the Open Source ethos of the project and the community.
Notes on safety and model usage
Even though I have a list of models, that I would like to see included, I think the approach of allowing specific AI tools & models as approved for contribution is flawed. There are many reasons for that and I would like to outline a couple of them.
1. Lack of Provenance
There is literally no way to prove a specific model was used for generating a specific piece of code. Any model can be claimed as any other model and the proof relies solely on the trust we place on the contributor.
2. Lack of real thread model
The policy currently states that, the AI Tools/models are currently vetted for proper training, and in our internal discussion at OpenCraft, it was also mentioned “currently approved ones have guarantees in case someone sues over the use of content produced by their LLMs”.
These seem irrelevant for the nature of work we do - Open Source code generation. Concerns like Intellectual Property theft and Credential leak are either not a concern (due to source being free for anyone) or doesn’t apply for the project (credentials are at best issues of the providers and infra teams and not the application developers). So, I am really uncertain as to what “vetted for proper training” and what “guarantees” mean in this context.
Possible misalignment?
The policy has clearly written with certain use cases & scenarios in mind where restricting tools/models made sense. However, I think, it has missed a few of them. For example:
- Use of code auto-completion in Zed editor uses the Zeta2 Open Weight model. There is no chat interface, no logs to share.
- Using Claude or Codex to come with a detailed solution in “plan” mode, and switching to DeepSeek v4 Flash for implementation in “build” mode in OpenCode, involves multiple models.
- Using Pi harness or AmpCode harness to automate co-ordination between multiple models and using features like “auto” or “smart” modes. They can use multiple models that are dynamically chosen under the hood that might optimized for cost, speed ..etc.,
As the models grow smarter & “harness engineering” becomes sophisticated a whole spectrum of use cases emerge. They present us with a future where approving specific models starts to feel like approving specific text editors.
So, I advocate for complete abandoning approval of models & tools and let the developers choose whatever tools they prefer. As an open source project we place the trust on the community - the people and we should continue to do so. The policy very clearly what’s expected of the contributors in both code generation and review stages of development. That in itself is a sufficient guideline.
Thank you.