Contributors meetup Async Update
May 3rd, 2023 - May 15th, 2023
Welcome to our Core Contributors async update!
1. Working Groups Updates
Working Groups Calendar
BTR Working Group
- Chair: @jalondonot
-
Headlines:
- Olive.4 release has been scheduled on 22/05/23, to include:
- Google Analytics feature back port suggested by Brian Mesick backport PR [FC-0014] [olive] Add GA 4 support to edX platform by UvgenGen · Pull Request #32106 · openedx/edx-platform
- Security update for Django suggested by Ned Batchelder
- Missed backport from olive.3 Backport for Olive.3 · Issue #253 · openedx/wg-build-test-release
- We’re 4 weeks far from Palm release:
- Release notes PR started: Palm Release Notes by pdpinch · Pull Request #321 · openedx/docs.openedx.org
- Test plan over 85% of completion
- Olive.4 release has been scheduled on 22/05/23, to include:
- Meeting notes:
-
Blockers or Calls/offers for help:
- Since we’re getting closer to the release date, we need as much help as possible to finish the pending issues, which mainly are Backport before palm.1 release · Issue #261 · openedx/wg-build-test-release · GitHub and Build-Test-Release Working Group · GitHub
Data Working Group
- Chair: @jill & @BrianMesick
-
Headlines:
- Funded contribution updates:
- All Google Analytics 4 PRs have merged for main, Palm, and Olive! Thanks to Adolfo and Raccoon Gang for a ton of work wrangling many PRs.
- The redis event bus work is nearing completion with v0.1.1 released this morning. We hope to have this (more easily) testable on main within a week
- Funded contribution updates:
- OARS production performance testing:
- EduNEXT has been trying out OARS on a fairly large production site.
- Event Sinks:
- A ClickHouse event sink plugin exists for pushing data in real-ish time to the analytics db, this should unlock some new-to-us use cases and serve as a pattern for other folks who would like more immediate updates to important data in different backends.
- event-sink-clickhouse is a new type of plugin project, created to listen for Signals and Open edX Events and transform / send them asynchronously to different backends.
-
Highlight
- Work is beginning on (optionally) getting (a configurable subset of) tracking log events on the event bus thanks to eduNEXT!
-
Meeting notes:
2023-05-03 Data WG Meeting notes -
Blockers or Calls/offers for help:
- Time is running out to get your voice heard on what reports you would like to see in OARS v1! The product team is pulling together and prioritizing all of the feedback at the end of this month.
DEPR Working Group
- Chair: @Diana_Huang
-
Headlines:
- Legacy Frontend Next Steps
- No guidance/DEPR/ADR/OEP on not working on legacy frontend code in edx-platform (or other IDAs)
- Replatform legacy LMS pages into micro-frontends · Issue #31620 · openedx/edx-platform
- Replatform legacy CMS pages into micro-frontends · Issue #31621 · openedx/edx-platform
- Complete the MFE conversion process · Issue #156 · openedx/wg-frontend
- Elasticsearch Project: Move from Elasticsearch to OpenSearch · Issue #16 · openedx/public-engineering
- 2U is the major blocker on this. Arbi-BOM did do some discovery on this, but they aren’t equipped to do the migration for one team.
- Deprecation Checklist: New DEPR ticket was created: [DEPR]: Complete removal of EdxRestApiClient · Issue #189 · openedx/public-engineering
- Legacy Frontend Next Steps
- Meeting notes:
- Blockers or Calls/offers for help:
DevEx Working Group
- Chair: Rebecca Graber & Kyle Mccormick
-
Headlines:
- Orbstack:
- Some performance numbers of related tools: [Docker Desktop] Improve Mac File system performance · Issue #7 · docker/roadmap
- [Discovery] Docker Desktop alternatives · Issue #93 · edx/edx-arch-experiments (written by 2U Arch-BOM, who probably won’t have time to look deeply into this for a few months)
- Latest Tutor:
- Palm is being released next month. New breaking changes!
- In Palm, it should be easier to use Tutor using your own code.
- Improvements to Tutor image build speed coming in Palm.
- Changes:
- bind-mount is not available in
tutor local.
Instead, there is aMOUNTS
setting for persistent bind-mounts. - optimizations for building images
- pulls cache from remote registry. 3-4x speed improvement when building from scratch!
- optimizations in the openedx dockerfile:
- mounts a reusable pip cache folder, meaning we don’t have to rebuild reqs every time
- This uses compose v2
- Using the MOUNTS config, we can mount outside folders at build time
- try out the Palm branch \o/ https://github.com/overhangio/tutor/pull/827/ you will need the most recent version of compose (
docker compose
instead ofdocker-compose
) - 2U plans to work on test data for developers.
- Further build optimizations & simplifications expected in Quince, especially around static assets.
- Orbstack:
- Meeting notes:
-
Blockers or Calls/offers for help:
- Tech Radar #28 is out, probably worth reviewing for good suggestions: Technology Radar | An opinionated guide to technology frontiers | Thoughtworks
- Various places we could use help depending on your interest. Reach out in #wg-developer-experience and we can find you something.
DevOps Working Group
Hi @regis ! Could you help us with this information please?
- Chair: @regis
- Headlines:
- Meeting notes:
- Blockers or Calls/offers for help:
Educators Working Group
- Chair: @john_curricume
- Next Meetup: May 22nd
- Meeting notes:
- Blockers or Calls/offers for help:
Frontend Working Group
- Chair: @arbrandes
-
Headlines:
- MFEs in Palm:
- MFE domains work with Pedro Martello. I suggest watching the recording of the demo he gave during the last FWG meeting.
- Open PR that fixes and make leaner-dashboard work tutor fix: force LMS url to reload when changed by ghassanmas · Pull Request #136 · openedx/frontend-app-learner-dashboard
- Backport before palm.1 release · Issue #261 · openedx/wg-build-test-release
- Palm updates:
- Node 18 is finally unblocked; we have a maintainer for frontend-app-communications, so that’s going in.
- eduNext has volunteered to maintain frontend-app-communications!
- Frontend Plugins
- Go to the thread for opinions: Micro-frontend plugins: current state and upcoming efforts
- Open edX Piral Demo: Presentation of the Open edX Piral POC demonstrating how to implement a Piral shell to load MFEs into a single page app context. For background see: FC-0007 - Modular MFE Domains Discovery
- Deprecating more legacy UI code: They want to do more coordination and planning for replacing legacy UI code with MFEs; the DEPR WG meetings are the currently proposed venue for conversations around this.
- MFEs in Palm:
-
Highlight
- DEPR and FWG will start working together on deprecating all the legacy UI code in edx-platform.
- In the upcoming months we expect to need community help not only on this deprecation effort, but in the MFE domains migration. Some of it will likely be funded by Axim.
- Meeting notes:
- Blockers or Calls/offers for help:
-
- We need somebody to take up writing a contrib tutor plugin for frontend-app-learner-dashboard. It will be marked as experimental for Palm, but it can live in the openedx Github org.
Large Instances Working Group
- Chair: Braden MacDonald & Felipe Montoya
-
Headlines:
- List of issues on Harmony project GitHub:
- publishing tutor plugin - still blocked until one provider is using this in production
- Monitoring with Prometheus - metrics-server is now installed by another PR; we did not get an update from Lawrence. We will split this into separate tickets to clarify next steps.
- There is a change that we need to edx-search which is in v3.5.0 but not in the version that’s included in Palm (3.4.0). Jhony has opened a backport PR to resolve this.
- Enabling SSL support for ElasticSearch/OpenSearch: hasn’t been prioritized for implementation yet.
- New issue: hosting the Helm chart “properly”. Jhony has been testing a system that uses GitHub pages to host the Helm chart, and it seems to be working well.
- Braden mentioned that we should add tests to the Helm chart, and will open an issue.
- Deploying this in production: In the next sprint, eduNEXT will start to deploy this onto one of their clusters and report what they find.
- List of issues on Harmony project GitHub:
- Meeting notes:
- Blockers or Calls/offers for help:
Marketing Working Group
- Chair: Eden Huthmacher
- Headlines:
- Meeting notes:
- Blockers or Calls/offers for help:
Maintainers
-
Headlines:
- Maria Grimaldi: Added code-owners. Added dependabot. Need to update docs in the next 2 weeks. Blockers: Need Read the docs set up.
- Adolfo Brandes: Multiple MFEs
- Palm Node 18 upgrade focus
- This is somewhat controversial as the Enterprise MFE has an issue with the upgrade
- Considering merging the upgrades directly to the Palm branches
- Node 16 will be out of support before Quince – September
- Adolfo will focus unblocking the Enterprise issues
- There is another issue frontend app discussions that is requiring a similar strategy.
- Palm Node 18 upgrade focus
- Edward Zarecor: Still working on a solution for detecting PRs that need the tests run. Blocked by slow GitHub support. Phase 4 will be the monolith, duck. Will work with Feanil to update our Phase 2 status
- Jeremy Bowman: Hackathon output feat: Added console and streamlit dashboards, fixed SQLite empty values by jmbowman · Pull Request #374 · openedx/edx-repo-health
- Meeting notes:
- Blockers or Calls/offers for help:
Product Working Group
-
Headlines:
- Feedback on proposal to reorganize the Working Group.
- Writing community guidelines for building features:
- Some guidelines are now proposed for how to handle pull requests and how to propose making a feature (making a roadmap ticket, etc). This needs to be documented somewhere. Who can take this task?
- Wiki documentation of PR review process [Ryan/Jenna/Shelly]
- Documentation of doing product discovery/feature definition in the open and how to submit [Santiago]
- Once it’s in wiki, translate to docs.openedx.oeg [Sarina]
- Some guidelines are now proposed for how to handle pull requests and how to propose making a feature (making a roadmap ticket, etc). This needs to be documented somewhere. Who can take this task?
-
Meeting notes:
https://openedx.atlassian.net/wiki/spaces/COMM/pages/3748560901/2023-05-09±+Product+Working+Group+Notes+and+Agenda - Blockers or Calls/offers for help:
Security Working Group
- Chair: @feanil
- Headlines:
- Meeting notes:
- Blockers or Calls/offers for help:
TOC
Hi @antoviaque! would you like to add any updates?
- Headlines
- Blockers and Calls/offers for help
Translation Working Group
- Chair: Eden Huthmacher
- Headlines:
- Meeting notes:
- Blockers or Calls/offers for help:
2. Events
- Local & International University Use Cases of the Open edX Platform will be on May 19th, 2023 at 9:30 AM (MDT)
- Events: Conference, Meetups, etc..
3. Projects
Would anyone like to highlight any new or ongoing projects?
4. Next async update and meetup
- Monday May 15th - Update async!
-
Tuesday May 16th - Join the meetup here!
- Details and draft agenda on the GitHub board
Please reply to this post with any questions or comments you may have!