Unable to start devstack. Fails at the provisioning command

Development
1

OS: Ubuntu 20.04.6 LTS
Docker version: 24.0.2, build cb74dfc
Docker Compose version: v2.18.1
Python version: 3.8.10

Steps:

Cloning the code

git clone https://github.com/edx/devstack
cd devstack
git checkout open-release/olive.master
make dev.clone

Installing requirements

make requirements

Pulling images

make dev.pull

Running provisioning script

make dev.provision

Error encountered:

Applying integrated_channel.0017_contentmetadataitemtransmission_friendly_status_message… OK
Applying integrated_channel.0018_genericlearnerdatatransmissionaudit_friendly_status_message… OK
Applying integrated_channel.0016_contentmetadataitemtransmission_marked_for… OK
Applying integrated_channel.0019_merge_20220928_1842… OK
Applying integrated_channel.0020_auto_20220929_1712… OK
Applying integrated_channel.0021_remove_contentmetadataitemtransmission_api_response_body… OK
Applying blackboard.0002_auto_20220302_2231…System check identified some issues:

WARNINGS:
?: (2_0.W001) Your URL pattern ‘edx_name_affirmation/v1/verified_name/(?P<verified_name_id>\d+)$’ [name=‘verified_name_by_id’] has a route that contains ‘(?P<’, begins with a ‘^’, or ends with a ‘$’. This was likely an oversight when migrating to django.urls.path().
consent.DataSharingConsent.granted: (fields.W903) NullBooleanField is deprecated. Support for it (except in historical migrations) will be removed in Django 4.0.
HINT: Use BooleanField(null=True) instead.
consent.HistoricalDataSharingConsent.granted: (fields.W903) NullBooleanField is deprecated. Support for it (except in historical migrations) will be removed in Django 4.0.
HINT: Use BooleanField(null=True) instead.
Traceback (most recent call last):
File “manage.py”, line 106, in
execute_from_command_line([sys.argv[0]] + django_args)
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/core/management/init.py”, line 419, in execute_from_command_line
utility.execute()
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/core/management/init.py”, line 413, in execute
self.fetch_command(subcommand).run_from_argv(self.argv)
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/core/management/base.py”, line 354, in run_from_argv
self.execute(*args, **cmd_options)
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/core/management/base.py”, line 398, in execute
output = self.handle(*args, **options)
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/core/management/base.py”, line 89, in wrapped
res = handle_func(*args, **kwargs)
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/core/management/commands/migrate.py”, line 244, in handle
post_migrate_state = executor.migrate(
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/db/migrations/executor.py”, line 117, in migrate
state = self._migrate_all_forwards(state, plan, full_plan, fake=fake, fake_initial=fake_initial)
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/db/migrations/executor.py”, line 147, in _migrate_all_forwards
state = self.apply_migration(state, migration, fake=fake, fake_initial=fake_initial)
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/db/migrations/executor.py”, line 227, in apply_migration
state = migration.apply(state, schema_editor)
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/db/migrations/migration.py”, line 116, in apply
operation.state_forwards(self.app_label, project_state)
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/db/migrations/operations/fields.py”, line 222, in state_forwards
model_state = state.models[app_label, self.model_name_lower]
KeyError: (‘blackboard’, ‘blackboardenterprisecustomerconfiguration’)

Captured Task Output:

—> pavelib.servers.update_db
—> pavelib.prereqs.install_prereqs
—> pavelib.prereqs.install_node_prereqs
—> pavelib.prereqs.install_python_prereqs
—> pavelib.prereqs.uninstall_python_packages
pip freeze > /edx/app/edxapp/edx-platform/test_root/log/pip_freeze.log
NO_EDXAPP_SUDO=1 EDX_PLATFORM_SETTINGS_OVERRIDE=devstack_docker /edx/bin/edxapp-migrate-lms --traceback --pythonpath=.

Build failed running pavelib.servers.update_db: Subprocess return code: 1
make[1]: *** [Makefile:220: impl-dev.provision] Error 1
make[1]: Leaving directory ‘/home/menas/openEdX/devstack’
Would you like to assist devstack development by sending anonymous usage metrics to edX? Run make metrics-opt-in to learn more!
make: *** [Makefile:224: dev.provision] Error 2

2

Sorry that I don’t have time to fully look into this for you, but I suspect it is related to some combo of the following:

  • edx-enterprise migrations were both squashed,
  • the original migrations were removed,
  • possibly the devstack cached database was part way through these migrations, and still requires the original.

See the revert PRs here for some more details: Pull requests · openedx/edx-enterprise · GitHub

It may be possible to run the appropriate migration commands in the container to rollback migrations to a point before the squash, and then run all migrations again and it will pick up the squashed version. Or maybe some other solution. I can’t say for sure, but hopefully this gives you or others enough information to work this out.

Good luck.

3

I’m guessing that you did not use the OPENEDX_RELEASE environment variable, and therefore all of your repos (except for devstack) have the master branch checked out rather than Olive master. See the instructions at the top of Developing on Open edX named release branches — Open edX Devstack Unversioned documentation

(I’m not sure how this would produce the precise error you’re seeing, it’s just my guess.)

4

@Tim_McCormack, @regis I am doing an upgrade from tutor Lilac to tutor Palm, and have never used devstack on past versions of the server (started from a tutor AMI.) I am getting this same KeyError on blackboard when running the tutor local upgrade --from=lilac. These seems to have to do with “user_tours” migrations? I have disabled all plugins before upgrade except for forum, mfe, and license. Any thoughts on what else could possibly be causing this blackboard key error? (I am on tutor, version 16.0.2, the latest as of right now.)

ubuntu@ip-172-31-83-146:~$ tutor local upgrade --from=lilac
⚠️  This command only performs a partial upgrade of your Open edX platform. To perform a full upgrade, you should run `tutor local launch` (or `tutor dev launch` in development).
====================================
        Upgrading from Maple
====================================
Environment generated in /home/ubuntu/.local/share/tutor/env
docker compose -f /home/ubuntu/.local/share/tutor/env/local/docker-compose.yml -f /home/ubuntu/.local/share/tutor/env/local/docker-compose.prod.yml --project-name tutor_local run --rm lms sh -e -c './manage.py lms migrate user_tours'
[+] Building 0.0s (0/0)                                                                                                                                                                                                                                     
WARN[0000] Found orphan containers ([tutor_local_nginx_1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up. 
[+] Creating 6/0
 ✔ Container tutor_local-smtp-1           Running                                                                                                                                                                                                      0.0s 
 ✔ Container tutor_local-mysql-1          Running                                                                                                                                                                                                      0.0s 
 ✔ Container tutor_local-permissions-1    Created                                                                                                                                                                                                      0.0s 
 ✔ Container tutor_local-redis-1          Running                                                                                                                                                                                                      0.0s 
 ✔ Container tutor_local-elasticsearch-1  Running                                                                                                                                                                                                      0.0s 
 ✔ Container tutor_local-forum-1          Running                                                                                                                                                                                                      0.0s 
[+] Running 2/1
 ✔ Container tutor_local-permissions-1  Started                                                                                                                                                                                                        0.2s 
 ✔ Container tutor_local-mongodb-1      Started                                                                                                                                                                                                        0.0s 
[+] Building 0.0s (0/0)                                                                                                                                                                                                                                     
Operations to perform:
  Apply all migrations: user_tours
Running migrations:
  No migrations to apply.
Traceback (most recent call last):
  File "./manage.py", line 106, in <module>
    execute_from_command_line([sys.argv[0]] + django_args)
  File "/openedx/venv/lib/python3.8/site-packages/django/core/management/__init__.py", line 419, in execute_from_command_line
    utility.execute()
  File "/openedx/venv/lib/python3.8/site-packages/django/core/management/__init__.py", line 413, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "/openedx/venv/lib/python3.8/site-packages/django/core/management/base.py", line 354, in run_from_argv
    self.execute(*args, **cmd_options)
  File "/openedx/venv/lib/python3.8/site-packages/django/core/management/base.py", line 398, in execute
    output = self.handle(*args, **options)
  File "/openedx/venv/lib/python3.8/site-packages/django/core/management/base.py", line 89, in wrapped
    res = handle_func(*args, **kwargs)
  File "/openedx/venv/lib/python3.8/site-packages/django/core/management/commands/migrate.py", line 224, in handle
    executor.loader.project_state(),
  File "/openedx/venv/lib/python3.8/site-packages/django/db/migrations/loader.py", line 335, in project_state
    return self.graph.make_state(nodes=nodes, at_end=at_end, real_apps=list(self.unmigrated_apps))
  File "/openedx/venv/lib/python3.8/site-packages/django/db/migrations/graph.py", line 315, in make_state
    project_state = self.nodes[node].mutate_state(project_state, preserve=False)
  File "/openedx/venv/lib/python3.8/site-packages/django/db/migrations/migration.py", line 89, in mutate_state
    operation.state_forwards(self.app_label, new_state)
  File "/openedx/venv/lib/python3.8/site-packages/django/db/migrations/operations/fields.py", line 222, in state_forwards
    model_state = state.models[app_label, self.model_name_lower]
KeyError: ('blackboard', 'blackboardenterprisecustomerconfiguration')
Error: Command failed with status 1: docker compose -f /home/ubuntu/.local/share/tutor/env/local/docker-compose.yml -f /home/ubuntu/.local/share/tutor/env/local/docker-compose.prod.yml --project-name tutor_local run --rm lms sh -e -c ./manage.py lms migrate user_tours

Edit: Actually, it always dies with the below, and then when I re-try the command it dies with the above. Confirmed on two VMs.

Operations to perform:
  Apply all migrations: split_modulestore_django
Running migrations:
  Applying split_modulestore_django.0001_initial... OK
  Applying split_modulestore_django.0002_data_migration...Traceback (most recent call last):
  File "./manage.py", line 106, in <module>
    execute_from_command_line([sys.argv[0]] + django_args)
  File "/openedx/venv/lib/python3.8/site-packages/django/core/management/__init__.py", line 419, in execute_from_command_line
    utility.execute()
  File "/openedx/venv/lib/python3.8/site-packages/django/core/management/__init__.py", line 413, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "/openedx/venv/lib/python3.8/site-packages/django/core/management/base.py", line 354, in run_from_argv
    self.execute(*args, **cmd_options)
  File "/openedx/venv/lib/python3.8/site-packages/django/core/management/base.py", line 398, in execute
    output = self.handle(*args, **options)
  File "/openedx/venv/lib/python3.8/site-packages/django/core/management/base.py", line 89, in wrapped
    res = handle_func(*args, **kwargs)
  File "/openedx/venv/lib/python3.8/site-packages/django/core/management/commands/migrate.py", line 244, in handle
    post_migrate_state = executor.migrate(
  File "/openedx/venv/lib/python3.8/site-packages/django/db/migrations/executor.py", line 117, in migrate
    state = self._migrate_all_forwards(state, plan, full_plan, fake=fake, fake_initial=fake_initial)
  File "/openedx/venv/lib/python3.8/site-packages/django/db/migrations/executor.py", line 147, in _migrate_all_forwards
    state = self.apply_migration(state, migration, fake=fake, fake_initial=fake_initial)
  File "/openedx/venv/lib/python3.8/site-packages/django/db/migrations/executor.py", line 227, in apply_migration
    state = migration.apply(state, schema_editor)
  File "/openedx/venv/lib/python3.8/site-packages/django/db/migrations/migration.py", line 123, in apply
    operation.database_forwards(self.app_label, schema_editor, old_state, project_state)
  File "/openedx/venv/lib/python3.8/site-packages/django/db/migrations/operations/special.py", line 190, in database_forwards
    self.code(from_state.apps, schema_editor)
  File "/openedx/edx-platform/common/djangoapps/split_modulestore_django/migrations/0002_data_migration.py", line 26, in forwards_func
    for course_index in split_modulestore.db_connection.find_matching_course_indexes(force_mongo=True):
  File "/openedx/venv/lib/python3.8/site-packages/pymongo/cursor.py", line 1280, in next
    if len(self.__data) or self._refresh():
  File "/openedx/venv/lib/python3.8/site-packages/pymongo/cursor.py", line 1165, in _refresh
    self.__session = self.__collection.database.client._ensure_session()
  File "/openedx/venv/lib/python3.8/site-packages/pymongo/mongo_client.py", line 2027, in _ensure_session
    return self.__start_session(True, causal_consistency=False)
  File "/openedx/venv/lib/python3.8/site-packages/pymongo/mongo_client.py", line 1976, in __start_session
    server_session = self._get_server_session()
  File "/openedx/venv/lib/python3.8/site-packages/pymongo/mongo_client.py", line 2013, in _get_server_session
    return self._topology.get_server_session()
  File "/openedx/venv/lib/python3.8/site-packages/pymongo/topology.py", line 525, in get_server_session
    session_timeout = self._check_session_support()
  File "/openedx/venv/lib/python3.8/site-packages/pymongo/topology.py", line 507, in _check_session_support
    self._select_servers_loop(
  File "/openedx/venv/lib/python3.8/site-packages/pymongo/topology.py", line 226, in _select_servers_loop
    raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: mongodb:27017: [Errno -3] Temporary failure in name resolution, Timeout: 30s, Topology Description: <TopologyDescription id: 649ca335dd8c796ea1093f54, topology_type: Single, servers: [<ServerDescription ('mongodb', 27017) server_type: Unknown, rtt: None, error=AutoReconnect('mongodb:27017: [Errno -3] Temporary failure in name resolution')>]>
Error: Command failed with status 1: docker compose -f /home/ubuntu/.local/share/tutor/env/local/docker-compose.yml -f /home/ubuntu/.local/share/tutor/env/local/docker-compose.prod.yml --project-name tutor_local run --rm cms sh -e -c ./manage.py cms migrate split_modulestore_django
5

What are the logs coming out of the mongodb container? tutor local logs --tail=100 mongodb

6

@regis this is too long to be posted, so I removed a few of the oldest lines. The full paste is here

Server 1:

ubuntu@ip-172-31-83-146:~$ tutor local logs --tail=100 mongodb
docker compose -f /home/ubuntu/.local/share/tutor/env/local/docker-compose.yml -f /home/ubuntu/.local/share/tutor/env/local/docker-compose.prod.yml --project-name tutor_local logs --tail 100 mongodb
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:25.725+00:00"},"s":"I",  "c":"CONTROL",  "id":21951,   "ctx":"initandlisten","msg":"Options set by command line","attr":{"options":{"net":{"bindIp":"*"},"storage":{"engine":"wiredTiger","journal":{"enabled":false}}}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:25.726+00:00"},"s":"I",  "c":"STORAGE",  "id":22297,   "ctx":"initandlisten","msg":"Using the XFS filesystem is strongly recommended with the WiredTiger storage engine. See http://dochub.mongodb.org/core/prodnotes-filesystem","tags":["startupWarnings"]}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:25.726+00:00"},"s":"I",  "c":"STORAGE",  "id":22315,   "ctx":"initandlisten","msg":"Opening WiredTiger","attr":{"config":"create,cache_size=7482M,session_max=33000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000,close_scan_interval=10,close_handle_minimum=250),statistics_log=(wait=0),verbose=[recovery_progress,checkpoint_progress,compact_progress],,log=(enabled=false),"}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:26.426+00:00"},"s":"F",  "c":"STORAGE",  "id":4671205, "ctx":"initandlisten","msg":"This version of MongoDB is too recent to start up on the existing data files. Try MongoDB 4.2 or earlier."}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:26.426+00:00"},"s":"F",  "c":"-",        "id":23089,   "ctx":"initandlisten","msg":"Fatal assertion","attr":{"msgid":4671205,"file":"src/mongo/db/storage/wiredtiger/wiredtiger_kv_engine.cpp","line":923}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:26.426+00:00"},"s":"F",  "c":"-",        "id":23090,   "ctx":"initandlisten","msg":"\n\n***aborting after fassert() failure\n\n"}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:26.426+00:00"},"s":"F",  "c":"CONTROL",  "id":4757800, "ctx":"initandlisten","msg":"Writing fatal message","attr":{"message":"Got signal: 6 (Aborted).\n"}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:26.479+00:00"},"s":"I",  "c":"CONTROL",  "id":31431,   "ctx":"initandlisten","msg":"BACKTRACE: {bt}","attr":{"bt":{"backtrace":[{"a":"55A4B36072EA","b":"55A4B07E4000","o":"2E232EA","s":"_ZN5mongo18stack_trace_detail12_GLOBAL__N_119printStackTraceImplERKNS1_7OptionsEPNS_14StackTraceSinkE.constprop.606","s+":"1EA"},{"a":"55A4B3608D79","b":"55A4B07E4000","o":"2E24D79","s":"_ZN5mongo15printStackTraceEv","s+":"29"},{"a":"55A4B3606106","b":"55A4B07E4000","o":"2E22106","s":"_ZN5mongo12_GLOBAL__N_116abruptQuitActionEiP9siginfo_tPv","s+":"66"},{"a":"7FC78AA7E420","b":"7FC78AA6A000","o":"14420","s":"funlockfile","s+":"60"},{"a":"7FC78A8BB00B","b":"7FC78A878000","o":"4300B","s":"gsignal","s+":"CB"},{"a":"7FC78A89A859","b":"7FC78A878000","o":"22859","s":"abort","s+":"12B"},{"a":"55A4B173B902","b":"55A4B07E4000","o":"F57902","s":"_ZN5mongo25fassertFailedWithLocationEiPKcj","s+":"12B"},{"a":"55A4B1403F65","b":"55A4B07E4000","o":"C1FF65","s":"_ZN5mongo18WiredTigerKVEngine15_openWiredTigerERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_.cold.1878","s+":"1C7"},{"a":"55A4B184F07A","b":"55A4B07E4000","o":"106B07A","s":"_ZN5mongo18WiredTigerKVEngineC2ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_PNS_11ClockSourceES8_mmbbbb","s+":"137A"},{"a":"55A4B182C820","b":"55A4B07E4000","o":"1048820","s":"_ZNK5mongo12_GLOBAL__N_117WiredTigerFactory6createERKNS_19StorageGlobalParamsEPKNS_21StorageEngineLockFileE","s+":"120"},{"a":"55A4B2157617","b":"55A4B07E4000","o":"1973617","s":"_ZN5mongo23initializeStorageEngineEPNS_14ServiceContextENS_22StorageEngineInitFlagsE","s+":"4F7"},{"a":"55A4B17D7B67","b":"55A4B07E4000","o":"FF3B67","s":"_ZN5mongo12_GLOBAL__N_114_initAndListenEPNS_14ServiceContextEi.isra.1585","s+":"3F7"},{"a":"55A4B17DBD9A","b":"55A4B07E4000","o":"FF7D9A","s":"_ZN5mongo12_GLOBAL__N_111mongoDbMainEiPPc","s+":"A5A"},{"a":"55A4B174AFD9","b":"55A4B07E4000","o":"F66FD9","s":"main","s+":"9"},{"a":"7FC78A89C083","b":"7FC78A878000","o":"24083","s":"__libc_start_main","s+":"F3"},{"a":"55A4B17D6F9E","b":"55A4B07E4000","o":"FF2F9E","s":"_start","s+":"2E"}],"processInfo":{"mongodbVersion":"4.4.22","gitVersion":"fc832685b99221cffb1f5bb5a4ff5ad3e1c416b2","compiledModules":[],"uname":{"sysname":"Linux","release":"5.19.0-1027-aws","version":"#28~22.04.1-Ubuntu SMP Wed May 31 18:30:36 UTC 2023","machine":"x86_64"},"somap":[{"b":"55A4B07E4000","elfType":3,"buildId":"D875E436AF78D4BF015292B71B5DC4A3CE16517E"},{"b":"7FC78AA6A000","path":"/lib/x86_64-linux-gnu/libpthread.so.0","elfType":3,"buildId":"7B4536F41CDAA5888408E82D0836E33DCF436466"},{"b":"7FC78A878000","path":"/lib/x86_64-linux-gnu/libc.so.6","elfType":3,"buildId":"1878E6B475720C7C51969E69AB2D276FAE6D1DEE"}]}}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:26.479+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"55A4B36072EA","b":"55A4B07E4000","o":"2E232EA","s":"_ZN5mongo18stack_trace_detail12_GLOBAL__N_119printStackTraceImplERKNS1_7OptionsEPNS_14StackTraceSinkE.constprop.606","s+":"1EA"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:26.479+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"55A4B3608D79","b":"55A4B07E4000","o":"2E24D79","s":"_ZN5mongo15printStackTraceEv","s+":"29"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:26.479+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"55A4B3606106","b":"55A4B07E4000","o":"2E22106","s":"_ZN5mongo12_GLOBAL__N_116abruptQuitActionEiP9siginfo_tPv","s+":"66"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:26.479+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"7FC78AA7E420","b":"7FC78AA6A000","o":"14420","s":"funlockfile","s+":"60"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:26.480+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"7FC78A8BB00B","b":"7FC78A878000","o":"4300B","s":"gsignal","s+":"CB"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:26.480+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"7FC78A89A859","b":"7FC78A878000","o":"22859","s":"abort","s+":"12B"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:26.480+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"55A4B173B902","b":"55A4B07E4000","o":"F57902","s":"_ZN5mongo25fassertFailedWithLocationEiPKcj","s+":"12B"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:26.480+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"55A4B1403F65","b":"55A4B07E4000","o":"C1FF65","s":"_ZN5mongo18WiredTigerKVEngine15_openWiredTigerERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_.cold.1878","s+":"1C7"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:26.480+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"55A4B184F07A","b":"55A4B07E4000","o":"106B07A","s":"_ZN5mongo18WiredTigerKVEngineC2ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_PNS_11ClockSourceES8_mmbbbb","s+":"137A"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:26.480+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"55A4B182C820","b":"55A4B07E4000","o":"1048820","s":"_ZNK5mongo12_GLOBAL__N_117WiredTigerFactory6createERKNS_19StorageGlobalParamsEPKNS_21StorageEngineLockFileE","s+":"120"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:26.480+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"55A4B2157617","b":"55A4B07E4000","o":"1973617","s":"_ZN5mongo23initializeStorageEngineEPNS_14ServiceContextENS_22StorageEngineInitFlagsE","s+":"4F7"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:26.480+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"55A4B17D7B67","b":"55A4B07E4000","o":"FF3B67","s":"_ZN5mongo12_GLOBAL__N_114_initAndListenEPNS_14ServiceContextEi.isra.1585","s+":"3F7"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:26.480+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"55A4B17DBD9A","b":"55A4B07E4000","o":"FF7D9A","s":"_ZN5mongo12_GLOBAL__N_111mongoDbMainEiPPc","s+":"A5A"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:26.480+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"55A4B174AFD9","b":"55A4B07E4000","o":"F66FD9","s":"main","s+":"9"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:26.480+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"7FC78A89C083","b":"7FC78A878000","o":"24083","s":"__libc_start_main","s+":"F3"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:26.480+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"55A4B17D6F9E","b":"55A4B07E4000","o":"FF2F9E","s":"_start","s+":"2E"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:39.571+00:00"},"s":"I",  "c":"CONTROL",  "id":23285,   "ctx":"main","msg":"Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols 'none'"}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:39.573+00:00"},"s":"I",  "c":"NETWORK",  "id":4648601, "ctx":"main","msg":"Implicit TCP FastOpen unavailable. If TCP FastOpen is required, set tcpFastOpenServer, tcpFastOpenClient, and tcpFastOpenQueueSize."}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:39.573+00:00"},"s":"I",  "c":"STORAGE",  "id":4615611, "ctx":"initandlisten","msg":"MongoDB starting","attr":{"pid":1,"port":27017,"dbPath":"/data/db","architecture":"64-bit","host":"49fc6689f487"}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:39.573+00:00"},"s":"I",  "c":"CONTROL",  "id":23403,   "ctx":"initandlisten","msg":"Build Info","attr":{"buildInfo":{"version":"4.4.22","gitVersion":"fc832685b99221cffb1f5bb5a4ff5ad3e1c416b2","openSSLVersion":"OpenSSL 1.1.1f  31 Mar 2020","modules":[],"allocator":"tcmalloc","environment":{"distmod":"ubuntu2004","distarch":"x86_64","target_arch":"x86_64"}}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:39.573+00:00"},"s":"I",  "c":"CONTROL",  "id":51765,   "ctx":"initandlisten","msg":"Operating System","attr":{"os":{"name":"Ubuntu","version":"20.04"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:39.573+00:00"},"s":"I",  "c":"CONTROL",  "id":21951,   "ctx":"initandlisten","msg":"Options set by command line","attr":{"options":{"net":{"bindIp":"*"},"storage":{"engine":"wiredTiger","journal":{"enabled":false}}}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:39.574+00:00"},"s":"I",  "c":"STORAGE",  "id":22297,   "ctx":"initandlisten","msg":"Using the XFS filesystem is strongly recommended with the WiredTiger storage engine. See http://dochub.mongodb.org/core/prodnotes-filesystem","tags":["startupWarnings"]}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:39.574+00:00"},"s":"I",  "c":"STORAGE",  "id":22315,   "ctx":"initandlisten","msg":"Opening WiredTiger","attr":{"config":"create,cache_size=7482M,session_max=33000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000,close_scan_interval=10,close_handle_minimum=250),statistics_log=(wait=0),verbose=[recovery_progress,checkpoint_progress,compact_progress],,log=(enabled=false),"}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:40.270+00:00"},"s":"F",  "c":"STORAGE",  "id":4671205, "ctx":"initandlisten","msg":"This version of MongoDB is too recent to start up on the existing data files. Try MongoDB 4.2 or earlier."}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:40.270+00:00"},"s":"F",  "c":"-",        "id":23089,   "ctx":"initandlisten","msg":"Fatal assertion","attr":{"msgid":4671205,"file":"src/mongo/db/storage/wiredtiger/wiredtiger_kv_engine.cpp","line":923}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:40.270+00:00"},"s":"F",  "c":"-",        "id":23090,   "ctx":"initandlisten","msg":"\n\n***aborting after fassert() failure\n\n"}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:40.270+00:00"},"s":"F",  "c":"CONTROL",  "id":4757800, "ctx":"initandlisten","msg":"Writing fatal message","attr":{"message":"Got signal: 6 (Aborted).\n"}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:40.322+00:00"},"s":"I",  "c":"CONTROL",  "id":31431,   "ctx":"initandlisten","msg":"BACKTRACE: {bt}","attr":{"bt":{"backtrace":[{"a":"55925979F2EA","b":"55925697C000","o":"2E232EA","s":"_ZN5mongo18stack_trace_detail12_GLOBAL__N_119printStackTraceImplERKNS1_7OptionsEPNS_14StackTraceSinkE.constprop.606","s+":"1EA"},{"a":"5592597A0D79","b":"55925697C000","o":"2E24D79","s":"_ZN5mongo15printStackTraceEv","s+":"29"},{"a":"55925979E106","b":"55925697C000","o":"2E22106","s":"_ZN5mongo12_GLOBAL__N_116abruptQuitActionEiP9siginfo_tPv","s+":"66"},{"a":"7F2CA18C7420","b":"7F2CA18B3000","o":"14420","s":"funlockfile","s+":"60"},{"a":"7F2CA170400B","b":"7F2CA16C1000","o":"4300B","s":"gsignal","s+":"CB"},{"a":"7F2CA16E3859","b":"7F2CA16C1000","o":"22859","s":"abort","s+":"12B"},{"a":"5592578D3902","b":"55925697C000","o":"F57902","s":"_ZN5mongo25fassertFailedWithLocationEiPKcj","s+":"12B"},{"a":"55925759BF65","b":"55925697C000","o":"C1FF65","s":"_ZN5mongo18WiredTigerKVEngine15_openWiredTigerERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_.cold.1878","s+":"1C7"},{"a":"5592579E707A","b":"55925697C000","o":"106B07A","s":"_ZN5mongo18WiredTigerKVEngineC2ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_PNS_11ClockSourceES8_mmbbbb","s+":"137A"},{"a":"5592579C4820","b":"55925697C000","o":"1048820","s":"_ZNK5mongo12_GLOBAL__N_117WiredTigerFactory6createERKNS_19StorageGlobalParamsEPKNS_21StorageEngineLockFileE","s+":"120"},{"a":"5592582EF617","b":"55925697C000","o":"1973617","s":"_ZN5mongo23initializeStorageEngineEPNS_14ServiceContextENS_22StorageEngineInitFlagsE","s+":"4F7"},{"a":"55925796FB67","b":"55925697C000","o":"FF3B67","s":"_ZN5mongo12_GLOBAL__N_114_initAndListenEPNS_14ServiceContextEi.isra.1585","s+":"3F7"},{"a":"559257973D9A","b":"55925697C000","o":"FF7D9A","s":"_ZN5mongo12_GLOBAL__N_111mongoDbMainEiPPc","s+":"A5A"},{"a":"5592578E2FD9","b":"55925697C000","o":"F66FD9","s":"main","s+":"9"},{"a":"7F2CA16E5083","b":"7F2CA16C1000","o":"24083","s":"__libc_start_main","s+":"F3"},{"a":"55925796EF9E","b":"55925697C000","o":"FF2F9E","s":"_start","s+":"2E"}],"processInfo":{"mongodbVersion":"4.4.22","gitVersion":"fc832685b99221cffb1f5bb5a4ff5ad3e1c416b2","compiledModules":[],"uname":{"sysname":"Linux","release":"5.19.0-1027-aws","version":"#28~22.04.1-Ubuntu SMP Wed May 31 18:30:36 UTC 2023","machine":"x86_64"},"somap":[{"b":"55925697C000","elfType":3,"buildId":"D875E436AF78D4BF015292B71B5DC4A3CE16517E"},{"b":"7F2CA18B3000","path":"/lib/x86_64-linux-gnu/libpthread.so.0","elfType":3,"buildId":"7B4536F41CDAA5888408E82D0836E33DCF436466"},{"b":"7F2CA16C1000","path":"/lib/x86_64-linux-gnu/libc.so.6","elfType":3,"buildId":"1878E6B475720C7C51969E69AB2D276FAE6D1DEE"}]}}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:40.322+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"55925979F2EA","b":"55925697C000","o":"2E232EA","s":"_ZN5mongo18stack_trace_detail12_GLOBAL__N_119printStackTraceImplERKNS1_7OptionsEPNS_14StackTraceSinkE.constprop.606","s+":"1EA"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:40.322+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"5592597A0D79","b":"55925697C000","o":"2E24D79","s":"_ZN5mongo15printStackTraceEv","s+":"29"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:40.322+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"55925979E106","b":"55925697C000","o":"2E22106","s":"_ZN5mongo12_GLOBAL__N_116abruptQuitActionEiP9siginfo_tPv","s+":"66"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:40.322+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"7F2CA18C7420","b":"7F2CA18B3000","o":"14420","s":"funlockfile","s+":"60"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:40.322+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"7F2CA170400B","b":"7F2CA16C1000","o":"4300B","s":"gsignal","s+":"CB"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:40.322+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"7F2CA16E3859","b":"7F2CA16C1000","o":"22859","s":"abort","s+":"12B"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:40.322+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"5592578D3902","b":"55925697C000","o":"F57902","s":"_ZN5mongo25fassertFailedWithLocationEiPKcj","s+":"12B"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:40.322+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"55925759BF65","b":"55925697C000","o":"C1FF65","s":"_ZN5mongo18WiredTigerKVEngine15_openWiredTigerERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_.cold.1878","s+":"1C7"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:40.322+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"5592579E707A","b":"55925697C000","o":"106B07A","s":"_ZN5mongo18WiredTigerKVEngineC2ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_PNS_11ClockSourceES8_mmbbbb","s+":"137A"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:40.322+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"5592579C4820","b":"55925697C000","o":"1048820","s":"_ZNK5mongo12_GLOBAL__N_117WiredTigerFactory6createERKNS_19StorageGlobalParamsEPKNS_21StorageEngineLockFileE","s+":"120"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:40.322+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"5592582EF617","b":"55925697C000","o":"1973617","s":"_ZN5mongo23initializeStorageEngineEPNS_14ServiceContextENS_22StorageEngineInitFlagsE","s+":"4F7"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:40.322+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"55925796FB67","b":"55925697C000","o":"FF3B67","s":"_ZN5mongo12_GLOBAL__N_114_initAndListenEPNS_14ServiceContextEi.isra.1585","s+":"3F7"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:40.322+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"559257973D9A","b":"55925697C000","o":"FF7D9A","s":"_ZN5mongo12_GLOBAL__N_111mongoDbMainEiPPc","s+":"A5A"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:40.322+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"5592578E2FD9","b":"55925697C000","o":"F66FD9","s":"main","s+":"9"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:40.322+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"7F2CA16E5083","b":"7F2CA16C1000","o":"24083","s":"__libc_start_main","s+":"F3"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:21:40.322+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"55925796EF9E","b":"55925697C000","o":"FF2F9E","s":"_start","s+":"2E"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.211+00:00"},"s":"I",  "c":"CONTROL",  "id":23285,   "ctx":"main","msg":"Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols 'none'"}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.213+00:00"},"s":"I",  "c":"NETWORK",  "id":4648601, "ctx":"main","msg":"Implicit TCP FastOpen unavailable. If TCP FastOpen is required, set tcpFastOpenServer, tcpFastOpenClient, and tcpFastOpenQueueSize."}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.214+00:00"},"s":"I",  "c":"STORAGE",  "id":4615611, "ctx":"initandlisten","msg":"MongoDB starting","attr":{"pid":1,"port":27017,"dbPath":"/data/db","architecture":"64-bit","host":"49fc6689f487"}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.214+00:00"},"s":"I",  "c":"CONTROL",  "id":23403,   "ctx":"initandlisten","msg":"Build Info","attr":{"buildInfo":{"version":"4.4.22","gitVersion":"fc832685b99221cffb1f5bb5a4ff5ad3e1c416b2","openSSLVersion":"OpenSSL 1.1.1f  31 Mar 2020","modules":[],"allocator":"tcmalloc","environment":{"distmod":"ubuntu2004","distarch":"x86_64","target_arch":"x86_64"}}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.214+00:00"},"s":"I",  "c":"CONTROL",  "id":51765,   "ctx":"initandlisten","msg":"Operating System","attr":{"os":{"name":"Ubuntu","version":"20.04"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.214+00:00"},"s":"I",  "c":"CONTROL",  "id":21951,   "ctx":"initandlisten","msg":"Options set by command line","attr":{"options":{"net":{"bindIp":"*"},"storage":{"engine":"wiredTiger","journal":{"enabled":false}}}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.214+00:00"},"s":"I",  "c":"STORAGE",  "id":22297,   "ctx":"initandlisten","msg":"Using the XFS filesystem is strongly recommended with the WiredTiger storage engine. See http://dochub.mongodb.org/core/prodnotes-filesystem","tags":["startupWarnings"]}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.214+00:00"},"s":"I",  "c":"STORAGE",  "id":22315,   "ctx":"initandlisten","msg":"Opening WiredTiger","attr":{"config":"create,cache_size=7482M,session_max=33000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000,close_scan_interval=10,close_handle_minimum=250),statistics_log=(wait=0),verbose=[recovery_progress,checkpoint_progress,compact_progress],,log=(enabled=false),"}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.911+00:00"},"s":"F",  "c":"STORAGE",  "id":4671205, "ctx":"initandlisten","msg":"This version of MongoDB is too recent to start up on the existing data files. Try MongoDB 4.2 or earlier."}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.911+00:00"},"s":"F",  "c":"-",        "id":23089,   "ctx":"initandlisten","msg":"Fatal assertion","attr":{"msgid":4671205,"file":"src/mongo/db/storage/wiredtiger/wiredtiger_kv_engine.cpp","line":923}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.911+00:00"},"s":"F",  "c":"-",        "id":23090,   "ctx":"initandlisten","msg":"\n\n***aborting after fassert() failure\n\n"}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.911+00:00"},"s":"F",  "c":"CONTROL",  "id":4757800, "ctx":"initandlisten","msg":"Writing fatal message","attr":{"message":"Got signal: 6 (Aborted).\n"}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.963+00:00"},"s":"I",  "c":"CONTROL",  "id":31431,   "ctx":"initandlisten","msg":"BACKTRACE: {bt}","attr":{"bt":{"backtrace":[{"a":"563C9F6BA2EA","b":"563C9C897000","o":"2E232EA","s":"_ZN5mongo18stack_trace_detail12_GLOBAL__N_119printStackTraceImplERKNS1_7OptionsEPNS_14StackTraceSinkE.constprop.606","s+":"1EA"},{"a":"563C9F6BBD79","b":"563C9C897000","o":"2E24D79","s":"_ZN5mongo15printStackTraceEv","s+":"29"},{"a":"563C9F6B9106","b":"563C9C897000","o":"2E22106","s":"_ZN5mongo12_GLOBAL__N_116abruptQuitActionEiP9siginfo_tPv","s+":"66"},{"a":"7FC7BD781420","b":"7FC7BD76D000","o":"14420","s":"funlockfile","s+":"60"},{"a":"7FC7BD5BE00B","b":"7FC7BD57B000","o":"4300B","s":"gsignal","s+":"CB"},{"a":"7FC7BD59D859","b":"7FC7BD57B000","o":"22859","s":"abort","s+":"12B"},{"a":"563C9D7EE902","b":"563C9C897000","o":"F57902","s":"_ZN5mongo25fassertFailedWithLocationEiPKcj","s+":"12B"},{"a":"563C9D4B6F65","b":"563C9C897000","o":"C1FF65","s":"_ZN5mongo18WiredTigerKVEngine15_openWiredTigerERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_.cold.1878","s+":"1C7"},{"a":"563C9D90207A","b":"563C9C897000","o":"106B07A","s":"_ZN5mongo18WiredTigerKVEngineC2ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_PNS_11ClockSourceES8_mmbbbb","s+":"137A"},{"a":"563C9D8DF820","b":"563C9C897000","o":"1048820","s":"_ZNK5mongo12_GLOBAL__N_117WiredTigerFactory6createERKNS_19StorageGlobalParamsEPKNS_21StorageEngineLockFileE","s+":"120"},{"a":"563C9E20A617","b":"563C9C897000","o":"1973617","s":"_ZN5mongo23initializeStorageEngineEPNS_14ServiceContextENS_22StorageEngineInitFlagsE","s+":"4F7"},{"a":"563C9D88AB67","b":"563C9C897000","o":"FF3B67","s":"_ZN5mongo12_GLOBAL__N_114_initAndListenEPNS_14ServiceContextEi.isra.1585","s+":"3F7"},{"a":"563C9D88ED9A","b":"563C9C897000","o":"FF7D9A","s":"_ZN5mongo12_GLOBAL__N_111mongoDbMainEiPPc","s+":"A5A"},{"a":"563C9D7FDFD9","b":"563C9C897000","o":"F66FD9","s":"main","s+":"9"},{"a":"7FC7BD59F083","b":"7FC7BD57B000","o":"24083","s":"__libc_start_main","s+":"F3"},{"a":"563C9D889F9E","b":"563C9C897000","o":"FF2F9E","s":"_start","s+":"2E"}],"processInfo":{"mongodbVersion":"4.4.22","gitVersion":"fc832685b99221cffb1f5bb5a4ff5ad3e1c416b2","compiledModules":[],"uname":{"sysname":"Linux","release":"5.19.0-1027-aws","version":"#28~22.04.1-Ubuntu SMP Wed May 31 18:30:36 UTC 2023","machine":"x86_64"},"somap":[{"b":"563C9C897000","elfType":3,"buildId":"D875E436AF78D4BF015292B71B5DC4A3CE16517E"},{"b":"7FC7BD76D000","path":"/lib/x86_64-linux-gnu/libpthread.so.0","elfType":3,"buildId":"7B4536F41CDAA5888408E82D0836E33DCF436466"},{"b":"7FC7BD57B000","path":"/lib/x86_64-linux-gnu/libc.so.6","elfType":3,"buildId":"1878E6B475720C7C51969E69AB2D276FAE6D1DEE"}]}}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.963+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"563C9F6BA2EA","b":"563C9C897000","o":"2E232EA","s":"_ZN5mongo18stack_trace_detail12_GLOBAL__N_119printStackTraceImplERKNS1_7OptionsEPNS_14StackTraceSinkE.constprop.606","s+":"1EA"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.963+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"563C9F6BBD79","b":"563C9C897000","o":"2E24D79","s":"_ZN5mongo15printStackTraceEv","s+":"29"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.964+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"563C9F6B9106","b":"563C9C897000","o":"2E22106","s":"_ZN5mongo12_GLOBAL__N_116abruptQuitActionEiP9siginfo_tPv","s+":"66"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.964+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"7FC7BD781420","b":"7FC7BD76D000","o":"14420","s":"funlockfile","s+":"60"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.964+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"7FC7BD5BE00B","b":"7FC7BD57B000","o":"4300B","s":"gsignal","s+":"CB"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.964+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"7FC7BD59D859","b":"7FC7BD57B000","o":"22859","s":"abort","s+":"12B"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.964+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"563C9D7EE902","b":"563C9C897000","o":"F57902","s":"_ZN5mongo25fassertFailedWithLocationEiPKcj","s+":"12B"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.964+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"563C9D4B6F65","b":"563C9C897000","o":"C1FF65","s":"_ZN5mongo18WiredTigerKVEngine15_openWiredTigerERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_.cold.1878","s+":"1C7"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.964+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"563C9D90207A","b":"563C9C897000","o":"106B07A","s":"_ZN5mongo18WiredTigerKVEngineC2ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_PNS_11ClockSourceES8_mmbbbb","s+":"137A"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.964+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"563C9D8DF820","b":"563C9C897000","o":"1048820","s":"_ZNK5mongo12_GLOBAL__N_117WiredTigerFactory6createERKNS_19StorageGlobalParamsEPKNS_21StorageEngineLockFileE","s+":"120"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.964+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"563C9E20A617","b":"563C9C897000","o":"1973617","s":"_ZN5mongo23initializeStorageEngineEPNS_14ServiceContextENS_22StorageEngineInitFlagsE","s+":"4F7"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.964+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"563C9D88AB67","b":"563C9C897000","o":"FF3B67","s":"_ZN5mongo12_GLOBAL__N_114_initAndListenEPNS_14ServiceContextEi.isra.1585","s+":"3F7"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.964+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"563C9D88ED9A","b":"563C9C897000","o":"FF7D9A","s":"_ZN5mongo12_GLOBAL__N_111mongoDbMainEiPPc","s+":"A5A"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.964+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"563C9D7FDFD9","b":"563C9C897000","o":"F66FD9","s":"main","s+":"9"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.964+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"7FC7BD59F083","b":"7FC7BD57B000","o":"24083","s":"__libc_start_main","s+":"F3"}}}
tutor_local-mongodb-1  | {"t":{"$date":"2023-06-29T14:22:06.964+00:00"},"s":"I",  "c":"CONTROL",  "id":31427,   "ctx":"initandlisten","msg":"  Frame: {frame}","attr":{"frame":{"a":"563C9D889F9E","b":"563C9C897000","o":"FF2F9E","s":"_start","s+":"2E"}}}
7

I also tried rebuilding openedx and rebuilding all, but neither helped fix the issue (I’m actually not sure if build all has ever completed yet. It seems like it might be freezing the servers and making them unresponsive…)