Error when updating Open Edx (open-release/ironwood.2)

Site Operators Site Operations Help
1

Hi everyone! I’m trying to update Open Edx using “sudo /edx/bin/update -v edx-platform master” command. I got an error during execution of create application and auth config task. Here’s the verbose output:

TASK [edxapp : create application and auth config] *********************************************************************************************************************
task path: /edx/app/edx_ansible/edx_ansible/playbooks/roles/edxapp/tasks/service_variant_config.yml:2
Using module file /edx/app/edx_ansible/venvs/edx_ansible/local/lib/python2.7/site-packages/ansible/modules/files/stat.py
ESTABLISH LOCAL CONNECTION FOR USER: root
EXEC /bin/sh -c ‘echo ~ && sleep 0’
EXEC /bin/sh -c ‘( umask 77 && mkdir -p “echo /home/guest/.ansible/tmp/ansible-tmp-1585562967.58-199919074784077” && echo ansible-tmp-1585562967.58-199919074784077="echo /home/guest/.ansible/tmp/ansible-tmp-1585562967.58-199919074784077" ) && sleep 0’
PUT /tmp/tmpPsepC_ TO /home/guest/.ansible/tmp/ansible-tmp-1585562967.58-199919074784077/stat.py
EXEC /bin/sh -c ‘chmod u+x /home/guest/.ansible/tmp/ansible-tmp-1585562967.58-199919074784077/ /home/guest/.ansible/tmp/ansible-tmp-1585562967.58-199919074784077/stat.py && sleep 0’
EXEC /bin/sh -c ‘/usr/bin/python /home/guest/.ansible/tmp/ansible-tmp-1585562967.58-199919074784077/stat.py; rm -rf “/home/guest/.ansible/tmp/ansible-tmp-1585562967.58-199919074784077/” > /dev/null 2>&1 && sleep 0’
EXEC /bin/sh -c ‘echo ~ && sleep 0’
EXEC /bin/sh -c ‘( umask 77 && mkdir -p “echo /home/guest/.ansible/tmp/ansible-tmp-1585562967.94-80864555218132” && echo ansible-tmp-1585562967.94-80864555218132="echo /home/guest/.ansible/tmp/ansible-tmp-1585562967.94-80864555218132" ) && sleep 0’
Using module file /edx/app/edx_ansible/venvs/edx_ansible/local/lib/python2.7/site-packages/ansible/modules/files/stat.py
PUT /tmp/tmpyTAyhr TO /home/guest/.ansible/tmp/ansible-tmp-1585562967.94-80864555218132/stat.py
EXEC /bin/sh -c ‘chmod u+x /home/guest/.ansible/tmp/ansible-tmp-1585562967.94-80864555218132/ /home/guest/.ansible/tmp/ansible-tmp-1585562967.94-80864555218132/stat.py && sleep 0’
EXEC /bin/sh -c ‘/usr/bin/python /home/guest/.ansible/tmp/ansible-tmp-1585562967.94-80864555218132/stat.py && sleep 0’
Using module file /edx/app/edx_ansible/venvs/edx_ansible/local/lib/python2.7/site-packages/ansible/modules/files/file.py
PUT /tmp/tmp9VXPww TO /home/guest/.ansible/tmp/ansible-tmp-1585562967.94-80864555218132/file.py
EXEC /bin/sh -c ‘chmod u+x /home/guest/.ansible/tmp/ansible-tmp-1585562967.94-80864555218132/ /home/guest/.ansible/tmp/ansible-tmp-1585562967.94-80864555218132/file.py && sleep 0’
EXEC /bin/sh -c ‘/usr/bin/python /home/guest/.ansible/tmp/ansible-tmp-1585562967.94-80864555218132/file.py && sleep 0’
EXEC /bin/sh -c ‘rm -f -r /home/guest/.ansible/tmp/ansible-tmp-1585562967.94-80864555218132/ > /dev/null 2>&1 && sleep 0’
ok: [localhost] => (item=[u’lms’, u’env’]) => {
“changed”: false,
“diff”: {
“after”: {
“path”: “/edx/app/edxapp/lms.env.json”
},
“before”: {
“path”: “/edx/app/edxapp/lms.env.json”
}
},
“gid”: 33,
“group”: “www-data”,
“invocation”: {
“module_args”: {
“attributes”: null,
“backup”: null,
“content”: null,
“delimiter”: null,
“dest”: “/edx/app/edxapp/lms.env.json”,
“diff_peek”: null,
“directory_mode”: null,
“follow”: true,
“force”: false,
“group”: “www-data”,
“mode”: 416,
“original_basename”: “lms.env.json.j2”,
“owner”: “edxapp”,
“path”: “/edx/app/edxapp/lms.env.json”,
“recurse”: false,
“regexp”: null,
“remote_src”: null,
“selevel”: null,
“serole”: null,
“setype”: null,
“seuser”: null,
“src”: null,
“state”: null,
“unsafe_writes”: null,
“validate”: null
}
},
“item”: [
“lms”,
“env”
],
“mode”: “0640”,
“owner”: “edxapp”,
“path”: “/edx/app/edxapp/lms.env.json”,
“size”: 16402,
“state”: “file”,
“uid”: 1003
}
Using module file /edx/app/edx_ansible/venvs/edx_ansible/local/lib/python2.7/site-packages/ansible/modules/files/stat.py
EXEC /bin/sh -c ‘echo ~ && sleep 0’
EXEC /bin/sh -c ‘( umask 77 && mkdir -p “echo /home/guest/.ansible/tmp/ansible-tmp-1585562968.25-119888215497118” && echo ansible-tmp-1585562968.25-119888215497118="echo /home/guest/.ansible/tmp/ansible-tmp-1585562968.25-119888215497118" ) && sleep 0’
PUT /tmp/tmp5l4kef TO /home/guest/.ansible/tmp/ansible-tmp-1585562968.25-119888215497118/stat.py
EXEC /bin/sh -c ‘chmod u+x /home/guest/.ansible/tmp/ansible-tmp-1585562968.25-119888215497118/ /home/guest/.ansible/tmp/ansible-tmp-1585562968.25-119888215497118/stat.py && sleep 0’
EXEC /bin/sh -c ‘/usr/bin/python /home/guest/.ansible/tmp/ansible-tmp-1585562968.25-119888215497118/stat.py; rm -rf “/home/guest/.ansible/tmp/ansible-tmp-1585562968.25-119888215497118/” > /dev/null 2>&1 && sleep 0’
failed: [localhost] (item=[u’lms’, u’auth’]) => {
“failed”: true,
“item”: [
“lms”,
“auth”
],
“msg”: “AnsibleUndefinedVariable: {u’SEGMENT_KEY’: u’{{ EDXAPP_LMS_SEGMENT_KEY }}’, u’AWS_QUERYSTRING_AUTH’: u’{{ EDXAPP_AWS_QUERYSTRING_AUTH }}’, u’SWIFT_USE_TEMP_URLS’: u’{{ EDXAPP_SWIFT_USE_TEMP_URLS }}’, u’EVENT_TRACKING_SEGMENTIO_EMIT_WHITELIST’: u’{{ EDXAPP_EVENT_TRACKING_SEGMENTIO_EMIT_WHITELIST }}’, u’OPTIMIZELY_PROJECT_ID’: u’{{ EDXAPP_OPTIMIZELY_PROJECT_ID }}’, u’SWIFT_TEMP_URL_DURATION’: u’{{ EDXAPP_SWIFT_TEMP_URL_DURATION }}’, u’SWIFT_AUTH_VERSION’: u’{{ EDXAPP_SWIFT_AUTH_VERSION }}’, u’SWIFT_TENANT_NAME’: u’{{ EDXAPP_SWIFT_TENANT_NAME }}’, u’ECOMMERCE_API_SIGNING_KEY’: u’{{ EDXAPP_ECOMMERCE_API_SIGNING_KEY }}’, u’CONTENTSTORE’: {u’ENGINE’: u’xmodule.contentstore.mongo.MongoContentStore’, u’DOC_STORE_CONFIG’: u’{{ EDXAPP_LMS_SPLIT_DOC_STORE_CONFIG }}’, u’ADDITIONAL_OPTIONS’: u’{{ EDXAPP_CONTENTSTORE_ADDITIONAL_OPTS }}’, u’OPTIONS’: {u’db’: u’{{ EDXAPP_MONGO_DB_NAME }}’, u’ssl’: u’{{ EDXAPP_MONGO_USE_SSL }}’, u’host’: u’{{ EDXAPP_MONGO_HOSTS }}’, u’user’: u’{{ EDXAPP_MONGO_USER }}’, u’password’: u’{{ EDXAPP_MONGO_PASSWORD }}’, u’port’: u’{{ EDXAPP_MONGO_PORT }}’}}, u’ENTERPRISE_SERVICE_WORKER_USERNAME’: u’{{ EDXAPP_ENTERPRISE_SERVICE_WORKER_USERNAME }}’, u’SECRET_KEY’: u’{{ EDXAPP_EDXAPP_SECRET_KEY }}’, u’ANALYTICS_API_KEY’: u’{{ EDXAPP_LMS_ANALYTICS_API_KEY }}’, u’EMAIL_HOST_PASSWORD’: u’{{ EDXAPP_EMAIL_HOST_PASSWORD }}’, u’ZENDESK_USER’: u’{{ EDXAPP_ZENDESK_USER }}’, u’AWS_S3_CUSTOM_DOMAIN’: u’{{ EDXAPP_AWS_S3_CUSTOM_DOMAIN }}’, u’GOOGLE_ANALYTICS_LINKEDIN’: u’{{ EDXAPP_GOOGLE_ANALYTICS_LINKEDIN }}’, u’SWIFT_USERNAME’: u’{{ EDXAPP_SWIFT_USERNAME }}’, u’DJFS’: u’{{ EDXAPP_DJFS }}’, u’PROFILE_IMAGE_SECRET_KEY’: u’{{ EDXAPP_PROFILE_IMAGE_SECRET_KEY }}’, u’BRANCH_IO_KEY’: u’{{ EDXAPP_BRANCH_IO_KEY }}’, u’VERIFY_STUDENT’: u’{{ EDXAPP_VERIFY_STUDENT }}’, u’FACEBOOK_API_VERSION’: u’{{ EDXAPP_FACEBOOK_API_VERSION }}’, u’CELERY_BROKER_USER’: u’{{ EDXAPP_CELERY_USER }}’, u’SWIFT_AUTH_URL’: u’{{ EDXAPP_SWIFT_AUTH_URL }}’, u’GOOGLE_ANALYTICS_TRACKING_ID’: u’{{ EDXAPP_GOOGLE_ANALYTICS_TRACKING_ID }}’, u’CC_PROCESSOR’: u’{{ EDXAPP_CC_PROCESSOR }}’, u’GOOGLE_ANALYTICS_ACCOUNT’: u’{{ EDXAPP_GOOGLE_ANALYTICS_ACCOUNT }}’, u’SOCIAL_AUTH_SAML_SP_PRIVATE_KEY’: u’{{ EDXAPP_SOCIAL_AUTH_SAML_SP_PRIVATE_KEY }}’, u’FACEBOOK_APP_SECRET’: u’{{ EDXAPP_FACEBOOK_APP_SECRET }}’, u’PROCTORING_BACKENDS’: u’{{ EDXAPP_PROCTORING_BACKENDS }}’, u’FERNET_KEYS’: u’{{ EDXAPP_FERNET_KEYS }}’, u’SWIFT_TEMP_URL_KEY’: u’{{ EDXAPP_SWIFT_TEMP_URL_KEY }}’, u’ENTERPRISE_REPORTING_SECRET’: u’{{ EDXAPP_ENTERPRISE_REPORTING_SECRET }}’, u’SWIFT_KEY’: u’{{ EDXAPP_SWIFT_KEY }}’, u’SOCIAL_AUTH_OAUTH_SECRETS’: u’{{ EDXAPP_SOCIAL_AUTH_OAUTH_SECRETS }}’, u’AWS_STORAGE_BUCKET_NAME’: u’{{ EDXAPP_AWS_STORAGE_BUCKET_NAME }}’, u’ZENDESK_OAUTH_ACCESS_TOKEN’: u’{{ EDXAPP_ZENDESK_OAUTH_ACCESS_TOKEN }}’, u’DATABASES’: u’{{ edxapp_databases }}’, u’DOC_STORE_CONFIG’: u’{{ EDXAPP_LMS_SPLIT_DOC_STORE_CONFIG }}’, u’ZENDESK_API_KEY’: u’{{ EDXAPP_ZENDESK_API_KEY }}’, u’CELERY_BROKER_PASSWORD’: u’{{ EDXAPP_CELERY_PASSWORD }}’, u’AWS_ACCESS_KEY_ID’: u’{{ EDXAPP_AWS_ACCESS_KEY_ID }}’, u’DEFAULT_FILE_STORAGE’: u’{{ EDXAPP_DEFAULT_FILE_STORAGE }}’, u’SOCIAL_AUTH_SAML_SP_PRIVATE_KEY_DICT’: u’{{ EDXAPP_SOCIAL_AUTH_SAML_SP_PRIVATE_KEY_DICT }}’, u’YOUTUBE_API_KEY’: u’{{ EDXAPP_YOUTUBE_API_KEY }}’, u’TRACKING_SEGMENTIO_WEBHOOK_SECRET’: u’{{ EDXAPP_TRACKING_SEGMENTIO_WEBHOOK_SECRET }}’, u’SOCIAL_AUTH_SAML_SP_PUBLIC_CERT’: u’{{ EDXAPP_SOCIAL_AUTH_SAML_SP_PUBLIC_CERT }}’, u’MODULESTORE’: {u’default’: {u’ENGINE’: u’xmodule.modulestore.mixed.MixedModuleStore’, u’OPTIONS’: {u’stores’: [{u’ENGINE’: u’xmodule.modulestore.split_mongo.split_draft.DraftVersioningModuleStore’, u’DOC_STORE_CONFIG’: u’{{ EDXAPP_LMS_SPLIT_DOC_STORE_CONFIG }}’, u’NAME’: u’split’, u’OPTIONS’: {u’fs_root’: u’{{ edxapp_course_data_dir }}’, u’render_template’: u’edxmako.shortcuts.render_to_string’, u’default_class’: u’xmodule.hidden_module.HiddenDescriptor’}}, {u’ENGINE’: u’xmodule.modulestore.mongo.DraftMongoModuleStore’, u’DOC_STORE_CONFIG’: u’{{ EDXAPP_LMS_DRAFT_DOC_STORE_CONFIG }}’, u’NAME’: u’draft’, u’OPTIONS’: {u’fs_root’: u’{{ edxapp_course_data_dir }}’, u’render_template’: u’edxmako.shortcuts.render_to_string’, u’default_class’: u’xmodule.hidden_module.HiddenDescriptor’}}], u’mappings’: {}}}}, u’ACE_CHANNEL_SAILTHRU_API_KEY’: u’{{ EDXAPP_ACE_CHANNEL_SAILTHRU_API_KEY }}’, u’SWIFT_REGION_NAME’: u’{{ EDXAPP_SWIFT_REGION_NAME }}’, u’CC_PROCESSOR_NAME’: u’{{ EDXAPP_CC_PROCESSOR_NAME }}’, u’SOCIAL_AUTH_SAML_SP_PUBLIC_CERT_DICT’: u’{{ EDXAPP_SOCIAL_AUTH_SAML_SP_PUBLIC_CERT_DICT }}’, u’EDX_API_KEY’: u’{{ EDXAPP_EDX_API_KEY }}’, u’AWS_SECRET_ACCESS_KEY’: u’{{ EDXAPP_AWS_SECRET_ACCESS_KEY }}’, u’FACEBOOK_APP_ID’: u’{{ EDXAPP_FACEBOOK_APP_ID }}’, u’XQUEUE_INTERFACE’: {u’url’: u’{{ EDXAPP_XQUEUE_URL }}’, u’basic_auth’: u’{{ EDXAPP_XQUEUE_BASIC_AUTH }}’, u’django_auth’: u’{{ EDXAPP_XQUEUE_DJANGO_AUTH }}’}, u’ACE_CHANNEL_SAILTHRU_API_SECRET’: u’{{ EDXAPP_ACE_CHANNEL_SAILTHRU_API_SECRET }}’, u’CREDIT_PROVIDER_SECRET_KEYS’: u’{{ EDXAPP_CREDIT_PROVIDER_SECRET_KEYS }}’, u’EMAIL_HOST_USER’: u’{{ EDXAPP_EMAIL_HOST_USER }}’, u’SWIFT_TENANT_ID’: u’{{ EDXAPP_SWIFT_TENANT_ID }}’}: ‘EDXAPP_EDXAPP_SECRET_KEY’ is undefined”
}

I have found a similar issue Error when installing Open edX ironwood.master: ‘EDXAPP_EDXAPP_SECRET_KEY’ is undefined, but suggested solution didn’t help me. I already have my-passwords.yml file in my home directory. Does anyone know how to fix this? Thanks in advance.

2

You should be using open-release/ironwood.master to get the latest fixes. Can you point us to the docs you were reading? We should make that clearer.

3

I redefined the variable OPENEDX_RELEASE to “open-release/ironwood.master” and started updating again, but it didn’t solve the problem. It’s still the same error. Sorry, I can’t find the page where I read that. It wasn’t the docs though.

4

Just a hunch.

You wrote that the problem seems to be with ‘EDXAPP_EDXAPP_SECRET_KEY’ is undefined

From https://github.com/edx/configuration/blob/2ede907d158ba980cd3f44c8092442cdb7418d3e/CHANGELOG.md

Role: edxapp

  • EDXAPP_EDXAPP_SECRET_KEY no longer has a default value

Is it possible you have forgotten to randomize the passwords? Step4 in https://openedx.atlassian.net/wiki/spaces/OpenOPS/pages/146440579/Native+Open+edX+platform+Ubuntu+16.04+64+bit+Installation

You need to keep the generated my-passwords.yml file where it was created during the installation. Do not put it in a safe place before the installation as completed.