Error while installing koa.master on Ubuntu 20.04 Server Virtual Machine

taha_jamil · May 20, 2021, 9:57am

Hello, while installing Open edX koa.master release, (following this guide: link) I am facing the error at step 5, pasted below (at the end of this full log file: https://pastebin.com/3yFrt601). Please let me know what I am doing wrong here? On a side note, I am totally new to this. Thanks in advance!

TASK [edxapp : migrate] ********************************************************
failed: [localhost] (item=lms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["/edx/bin/edxapp-migrate-lms"], "delta": "0:01:01.155515", "end": "2021-05-20 07:18:39.224244", "item": "lms", "msg": "non-zero return code", "rc": 1, "start": "2021-05-20 07:17:38.068729", "stderr": "2021-05-20 07:18:15,704 WARNING 44479 [py.warnings] [user None] [ip None] warnings.py:109 - /edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/newrelic/console.py:84: DeprecationWarning: `formatargspec` is deprecated since Python 3.5. Use `signature` and the `Signature` object directly\n  prototype = wrapper.__name__[3:] + ' ' + inspect.formatargspec(\n\nTraceback (most recent call last):\n  File \"manage.py\", line 120, in <module>\n    startup.run()\n  File \"/edx/app/edxapp/edx-platform/lms/startup.py\", line 20, in run\n    django.setup()\n  File \"/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/__init__.py\", line 24, in setup\n    apps.populate(settings.INSTALLED_APPS)\n  File \"/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/apps/registry.py\", line 91, in populate\n    app_config = AppConfig.create(entry)\n  File \"/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/apps/config.py\", line 90, in create\n    module = import_module(entry)\n  File \"/edx/app/edxapp/venvs/edxapp/lib/python3.8/importlib/__init__.py\", line 127, in import_module\n    return _bootstrap._gcd_import(name[level:], package, level)\n  File \"<frozen importlib._bootstrap>\", line 1014, in _gcd_import\n  File \"<frozen importlib._bootstrap>\", line 991, in _find_and_load\n  File \"<frozen importlib._bootstrap>\", line 961, in _find_and_load_unlocked\n  File \"<frozen importlib._bootstrap>\", line 219, in _call_with_frames_removed\n  File \"<frozen importlib._bootstrap>\", line 1014, in _gcd_import\n  File \"<frozen importlib._bootstrap>\", line 991, in _find_and_load\n  File \"<frozen importlib._bootstrap>\", line 975, in _find_and_load_unlocked\n  File \"<frozen importlib._bootstrap>\", line 671, in _load_unlocked\n  File \"<frozen importlib._bootstrap_external>\", line 783, in exec_module\n  File \"<frozen importlib._bootstrap>\", line 219, in _call_with_frames_removed\n  File \"/edx/app/edxapp/edx-platform/openedx/core/djangoapps/coursegraph/apps.py\", line 11, in <module>\n    class CoursegraphConfig(AppConfig):\n  File \"/edx/app/edxapp/edx-platform/openedx/core/djangoapps/coursegraph/apps.py\", line 17, in CoursegraphConfig\n    from openedx.core.djangoapps.coursegraph import tasks\n  File \"/edx/app/edxapp/edx-platform/openedx/core/djangoapps/coursegraph/tasks.py\", line 250, in <module>\n    @set_code_owner_attribute\nNameError: name 'set_code_owner_attribute' is not defined", "stderr_lines": ["2021-05-20 07:18:15,704 WARNING 44479 [py.warnings] [user None] [ip None] warnings.py:109 - /edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/newrelic/console.py:84: DeprecationWarning: `formatargspec` is deprecated since Python 3.5. Use `signature` and the `Signature` object directly", "  prototype = wrapper.__name__[3:] + ' ' + inspect.formatargspec(", "", "Traceback (most recent call last):", "  File \"manage.py\", line 120, in <module>", "    startup.run()", "  File \"/edx/app/edxapp/edx-platform/lms/startup.py\", line 20, in run", "    django.setup()", "  File \"/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/__init__.py\", line 24, in setup", "    apps.populate(settings.INSTALLED_APPS)", "  File \"/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/apps/registry.py\", line 91, in populate", "    app_config = AppConfig.create(entry)", "  File \"/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/apps/config.py\", line 90, in create", "    module = import_module(entry)", "  File \"/edx/app/edxapp/venvs/edxapp/lib/python3.8/importlib/__init__.py\", line 127, in import_module", "    return _bootstrap._gcd_import(name[level:], package, level)", "  File \"<frozen importlib._bootstrap>\", line 1014, in _gcd_import", "  File \"<frozen importlib._bootstrap>\", line 991, in _find_and_load", "  File \"<frozen importlib._bootstrap>\", line 961, in _find_and_load_unlocked", "  File \"<frozen importlib._bootstrap>\", line 219, in _call_with_frames_removed", "  File \"<frozen importlib._bootstrap>\", line 1014, in _gcd_import", "  File \"<frozen importlib._bootstrap>\", line 991, in _find_and_load", "  File \"<frozen importlib._bootstrap>\", line 975, in _find_and_load_unlocked", "  File \"<frozen importlib._bootstrap>\", line 671, in _load_unlocked", "  File \"<frozen importlib._bootstrap_external>\", line 783, in exec_module", "  File \"<frozen importlib._bootstrap>\", line 219, in _call_with_frames_removed", "  File \"/edx/app/edxapp/edx-platform/openedx/core/djangoapps/coursegraph/apps.py\", line 11, in <module>", "    class CoursegraphConfig(AppConfig):", "  File \"/edx/app/edxapp/edx-platform/openedx/core/djangoapps/coursegraph/apps.py\", line 17, in CoursegraphConfig", "    from openedx.core.djangoapps.coursegraph import tasks", "  File \"/edx/app/edxapp/edx-platform/openedx/core/djangoapps/coursegraph/tasks.py\", line 250, in <module>", "    @set_code_owner_attribute", "NameError: name 'set_code_owner_attribute' is not defined"], "stdout": "", "stdout_lines": []}
failed: [localhost] (item=cms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["/edx/bin/edxapp-migrate-cms"], "delta": "0:00:02.860943", "end": "2021-05-20 07:18:42.378986", "item": "cms", "msg": "non-zero return code", "rc": 1, "start": "2021-05-20 07:18:39.518043", "stderr": "2021-05-20 07:18:41,069 WARNING 44527 [py.warnings] [user None] [ip None] warnings.py:109 - /edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/newrelic/console.py:84: DeprecationWarning: `formatargspec` is deprecated since Python 3.5. Use `signature` and the `Signature` object directly\n  prototype = wrapper.__name__[3:] + ' ' + inspect.formatargspec(\n\nTraceback (most recent call last):\n  File \"manage.py\", line 120, in <module>\n    startup.run()\n  File \"/edx/app/edxapp/edx-platform/cms/startup.py\", line 20, in run\n    django.setup()\n  File \"/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/__init__.py\", line 24, in setup\n    apps.populate(settings.INSTALLED_APPS)\n  File \"/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/apps/registry.py\", line 91, in populate\n    app_config = AppConfig.create(entry)\n  File \"/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/apps/config.py\", line 90, in create\n    module = import_module(entry)\n  File \"/edx/app/edxapp/venvs/edxapp/lib/python3.8/importlib/__init__.py\", line 127, in import_module\n    return _bootstrap._gcd_import(name[level:], package, level)\n  File \"<frozen importlib._bootstrap>\", line 1014, in _gcd_import\n  File \"<frozen importlib._bootstrap>\", line 991, in _find_and_load\n  File \"<frozen importlib._bootstrap>\", line 961, in _find_and_load_unlocked\n  File \"<frozen importlib._bootstrap>\", line 219, in _call_with_frames_removed\n  File \"<frozen importlib._bootstrap>\", line 1014, in _gcd_import\n  File \"<frozen importlib._bootstrap>\", line 991, in _find_and_load\n  File \"<frozen importlib._bootstrap>\", line 975, in _find_and_load_unlocked\n  File \"<frozen importlib._bootstrap>\", line 671, in _load_unlocked\n  File \"<frozen importlib._bootstrap_external>\", line 783, in exec_module\n  File \"<frozen importlib._bootstrap>\", line 219, in _call_with_frames_removed\n  File \"/edx/app/edxapp/edx-platform/openedx/core/djangoapps/coursegraph/apps.py\", line 11, in <module>\n    class CoursegraphConfig(AppConfig):\n  File \"/edx/app/edxapp/edx-platform/openedx/core/djangoapps/coursegraph/apps.py\", line 17, in CoursegraphConfig\n    from openedx.core.djangoapps.coursegraph import tasks\n  File \"/edx/app/edxapp/edx-platform/openedx/core/djangoapps/coursegraph/tasks.py\", line 250, in <module>\n    @set_code_owner_attribute\nNameError: name 'set_code_owner_attribute' is not defined", "stderr_lines": ["2021-05-20 07:18:41,069 WARNING 44527 [py.warnings] [user None] [ip None] warnings.py:109 - /edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/newrelic/console.py:84: DeprecationWarning: `formatargspec` is deprecated since Python 3.5. Use `signature` and the `Signature` object directly", "  prototype = wrapper.__name__[3:] + ' ' + inspect.formatargspec(", "", "Traceback (most recent call last):", "  File \"manage.py\", line 120, in <module>", "    startup.run()", "  File \"/edx/app/edxapp/edx-platform/cms/startup.py\", line 20, in run", "    django.setup()", "  File \"/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/__init__.py\", line 24, in setup", "    apps.populate(settings.INSTALLED_APPS)", "  File \"/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/apps/registry.py\", line 91, in populate", "    app_config = AppConfig.create(entry)", "  File \"/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/apps/config.py\", line 90, in create", "    module = import_module(entry)", "  File \"/edx/app/edxapp/venvs/edxapp/lib/python3.8/importlib/__init__.py\", line 127, in import_module", "    return _bootstrap._gcd_import(name[level:], package, level)", "  File \"<frozen importlib._bootstrap>\", line 1014, in _gcd_import", "  File \"<frozen importlib._bootstrap>\", line 991, in _find_and_load", "  File \"<frozen importlib._bootstrap>\", line 961, in _find_and_load_unlocked", "  File \"<frozen importlib._bootstrap>\", line 219, in _call_with_frames_removed", "  File \"<frozen importlib._bootstrap>\", line 1014, in _gcd_import", "  File \"<frozen importlib._bootstrap>\", line 991, in _find_and_load", "  File \"<frozen importlib._bootstrap>\", line 975, in _find_and_load_unlocked", "  File \"<frozen importlib._bootstrap>\", line 671, in _load_unlocked", "  File \"<frozen importlib._bootstrap_external>\", line 783, in exec_module", "  File \"<frozen importlib._bootstrap>\", line 219, in _call_with_frames_removed", "  File \"/edx/app/edxapp/edx-platform/openedx/core/djangoapps/coursegraph/apps.py\", line 11, in <module>", "    class CoursegraphConfig(AppConfig):", "  File \"/edx/app/edxapp/edx-platform/openedx/core/djangoapps/coursegraph/apps.py\", line 17, in CoursegraphConfig", "    from openedx.core.djangoapps.coursegraph import tasks", "  File \"/edx/app/edxapp/edx-platform/openedx/core/djangoapps/coursegraph/tasks.py\", line 250, in <module>", "    @set_code_owner_attribute", "NameError: name 'set_code_owner_attribute' is not defined"], "stdout": "", "stdout_lines": []}

NO MORE HOSTS LEFT *************************************************************

PLAY RECAP *********************************************************************
localhost                  : ok=188  changed=127  unreachable=0    failed=1    skipped=309  rescued=0    ignored=3   

 
============================================================
Ansible failed!
------------------------------------------------------------
 
Decoded error:
== module_stderr ===========================
/root/.ansible/tmp/ansible-tmp-1621489513.8833401-25864-91040802929421/AnsiballZ_mongodb_rs_status:18: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
  import imp
Traceback (most recent call last):
  File "/root/.ansible/tmp/ansible-tmp-1621489513.8833401-25864-91040802929421/AnsiballZ_mongodb_rs_status", line 114, in <module>
    _ansiballz_main()
  File "/root/.ansible/tmp/ansible-tmp-1621489513.8833401-25864-91040802929421/AnsiballZ_mongodb_rs_status", line 106, in _ansiballz_main
    invoke_module(zipped_mod, temp_path, ANSIBALLZ_PARAMS)
  File "/root/.ansible/tmp/ansible-tmp-1621489513.8833401-25864-91040802929421/AnsiballZ_mongodb_rs_status", line 49, in invoke_module
    imp.load_module('__main__', mod, module, MOD_DESC)
  File "/usr/lib/python3.8/imp.py", line 234, in load_module
    return load_source(name, filename, file)
  File "/usr/lib/python3.8/imp.py", line 169, in load_source
    module = _exec(spec, sys.modules[name])
  File "<frozen importlib._bootstrap>", line 604, in _exec
  File "<frozen importlib._bootstrap_external>", line 783, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/tmp/ansible_mongodb_rs_status_payload_kfawj4_q/__main__.py", line 133, in <module>
  File "/tmp/ansible_mongodb_rs_status_payload_kfawj4_q/__main__.py", line 115, in main
  File "/usr/local/lib/python3.8/dist-packages/pymongo/database.py", line 529, in command
    with client._socket_for_reads(read_preference) as (sock_info, slave_ok):
  File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__
    return next(self.gen)
  File "/usr/local/lib/python3.8/dist-packages/pymongo/mongo_client.py", line 982, in _socket_for_reads
    server = topology.select_server(read_preference)
  File "/usr/local/lib/python3.8/dist-packages/pymongo/topology.py", line 222, in select_server
    return random.choice(self.select_servers(selector,
  File "/usr/local/lib/python3.8/dist-packages/pymongo/topology.py", line 182, in select_servers
    server_descriptions = self._select_servers_loop(
  File "/usr/local/lib/python3.8/dist-packages/pymongo/topology.py", line 198, in _select_servers_loop
    raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: 127.0.0.1:27017: [Errno 111] Connection refused

== msg ===========================
MODULE FAILURE
See stdout/stderr for the exact error

nedbat · May 20, 2021, 2:07pm

Thanks, looks like we need a fix for a recent fix applied to Koa.master. It should be applied today.

taha_jamil · May 20, 2021, 3:56pm

Thanks for the reply, is there a way for me to know when the fix has been applied? Also, do I have to start from step 1 once the fix has been applied?

nedbat · May 20, 2021, 7:34pm

The fix is now on open-release/koa.master. You should be able to run the “native.sh” step again, but it might be easier to just start from the beginning again.

taha_jamil · May 21, 2021, 11:07am

It is now going beyond that point. However, the setup just ends with “Installation failed!” and no further explanation whatsoever. Here’s the complete log (see the end of it): https://pastebin.com/d1aTsbHV What should I do now? Also, in parallel, I am now going to start the process all over on another Virtual Machine as well.

taha_jamil · May 21, 2021, 1:05pm

Update:

I have found this in the log, it says “ERROR: Could not install packages due to an EnvironmentError: [Errno 28] No space left on device: ‘/tmp/pip-install-ueqxsbbj/django/django/contrib/humanize/locale/af/LC_MESSAGES’”. However, I have provided it a Virtual Hard Drive of 32GB; out of which it is using only 13GB at the moment.

Ansible failed!

Decoded error:
== cmd ===========================
[‘make’, ‘production-requirements’]
== msg ===========================
non-zero return code
== stderr ================ bower datatables#1.10.10 bower datatables#1.10.10 bower datatables#1.10.10 bower datatables#1.10.10 bower datatables#1.10.10 bower datatables#1.10.10 bower datatables#1.10.10 bower backbone-super#~1.0.4 bower backbone-validation#~0.11.5 bower svg4everybody#~1.0.0 bower svg4everybody#~1.0.0 bower svg4everybody#~1.0.0 bower svg4everybody#~1.0.0 bower requirejs-plugins#~1.0.3 bower requirejs-plugins#~1.0.3 bower fontawesome#~4.3.0 bower fontawesome#~4.3.0 bower bootstrapaccessibili bower backbone#>= 1.0.0 ERROR: Could not ===========
invalid-meta for:/tmp/ecommerce/bower/06669348abd69fdff10f03f7c7ff1571-36580-qmlTAp/bower.json
invalid-meta The “main” field cannot contain font, image, audio, or video files
invalid-meta The “main” field cannot contain font, image, audio, or video files
invalid-meta The “main” field cannot contain font, image, audio, or video files
invalid-meta The “main” field cannot contain font, image, audio, or video files
invalid-meta The “main” field cannot contain font, image, audio, or video files
invalid-meta The “main” field has to contain only 1 file per filetype; found multiple .png files: [“media/images/sort_asc.png”,“media/images/sort_asc_disabled.png”,“media/images/sort_both.png”,“media/images/sort_desc.png”,“media/images/sort_desc_disabled.png”]
mismatch Version declared in the json (1.0.2) is different than the resolved one (1.0.4)
mismatch Version declared in the json (0.11.3) is different than the resolved one (0.11.5)
invalid-meta for:/tmp/ecommerce/bower/fd830639b380c47ac7605691a84ed11a-36580-sc3zpK/bower.json
invalid-meta The “main” field cannot contain minified files
invalid-meta The “main” field cannot contain minified files
invalid-meta The “main” field has to contain only 1 file per filetype; found multiple .js files: [“svg4everybody.min.js”,“svg4everybody.ie8.min.js”]
invalid-meta for:/tmp/ecommerce/bower/ad74b92b76f0adeb7f6f6fe62454cb7c-36580-6CErUa/bower.json
invalid-meta The “main” field has to contain only 1 file per filetype; found multiple .js files: [“src/async.js”,“src/depend.js”,“src/font.js”,“src/goog.js”,“src/image.js”,“src/json.js”,“src/mdown.js”,“src/noext.js”,“src/propertyParser.js”,“lib/Markdown.Converter.js”,“lib/text.js”]
invalid-meta for:/tmp/ecommerce/bower/4121662a0e17705c5dce874c683e353b-36580-pz6P5Z/bower.json
invalid-meta The “main” field cannot contain globs (example: “*.js”)
typlugin#~1.0.4 mismatch Version declared in the json (1.0.6) is different than the resolved one (1.0.7)
retry Download of https://github.com/jashkenas/backbone/archive/1.4.0.tar.gz failed with EINCOMPLETE, trying with git…
install packages due to an EnvironmentError: [Errno 28] No space left on device: ‘/tmp/pip-install-ueqxsbbj/django/django/contrib/humanize/locale/af/LC_MESSAGES’

nedbat · May 21, 2021, 6:49pm

It definitely looks like you are out of space. I don’t know how that squares with your disk size and usage stats, but something is out of space.

taha_jamil · May 21, 2021, 8:47pm

I’ll try giving it 8GB of RAM instead of 4GB now. Lets see if that does anything.

taha_jamil · May 21, 2021, 10:40pm

Same error (ERROR: Could not install packages due to an EnvironmentError: [Errno 28] No space left on device), even with 8GB of RAM. Here’s the output of “df -h” (if of any use):

Filesystem Size Used Avail Use% Mounted on
udev 3.9G 0 3.9G 0% /dev
tmpfs 797M 1.1M 796M 1% /run
/dev/mapper/ubuntu–vg-ubuntu–lv 20G 19G 329M 99% /
tmpfs 3.9G 20K 3.9G 1% /dev/shm
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 3.9G 0 3.9G 0% /sys/fs/cgroup
/dev/sda2 976M 105M 804M 12% /boot
/dev/loop2 32M 32M 0 100% /snap/snapd/10707
/dev/loop0 56M 56M 0 100% /snap/core18/1944
/dev/loop1 70M 70M 0 100% /snap/lxd/19188
tmpfs 797M 0 797M 0% /run/user/1000
/dev/loop3 33M 33M 0 100% /snap/snapd/11841
/dev/loop4 56M 56M 0 100% /snap/core18/2066
/dev/loop5 68M 68M 0 100% /snap/lxd/20326

Any suggestions?

sambapete · May 21, 2021, 11:06pm

EnvironmentError: [Errno 28] No space left on device

This usually indicates you ran out of space on a device in this case a disk on your system.

You may need to resize your disk or clean it up to recover some disk space.

If this is a Native installation, the recommendations are according to
https://openedx.atlassian.net/wiki/spaces/OpenOPS/pages/1969455764/Koa%2BLilac%2BNative%2BOpen%2BedX%2Bplatform%2BUbuntu%2B20.04%2B64%2Bbit%2BInstallation

Minimum 25GB of free disk, 50GB recommended for production servers

Your Virtual Hard Drive of 32GB may be too small to complete the installation successfully. I hope this helps.

taha_jamil · May 22, 2021, 11:07am

Attempting installation with 64GB Virtual Hard Drive this time.

taha_jamil · May 22, 2021, 9:15pm

Installed successfully, thank you both. Apparently, low space on Virtual Hard Drive really was the problem here.

PLAY RECAP *********************************************************************
localhost : ok=710 changed=476 unreachable=0 failed=0 skipped=1465 rescued=0 ignored=5

Installation finished at 2021-05-22 21:04:03

Can you provide me with links to appropriate guides for next steps? (configuration/modification related) Also, how do I start it up?

system · August 20, 2021, 9:15pm

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Install native Open edX: edxapp raises django exception Site Operations Help	4	873	May 25, 2021
Installation Fails for Koa.master, Koa.1 and Koa.2 with "KeyError: 'PREVIEW_LMS_BASE'" Site Operations Help koa	4	931	February 11, 2021
Ansible failed while installing koa.master on virtual machine : (error cldr@data ) Site Operations Help koa	3	1051	September 12, 2021
No /edx/bin/python.edxapp in koa2a Site Operations Help	2	449	February 24, 2021
Lilac2 ansible failing during install Site Operators	0	512	January 17, 2022

Error while installing koa.master on Ubuntu 20.04 Server Virtual Machine

Ansible failed!

Related Topics