Failed to run make dev.provision

Hi guys, so I’m a newbie at edx and only know about frontend. Anyway, I tried to run the edx devstack on master branch. I use MacOS and have python3, docker desktop installed, I followed the steps and successfully ran make requirements, make dev.clone.https, make dev.pull.large-and-slow. However, at the step make dev.provision, it threw an error and with my limited knowledge, I can’t quite figured out how to resolve it. Here’s the image of the error. Please tell me what i need to provide for you guys to be able to help me. Thank you in advance.

Hi @Chien_Dao , just a suggestion - in future please copy/paste the relevant error as text into the forum post, instead of a linked screenshot. That will make it easier for those helping to read and copy text from the log output. :slight_smile:

Ah my bad, at the time i made this thread, i didn’t have my mac with me and only have the picture of the error. The output log from when i ran make dev.provision is too big so i’ll just post the ending part of it. Please tell me if i need to post the other part too.

PLAY RECAP *********************************************************************

127.0.0.1 : ok=33 changed=2 unreachable=0 failed=0 skipped=100 rescued=0 ignored=0

++ docker-compose exec -T lms bash -c 'rm /edx/app/edxapp/edx-platform/.prereqs_cache/Node_prereqs.sha1'

++ for app in '"${apps[@]}"'

++ docker-compose exec -T lms bash -c 'source /edx/app/edxapp/edxapp_env && cd /edx/app/edxapp/edx-platform && paver update_assets --settings devstack_docker'

---> pavelib.assets.update_assets

---> pavelib.prereqs.install_node_prereqs

audited 1863 packages in 15.037s

45 packages are looking for funding

run `npm fund` for details

found 2962 vulnerabilities (1338 low, 78 moderate, 1541 high, 5 critical)

run `npm audit fix` to fix them, or `npm audit` for details

Successfully installed NPM packages. Log found at /edx/app/edxapp/edx-platform/test_root/log/npm-install.log

---> pavelib.assets.process_xmodule_assets

---> pavelib.prereqs.install_python_prereqs

---> pavelib.prereqs.uninstall_python_packages

NO_PYTHON_UNINSTALL is set. No attempts will be made to uninstall old Python libs.

Python prereqs unchanged, skipping...

xmodule_assets common/static/xmodule

Finished processing xmodule assets.

mkdir_p path('common/static/common/js/vendor')

mkdir_p path('common/static/common/css')

mkdir_p path('common/static/common/css/vendor')

Copying vendor files into static directory

/bin/cp -rf node_modules/backbone.paginator/lib/backbone.paginator.js common/static/common/js/vendor

/bin/cp -rf node_modules/backbone/backbone.js common/static/common/js/vendor

/bin/cp -rf node_modules/bootstrap/dist/js/bootstrap.bundle.js common/static/common/js/vendor

/bin/cp -rf node_modules/hls.js/dist/hls.js common/static/common/js/vendor

/bin/cp -rf node_modules/jquery-migrate/dist/jquery-migrate.js common/static/common/js/vendor

/bin/cp -rf node_modules/jquery.scrollto/jquery.scrollTo.js common/static/common/js/vendor

/bin/cp -rf node_modules/jquery/dist/jquery.js common/static/common/js/vendor

/bin/cp -rf node_modules/moment-timezone/builds/moment-timezone-with-data.js common/static/common/js/vendor

/bin/cp -rf node_modules/moment/min/moment-with-locales.js common/static/common/js/vendor

/bin/cp -rf node_modules/picturefill/dist/picturefill.js common/static/common/js/vendor

/bin/cp -rf node_modules/requirejs/require.js common/static/common/js/vendor

/bin/cp -rf node_modules/underscore.string/dist/underscore.string.js common/static/common/js/vendor

/bin/cp -rf node_modules/underscore/underscore.js common/static/common/js/vendor

Copying vendor library dir: node_modules/@edx/studio-frontend/dist/

/bin/cp -rf node_modules/@edx/studio-frontend/dist/assets.min.js common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/courseHealthCheck.min.js.map common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/courseOutlineHealthCheck.min.js common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/common.min.js common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/editImageModal.min.css common/static/common/css/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/courseOutlineHealthCheck.min.js.map common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/courseHealthCheck.min.js common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/courseHealthCheck.min.css common/static/common/css/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/runtime.min.js.map common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/editImageModal.min.js.map common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/assets.min.css common/static/common/css/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/i18nMessages.min.js.map common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/assets.min.js.map common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/accessibilityPolicy.min.css common/static/common/css/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/courseOutlineHealthCheck.min.css common/static/common/css/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/i18nMessages.min.js common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/runtime.min.js common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/accessibilityPolicy.min.js.map common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/common.min.js.map common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/common.min.css common/static/common/css/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/accessibilityPolicy.min.js common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/editImageModal.min.js common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/i18n/messages/fr.json common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/i18n/messages/zh_CN.json common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/i18n/messages/ar.json common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/i18n/messages/es_419.json common/static/common/js/vendor

/bin/cp -rf node_modules/which-country/index.js common/static/common/js/vendor

Copying developer vendor files into static directory

/bin/cp -rf node_modules/sinon/pkg/sinon.js common/static/common/js/vendor

/bin/cp -rf node_modules/squirejs/src/Squire.js common/static/common/js/vendor

---> pavelib.assets.webpack

python manage.py lms --settings=devstack_docker print_setting STATIC_ROOT WEBPACK_CONFIG_PATH 2>/edx/app/edxapp/edx-platform/test_root/log/print_settings.log

python manage.py cms --settings=devstack_docker print_setting STATIC_ROOT 2>/edx/app/edxapp/edx-platform/test_root/log/print_settings.log

python manage.py cms --settings=devstack_docker print_setting JS_ENV_EXTRA_CONFIG 2>/edx/app/edxapp/edx-platform/test_root/log/print_settings.log --json

NODE_ENV=development STATIC_ROOT_LMS=/edx/var/edxapp/staticfiles STATIC_ROOT_CMS=/edx/var/edxapp/staticfiles/studio JS_ENV_EXTRA_CONFIG="{}" $(npm bin)/webpack --config=webpack.dev.config.js

[BABEL] Note: The code generator has deoptimised the styling of "/edx/app/edxapp/edx-platform/node_modules/@edx/frontend-component-cookie-policy-banner/node_modules/@edx/paragon/themeable/index.js" as it exceeds the max of "500KB".

Killed

Captured Task Output:

---------------------

---> pavelib.assets.update_assets

---> pavelib.prereqs.install_node_prereqs

---> pavelib.assets.process_xmodule_assets

---> pavelib.prereqs.install_python_prereqs

---> pavelib.prereqs.uninstall_python_packages

xmodule_assets common/static/xmodule

mkdir_p path('common/static/common/js/vendor')

mkdir_p path('common/static/common/css')

mkdir_p path('common/static/common/css/vendor')

/bin/cp -rf node_modules/backbone.paginator/lib/backbone.paginator.js common/static/common/js/vendor

/bin/cp -rf node_modules/backbone/backbone.js common/static/common/js/vendor

/bin/cp -rf node_modules/bootstrap/dist/js/bootstrap.bundle.js common/static/common/js/vendor

/bin/cp -rf node_modules/hls.js/dist/hls.js common/static/common/js/vendor

/bin/cp -rf node_modules/jquery-migrate/dist/jquery-migrate.js common/static/common/js/vendor

/bin/cp -rf node_modules/jquery.scrollto/jquery.scrollTo.js common/static/common/js/vendor

/bin/cp -rf node_modules/jquery/dist/jquery.js common/static/common/js/vendor

/bin/cp -rf node_modules/moment-timezone/builds/moment-timezone-with-data.js common/static/common/js/vendor

/bin/cp -rf node_modules/moment/min/moment-with-locales.js common/static/common/js/vendor

/bin/cp -rf node_modules/picturefill/dist/picturefill.js common/static/common/js/vendor

/bin/cp -rf node_modules/requirejs/require.js common/static/common/js/vendor

/bin/cp -rf node_modules/underscore.string/dist/underscore.string.js common/static/common/js/vendor

/bin/cp -rf node_modules/underscore/underscore.js common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/assets.min.js common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/courseHealthCheck.min.js.map common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/courseOutlineHealthCheck.min.js common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/common.min.js common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/editImageModal.min.css common/static/common/css/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/courseOutlineHealthCheck.min.js.map common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/courseHealthCheck.min.js common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/courseHealthCheck.min.css common/static/common/css/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/runtime.min.js.map common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/editImageModal.min.js.map common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/assets.min.css common/static/common/css/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/i18nMessages.min.js.map common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/assets.min.js.map common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/accessibilityPolicy.min.css common/static/common/css/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/courseOutlineHealthCheck.min.css common/static/common/css/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/i18nMessages.min.js common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/runtime.min.js common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/accessibilityPolicy.min.js.map common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/common.min.js.map common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/common.min.css common/static/common/css/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/accessibilityPolicy.min.js common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/editImageModal.min.js common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/i18n/messages/fr.json common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/i18n/messages/zh_CN.json common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/i18n/messages/ar.json common/static/common/js/vendor

/bin/cp -rf node_modules/@edx/studio-frontend/dist/i18n/messages/es_419.json common/static/common/js/vendor

/bin/cp -rf node_modules/which-country/index.js common/static/common/js/vendor

/bin/cp -rf node_modules/sinon/pkg/sinon.js common/static/common/js/vendor

/bin/cp -rf node_modules/squirejs/src/Squire.js common/static/common/js/vendor

---> pavelib.assets.webpack

python manage.py lms --settings=devstack_docker print_setting STATIC_ROOT WEBPACK_CONFIG_PATH 2>/edx/app/edxapp/edx-platform/test_root/log/print_settings.log

python manage.py cms --settings=devstack_docker print_setting STATIC_ROOT 2>/edx/app/edxapp/edx-platform/test_root/log/print_settings.log

python manage.py cms --settings=devstack_docker print_setting JS_ENV_EXTRA_CONFIG 2>/edx/app/edxapp/edx-platform/test_root/log/print_settings.log --json

NODE_ENV=development STATIC_ROOT_LMS=/edx/var/edxapp/staticfiles STATIC_ROOT_CMS=/edx/var/edxapp/staticfiles/studio JS_ENV_EXTRA_CONFIG="{}" $(npm bin)/webpack --config=webpack.dev.config.js

Build failed running pavelib.assets.update_assets: Subprocess return code: 137

make: *** [dev.provision] Error 1

please, you can run this command directly on the lms, or cms docker container and paste the log here? NODE_ENV=development STATIC_ROOT_LMS=/edx/var/edxapp/staticfiles STATIC_ROOT_CMS=/edx/var/edxapp/staticfiles/studio JS_ENV_EXTRA_CONFIG="{}" $(npm bin)/webpack --config=webpack.dev.config.js

So i quit trying to make it run on mac and decided to install ubuntu LTS 20.04 on my windows machine. Unfortunately, still failed at this step, but it’s a different error this time.

 Provisioning e2e...
+ ./provision-e2e.sh
++ '[' -z '/...path to edx.../edx/devstack/..' ']'
++ '[' '!' -d '/...path to edx.../edx/devstack/..' ']'
+++ make --silent dev.print-container.studio
++ docker cp /...path to edx.../edx/devstack/../edx-e2e-tests/upload_files/course.tar.gz 9310b9c0582c678c43db5173e410084e5f713850b2a36756ff2452edc3d57942:/tmp/
"docker cp" requires exactly 2 arguments.
See 'docker cp --help'.

Usage:  docker cp [OPTIONS] CONTAINER:SRC_PATH DEST_PATH|-
	docker cp [OPTIONS] SRC_PATH|- CONTAINER:DEST_PATH

Copy files/folders between a container and the local filesystem
make: *** [Makefile:228: dev.provision] Error 1

Pretty frustrated, please tell me what else i need to provide. Thank you!!

The failing command contains a a call to make dev.print-container.studio which ends up doing docker-compose ps --quiet studio (it’s here in the Makefile).
But it looks like it should be docker-compose ps -q studio (@Chien_Dao, try changing --quiet to -q in the Makefile).

More details about why the error happened:

~/opencraft/devstack11docker_master/devstack$  docker-compose ps --quiet studio       
List containers.

Usage: ps [options] [SERVICE...]

Options:
    -q    Only display IDs

~/opencraft/devstack11docker_master/devstack$  docker-compose ps -q studio     
c056820fe66ca67328d295a936ad11762b5e70c3b9d20576b43049a40ccd2078

~/opencraft/devstack11docker_master/devstack$  docker-compose -v
docker-compose version 1.18.0, build 8dd22a9

You can consider opening a devstack PR to use -q instead of --quiet in the Makefile, since it seems that -q works in more docker-compose versions than `–quiet``.