Provision.run error while running please help

rohan@rohan-VirtualBox:~/devstack$ sudo make dev.provision.run
DOCKER_COMPOSE_FILES="-f docker-compose.yml -f docker-compose-host.yml" ./provision.sh

  • RED=’\033[0;31m’
  • GREEN=’\033[0;32m’
  • YELLOW=’\033[0;33m’
  • NC=’\033[0m’
  • docker-compose up -d mysql mongo
    edx.devstack.mysql is up-to-date
    edx.devstack.mongo is up-to-date
  • echo ‘Waiting for MySQL’
    Waiting for MySQL
  • docker exec -i edx.devstack.mysql mysql -uroot -se ‘SELECT EXISTS(SELECT 1 FROM mysql.user WHERE user = ‘’‘root’’’)’
  • sleep 20
  • echo -e ‘MySQL ready’
    MySQL ready
  • echo -e ‘\033[0;32mCreating databases and users…\033[0m’
    Creating databases and users…
  • docker exec -i edx.devstack.mysql mysql -uroot mysql
  • docker exec -i edx.devstack.mongo mongo
    MongoDB shell version: 3.2.16
    connecting to: test
    connection to 127.0.0.1
    [
    {
    “user” : “admin”,
    “pwd” : “password”,
    “roles” : [
    “root”
    ],
    “database” : “admin”
    },
    {
    “user” : “cs_comments_service”,
    “pwd” : “password”,
    “roles” : [
    “readWrite”
    ],
    “database” : “cs_comments_service”
    },
    {
    “user” : “edxapp”,
    “pwd” : “password”,
    “roles” : [
    “readWrite”
    ],
    “database” : “edxapp”
    }
    ]
    bye
  • ./provision-lms.sh
    ++ apps=(lms studio)
    ++ ./load-db.sh edxapp
    Loading the edxapp database…
    Finished loading the edxapp database!
    ++ ./load-db.sh edxapp_csmh
    Loading the edxapp_csmh database…
    Finished loading the edxapp_csmh database!
    ++ for app in “{apps[@]}" ++ docker-compose -f docker-compose.yml -f docker-compose-host.yml up -d lms edx.devstack.mysql is up-to-date edx.devstack.mongo is up-to-date edx.devstack.devpi is up-to-date edx.devstack.memcached is up-to-date edx.devstack.lms is up-to-date ++ for app in "{apps[@]}”
    ++ docker-compose -f docker-compose.yml -f docker-compose-host.yml up -d studio
    edx.devstack.memcached is up-to-date
    edx.devstack.mongo is up-to-date
    edx.devstack.devpi is up-to-date
    edx.devstack.mysql is up-to-date
    edx.devstack.studio is up-to-date
    ++ docker-compose exec lms bash -c ‘source /edx/app/edxapp/edxapp_env && cd /edx/app/edxapp/edx-platform && NO_PYTHON_UNINSTALL=1 paver install_prereqs’
    —> pavelib.prereqs.install_prereqs
    —> pavelib.prereqs.install_node_prereqs
    Node prereqs unchanged, skipping…
    —> pavelib.prereqs.install_python_prereqs
    —> pavelib.prereqs.uninstall_python_packages
    NO_PYTHON_UNINSTALL is set. No attempts will be made to uninstall old Python libs.
    Python prereqs unchanged, skipping…
    pip freeze > /edx/app/edxapp/edx-platform/test_root/log/pip_freeze.log


++ docker-compose restart lms
Restarting edx.devstack.lms … done
++ docker-compose exec lms bash -c ‘source /edx/app/edxapp/edxapp_env && cd /edx/app/edxapp/edx-platform && paver update_db --settings devstack_docker’
—> pavelib.servers.update_db
—> pavelib.prereqs.install_prereqs
—> pavelib.prereqs.install_node_prereqs
Node prereqs unchanged, skipping…
—> pavelib.prereqs.install_python_prereqs
—> pavelib.prereqs.uninstall_python_packages
NO_PYTHON_UNINSTALL is set. No attempts will be made to uninstall old Python libs.
Python prereqs unchanged, skipping…
pip freeze > /edx/app/edxapp/edx-platform/test_root/log/pip_freeze.log



NO_EDXAPP_SUDO=1 EDX_PLATFORM_SETTINGS_OVERRIDE=devstack_docker /edx/bin/edxapp-migrate-lms --traceback --pythonpath=.
2021-03-03 11:43:00,638 WARNING 68 [py.warnings] [user None] [ip None] warnings.py:109 - /edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/newrelic/console.py:84: DeprecationWarning: formatargspec is deprecated since Python 3.5. Use signature and the Signature object directly
prototype = wrapper.name[3:] + ’ ’ + inspect.formatargspec(

2021-03-03 11:43:00,955 WARNING 68 [py.warnings] [user None] [ip None] warnings.py:109 - /edx/app/edxapp/edx-platform/lms/djangoapps/course_wiki/plugins/markdownedx/wiki_plugin.py:7: DeprecationWarning: ‘etree’ is deprecated. Use ‘xml.etree.ElementTree’ instead.
from lms.djangoapps.course_wiki.plugins.markdownedx import mdx_mathjax, mdx_video

2021-03-03 11:43:07,841 WARNING 68 [py.warnings] [user None] [ip None] warnings.py:109 - /edx/app/edxapp/venvs/edxapp/src/django-wiki/wiki/plugins/links/wiki_plugin.py:9: DeprecationWarning: ‘etree’ is deprecated. Use ‘xml.etree.ElementTree’ instead.
from wiki.plugins.links.mdx.djangowikilinks import WikiPathExtension

Traceback (most recent call last):
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/db/backends/base/base.py”, line 217, in ensure_connection
self.connect()
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/db/backends/base/base.py”, line 195, in connect
self.connection = self.get_new_connection(conn_params)
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/db/backends/mysql/base.py”, line 227, in get_new_connection
return Database.connect(**conn_params)
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/MySQLdb/init.py”, line 130, in Connect
return Connection(*args, **kwargs)
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/MySQLdb/connections.py”, line 185, in init
super().init(*args, **kwargs2)
MySQLdb._exceptions.OperationalError: (2005, “Unknown MySQL server host ‘edx.devstack.mysql57’ (22)”)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File “manage.py”, line 123, in
execute_from_command_line([sys.argv[0]] + django_args)
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/core/management/init.py”, line 381, in execute_from_command_line
utility.execute()
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/core/management/init.py”, line 375, in execute
self.fetch_command(subcommand).run_from_argv(self.argv)
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/core/management/base.py”, line 323, in run_from_argv
self.execute(*args, **cmd_options)
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/core/management/base.py”, line 361, in execute
self.check()
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/core/management/base.py”, line 387, in check
all_issues = self._run_checks(
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/core/management/commands/migrate.py”, line 64, in _run_checks
issues = run_checks(tags=[Tags.database])
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/core/checks/registry.py”, line 72, in run_checks
new_errors = check(app_configs=app_configs)
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/core/checks/database.py”, line 10, in check_database_backends
issues.extend(conn.validation.check(**kwargs))
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/db/backends/mysql/validation.py”, line 9, in check
issues.extend(self._check_sql_mode(**kwargs))
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/db/backends/mysql/validation.py”, line 13, in _check_sql_mode
with self.connection.cursor() as cursor:
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/db/backends/base/base.py”, line 256, in cursor
return self._cursor()
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/db/backends/base/base.py”, line 233, in _cursor
self.ensure_connection()
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/db/backends/base/base.py”, line 217, in ensure_connection
self.connect()
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/db/utils.py”, line 89, in exit
raise dj_exc_value.with_traceback(traceback) from exc_value
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/db/backends/base/base.py”, line 217, in ensure_connection
self.connect()
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/db/backends/base/base.py”, line 195, in connect
self.connection = self.get_new_connection(conn_params)
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/db/backends/mysql/base.py”, line 227, in get_new_connection
return Database.connect(**conn_params)
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/MySQLdb/init.py”, line 130, in Connect
return Connection(*args, **kwargs)
File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/MySQLdb/connections.py”, line 185, in init
super().init(*args, **kwargs2)
django.db.utils.OperationalError: (2005, “Unknown MySQL server host ‘edx.devstack.mysql57’ (22)”)

Captured Task Output:

—> pavelib.servers.update_db
—> pavelib.prereqs.install_prereqs
—> pavelib.prereqs.install_node_prereqs
—> pavelib.prereqs.install_python_prereqs
—> pavelib.prereqs.uninstall_python_packages
pip freeze > /edx/app/edxapp/edx-platform/test_root/log/pip_freeze.log
NO_EDXAPP_SUDO=1 EDX_PLATFORM_SETTINGS_OVERRIDE=devstack_docker /edx/bin/edxapp-migrate-lms --traceback --pythonpath=.

Build failed running pavelib.servers.update_db: Subprocess return code: 1
Makefile:44: recipe for target ‘dev.provision.run’ failed
make: *** [dev.provision.run] Error 1
@nedbat

Hey @Rohan_Singh did you have a previous installation running on the same machine? Also, can you do a docker ps and see if all the containers are running on your machine?

1 Like

Hi @Rohan_Singh, can you also tell us which version of the devstack and OpenEdx are you trying to install?

It is always a good idea to give us as many details as you can. Here are some tips:

1 Like

resolved thank u for replying buddy

Kindly share how did you resolve this error, as I am facing same error…!!
Thanks

Hi,
I am facing the same issue.
I checked out juniper.master branch followed by steps of
created virtual env
set OPENEDX_RELEASE=juniper.master
make dev.checkout
make requirements
make dev.clone
make dev.pull
make dev.provision

During the dev.provision step, it gives the following error.

File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/db/backends/base/base.py”, line 217, in ensure_connection
edx.devstack.lms | self.connect()
edx.devstack.lms | File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/db/backends/base/base.py”, line 195, in connect
edx.devstack.lms | self.connection = self.get_new_connection(conn_params)
edx.devstack.lms | File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/django/db/backends/mysql/base.py”, line 227, in get_new_connection
edx.devstack.lms | return Database.connect(**conn_params)
edx.devstack.lms | File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/MySQLdb/init.py”, line 130, in Connect
edx.devstack.lms | return Connection(*args, **kwargs)
edx.devstack.lms | File “/edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages/MySQLdb/connections.py”, line 185, in init
edx.devstack.lms | super().init(*args, **kwargs2)
edx.devstack.lms | MySQLdb._exceptions.OperationalError: (2005, “Unknown MySQL server host ‘edx.devstack.mysql57’ (22)”

Any help would be greatly appreciated.

Regards
Ravi

If you manage to solve this issue, can you share the solution with me.

I solved same issue locally.

TLDR Check that the container mysql57 is running.

  1. I found that host edx.devstack.mysql57 not started, and I add mysql57 to depends_on in docker-compose.yml for studio and lms services.
  lms:
    command: bash -c 'smth cmd'
    container_name: "edx.${COMPOSE_PROJECT_NAME:-devstack}.lms"
    hostname: lms.devstack.edx
    depends_on:
      - devpi
      - mysql
      - memcached
      - mongo
      - discovery
      - forum
      - firefox
      - chrome
      - mysql57

Now it starts mysql57 every time studio and lms starts.

Also i publish mysql57 port

ports:
      - "0.0.0.0:3306:3306"

2.This step may not be necessary, but in my case sql fixtures were not applied. Connecting to the mysql by root user and empty password, i created user edxapp001 with pswd password, databases edxapp and edxapp_csmh manually and grant privileges for edxapp001.

Something like that:

CREATE USER 'edxapp001' IDENTIFIED BY 'password';
CREATE DATABASE 'edxapp' COLLATE 'utf8_general_ci' CHARACTER SET 'utf8';
CREATE DATABASE 'edxapp_csmh' COLLATE utf8_general_ci CHARACTER SET 'utf8';
GRANT ALL PRIVILEGES ON *.* TO 'edxapp001'@'%';
FLUSH PRIVILEGES;

I solve other same errors in the same way.

P.S. Although the correct way is to read the documentation, understand the code, and only then do something, but it completely kills the magic.

could you mention the solution please