Cpu usage on tutor instance

Site Operators Tutor Help
1

Hi

I have deployed maple release on Aws instance with specs

32 GB RAM, 8 vCPUs, 640 GB SSD

$ tutor config printvalue OPENEDX_COMMON_VERSION
open-release/maple.3

there is no traffic however docker containers are reporting high cpu

CONTAINER ID   NAME                          CPU %     MEM USAGE / LIMIT     MEM %     NET I/O           BLOCK I/O         PIDS
f1e4c4129eb9   tutor_local_lms-worker_1      90.05%    1.196GiB / 3.906GiB   30.63%    8.27MB / 3.87MB   0B / 0B           21
0ae43522371d   tutor_local_mfe_1             0.00%     11.23MiB / 31.36GiB   0.03%     117kB / 13.5MB    12.3kB / 4.1kB    11
11d20f96cd8a   tutor_local_discovery_1       0.00%     149.6MiB / 31.36GiB   0.47%     44kB / 382kB      102kB / 0B        4
660275583e30   tutor_local_cms-worker_1      994.24%   1.434GiB / 31.36GiB   4.57%     753MB / 21.5MB    0B / 0B           57
8d6479d905f4   tutor_local_cms_1             0.00%     363.9MiB / 31.36GiB   1.13%     13.6kB / 14.3kB   0B / 0B           7
14571097ffb0   tutor_local_lms_1             29.43%    1.932GiB / 31.36GiB   6.16%     120MB / 77.1MB    0B / 0B           18
b56ba5f118dc   tutor_local_notes_1           0.02%     111.3MiB / 31.36GiB   0.35%     8.3kB / 4.01kB    0B / 0B           4
57dfbae7acf0   tutor_local_forum_1           0.01%     84.82MiB / 31.36GiB   0.26%     15.7kB / 9.98kB   0B / 4.1kB        13
97ba8b7567b8   tutor_local_mongodb_1         15.63%    121.5MiB / 31.36GiB   0.38%     12.5MB / 51.6MB   0B / 2.79MB       93
71b14208ddd2   tutor_local_elasticsearch_1   0.90%     1.435GiB / 31.36GiB   4.57%     90.1kB / 40kB     4.1kB / 2.32MB    92
69639dd0a060   tutor_local_redis_1           3.15%     507.9MiB / 31.36GiB   1.58%     6.86MB / 727MB    0B / 468MB        6
41a1b53d84fd   tutor_local_caddy_1           0.45%     20.86MiB / 31.36GiB   0.06%     70.2MB / 70.6MB   0B / 4.1kB        13
9adb1558746d   tutor_local_mysql_1           16.56%    366.2MiB / 31.36GiB   1.14%     29.3MB / 101MB    81.9kB / 92.2MB   44

Workers are set to

tutor config save \
  --set OPENEDX_LMS_UWSGI_WORKERS=10 \
  --set OPENEDX_CMS_UWSGI_WORKERS=10


#atop
 82880       - R  59% /openedx/venv/bin/python /openedx/venv/bin/celery worker --app=cms.celery --loglevel=info --hostname=edx.cms.core.default.%%h --maxtasksperchild 100 --exclude-queues=edx.lms.core.default
  82885       - R  55% /openedx/venv/bin/python /openedx/venv/bin/celery worker --app=cms.celery --loglevel=info --hostname=edx.cms.core.default.%%h --maxtasksperchild 100 --exclude-queues=edx.lms.core.default
  82872       - R  54% /openedx/venv/bin/python /openedx/venv/bin/celery worker --app=cms.celery --loglevel=info --hostname=edx.cms.core.default.%%h --maxtasksperchild 100 --exclude-queues=edx.lms.core.default
  82893       - R  52% /openedx/venv/bin/python /openedx/venv/bin/celery worker --app=cms.celery --loglevel=info --hostname=edx.cms.core.default.%%h --maxtasksperchild 100 --exclude-queues=edx.lms.core.default
  82851       - S  52% uwsgi --static-map /static=/openedx/staticfiles/ --static-map /media=/openedx/media/ --http 0.0.0.0:8000 --thunder-lock --single-interpreter --enable-threads --processes=10 --buffer-size=
  828

From login to course loading taking more than 1 minutes sometimes when only dozen user are online.

Any help or pointer please.

Regards
Zia

2

Upgraded to latest tutor release however still the performance is below average.

cms worker is working hard with very little traffic.

7e445fe4426a   tutor_local_cms-worker_1      1573.47%   1.651GiB / 31.36GiB   5.26%     8.64GB / 
203MB    0B / 532kB        57

tutor config printvalue OPENEDX_COMMON_VERSION
open-release/nutmeg.1


CONTAINER ID   NAME                          CPU %      MEM USAGE / LIMIT     MEM %     NET I/O           BLOCK I/O         PIDS
9adb1558746d   tutor_local_mysql_1           0.18%      455MiB / 31.36GiB     1.42%     107MB / 371MB     4.64MB / 775MB    42
41a1b53d84fd   tutor_local_caddy_1           0.00%      19.62MiB / 31.36GiB   0.06%     203MB / 209MB     9.72MB / 53.2kB   14
78dfc1d650c9   tutor_local_mfe_1             0.00%      11.17MiB / 31.36GiB   0.03%     776kB / 74.1MB    127kB / 4.1kB     12
ae01b2592115   tutor_local_elasticsearch_1   5.45%      1.68GiB / 31.36GiB    5.36%     51.5MB / 17.5MB   18.7MB / 50.7MB   112
76bf507bdf35   tutor_local_redis_1           6.15%      510.4MiB / 31.36GiB   1.59%     124MB / 8.49GB    1.08MB / 4.57GB   6
f1d0fc994557   tutor_local_mongodb_1         11.45%     132.2MiB / 31.36GiB   0.41%     28MB / 87.2MB     745kB / 17.3MB    100
7aa8ee44c3fe   tutor_local_notes_1           0.04%      118.3MiB / 31.36GiB   0.37%     6.13kB / 0B       0B / 0B           4
08c01cf47b87   tutor_local_forum_1           0.03%      209MiB / 31.36GiB     0.65%     125kB / 77.7kB    19.2MB / 0B       13
2897ed60ece3   tutor_local_lms-worker_1      5.35%      1.554GiB / 31.36GiB   4.95%     74.8MB / 34.5MB   8.19kB / 524kB    57
1698391c8514   tutor_local_discovery_1       0.00%      180.6MiB / 31.36GiB   0.56%     140kB / 475kB     254kB / 0B        4

7e445fe4426a   tutor_local_cms-worker_1      1573.47%   1.651GiB / 31.36GiB   5.26%     8.64GB / 
203MB    0B / 532kB        57

9f2f7d6b8a43   tutor_local_cms_1             134.03%    249.8MiB / 31.36GiB   0.78%     968B / 0B         0B / 0B           7
d58cc22739df   tutor_local_lms_1             502.06%    331.3MiB / 31.36GiB   1.03%     19kB / 8.6kB      0B / 0B           17

..atop top CPU usage

105569       - R  74% /openedx/venv/bin/python /openedx/venv/bin/celery --app=cms.celery worker --loglevel=info --hostname=edx.cms.core.default.%%h --max-tasks-
 105573       - R  73% /openedx/venv/bin/python /openedx/venv/bin/celery --app=cms.celery worker --loglevel=info --hostname=edx.cms.core.default.%%h --max-tasks-
 105564       - R  72% /openedx/venv/bin/python /openedx/venv/bin/celery --app=cms.celery worker --loglevel=info --hostname=edx.cms.core.default.%%h --max-tasks-
 105575       - R  70% /openedx/venv/bin/python /openedx/venv/bin/celery --app=cms.celery worker --loglevel=info --hostname=edx.cms.core.default.%%h --max-tasks-
 105558       - R  68% /openedx/venv/bin/python /openedx/venv/bin/celery --app=cms.celery worker --loglevel=info --hostname=edx.cms.core.default.%%h --max-tasks-
 105578       - R  68% /openedx/venv/bin/python /openedx/venv/bin/celery --app=cms.celery worker --loglevel=info --hostname=edx.cms.core.default.%%h --max-tasks-
 105579       - R  62% /openedx/venv/bin/python /openedx/venv/bin/celery --app=cms.celery worker --loglevel=info --hostname=edx.cms.core.default.%%h --max-tasks-


tutor config printvalue OPENEDX_COMMON_VERSION
open-release/nutmeg.1

Regards
Zia

3

I deployed mysql database to another server, since then there in no issue with high cpu usage.
So upgrading to latest tutor release together with mysql db move helped in resolving this issue.

Thanks!