Hi, I recently install devstack and analytic pipeline ([https://edx.readthedocs.io/projects/edx-installing-configuring-and-running/en/latest/installation/install_analytics.html). After all containers were up and running, all hadoop-related containers suddenly exit with only warnings in logs. Since I’m not familiar with Hadoop, I don’t really know what is going on.
make namenode-logs -d:
No implicit rule found for ‘Makefile’.
Finished prerequisites of target file ‘Makefile’.
No need to remake target ‘Makefile’.
Updating goal targets…
Considering target file ‘namenode-logs’.
File ‘namenode-logs’ does not exist.
Looking for an implicit rule for ‘namenode-logs’.
Trying pattern rule with stem ‘namenode’.
Found an implicit rule for ‘namenode-logs’.
Finished prerequisites of target file ‘namenode-logs’.
Must remake target ‘namenode-logs’.
docker-compose -f docker-compose.yml -f docker-compose-analytics-pipeline.yml logs -f --tail=500 namenode
Putting child 0x56280ab43c50 (namenode-logs) PID 27833 on the chain.
Live child 0x56280ab43c50 (namenode-logs) PID 27833
Attaching to edx.devstack.analytics_pipeline.namenode
edx.devstack.analytics_pipeline.namenode | 20/03/13 07:16:48 WARN security.UserGroupInformation: No groups available for user hadoop
edx.devstack.analytics_pipeline.namenode | 20/03/13 07:16:48 WARN security.UserGroupInformation: No groups available for user hadoop
edx.devstack.analytics_pipeline.namenode | 20/03/13 07:16:48 WARN security.UserGroupInformation: No groups available for user hadoop
edx.devstack.analytics_pipeline.namenode | 20/03/13 07:16:48 WARN security.UserGroupInformation: No groups available for user hadoop
edx.devstack.analytics_pipeline.namenode | 20/03/13 07:16:48 INFO hdfs.StateChange: BLOCK* allocate blk_1073741990_1166{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-19eaf234-e9b5-4f60-b275-324ae7c6e913:NORMAL:172.29.0.25:50010|RBW]]} for /tmp/hadoop-yarn/staging/history/done_intermediate/hadoop/job_1584082613813_0003_conf.xml_tmp
edx.devstack.analytics_pipeline.namenode | 20/03/13 07:16:48 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 172.29.0.25:50010 is added to blk_1073741990_1166{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-19eaf234-e9b5-4f60-b275-324ae7c6e913:NORMAL:172.29.0.25:50010|RBW]]} size 0
edx.devstack.analytics_pipeline.namenode | 20/03/13 07:16:48 WARN security.UserGroupInformation: No groups available for user hadoop
edx.devstack.analytics_pipeline.namenode | 20/03/13 07:16:48 INFO hdfs.StateChange: DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/hadoop/job_1584082613813_0003_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1065717855_1
edx.devstack.analytics_pipeline.namenode | 20/03/13 07:16:48 WARN security.UserGroupInformation: No groups available for user hadoop
Reaping winning child 0x56280ab43c50 PID 27833