Analytics pipeline: Failed to run task AnswerDistributionWorkflow

There are 2 different tracking directories

  1. One for hdfs://localhost:9000/data/logs/tracking/, it will be located at hdfs dfs -ls /data/logs/tracking
  2. One for user hadoop that located at /user/hadoop/data/logs/tracking by executing command hdfs dfs -ls data/logs/tracking

The first one is accurate. So cronjob was correct, and I need to create the directory as option 1.