HELP: Proper way to run ImportEnrollmentsIntoMysql task in Insights

[jramnai (JayRam Nai)]

Hi @chintan ,

First Run

remote-task --host localhost --user ubuntu --remote-name analyticstack --skip-setup --wait CourseEnrollmentEventsTask --local-scheduler --interval 2019-05-20-2019-05-25 --n-reduce-tasks 8 --verbose

remote-task --host localhost --user ubuntu --remote-name analyticstack --skip-setup --wait ImportEnrollmentsIntoMysql --local-scheduler --interval 2019-05-20-2019-05-25 --overwrite-n-days 7 --n-reduce-tasks 8 --verbose

Result of this was accurate and data was accumulated in Enrollments.

Second Run

remote-task --host localhost --user ubuntu --remote-name analyticstack --skip-setup --wait CourseEnrollmentEventsTask --local-scheduler --interval 2019-05-25-2019-05-26 --n-reduce-tasks 8 --verbose

remote-task --host localhost --user ubuntu --remote-name analyticstack --skip-setup --wait ImportEnrollmentsIntoMysql --local-scheduler --interval 2019-05-25-2019-05-26 --overwrite-n-days 3 --n-reduce-tasks 8 --verbose

And got inaccurate data and duplication, too.

So, I have repeated First Run and changed Second Run like below:

remote-task --host localhost --user ubuntu --remote-name analyticstack --skip-setup --wait CourseEnrollmentEventsTask --local-scheduler --interval 2019-05-25-2019-05-26 --n-reduce-tasks 8 --verbose

remote-task --host localhost --user ubuntu --remote-name analyticstack --skip-setup --wait ImportEnrollmentsIntoMysql --local-scheduler --interval 2019-05-20-2019-05-26 --overwrite-n-days 8 --n-reduce-tasks 8 --verbose

In above I have provided data of 25-05-2019 & 26-05-2019 to hadoop and deleted previous files in data directory.

But no luck.

Please check attached screenshots for reference:
First Run:

Second Run: