Running analytics tasks always exits like that connection to localhost closed, exit code 255.How to overcome it.
@HsuMonKo Could you provide more details? It will make it more likely to get an answer to your question, as currently it’s hard to tell what this error is. Where do you see the error? After doing which actions? Which version of Open edX and Analytics are you using? What did you do to configure it, and to try to debug the issue?
openedx version = open-release/hawthorn.1
I’m trying to install analytics on my openedx according to this link https://openedx.atlassian.net/wiki/spaces/OpenOPS/pages/43385371/edX+Analytics+Installation.And I’m running the tasks from https://github.com/edx/edx-analytics-pipeline/blob/master/docs/source/running_tasks.rst and it always exit like the following.
remote-task --host localhost --user root --remote-name analyticstack --skip-setup --wait ModuleEngagementWorkflowTask --local-scheduler --date $(date +%Y-%m-%d -d “2019-12-03”) --indexing-tasks 5 --throttle 0.5 --n-reduce-tasks 1 --overwrite-n-days 90
Parsed arguments = Namespace(branch=‘release’, extra_repo=None, host=‘localhost’, job_flow_id=None, job_flow_name=None, launch_task_arguments=[‘ModuleEngagementWorkflowTask’, ‘–local-scheduler’, ‘–date’, ‘2019-12-03’, ‘–indexing-tasks’, ‘5’, ‘–throttle’, ‘0.5’, ‘–n-reduce-tasks’, ‘1’, ‘–overwrite-n-days’, ‘90’], log_path=None, override_config=None, package=None, private_key=None, python_version=None, remote_name=‘analyticstack’, repo=None, secure_config=None, secure_config_branch=None, secure_config_repo=None, shell=None, skip_setup=True, sudo_user=‘hadoop’, user=‘root’, vagrant_path=None, verbose=False, virtualenv_extra_args=None, wait=True, wheel_url=None, workflow_profiler=None)
Running commands from path = /root/pipeline/share/edx.analytics.tasks
Remote name = analyticstack
Running command = [‘ssh’, ‘-tt’, ‘-o’, ‘ForwardAgent=yes’, ‘-o’, ‘StrictHostKeyChecking=no’, ‘-o’, ‘UserKnownHostsFile=/dev/null’, ‘-o’, ‘KbdInteractiveAuthentication=no’, ‘-o’, ‘PasswordAuthentication=no’, ‘-o’, ‘User=root’, ‘-o’, ‘ConnectTimeout=10’, ‘localhost’, “sudo -Hu hadoop /bin/bash -c ‘cd /var/lib/analytics-tasks/analyticstack/repo && . $HOME/.bashrc && . /var/lib/analytics-tasks/analyticstack/venv/bin/activate && launch-task ModuleEngagementWorkflowTask --local-scheduler --date 2019-12-03 --indexing-tasks 5 --throttle 0.5 --n-reduce-tasks 1 --overwrite-n-days 90’”]
Warning: Permanently added ‘localhost’ (ECDSA) to the list of known hosts.
No handlers could be found for logger “luigi-interface”
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘sqoop-import = edx.analytics.tasks.common.sqoop:SqoopImportFromMysql’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘run-vertica-sql-script = edx.analytics.tasks.warehouse.run_vertica_sql_script:RunVerticaSqlScriptTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘obfuscation = edx.analytics.tasks.export.obfuscation:ObfuscatedCourseTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘enrollment_validation = edx.analytics.tasks.monitor.enrollment_validation:CourseEnrollmentValidationTask’)
INFO:luigi-interface:Loaded [’/etc/luigi/client.cfg’, ‘client.cfg’]
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘problem_response = edx.analytics.tasks.insights.problem_response:LatestProblemResponseDataTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘load-warehouse-bigquery = edx.analytics.tasks.warehouse.load_warehouse_bigquery:LoadWarehouseBigQueryTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘push_to_vertica_lms_courseware_link_clicked = edx.analytics.tasks.warehouse.lms_courseware_link_clicked:PushToVerticaLMSCoursewareLinkClickedTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘load-internal-active-users = edx.analytics.tasks.warehouse.load_internal_reporting_active_users:LoadInternalReportingActiveUsersToWarehouse’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘video = edx.analytics.tasks.insights.video:InsertToMysqlAllVideoTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘ed_services_report = edx.analytics.tasks.warehouse.financial.ed_services_financial_report:BuildEdServicesReportTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘load-internal-database = edx.analytics.tasks.warehouse.load_internal_reporting_database:ImportMysqlToVerticaTask’)
DEBUG:snowflake.connector.ssl_wrap_socket:Injecting ssl_wrap_socket_with_ocsp
DEBUG:snowflake.connector.auth:cache directory: /edx/app/hadoop/.cache/snowflake
DEBUG:snowflake.connector.cursor:Failed to import pyarrow. No Apache Arrow result set format can be used.
DEBUG:snowflake.connector.cursor:Failed to import ArrowResult. No Apache Arrow result set format can be used.
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘load-insights = edx.analytics.tasks.warehouse.load_warehouse_insights:LoadInsightsTableToVertica’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘export-student-module = edx.analytics.tasks.export.database_exports:StudentModulePerCourseAfterImportWorkflow’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘calendar = edx.analytics.tasks.insights.calendar_task:CalendarTableTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘snowflake-load = edx.analytics.tasks.common.snowflake_load:SnowflakeLoadTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘affiliate_window = edx.analytics.tasks.warehouse.financial.fees:LoadFeesToWarehouse’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘orders = edx.analytics.tasks.warehouse.financial.orders_import:OrderTableTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘cybersource = edx.analytics.tasks.warehouse.financial.cybersource:DailyPullFromCybersourceTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘load-d-user = edx.analytics.tasks.warehouse.load_internal_reporting_user:LoadInternalReportingUserToWarehouse’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘load-google-sheet-warehouse = edx.analytics.tasks.warehouse.load_google_sheet_to_warehouse:LoadGoogleSpreadsheetsToWarehouseWorkflow’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘location-per-course = edx.analytics.tasks.insights.location_per_course:LastCountryOfUser’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘payment_reconcile = edx.analytics.tasks.warehouse.financial.reconcile:ReconcileOrdersAndTransactionsTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘load-warehouse = edx.analytics.tasks.warehouse.load_warehouse:LoadWarehouseWorkflow’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘engagement = edx.analytics.tasks.insights.module_engagement:ModuleEngagementDataTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘events_obfuscation = edx.analytics.tasks.export.events_obfuscation:ObfuscateCourseEventsTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘dump-student-module = edx.analytics.tasks.export.database_exports:StudentModulePerCourseTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘export-events-by-course = edx.analytics.tasks.export.event_exports_by_course:EventExportByCourseTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘load-ga-permissions = edx.analytics.tasks.warehouse.load_ga_permissions:LoadGoogleAnalyticsPermissionsWorkflow’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘noop = edx.analytics.tasks.monitor.performance:ParseEventLogPerformanceTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘course_blocks = edx.analytics.tasks.insights.course_blocks:CourseBlocksApiDataTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘export-vertica-sqoop = edx.analytics.tasks.common.vertica_export:ExportVerticaTableToS3Task’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘load-events = edx.analytics.tasks.warehouse.load_internal_reporting_events:TrackingEventRecordDataTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘load-d-certificates = edx.analytics.tasks.warehouse.load_internal_reporting_certificates:LoadInternalReportingCertificatesToWarehouse’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘user-activity = edx.analytics.tasks.insights.user_activity:InsertToMysqlCourseActivityTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘tags-dist = edx.analytics.tasks.insights.tags_dist:TagsDistributionPerCourse’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘bigquery-load = edx.analytics.tasks.common.bigquery_load:BigQueryLoadTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘run-vertica-sql-scripts = edx.analytics.tasks.warehouse.run_vertica_sql_scripts:RunVerticaSqlScriptTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘load-vertica-schema-bigquery = edx.analytics.tasks.warehouse.load_vertica_schema_to_bigquery:LoadVerticaSchemaFromS3ToBigQueryTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘paypal = edx.analytics.tasks.warehouse.financial.paypal:PaypalTransactionsByDayTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘grade-dist = edx.analytics.tasks.data_api.studentmodule_dist:GradeDistFromSqoopToMySQLWorkflow’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘database-import = edx.analytics.tasks.insights.database_imports:ImportAllDatabaseTablesTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘load-course-catalog = edx.analytics.tasks.warehouse.load_internal_reporting_course_catalog:PullDiscoveryCoursesAPIData’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘enrollments = edx.analytics.tasks.insights.enrollments:ImportEnrollmentsIntoMysql’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘event-type-dist = edx.analytics.tasks.warehouse.event_type_dist:PushToVerticaEventTypeDistributionTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘load-internal-course-structure = edx.analytics.tasks.warehouse.load_internal_reporting_course_structure:LoadCourseBlockRecordToVertica’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘enterprise_enrollments = edx.analytics.tasks.enterprise.enterprise_enrollments:ImportEnterpriseEnrollmentsIntoMysql’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘export-events = edx.analytics.tasks.export.event_exports:EventExportTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘financial_reports = edx.analytics.tasks.warehouse.financial.finance_reports:BuildFinancialReportsTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘load-warehouse-snowflake = edx.analytics.tasks.warehouse.load_warehouse_snowflake:LoadWarehouseSnowflakeTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘data_obfuscation = edx.analytics.tasks.export.data_obfuscation:ObfuscatedCourseDumpTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘course_list = edx.analytics.tasks.insights.course_list:CourseListApiDataTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘load-d-user-course = edx.analytics.tasks.warehouse.load_internal_reporting_user_course:LoadUserCourseSummary’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘load-d-country = edx.analytics.tasks.warehouse.load_internal_reporting_country:LoadInternalReportingCountryToWarehouse’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘overall_events = edx.analytics.tasks.monitor.overall_events:TotalEventsDailyTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘load-f-user-activity = edx.analytics.tasks.warehouse.load_internal_reporting_user_activity:LoadInternalReportingUserActivityToWarehouse’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘enterprise_user = edx.analytics.tasks.enterprise.enterprise_user:ImportEnterpriseUsersIntoMysql’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘paypal-report = edx.analytics.tasks.warehouse.financial.paypal_ftpreport:LoadPayPalCaseReportToVertica’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘answer-dist = edx.analytics.tasks.insights.answer_dist:AnswerDistributionPerCourse’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘load-vertica-schema-snowflake = edx.analytics.tasks.warehouse.load_vertica_schema_to_snowflake:LoadVerticaSchemaFromS3ToSnowflakeTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘student_engagement = edx.analytics.tasks.data_api.student_engagement:StudentEngagementTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘insert-into-table = edx.analytics.tasks.common.mysql_load:MysqlInsertTask’)
DEBUG:stevedore.extension:found extension EntryPoint.parse(‘all_events_report = edx.analytics.tasks.monitor.total_events_report:TotalEventsReportWorkflow’)
DEBUG:edx.analytics.tasks.launchers.local:Loading override configuration ‘override.cfg’…
/var/lib/analytics-tasks/analyticstack/venv/src/luigi/luigi/parameter.py:261: UserWarning: Parameter “input_format” with value “None” is not of type string.
warnings.warn(‘Parameter “{}” with value “{}” is not of type string.’.format(param_name, param_value))
/var/lib/analytics-tasks/analyticstack/venv/src/luigi/luigi/parameter.py:261: UserWarning: Parameter “pool” with value “None” is not of type string.
warnings.warn(‘Parameter “{}” with value “{}” is not of type string.’.format(param_name, param_value))
/var/lib/analytics-tasks/analyticstack/venv/src/luigi/luigi/parameter.py:261: UserWarning: Parameter “effective_user” with value “None” is not of type string.
warnings.warn(‘Parameter “{}” with value “{}” is not of type string.’.format(param_name, param_value))
/var/lib/analytics-tasks/analyticstack/venv/src/luigi/luigi/parameter.py:261: UserWarning: Parameter “namenode_host” with value “None” is not of type string.
warnings.warn(‘Parameter “{}” with value “{}” is not of type string.’.format(param_name, param_value))
2019-12-05 14:54:47,953 WARNING 92232 [edx.analytics.tasks.util.elasticsearch_target] elasticsearch_target.py:88 - ConnectionError((<urllib3.connection.HTTPConnection object at 0x7f9d11ced990>, u’Connection to 172.17.0.1 timed out. (connect timeout=60)’)) caused by: ConnectTimeoutError((<urllib3.connection.HTTPConnection object at 0x7f9d11ced990>, u’Connection to 172.17.0.1 timed out. (connect timeout=60)’))
Connection to localhost closed.
Exiting with status = 255