错误处理

任务运行错误

错误描述 任务运行后处于失败状态，并显示了类似以下的备注信息，其原因是运行时内存溢出：

====================appLogs====================
application_1546479764281_1669
User class threw exception: org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 1.0 failed 4 times, most recent failure: Lost task 0.3 in stage 1.0 (TID 203, node01, executor 4): ExecutorLostFailure (executor 4 exited caused by one of the running tasks) Reason: Container marked as failed: container_e06_1546479764281_1669_01_000005 on host: node01. Exit status: 143. Diagnostics: Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143
Killed by external signal
Driver stacktrace:

原因 由于计算的数据量较大，导致运行时内存溢出 解决方法 在数据开发-环境参数模块中，将本任务的driver和executor调大，如下图所示：