为什么我的应用程序没有完成 spark
why my application doesnt finish spark
i 运行 一个 spark 应用程序（输入 90Mo），根据作业 UI 我所有的作业都已完成，但我注意到我的应用程序没有完成，这是最后的消息（为什么我不知道 SC 是否已成功停止）
16/09/13 02:17:31 INFO DAGScheduler: Job 15 finished: saveAsTextFile at slowlyChangingDimension.java:244, took 1,222274 s
16/09/13 02:17:38 INFO BlockManagerInfo: Removed broadcast_49_piece0 on 10.0.10.45:46789 in memory (size: 26.2 KB, free: 1424.7 MB)
16/09/13 02:17:38 INFO BlockManagerInfo: Removed broadcast_49_piece0 on 10.0.10.51:54860 in memory (size: 26.2 KB, free: 1424.7 MB)
16/09/13 02:17:38 INFO BlockManagerInfo: Removed broadcast_48_piece0 on 10.0.10.45:46789 in memory (size: 4.4 KB, free: 1424.7 MB)
16/09/13 02:17:38 INFO BlockManagerInfo: Removed broadcast_48_piece0 on 10.0.10.53:56003 in memory (size: 4.4 KB, free: 1458.5 MB)
16/09/13 02:17:38 INFO BlockManagerInfo: Removed broadcast_48_piece0 on 10.0.10.47:51300 in memory (size: 4.4 KB, free: 1458.5 MB)
16/09/13 02:17:38 INFO BlockManagerInfo: Removed broadcast_48_piece0 on 10.0.10.51:54860 in memory (size: 4.4 KB, free: 1424.7 MB)
16/09/13 02:17:38 INFO BlockManagerInfo: Removed broadcast_48_piece0 on 10.0.10.54:44644 in memory (size: 4.4 KB, free: 1458.6 MB)
16/09/13 02:17:38 INFO BlockManagerInfo: Removed broadcast_48_piece0 on 10.0.10.52:32794 in memory (size: 4.4 KB, free: 1458.6 MB)
16/09/13 02:17:38 INFO BlockManagerInfo: Removed broadcast_47_piece0 on 10.0.10.45:46789 in memory (size: 26.2 KB, free: 1424.7 MB)
16/09/13 02:17:38 INFO BlockManagerInfo: Removed broadcast_47_piece0 on 10.0.10.48:54348 in memory (size: 26.2 KB, free: 1458.6 MB)
16/09/13 02:17:38 INFO ContextCleaner: Cleaned shuffle 28
因为这是批量申请。你应该在程序的最后一行使用 context.stop() ，这样它就可以正常工作了。
如果不是这种情况，那么您能否分享您的代码 运行。
i 运行 一个 spark 应用程序（输入 90Mo），根据作业 UI 我所有的作业都已完成，但我注意到我的应用程序没有完成，这是最后的消息（为什么我不知道 SC 是否已成功停止）
16/09/13 02:17:31 INFO DAGScheduler: Job 15 finished: saveAsTextFile at slowlyChangingDimension.java:244, took 1,222274 s 16/09/13 02:17:38 INFO BlockManagerInfo: Removed broadcast_49_piece0 on 10.0.10.45:46789 in memory (size: 26.2 KB, free: 1424.7 MB) 16/09/13 02:17:38 INFO BlockManagerInfo: Removed broadcast_49_piece0 on 10.0.10.51:54860 in memory (size: 26.2 KB, free: 1424.7 MB) 16/09/13 02:17:38 INFO BlockManagerInfo: Removed broadcast_48_piece0 on 10.0.10.45:46789 in memory (size: 4.4 KB, free: 1424.7 MB) 16/09/13 02:17:38 INFO BlockManagerInfo: Removed broadcast_48_piece0 on 10.0.10.53:56003 in memory (size: 4.4 KB, free: 1458.5 MB) 16/09/13 02:17:38 INFO BlockManagerInfo: Removed broadcast_48_piece0 on 10.0.10.47:51300 in memory (size: 4.4 KB, free: 1458.5 MB) 16/09/13 02:17:38 INFO BlockManagerInfo: Removed broadcast_48_piece0 on 10.0.10.51:54860 in memory (size: 4.4 KB, free: 1424.7 MB) 16/09/13 02:17:38 INFO BlockManagerInfo: Removed broadcast_48_piece0 on 10.0.10.54:44644 in memory (size: 4.4 KB, free: 1458.6 MB) 16/09/13 02:17:38 INFO BlockManagerInfo: Removed broadcast_48_piece0 on 10.0.10.52:32794 in memory (size: 4.4 KB, free: 1458.6 MB) 16/09/13 02:17:38 INFO BlockManagerInfo: Removed broadcast_47_piece0 on 10.0.10.45:46789 in memory (size: 26.2 KB, free: 1424.7 MB) 16/09/13 02:17:38 INFO BlockManagerInfo: Removed broadcast_47_piece0 on 10.0.10.48:54348 in memory (size: 26.2 KB, free: 1458.6 MB) 16/09/13 02:17:38 INFO ContextCleaner: Cleaned shuffle 28
因为这是批量申请。你应该在程序的最后一行使用 context.stop() ，这样它就可以正常工作了。
如果不是这种情况，那么您能否分享您的代码 运行。