如何在eclipse中关闭hadoop源代码中的推测执行

Question

我需要在hadoop源代码中关闭它，而我在eclipse中找不到它的包。 https://hadoop.apache.org/docs/stable/api/org/apache/hadoop/mapreduce/Job.html#setReduceSpeculativeExecution%28boolean%29

Answer 1

如果要禁用推测执行，请在 mapred-site.xml 中添加这些属性。

<property>
   <name>mapreduce.map.speculative</name>
   <value>false</value>
</property>
<property>
   <name>mapreduce.reduce.speculative</name>
   <value>false</value>
</property>

或者在作业级别，设置驱动程序中的属性class。

Configuration conf = new Configuration();
conf.set(“mapreduce.map.speculative”,false);
conf.set(“mapreduce.reduce.speculative”,false);

其源代码参考这些：hadoop-mapreduce-project, Job and JobConf

如何在eclipse中关闭hadoop源代码中的推测执行

how turn off speculative execution in hadoop source code in eclipse

java

eclipse

hadoop

hadoop2