Friday 15 May 2015

mapreduce - How to scheduling hadoop map tasks in different node cluster -


I have the only map program in which there are more than 10 maps in my cluster 5 nodes, my question is Can I schedule nodes to run the functions of which map? For example, let's run in node 1 in node 1, the node 3 running in node 3 and map 9 of node 5 is going on. If I can do this, then what changes are needed in my code and configuration file? By the way, I use HDFS. Thanks!

Affinity can not be set in Hadoop for node mapping for map work. The scheduler automatically decides on a fixed workbench / slot position where a map is to be run.

No comments:

Post a Comment