1. eclipse配置连接hadoop
将hadoop的plugins包,拷贝到eclipse的plugins目录下。管理员启动eclipse
在eclipse的windows下,preferences,找到Hadoop Map/Reduce,添加hadoop安装目录。即可。
在eclipse下,选windows,show view下,将map/reduce location调出来。 右击添加,具体端口参考配置文件。
# vim /opt/hadoop-2.6.0/etc/hadoop/core-site.xml
<configuration>
<property>
<name>hadoop.tmp.dir</name>
<value>file:/opt/hadoop-2.6.0/tmp</value>
<description>Abase for other temporary directories.</description>
</property>
<property>
<name>fs.defaultFS</name>
<value>hdfs://192.168.208.110:9000</value>
</property>
</configuration>
# vim /opt/hadoop-2.6.0/etc/hadoop/hdfs-site.xml
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
<property>
<name>dfs.namenode.name.dir</name>
<value>file:/opt/hadoop-2.6.0/tmp/dfs/name</value>
</property>
<property>
<name>dfs.datanode.data.dir</name>
<value>file:/opt/hadoop-2.6.0/tmp/dfs/data</value>
</property>
<property>
<name>dfs.permissions.enabled</name>
<value>false</value>
</property>
</configuration>
# vim /opt/hadoop-2.6.0/etc/hadoop/mapred-site.xml
<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
<property>
<name>mapred.job.tracker</name>
<value>192.168.208.110:10020</value>
</property>
</configuration>
# vim /opt/hadoop-2.6.0/etc/hadoop/yarn-site.xml
<configuration>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
</configuration>
2. eclipse运行mapreduce程序
hdfs://192.168.208.110:9000/tmp/input
hdfs://192.168.208.110:9000/tmp/output