笔记屋 笔记屋
  • 首页
  • 大数据
    • Hadoop
  • 码农碎笔
  • 杂乱无章
  • 好物收藏

Hadoop完全分布式-常用脚本

查看服务器进程

查看java 进程脚本:jpsall


[hadoop@hadoop102 ~]$ cd /home/hadoop/bin
[hadoop@hadoop102 ~]$ vim jpsall

然后输入


#!/bin/bash
for host in hadoop102 hadoop103 hadoop104
do
 echo =============== $host ===============
 ssh $host jps $@ | grep -v Jps
done

保存后退出,然后赋予脚本执行权限


[hadoop@hadoop102 bin]$ chmod +x jpsall

hadoop 集群启停脚本

(包含 hdfs,yarn,historyserver):myhadoop.sh


[hadoop@hadoop102 ~]$ cd /home/hadoop/bin
[hadoop@hadoop102 ~]$ vim myhadoop.sh

然后输入


#!/bin/bash
if [ $# -lt 1 ]
then
 echo "No Args Input..."
 exit ;
fi
case $1 in
"start")
 echo " =================== 启动 hadoop 集群 ==================="
 echo " --------------- 启动 hdfs ---------------"
 ssh hadoop102 "/opt/module/hadoop-3.1.3/sbin/start-dfs.sh"
 echo " --------------- 启动 yarn ---------------"
 ssh hadoop103 "/opt/module/hadoop-3.1.3/sbin/start-yarn.sh"
 echo " --------------- 启动 historyserver ---------------"
 ssh hadoop102 "/opt/module/hadoop-3.1.3/bin/mapred --daemon start 
historyserver"
;;
"stop")
 echo " =================== 关闭 hadoop 集群 ==================="
 echo " --------------- 关闭 historyserver ---------------"
 ssh hadoop102 "/opt/module/hadoop-3.1.3/bin/mapred --daemon stop 
historyserver"
 echo " --------------- 关闭 yarn ---------------"
 ssh hadoop103 "/opt/module/hadoop-3.1.3/sbin/stop-yarn.sh"
 echo " --------------- 关闭 hdfs ---------------"
 ssh hadoop102 "/opt/module/hadoop-3.1.3/sbin/stop-dfs.sh"
;;
*)
 echo "Input Args Error..."
;;
esac

保存后退出,然后赋予脚本执行权限


[hadoop@hadoop102 bin]$ chmod +x myhadoop.sh

分发/home/atguigu/bin 目录,保证自定义脚本在三台机器上都可以使用


[hadoop@hadoop102 ~]$ xsync /home/hadoop/bin/
有帮助?
Hadoop完全分布式-配置日志聚集
几个常用镜像网站
Copyright © 2022 笔记屋. 苏ICP备20033168号