当前位置:   article > 正文

shell脚本遍历redis集群所有节点日志,并入库到hadoop中,进行数据分析_redis集群怎么遍历所有节点

redis集群怎么遍历所有节点

shell脚本遍历redis集群所有节点,并入库到hadoop中的数据库中,进行数据分析,在此留存,以备他用

  1. [AAAAAAnilRedis@FXYY-FS-redis2 ~]$ cat /home/AAAAAAnilRedis/script/fetchRecord.sh
  2. #/bin/bash
  3. export HADOOP_ROOT_LOGGER=INFO,console
  4. date
  5. UNLOCK_FILE="/home/AAAAAAnilRedis/lock/unlock.txt"
  6. LOG_FILE="/home/AAAAAAnilRedis/script/runlog.txt"
  7. rm /home/AAAAAAnilRedis/script/runlog.txt
  8. rm /home/AAAAAAnilRedis/data/otc*
  9. echo "start fetch....." > ${LOG_FILE}
  10. echo `date` >> ${LOG_FILE}
  11. echo `date` >> /home/AAAAAAnilRedis/script/delay.txt
  12. fetch(){
  13. echo "begin fetching....."
  14. echo $1
  15. }
  16. fetch "keys 'SM_*'" | /home/AAAAAAnilRedis/redis/redis-3.2.1/src/redis-cli -c -p 30001 -h 10.252.149.180 > /home/AAAAAAnilRedis/data/otc10.txt &
  17. fetch "keys 'SM_*'" | /home/AAAAAAnilRedis/redis/redis-3.2.1/src/redis-cli -c -p 30002 -h 10.252.149.180 > /home/AAAAAAnilRedis/data/otc11.txt &
  18. fetch "keys 'SM_*'" | /home/AAAAAAnilRedis/redis/redis-3.2.1/src/redis-cli -c -p 30003 -h 10.252.149.180 > /home/AAAAAAnilRedis/data/otc12.txt &
  19. fetch "keys 'SM_*'" | /home/AAAAAAnilRedis/redis/redis-3.2.1/src/redis-cli -c -p 30004 -h 10.252.149.180 > /home/AAAAAAnilRedis/data/otc13.txt &
  20. fetch "keys 'SM_*'" | /home/AAAAAAnilRedis/redis/redis-3.2.1/src/redis-cli -c -p 30005 -h 10.252.149.180 > /home/AAAAAAnilRedis/data/otc14.txt &
  21. fetch "keys 'SM_*'" | /home/AAAAAAnilRedis/redis/redis-3.2.1/src/redis-cli -c -p 30006 -h 10.252.149.180 > /home/AAAAAAnilRedis/data/otc15.txt &
  22. fetch "keys 'SM_*'" | /home/AAAAAAnilRedis/redis/redis-3.2.1/src/redis-cli -c -p 30007 -h 10.252.149.180 > /home/AAAAAAnilRedis/data/otc16.txt &
  23. fetch "keys 'SM_*'" | /home/AAAAAAnilRedis/redis/redis-3.2.1/src/redis-cli -c -p 30008 -h 10.252.149.180 > /home/AAAAAAnilRedis/data/otc17.txt &
  24. fetch "keys 'SM_*'" | /home/AAAAAAnilRedis/redis/redis-3.2.1/src/redis-cli -c -p 31001 -h 10.252.149.180 > /home/AAAAAAnilRedis/data/otc18.txt &
  25. fetch "keys 'SM_*'" | /home/AAAAAAnilRedis/redis/redis-3.2.1/src/redis-cli -c -p 31002 -h 10.252.149.180 > /home/AAAAAAnilRedis/data/otc19.txt &
  26. fetch "keys 'SM_*'" | /home/AAAAAAnilRedis/redis/redis-3.2.1/src/redis-cli -c -p 31003 -h 10.252.149.180 > /home/AAAAAAnilRedis/data/otc20.txt &
  27. fetch "keys 'SM_*'" | /home/AAAAAAnilRedis/redis/redis-3.2.1/src/redis-cli -c -p 31004 -h 10.252.149.180 > /home/AAAAAAnilRedis/data/otc21.txt &
  28. fetch "keys 'SM_*'" | /home/AAAAAAnilRedis/redis/redis-3.2.1/src/redis-cli -c -p 31005 -h 10.252.149.180 > /home/AAAAAAnilRedis/data/otc22.txt &
  29. fetch "keys 'SM_*'" | /home/AAAAAAnilRedis/redis/redis-3.2.1/src/redis-cli -c -p 31006 -h 10.252.149.180 > /home/AAAAAAnilRedis/data/otc23.txt &
  30. fetch "keys 'SM_*'" | /home/AAAAAAnilRedis/redis/redis-3.2.1/src/redis-cli -c -p 31007 -h 10.252.149.180 > /home/AAAAAAnilRedis/data/otc24.txt &
  31. fetch "keys 'SM_*'" | /home/AAAAAAnilRedis/redis/redis-3.2.1/src/redis-cli -c -p 31008 -h 10.252.149.180 > /home/AAAAAAnilRedis/data/otc25.txt &
  32. fetch "keys 'SM_*'" | /home/AAAAAAnilRedis/redis/redis-3.2.1/src/redis-cli -c -p 30009 -h 10.252.149.180 > /home/AAAAAAnilRedis/data/otc26.txt &
  33. fetch "keys 'SM_*'" | /home/AAAAAAnilRedis/redis/redis-3.2.1/src/redis-cli -c -p 30010 -h 10.252.149.180 > /home/AAAAAAnilRedis/data/otc27.txt &
  34. fetch "keys 'SM_*'" | /home/AAAAAAnilRedis/redis/redis-3.2.1/src/redis-cli -c -p 30011 -h 10.2
本文内容由网友自发贡献,转载请注明出处:https://www.wpsshop.cn/w/寸_铁/article/detail/735644
推荐阅读
相关标签
  

闽ICP备14008679号