devbox
weixin_40725706
这个屌丝很懒，什么也没留下！
关注作者
热门标签
热门文章
当前位置:   article > 正文

CentOS 7.2搭建FastDFS 分布式文件系统，实现高可用集群_centos搭建fastdfs服务器

作者：weixin_40725706 | 2024-08-03 13:50:19

赞

踩

centos搭建fastdfs服务器

分布式集群搭建结构

  • 双Tracker
  • 2组Group
  • 轮询存储策略
  • Keepalived+Nginx高可用
  • Nginx缓存
  • 4个存储节点

一、 集群规划清单

1.安装清单

软件名称版本百度云盘存放名称
FastDFS5.11fastdfs-5.11.zip
FastDFS-Nginx-module无fastdfs-nginx-module-master.zip
LibFastCommon1.0.36libfastcommon-1.0.36.zip
nginx1.10.3nginx-1.10.3.tar.gz
nginx-pure-cache2.3ngx_cache_purge-2.3.tar.gz

安装所需文件均上传到百度云盘，位置：FastDFS百度云盘

2.集群规划

虚拟机IP说明
Keepalived+Nginx1[Master]192.168.43.101Nginx Server 01
Keeepalived+Nginx[Backup]192.168.43.102Nginx Server 02
VIP192.168.43.150虚拟漂移IP
Tracker01192.168.43.70Tracker01服务器
Tracker02192.168.43.71Tracker02服务器
Storage01192.168.43.72Storage01服务器【group1】
Storage02192.168.43.73Storage02服务器【group1】
Storage03192.168.43.74Storage03服务器【group2】
Storage04192.168.43.75Storage04服务器【group2】

整体架构图如下图所示：

 图片来源：CSDN作者 liuyazhuang

二、集群安装

以下操作均在关闭所有节点防火墙进行的，请根据个人情况开启相关端口或关闭防火墙

1.安装LibFastCommon/FastDFS模块

执行节点 Tracker01、Tracker02、Storage01、Storage03、Storage04

[root@localhost fastDFS]# unzip libfastcommon-1.0.36.zip

解压后目录如下：

  1. [root@localhost fastdfs-5.11]# ll
  2. [root@localhost libfastcommon-1.0.36]# ll
  3. 总用量 32
  4. drwxr-xr-x. 2 root root  117 4月   5 2017 doc
  5. -rw-r--r--. 1 root root 8005 4月   5 2017 HISTORY
  6. -rw-r--r--. 1 root root  566 4月   5 2017 INSTALL
  7. -rw-r--r--. 1 root root 1606 4月   5 2017 libfastcommon.spec
  8. -rwxr-xr-x. 1 root root 3099 4月   5 2017 make.sh
  9. drwxr-xr-x. 2 root root  191 4月   5 2017 php-fastcommon
  10. -rw-r--r--. 1 root root 2763 4月   5 2017 README
  11. drwxr-xr-x. 3 root root 4096 1月  17 11:21 src

安装C编译工具 gcc

[root@localhost fastdfs-5.11]# yum -y install gcc-c++
  • 安装装LibFastCommon

编译libfastcommon软件并安装

[root@localhost fastdfs-5.11]# ./make.sh  && ./make.sh install

为libcommon 创建软链接到/usr/local/lib目录下

  1. [root@localhost fastdfs-5.11]# ln -s /usr/lib64/libfastcommon.so /usr/local/lib/libfastcommon.so
  2. [root@localhost fastdfs-5.11]# ln -s /usr/lib64/libfastcommon.so /usr/lib/libfastcommon.so
  3. [root@localhost fastdfs-5.11]# ln -s /usr/lib64/libfdfsclient.so /usr/local/lib/libfdfsclient.so
  4. [root@localhost fastdfs-5.11]# ln -s /usr/lib64/libfdfsclient.so /usr/lib/libfdfsclient.so
  • 安装FastDFS
    解压安装包

[root@localhost fastDFS]# unzip fastdfs-5.11.zip

进入解压目录并进行编译和安装

  1. [root@localhost fastDFS]# cd fastdfs-5.11/
  2. [root@localhost fastdfs-5.11]# ./make.sh  && ./make.sh install

安装成功后，FastDFS会安装在/etc/fdfs目录下：

  1. [root@localhost fastdfs-5.11]# ll /etc/fdfs/
  2. 总用量 76
  3. -rw-r--r--. 1 root root   316 1月  17 11:47 client.conf
  4. -rw-r--r--. 1 root root  1461 1月  17 11:25 client.conf.sample
  5. -rw-r--r--. 1 root root   955 1月  17 13:20 http.conf
  6. -rw-r--r--. 1 root root 31172 1月  17 13:21 mime.types
  7. -rw-r--r--. 1 root root  3716 1月  17 12:57 mod_fastdfs.conf
  8. -rw-r--r--. 1 root root  1278 1月  17 11:40 storage.conf
  9. -rw-r--r--. 1 root root  7927 1月  17 11:25 storage.conf.sample
  10. -rw-r--r--. 1 root root   105 1月  17 11:25 storage_ids.conf.sample
  11. -rw-r--r--. 1 root root  1356 1月  17 11:34 tracker.conf
  12. -rw-r--r--. 1 root root  7389 1月  17 11:25 tracker.conf.sample

我们需要把这三个示例文件复制一份，去掉.sample

  1. [root@localhost fdfs]# cp client.conf.sample client.conf
  2. [root@localhost fdfs]# cp storage.conf.sample storage.conf
  3. [root@localhost fdfs]# cp tracker.conf.sample tracker.conf

FastDFS安装结束

2.安装Tracker并实现节点信息配置

执行节点 Tracker01、Tracker02

  • 创建tracker工作目录

此目录用于保存tracker 的data和log

[root@localhost fdfs]# mkdir /opt/fastdfs_tracker
  • 配置tracker

配置 /etc/fdfs目录下tracker.conf
主要实现以下5个配置内容：

  1. 1.disabled=false 
  2. 2.port=22122 #默认端口号 
  3. 3.base_path=/opt/fastdfs_tracker #我刚刚创建的目录 
  4. 4.http.server_port=8080 #默认端口是8080
  5. 5.store_lookup=0  #采用轮询策略进行存储，0 轮询 1：始终定向到某个group 2：负载进行存储文件

完整tracker.conf 文件信息如下：

  1. disabled=false
  2.  
  3. bind_addr= 0.0.0.0
  4.  
  5. port=22122
  6.  
  7. connect_timeout=30
  8.  
  9. network_timeout=60
  10.  
  11. base_path=/opt/fastdfs_tracker
  12.  
  13. max_connections=512
  14.  
  15. accept_threads=1
  16.  
  17. work_threads=4
  18.  
  19. min_buff_size = 8KB
  20.  
  21. max_buff_size = 128KB
  22.  
  23. store_lookup=0
  24.  
  25. store_group=group2
  26.  
  27. store_server=0
  28.  
  29. store_path=0
  30.  
  31. download_server=0
  32.  
  33. reserved_storage_space = 10%
  34.  
  35. log_level=info
  36.  
  37. run_by_group=
  38.  
  39. run_by_user=
  40.  
  41. allow_hosts=*
  42.  
  43. sync_log_buff_interval = 10
  44.  
  45. check_active_interval = 120
  46.  
  47. thread_stack_size = 64KB
  48.  
  49. storage_ip_changed_auto_adjust = true
  50.  
  51. storage_sync_file_max_delay = 86400
  52.  
  53. storage_sync_file_max_time = 300
  54.  
  55. use_trunk_file = false 
  56.  
  57. slot_min_size = 256
  58.  
  59. slot_max_size = 16MB
  60.  
  61. trunk_file_size = 64MB
  62.  
  63. trunk_create_file_advance = false
  64.  
  65. trunk_create_file_time_base = 02:00
  66.  
  67. trunk_create_file_interval = 86400
  68.  
  69. trunk_create_file_space_threshold = 20G
  70.  
  71. trunk_init_check_occupying = false
  72.  
  73. trunk_init_reload_from_binlog = false
  74.  
  75. trunk_compress_binlog_min_interval = 0
  76.  
  77. use_storage_id = false
  78.  
  79. storage_ids_filename = storage_ids.conf
  80.  
  81. id_type_in_filename = ip
  82.  
  83. store_slave_file_use_link = false
  84.  
  85. rotate_error_log = false
  86.  
  87. error_log_rotate_time=00:00
  88.  
  89. rotate_error_log_size = 0
  90.  
  91. log_file_keep_days = 0
  92.  
  93. use_connection_pool = false
  94.  
  95. connection_pool_max_idle_time = 3600
  96.  
  97. http.server_port=8080
  98.  
  99. http.check_alive_interval=30
  100.  
  101. http.check_alive_type=tcp
  102.  
  103. http.check_alive_uri=/status.html

修改保存后创建软引用

[root@localhost fdfs]# ln -s /usr/bin/fdfs_storaged /usr/local/bin
  • 启动tracker，并加入开机启动项

[root@localhost fdfs]# service fdfs_trackerd start

将tracker加入开机启动项

[root@localhost fdfs]# echo "service fdfs_trackerd start" |tee -a /etc/rc.d/rc.local

3.安装Storage模块并实现配置

执行节点 Storage01、Storage02、Storage03、Storage04

  • 建立存储目录

在存储各节点建了两个目录fastdfs_storage_data,fastdfs_storage

  1. [root@localhost opt]# mkdir fastdfs_storage
  2. [root@localhost opt]# mkdir fastdfs_storage_data
  3. [root@localhost opt]# ll
  4. 总用量 0
  5. drwxr-xr-x. 4 root root 30 1月  17 11:45 fastdfs_storage
  6. drwxr-xr-x. 3 root root 18 1月  17 11:45 fastdfs_storage_data
  7. drwxr-xr-x. 4 root root 30 1月  17 11:35 fastdfs_tracker
  • 修改存储节点目录下/etc/fdfs/storage.conf配置信息，具体如下：

  1. disabled=false #启用配置文件  
  2. group_name=group1 #组名（第一组为 group1， 第二组为 group2）  
  3. port=23000 #storage 的端口号,同一个组的 storage 端口号必须相同  
  4. base_path=/opt/fastdfs_storage #设置storage数据文件和日志目录 
  5. store_path0=/opt/fastdfs_storage_data #实际文件存储路径  
  6. store_path_count=1 #存储路径个数，需要和 store_path 个数匹配  
  7. tracker_server=192.168.43.70:22122 #tracker 服务器的 IP 地址和端口  
  8. tracker_server=192.168.43.70:22122 #多个 tracker 直接添加多条配置  
  9. http.server_port=8888 #设置 http 端口号

完整配置信息如下：

  1. disabled=false
  2. group_name=group1
  3. bind_addr=
  4. client_bind=true
  5. port=23000
  6. connect_timeout=30
  7. network_timeout=60
  8. heart_beat_interval=30
  9. stat_report_interval=60
  10. base_path=/opt/fastdfs_storage
  11. max_connections=256
  12. buff_size = 256KB
  13. accept_threads=1
  14. work_threads=4
  15. disk_rw_separated = true
  16. disk_reader_threads = 1
  17. disk_writer_threads = 1
  18. sync_wait_msec=50
  19. sync_interval=0
  20. sync_start_time=00:00
  21. sync_end_time=23:59
  22. write_mark_file_freq=500
  23. store_path_count=1
  24. store_path0=/opt/fastdfs_storage_data
  25. subdir_count_per_path=256
  26. tracker_server=192.168.43.70:22122
  27. tracker_server=192.168.43.71:22122
  28. log_level=info
  29. run_by_group=
  30. run_by_user=
  31. allow_hosts=*
  32. file_distribute_path_mode=0
  33. file_distribute_rotate_count=100
  34. fsync_after_written_bytes=0
  35. sync_log_buff_interval=10
  36. sync_binlog_buff_interval=10
  37. sync_stat_file_interval=300
  38. thread_stack_size=512KB
  39. upload_priority=10
  40. if_alias_prefix=
  41. check_file_duplicate=0
  42. file_signature_method=hash
  43. key_namespace=FastDFS
  44. keep_alive=0
  45. use_access_log = false
  46. rotate_access_log = false
  47. access_log_rotate_time=00:00
  48. rotate_error_log = false
  49. error_log_rotate_time=00:00
  50. rotate_access_log_size = 0
  51. rotate_error_log_size = 0
  52. log_file_keep_days = 0
  53. file_sync_skip_invalid_record=false
  54. use_connection_pool = false
  55. connection_pool_max_idle_time = 3600
  56. http.domain_name=
  57. http.server_port=8888
  • 启动Storage
    各节点配置好信息好之后，启动Storage

[root@localhost fdfs]# service fdfs_storaged start

启动后查看日志情况

  1. [root@localhost fdfs]# fdfs_monitor /etc/fdfs/storage.conf
  2. [2018-01-20 16:56:48] DEBUG - base_path=/opt/fastdfs_storage, connect_timeout=30, network_timeout=60, tracker_server_count=2, anti_steal_token=0, anti_steal_secret_key length=0, use_connection_pool=0, g_connection_pool_max_idle_time=3600s, use_storage_id=0, storage server id count: 0
  3.  
  4. server_count=2, server_index=0
  5.  
  6. tracker server is 192.168.43.70:22122
  7.  
  8. group count: 2
  9.  
  10. Group 1:
  11. group name = group1
  12. disk total space = 47073 MB
  13. disk free space = 35162 MB
  14. trunk free space = 0 MB
  15. storage server count = 2
  16. active server count = 2
  17. storage server port = 23000
  18. storage HTTP port = 8888
  19. store path count = 1
  20. subdir count per path = 256
  21. current write server index = 0
  22. current trunk file id = 0
  23.  
  24.     Storage 1:
  25.         id = 192.168.43.72
  26.         ip_addr = 192.168.43.72 (localhost.localdomain)  ACTIVE
  27.         http domain = 
  28.         version = 5.11
  29.         join time = 2018-01-19 13:59:30
  30.         up time = 2018-01-20 12:37:18
  31.         total storage = 47073 MB
  32.         free storage = 35162 MB
  33.         upload priority = 10
  34.         store_path_count = 1
  35.         subdir_count_per_path = 256
  36.         storage_port = 23000
  37.         storage_http_port = 8888
  38.         current_write_path = 0
  39.         source storage id = 
  40.         if_trunk_server = 0
  41.         connection.alloc_count = 256
  42.         connection.current_count = 1
  43.         connection.max_count = 1
  44.         total_upload_count = 3
  45.         success_upload_count = 3
  46.         total_append_count = 0
  47.         success_append_count = 0
  48.         total_modify_count = 0
  49.         success_modify_count = 0
  50.         total_truncate_count = 0
  51.         success_truncate_count = 0
  52.         total_set_meta_count = 0
  53.         success_set_meta_count = 0
  54.         total_delete_count = 0
  55.         success_delete_count = 0
  56.         total_download_count = 0
  57.         success_download_count = 0
  58.         total_get_meta_count = 0
  59.         success_get_meta_count = 0
  60.         total_create_link_count = 0
  61.         success_create_link_count = 0
  62.         total_delete_link_count = 0
  63.         success_delete_link_count = 0
  64.         total_upload_bytes = 791904
  65.         success_upload_bytes = 791904
  66.         total_append_bytes = 0
  67.         success_append_bytes = 0
  68.         total_modify_bytes = 0
  69.         success_modify_bytes = 0
  70.         stotal_download_bytes = 0
  71.         success_download_bytes = 0
  72.         total_sync_in_bytes = 775234
  73.         success_sync_in_bytes = 775234
  74.         total_sync_out_bytes = 0
  75.         success_sync_out_bytes = 0
  76.         total_file_open_count = 4
  77.         success_file_open_count = 4
  78.         total_file_read_count = 0
  79.         success_file_read_count = 0
  80.         total_file_write_count = 8
  81.         success_file_write_count = 8
  82.         last_heart_beat_time = 2018-01-20 16:56:18
  83.         last_source_update = 2018-01-19 19:34:55
  84.         last_sync_update = 2018-01-19 15:28:56
  85.         last_synced_timestamp = 2018-01-19 15:28:48 (0s delay)
  86.     Storage 2:
  87.         id = 192.168.43.73
  88.         ip_addr = 192.168.43.73  ACTIVE
  89.         http domain = 
  90.         version = 5.11
  91.         join time = 2018-01-19 14:00:21
  92.         up time = 2018-01-20 12:37:42
  93.         total storage = 47073 MB
  94.         free storage = 35166 MB
  95.         upload priority = 10
  96.         store_path_count = 1
  97.         subdir_count_per_path = 256
  98.         storage_port = 23000
  99.         storage_http_port = 8888
  100.         current_write_path = 0
  101.         source storage id = 192.168.43.72
  102.         if_trunk_server = 0
  103.         connection.alloc_count = 256
  104.         connection.current_count = 1
  105.         connection.max_count = 1
  106.         total_upload_count = 1
  107.         success_upload_count = 1
  108.         total_append_count = 0
  109.         success_append_count = 0
  110.         total_modify_count = 0
  111.         success_modify_count = 0
  112.         total_truncate_count = 0
  113.         success_truncate_count = 0
  114.         total_set_meta_count = 0
  115.         success_set_meta_count = 0
  116.         total_delete_count = 0
  117.         success_delete_count = 0
  118.         total_download_count = 0
  119.         success_download_count = 0
  120.         total_get_meta_count = 0
  121.         success_get_meta_count = 0
  122.         total_create_link_count = 0
  123.         success_create_link_count = 0
  124.         total_delete_link_count = 0
  125.         success_delete_link_count = 0
  126.         total_upload_bytes = 775234
  127.         success_upload_bytes = 775234
  128.         total_append_bytes = 0
  129.         success_append_bytes = 0
  130.         total_modify_bytes = 0
  131.         success_modify_bytes = 0
  132.         stotal_download_bytes = 0
  133.         success_download_bytes = 0
  134.         total_sync_in_bytes = 791904
  135.         success_sync_in_bytes = 791904
  136.         total_sync_out_bytes = 0
  137.         success_sync_out_bytes = 0
  138.         total_file_open_count = 4
  139.         success_file_open_count = 4
  140.         total_file_read_count = 0
  141.         success_file_read_count = 0
  142.         total_file_write_count = 8
  143.         success_file_write_count = 8
  144.         last_heart_beat_time = 2018-01-20 16:56:42
  145.         last_source_update = 2018-01-19 15:28:48
  146.         last_sync_update = 2018-01-19 19:34:59
  147.         last_synced_timestamp = 2018-01-19 19:34:55 (0s delay)
  148.  
  149. Group 2:
  150. group name = group2
  151. disk total space = 47073 MB
  152. disk free space = 35165 MB
  153. trunk free space = 0 MB
  154. storage server count = 2
  155. active server count = 2
  156. storage server port = 23000
  157. storage HTTP port = 8888
  158. store path count = 1
  159. subdir count per path = 256
  160. current write server index = 0
  161. current trunk file id = 0
  162.  
  163.     Storage 1:
  164.         id = 192.168.43.74
  165.         ip_addr = 192.168.43.74  ACTIVE
  166.         http domain = 
  167.         version = 5.11
  168.         join time = 2018-01-19 14:01:05
  169.         up time = 2018-01-20 12:38:00
  170.         total storage = 47073 MB
  171.         free storage = 35165 MB
  172.         upload priority = 10
  173.         store_path_count = 1
  174.         subdir_count_per_path = 256
  175.         storage_port = 23000
  176.         storage_http_port = 8888
  177.         current_write_path = 0
  178.         source storage id = 
  179.         if_trunk_server = 0
  180.         connection.alloc_count = 256
  181.         connection.current_count = 1
  182.         connection.max_count = 1
  183.         total_upload_count = 4
  184.         success_upload_count = 4
  185.         total_append_count = 0
  186.         success_append_count = 0
  187.         total_modify_count = 0
  188.         success_modify_count = 0
  189.         total_truncate_count = 0
  190.         success_truncate_count = 0
  191.         total_set_meta_count = 0
  192.         success_set_meta_count = 0
  193.         total_delete_count = 0
  194.         success_delete_count = 0
  195.         total_download_count = 0
  196.         success_download_count = 0
  197.         total_get_meta_count = 0
  198.         success_get_meta_count = 0
  199.         total_create_link_count = 0
  200.         success_create_link_count = 0
  201.         total_delete_link_count = 0
  202.         success_delete_link_count = 0
  203.         total_upload_bytes = 2107770
  204.         success_upload_bytes = 2107770
  205.         total_append_bytes = 0
  206.         success_append_bytes = 0
  207.         total_modify_bytes = 0
  208.         success_modify_bytes = 0
  209.         stotal_download_bytes = 0
  210.         success_download_bytes = 0
  211.         total_sync_in_bytes = 1550468
  212.         success_sync_in_bytes = 1550468
  213.         total_sync_out_bytes = 0
  214.         success_sync_out_bytes = 0
  215.         total_file_open_count = 6
  216.         success_file_open_count = 6
  217.         total_file_read_count = 0
  218.         success_file_read_count = 0
  219.         total_file_write_count = 15
  220.         success_file_write_count = 15
  221.         last_heart_beat_time = 2018-01-20 16:56:38
  222.         last_source_update = 2018-01-19 19:35:40
  223.         last_sync_update = 2018-01-19 15:28:53
  224.         last_synced_timestamp = 2018-01-19 15:28:50 (-1s delay)
  225.     Storage 2:
  226.         id = 192.168.43.75
  227.         ip_addr = 192.168.43.75  ACTIVE
  228.         http domain = 
  229.         version = 5.11
  230.         join time = 2018-01-19 14:01:27
  231.         up time = 2018-01-20 12:38:20
  232.         total storage = 47073 MB
  233.         free storage = 35165 MB
  234.         upload priority = 10
  235.         store_path_count = 1
  236.         subdir_count_per_path = 256
  237.         storage_port = 23000
  238.         storage_http_port = 8888
  239.         current_write_path = 0
  240.         source storage id = 192.168.43.74
  241.         if_trunk_server = 0
  242.         connection.alloc_count = 256
  243.         connection.current_count = 1
  244.         connection.max_count = 1
  245.         total_upload_count = 2
  246.         success_upload_count = 2
  247.         total_append_count = 0
  248.         success_append_count = 0
  249.         total_modify_count = 0
  250.         success_modify_count = 0
  251.         total_truncate_count = 0
  252.         success_truncate_count = 0
  253.         total_set_meta_count = 0
  254.         success_set_meta_count = 0
  255.         total_delete_count = 0
  256.         success_delete_count = 0
  257.         total_download_count = 0
  258.         success_download_count = 0
  259.         total_get_meta_count = 0
  260.         success_get_meta_count = 0
  261.         total_create_link_count = 0
  262.         success_create_link_count = 0
  263.         total_delete_link_count = 0
  264.         success_delete_link_count = 0
  265.         total_upload_bytes = 1550468
  266.         success_upload_bytes = 1550468
  267.         total_append_bytes = 0
  268.         success_append_bytes = 0
  269.         total_modify_bytes = 0
  270.         success_modify_bytes = 0
  271.         stotal_download_bytes = 0
  272.         success_download_bytes = 0
  273.         total_sync_in_bytes = 2107770
  274.         success_sync_in_bytes = 2107770
  275.         total_sync_out_bytes = 0
  276.         success_sync_out_bytes = 0
  277.         total_file_open_count = 6
  278.         success_file_open_count = 6
  279.         total_file_read_count = 0
  280.         success_file_read_count = 0
  281.         total_file_write_count = 15
  282.         success_file_write_count = 15
  283.         last_heart_beat_time = 2018-01-20 16:56:23
  284.         last_source_update = 2018-01-19 15:28:49
  285.         last_sync_update = 2018-01-19 19:35:46
  286.         last_synced_timestamp = 2018-01-19 19:35:40 (0s delay)

如果看到有2组Storage信息，则表示配置信息配置成功，并注册到Tracker中，查看日志启动情况

  1. [root@localhost fdfs]# tail -f /opt/fastdfs_storage/logs/storaged.log 
  2.  
  3. [2018-01-20 12:37:18] INFO - FastDFS v5.11, base_path=/opt/fastdfs_storage, store_path_count=1, subdir_count_per_path=256, group_name=group1, run_by_group=, run_by_user=, connect_timeout=30s, network_timeout=60s, port=23000, bind_addr=, client_bind=1, max_connections=256, accept_threads=1, work_threads=4, disk_rw_separated=1, disk_reader_threads=1, disk_writer_threads=1, buff_size=256KB, heart_beat_interval=30s, stat_report_interval=60s, tracker_server_count=2, sync_wait_msec=50ms, sync_interval=0ms, sync_start_time=00:00, sync_end_time=23:59, write_mark_file_freq=500, allow_ip_count=-1, file_distribute_path_mode=0, file_distribute_rotate_count=100, fsync_after_written_bytes=0, sync_log_buff_interval=10s, sync_binlog_buff_interval=10s, sync_stat_file_interval=300s, thread_stack_size=512 KB, upload_priority=10, if_alias_prefix=, check_file_duplicate=0, file_signature_method=hash, FDHT group count=0, FDHT server count=0, FDHT key_namespace=, FDHT keep_alive=0, HTTP server port=8888, domain name=, use_access_log=0, rotate_access_log=0, access_log_rotate_time=00:00, rotate_error_log=0, error_log_rotate_time=00:00, rotate_access_log_size=0, rotate_error_log_size=0, log_file_keep_days=0, file_sync_skip_invalid_record=0, use_connection_pool=0, g_connection_pool_max_idle_time=3600s
  4. [2018-01-20 12:37:18] INFO - file: storage_param_getter.c, line: 191, use_storage_id=0, id_type_in_filename=ip, storage_ip_changed_auto_adjust=1, store_path=0, reserved_storage_space=10.00%, use_trunk_file=0, slot_min_size=256, slot_max_size=16 MB, trunk_file_size=64 MB, trunk_create_file_advance=0, trunk_create_file_time_base=02:00, trunk_create_file_interval=86400, trunk_create_file_space_threshold=20 GB, trunk_init_check_occupying=0, trunk_init_reload_from_binlog=0, trunk_compress_binlog_min_interval=0, store_slave_file_use_link=0
  5. [2018-01-20 12:37:18] INFO - file: storage_func.c, line: 257, tracker_client_ip: 192.168.43.72, my_server_id_str: 192.168.43.72, g_server_id_in_filename: 1210820800
  6. [2018-01-20 12:37:18] INFO - file: tracker_client_thread.c, line: 310, successfully connect to tracker server 192.168.43.71:22122, as a tracker client, my ip is 192.168.43.72
  7. [2018-01-20 12:37:18] INFO - file: tracker_client_thread.c, line: 1947, tracker server: #0. 192.168.43.70:22122, my_report_status: -1
  8. [2018-01-20 12:37:18] INFO - file: tracker_client_thread.c, line: 310, successfully connect to tracker server 192.168.43.70:22122, as a tracker client, my ip is 192.168.43.72
  9. [2018-01-20 12:37:18] INFO - file: tracker_client_thread.c, line: 1947, tracker server: #0. 192.168.43.70:22122, my_report_status: -1
  10. [2018-01-20 12:37:48] INFO - file: tracker_client_thread.c, line: 1263, tracker server 192.168.43.71:22122, set tracker leader: 192.168.43.71:22122
  11. [2018-01-20 12:37:48] INFO - file: storage_sync.c, line: 2732, successfully connect to storage server 192.168.43.73:23000

发现此时192.168.43.71作为Tracker的Leader。

  • 设置Storage开机自启动

[root@localhost fdfs]#  echo "service fdfs_storaged start" |tee -a /etc/rc.d/rc.local
  • 安装fastdfs-nginx-module、Nginx模块

安装Nginx模块所需的依赖环境

  1. [root@localhost fdfs]# yum -y install pcre pcre-devel  
  2. [root@localhost fdfs]# yum -y install zlib zlib-devel  
  3. [root@localhost fdfs]# yum -y install openssl openssl-devel

解压nginx和fastdfs-nginx-module

  1. [root@localhost fdfs]# tar -zxvf nginx-1.10.3.tar.gz
  2. [root@localhost fdfs]# unzip fastdfs-nginx-module-master.zip

进入Nginx解压目录进行编译安装

[root@localhost nginx-1.10.3]# ./configure --prefix=/usr/local/nginx --add-module=/home/zhangyongliang/apps/fastdfs-nginx-module-master/src #解压后fastdfs-nginx-module所在的位置

安装成功后，nginx会安装在/usr/local/nginx,安装后查看

  1. [root@localhost src]# ll /usr/local/nginx/
  2. 总用量 8
  3. drwx------. 2 nobody root    6 1月  17 13:23 client_body_temp
  4. drwxr-xr-x. 2 root   root 4096 1月  17 13:17 conf
  5. drwx------. 2 nobody root    6 1月  17 13:23 fastcgi_temp
  6. drwxr-xr-x. 2 root   root   40 1月  17 13:17 html
  7. drwxr-xr-x. 2 root   root   58 1月  17 13:49 logs
  8. -rw-r--r--. 1 root   root 1156 1月  17 13:29 nginx.conf
  9. drwx------. 2 nobody root    6 1月  17 13:23 proxy_temp
  10. drwxr-xr-x. 2 root   root   19 1月  17 13:17 sbin
  11. drwx------. 2 nobody root    6 1月  17 13:23 scgi_temp
  12. drwx------. 2 nobody root    6 1月  17 13:23 uwsgi_temp

安装成功后，nginx尚未运行时，nginx文件夹没有临时文件夹，例如fastcgi_temp这些文件。


复制 fastdfs-nginx-module 源码中的配置文件到/etc/fdfs 目录， 并修改

  1. [root@localhost src]# cp /usr/local/src/fastdfs-nginx-module/src/mod_fastdfs.conf /etc/fdfs/  
  2. [root@localhost src]# vi /etc/fdfs/mod_fastdfs.conf  

  1. (1)第1组 Storage 的 mod_fastdfs.conf 配置如下：  
  2. connect_timeout=10  
  3. base_path=/opt/fastdfs_storage
  4. tracker_server=192.168.1.131:22122  
  5. tracker_server=192.168.1.132:22122  
  6. storage_server_port=23000  
  7. group_name=group1  
  8. url_have_group_name = true  
  9. store_path0=/opt/fastdfs_storage_data
  10. group_count = 2  
  11. [group1]  
  12. group_name=group1  
  13. storage_server_port=23000  
  14. store_path_count=1  
  15. store_path0=/opt/fastdfs_storage_data
  16. [group2]  
  17. group_name=group2  
  18. storage_server_port=23000  
  19. store_path_count=1  
  20. store_path0=/opt/fastdfs_storage_data 
  21. (2)第2组 Storage 的 mod_fastdfs.conf 配置与第一组配置只有 group_name 不同：  
  22. group_name=group2

完整信息如下：

  1. # connect timeout in seconds
  2. # default value is 30s
  3. connect_timeout=2
  4.  
  5. # network recv and send timeout in seconds
  6. # default value is 30s
  7. network_timeout=30
  8.  
  9. # the base path to store log files
  10. base_path=/opt/fastdfs_storage
  11.  
  12. # if load FastDFS parameters from tracker server
  13. # since V1.12
  14. # default value is false
  15. load_fdfs_parameters_from_tracker=true
  16.  
  17. # storage sync file max delay seconds
  18. # same as tracker.conf
  19. # valid only when load_fdfs_parameters_from_tracker is false
  20. # since V1.12
  21. # default value is 86400 seconds (one day)
  22. storage_sync_file_max_delay = 86400
  23.  
  24. # if use storage ID instead of IP address
  25. # same as tracker.conf
  26. # valid only when load_fdfs_parameters_from_tracker is false
  27. # default value is false
  28. # since V1.13
  29. use_storage_id = false
  30.  
  31. # specify storage ids filename, can use relative or absolute path
  32. # same as tracker.conf
  33. # valid only when load_fdfs_parameters_from_tracker is false
  34. # since V1.13
  35. storage_ids_filename = storage_ids.conf
  36.  
  37. # FastDFS tracker_server can ocur more than once, and tracker_server format is
  38. #  "host:port", host can be hostname or ip address
  39. # valid only when load_fdfs_parameters_from_tracker is true
  40. tracker_server=192.168.43.70:22122
  41. tracker_server=192.168.43.71:22122
  42.  
  43. # the port of the local storage server
  44. # the default value is 23000
  45. storage_server_port=23000
  46.  
  47. # the group name of the local storage server
  48. group_name=group1
  49.  
  50. # if the url / uri including the group name
  51. # set to false when uri like /M00/00/00/xxx
  52. # set to true when uri like ${group_name}/M00/00/00/xxx, such as group1/M00/xxx
  53. # default value is false
  54. url_have_group_name = true
  55.  
  56. # path(disk or mount point) count, default value is 1
  57. # must same as storage.conf
  58. store_path_count=1
  59.  
  60. # store_path#, based 0, if store_path0 not exists, it's value is base_path
  61. # the paths must be exist
  62. # must same as storage.conf
  63. store_path0=/opt/fastdfs_storage_data
  64. #store_path1=/home/yuqing/fastdfs1
  65.  
  66. # standard log level as syslog, case insensitive, value list:
  67. ### emerg for emergency
  68. ### alert
  69. ### crit for critical
  70. ### error
  71. ### warn for warning
  72. ### notice
  73. ### info
  74. ### debug
  75. log_level=info
  76.  
  77. # set the log filename, such as /usr/local/apache2/logs/mod_fastdfs.log
  78. # empty for output to stderr (apache and nginx error_log file)
  79. log_filename=
  80.  
  81. # response mode when the file not exist in the local file system
  82. ## proxy: get the content from other storage server, then send to client
  83. ## redirect: redirect to the original storage server (HTTP Header is Location)
  84. response_mode=proxy
  85.  
  86. # the NIC alias prefix, such as eth in Linux, you can see it by ifconfig -a
  87. # multi aliases split by comma. empty value means auto set by OS type
  88. # this paramter used to get all ip address of the local host
  89. # default values is empty
  90. if_alias_prefix=
  91.  
  92. # use "#include" directive to include HTTP config file
  93. # NOTE: #include is an include directive, do NOT remove the # before include
  94. #include http.conf
  95.  
  96.  
  97. # if support flv
  98. # default value is false
  99. # since v1.15
  100. flv_support = true
  101.  
  102. # flv file extension name
  103. # default value is flv
  104. # since v1.15
  105. flv_extension = flv
  106.  
  107.  
  108. # set the group count
  109. # set to none zero to support multi-group on this storage server
  110. # set to 0  for single group only
  111. # groups settings section as [group1], [group2], ..., [groupN]
  112. # default value is 0
  113. # since v1.14
  114. group_count = 2
  115.  
  116. # group settings for group #1
  117. # since v1.14
  118. # when support multi-group on this storage server, uncomment following section
  119. [group1]
  120. group_name=group1
  121. storage_server_port=23000
  122. store_path_count=1
  123. store_path0=/opt/fastdfs_storage_data
  124. [group2]
  125. group_name=group2
  126. storage_server_port=23000
  127. store_path_count=1
  128. store_path0=/opt/fastdfs_storage_data
  129. # group settings for group #2
  130. # since v1.14
  131. # when support multi-group, uncomment following section as neccessary
  132. #[group2]
  133. #group_name=group2
  134. #storage_server_port=23000
  135. #store_path_count=1
  136. #store_path0=/home/yuqing/fastdfs

复制 FastDFS 安装目录的部分配置文件到/etc/fdfs 目录

  1. [root@localhost conf]# pwd
  2. /home/zhangyongliang/apps/fastdfs-5.11/conf
  3. [root@localhost conf]# cp http.conf  mime.types  /etc/fdfs/

创建M00至storage存储目录的符号连接：

ln  -s  /opt/fastdfs_storage_data/data/ /opt/fastdfs_storage_data/data/M00

配置 Nginx， 简洁版 nginx 配置样例

  1. # vi /usr/local/nginx/conf/nginx.conf  
  2. user root;  
  3. worker_processes 1;  
  4. events {  
  5.     worker_connections 1024;  
  6. }  
  7. http {  
  8.     include mime.types;  
  9.     default_type application/octet-stream;  
  10.     sendfile on;  
  11.     keepalive_timeout 65;  
  12.     server {  
  13.         listen 8888;  
  14.         server_name localhost;  
  15.         location ~/group([0-9])/M00 {  
  16.             #alias /fastdfs/storage/data;  
  17.             ngx_fastdfs_module;  
  18.         }  
  19.         error_page 500 502 503 504 /50x.html;  
  20.         location = /50x.html {  
  21.             root html;  
  22.         }  
  23.     }  
  24. }

注意、 说明：

8888 端口值是要与/etc/fdfs/storage.conf 中的 http.server_port=8888 相对应，因为 http.server_port 默认为 8888,如果想改成 80，则要对应修改过来。

重新启动各节点的Nginx服务

[root@localhost conf]#/usr/local/nginx/sbin/nginx -s reload

4.文件上传测试

执行节点Tracker01、Tracker02

修改 Tracker 服务器中的客户端配置文件

  1. # vi /etc/fdfs/client.conf  
  2. base_path=/fastdfs/tracker  
  3. tracker_server=192.168.43.70:22122  
  4. tracker_server=192.168.43.71:22122

执行如下文件上传命令

  1. [root@localhost zhangyongliang]# fdfs_upload_file /etc/fdfs/client.conf P71022-205803.jpg 
  2. group1/M00/00/00/wKgrSFpjC26AH1g2AAvUQrxXbkA557.jpg
  3. [root@localhost zhangyongliang]# fdfs_upload_file /etc/fdfs/client.conf P71022-205803.jpg 
  4. group2/M00/00/00/wKgrSlpjC3aAARrXAAvUQrxXbkA048.jpg

进行2次上传后，发现文件被均衡分到2个group。

5.Tracker安装Nginx、 ngx_cache_purge 模块

  • 安装编译 Nginx 所需的依赖包

[root@localhost zhangyongliang]# yum install gcc gcc-c++ make automake autoconf libtool pcre pcre-devel zlib zlib-devel openssl openssl-devel

解压Nginx和ngx_cache_pure模块

  1. [root@localhost apps]# tar ngx_cache_purge-2.3.tar.gz
  2. [root@localhost apps]# tar nginx-1.10.3.tar.gz

编译安装 Nginx（添加 ngx_cache_purge 模块）

  1. [root@localhost apps]# cd nginx-1.13.0  
  2. [root@localhost nginx-1.13.0# ./configure --prefix=/usr/local/nginx --add-module=/usr/local/src/ngx_cache_purge-2.3  
  3. [root@localhost nginx-1.13.0]# make && make install

配置 Nginx， 设置负载均衡以及缓存

  1. # vi /usr/local/nginx/conf/nginx.conf  
  2.  
  3. #user  nobody;
  4. worker_processes  1;
  5.  
  6. #error_log  logs/error.log;
  7. #error_log  logs/error.log  notice;
  8. #error_log  logs/error.log  info;
  9.  
  10. #pid        logs/nginx.pid;
  11.  
  12.  
  13. events {
  14.     worker_connections  1024;
  15. }
  16.  
  17.  
  18. http {
  19.     include       mime.types;
  20.     default_type  application/octet-stream;
  21.  
  22.     #log_format  main  '$remote_addr - $remote_user [$time_local] "$request" '
  23.     #                  '$status $body_bytes_sent "$http_referer" '
  24.     #                  '"$http_user_agent" "$http_x_forwarded_for"';
  25.  
  26.     #access_log  logs/access.log  main;
  27.     sendfile        on;  
  28.     tcp_nopush      on;  
  29.     #tcp_nopush     on;
  30.     #keepalive_timeout  0;
  31.     keepalive_timeout  65;
  32.  
  33.     #gzip  on;
  34.     #设置缓存  
  35.     server_names_hash_bucket_size 128;  
  36.     client_header_buffer_size 32k;  
  37.     large_client_header_buffers 4 32k;  
  38.     client_max_body_size 300m;  
  39.   
  40.     proxy_redirect off;  
  41.     proxy_set_header Host $http_host;  
  42.     proxy_set_header X-Real-IP $remote_addr;  
  43.     proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;  
  44.     proxy_connect_timeout 90;  
  45.     proxy_send_timeout 90;  
  46.     proxy_read_timeout 90;  
  47.     proxy_buffer_size 16k;  
  48.     proxy_buffers 4 64k;  
  49.     proxy_busy_buffers_size 128k;  
  50.     proxy_temp_file_write_size 128k;
  51.     #设置缓存存储路径，存储方式，分别内存大小，磁盘最大空间，缓存期限  
  52.     proxy_cache_path /opt/fastdfs_tracker/proxy_cache levels=1:2 
  53.     keys_zone=http-cache:200m max_size=1g inactive=30d;
  54.     proxy_temp_path /opt/fastdfs_tracker/tmp;
  55.     #group1的服务设置  
  56.     upstream fdfs_group1 {  
  57.          server 192.168.43.72:8888 weight=1 max_fails=2 fail_timeout=30s;  
  58.          server 192.168.43.73:8888 weight=1 max_fails=2 fail_timeout=30s;  
  59.     }
  60.     #group2的服务设置  
  61.     upstream fdfs_group2 {  
  62.          server 192.168.43.74:8888 weight=1 max_fails=2 fail_timeout=30s;  
  63.          server 192.168.43.75:8888 weight=1 max_fails=2 fail_timeout=30s;  
  64.     }
  65.     
  66.     server {
  67.         listen       8000;
  68.         server_name  localhost;
  69.  
  70.         #charset koi8-r;
  71.  
  72.         #access_log  logs/host.access.log  main;
  73.         #group1的负载均衡配置  
  74.         location /group1/M00 {  
  75.             proxy_next_upstream http_502 http_504 error timeout invalid_header;  
  76.             proxy_cache http-cache;  
  77.             proxy_cache_valid 200 304 12h;  
  78.             proxy_cache_key $uri$is_args$args;  
  79.             #对应group1的服务设置  
  80.             proxy_pass http://fdfs_group1;  
  81.             expires 30d;  
  82.         }
  83.         location /group2/M00 {  
  84.             proxy_next_upstream http_502 http_504 error timeout invalid_header;  
  85.             proxy_cache http-cache;  
  86.             proxy_cache_valid 200 304 12h;  
  87.             proxy_cache_key $uri$is_args$args;  
  88.             #对应group2的服务设置  
  89.             proxy_pass http://fdfs_group2;  
  90.             expires 30d;  
  91.          }
  92.         location ~/purge(/.*) {  
  93.             allow 127.0.0.1;  
  94.             allow 192.168.43.0/24;  
  95.             deny all;  
  96.             proxy_cache_purge http-cache $1$is_args$args;  
  97.         }        
  98.         location / {
  99.             root   html;
  100.             index  index.html index.htm;
  101.         }
  102.  
  103.         #error_page  404              /404.html;
  104.  
  105.         # redirect server error pages to the static page /50x.html
  106.         #
  107.         error_page   500 502 503 504  /50x.html;
  108.         location = /50x.html {
  109.             root   html;
  110.         }
  111.  
  112.         # proxy the PHP scripts to Apache listening on 127.0.0.1:80
  113.         #
  114.         #location ~ \.php$ {
  115.         #    proxy_pass   http://127.0.0.1;
  116.         #}
  117.  
  118.         # pass the PHP scripts to FastCGI server listening on 127.0.0.1:9000
  119.         #
  120.         #location ~ \.php$ {
  121.         #    root           html;
  122.         #    fastcgi_pass   127.0.0.1:9000;
  123.         #    fastcgi_index  index.php;
  124.         #    fastcgi_param  SCRIPT_FILENAME  /scripts$fastcgi_script_name;
  125.         #    include        fastcgi_params;
  126.         #}
  127.  
  128.         # deny access to .htaccess files, if Apache's document root
  129.         # concurs with nginx's one
  130.         #
  131.         #location ~ /\.ht {
  132.         #    deny  all;
  133.         #}
  134.     }
  135.  
  136.  
  137.     # another virtual host using mix of IP-, name-, and port-based configuration
  138.     #
  139.     #server {
  140.     #    listen       8000;
  141.     #    listen       somename:8080;
  142.     #    server_name  somename  alias  another.alias;
  143.  
  144.     #    location / {
  145.     #        root   html;
  146.     #        index  index.html index.htm;
  147.     #    }
  148.     #}
  149.  
  150.  
  151.     # HTTPS server
  152.     #
  153.     #server {
  154.     #    listen       443 ssl;
  155.     #    server_name  localhost;
  156.  
  157.     #    ssl_certificate      cert.pem;
  158.     #    ssl_certificate_key  cert.key;
  159.  
  160.     #    ssl_session_cache    shared:SSL:1m;
  161.     #    ssl_session_timeout  5m;
  162.  
  163.     #    ssl_ciphers  HIGH:!aNULL:!MD5;
  164.     #    ssl_prefer_server_ciphers  on;
  165.  
  166.     #    location / {
  167.     #        root   html;
  168.     #        index  index.html index.htm;
  169.     #    }
  170.     #}
  171.  
  172. }

根据Nginx配置，创建对应目录下的文件夹

  1. [root@localhost fastdfs_tracker]# mkdir proxy_cache tmp
  2. [root@localhost fastdfs_tracker]# ll
  3. 总用量 0
  4. drwxr-xr-x. 2 root   root 178 1月  20 12:37 data
  5. drwxr-xr-x. 2 root   root  26 1月  19 12:01 logs
  6. drwxr-xr-x. 7 nobody root  51 1月  19 19:35 proxy_cache
  7. drwxr-xr-x. 2 nobody root   6 1月  19 19:35 tmp

重启Nginx进行访问测试

  1. 重启 Nginx  
  2. [root@localhost fastdfs_tracker]# /usr/local/nginx/sbin/nginx -s reload

前面直接通过访问 Storage 节点中的 Nginx 的文件

http://192.168.43.72:8888/group1/M00/00/00/wKgrSFpjC26AH1g2AAvUQrxXbkA557.jpg]

http://192.168.43.74:8888/group2/M00/00/00/wKgrSlpjC3aAARrXAAvUQrxXbkA048.jpg

现在可以通过 Tracker 中的 Nginx 来进行访问

(1)通过 Tracker1 中的 Nginx 来访问

http://192.168.43.70:8000/group1/M00/00/00/wKgrSFpjC26AH1g2AAvUQrxXbkA557.jpg

http://192.168.43.70:8000/group2/M00/00/00/wKgrSlpjC3aAARrXAAvUQrxXbkA048.jpg

(2)通过 Tracker2 中的 Nginx 来访问

http://192.168.43.71:8000/group1/M00/00/00/wKgrSFpjC26AH1g2AAvUQrxXbkA557.jpg

http://192.168.50.71:8000/group2/M00/00/00/wKgrSlpjC3aAARrXAAvUQrxXbkA048.jpg

6.构建Keepalive+Nginx 实现虚拟IP的代理

关于使用Keepalive+Nginx进行代理的环境安装，请参考本人简书此文：Keepalived+Nginx+Tomcat 实现高可用Web集群

本文不再做赘述说明

  • 启动Keepalvie+nginx Master主节点【192.168.43.101】
  • 启动Keepalvie+nginx BackUp备节点【192.168.43.102】


    修改2个节点Nginx下目录的nginx.conf的配置文件信息，添加如下内容

    主要内容为2个Tracker加入到Keepalive+nginx代理当中

  1. upstream fastdfs_tracker {  
  2.    server 192.168.43.70:8000 weight=1 max_fails=2 fail_timeout=30s;  
  3.    server 192.168.43.71:8000 weight=1 max_fails=2 fail_timeout=30s;  
  4. }

第二处修改是添加了一个location并且匹配规则是路径当中有fastdfs

  1. location /fastdfs {  
  2.            root html;  
  3.            index index.html index.htm;  
  4.            proxy_pass http://fastdfs_tracker/;  
  5.            proxy_set_header Host $http_host;  
  6.            proxy_set_header Cookie $http_cookie;  
  7.            proxy_set_header X-Real-IP $remote_addr;  
  8.            proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;  
  9.            proxy_set_header X-Forwarded-Proto $scheme;  
  10.            client_max_body_size 300m;  
  11.         }

完整配置代码如下：

  1.  
  2. #user  nobody;
  3. worker_processes  1;
  4.  
  5. #error_log  logs/error.log;
  6. #error_log  logs/error.log  notice;
  7. #error_log  logs/error.log  info;
  8.  
  9. #pid        logs/nginx.pid;
  10.  
  11.  
  12. events {
  13.     worker_connections  1024;
  14. }
  15.  
  16.  
  17. http {
  18.     include       mime.types;
  19.     default_type  application/octet-stream;
  20.  
  21.     #log_format  main  '$remote_addr - $remote_user [$time_local] "$request" '
  22.     #                  '$status $body_bytes_sent "$http_referer" '
  23.     #                  '"$http_user_agent" "$http_x_forwarded_for"';
  24.  
  25.     #access_log  logs/access.log  main;
  26.  
  27.     sendfile        on;
  28.     #tcp_nopush     on;
  29.  
  30.     #keepalive_timeout  0;
  31.     keepalive_timeout  65;
  32.  
  33.     #gzip  on;
  34.     upstream fastdfs_tracker {  
  35.        server 192.168.43.70:8000 weight=1 max_fails=2 fail_timeout=30s;  
  36.        server 192.168.43.71:8000 weight=1 max_fails=2 fail_timeout=30s;  
  37.     }  
  38.     upstream tomcat{
  39.      server 192.168.43.103:8080 weight=1;
  40.      server 192.168.43.104:8080 weight=1;
  41.     }
  42.  
  43.     server {
  44.         listen       80;
  45.         server_name  localhost;
  46.  
  47.         #charset koi8-r;
  48.  
  49.         #access_log  logs/host.access.log  main;
  50.  
  51.         location / {
  52.             proxy_pass http://tomcat;
  53.             proxy_set_header X-NGINX "NGINX-1";
  54.             root   html;
  55.             index  index.html index.htm;
  56.         }
  57.  
  58.         #error_page  404              /404.html;
  59.  
  60.         # redirect server error pages to the static page /50x.html
  61.         #
  62.         error_page   500 502 503 504  /50x.html;
  63.         location = /50x.html {
  64.             root   html;
  65.         }
  66.         location /fastdfs {  
  67.            root html;  
  68.            index index.html index.htm;  
  69.            proxy_pass http://fastdfs_tracker/;  
  70.            proxy_set_header Host $http_host;  
  71.            proxy_set_header Cookie $http_cookie;  
  72.            proxy_set_header X-Real-IP $remote_addr;  
  73.            proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;  
  74.            proxy_set_header X-Forwarded-Proto $scheme;  
  75.            client_max_body_size 300m;  
  76.         }  
  77.  
  78.         # proxy the PHP scripts to Apache listening on 127.0.0.1:80
  79.         #
  80.         #location ~ \.php$ {
  81.         #    proxy_pass   http://127.0.0.1;
  82.         #}
  83.  
  84.         # pass the PHP scripts to FastCGI server listening on 127.0.0.1:9000
  85.         #
  86.         #location ~ \.php$ {
  87.         #    root           html;
  88.         #    fastcgi_pass   127.0.0.1:9000;
  89.         #    fastcgi_index  index.php;
  90.         #    fastcgi_param  SCRIPT_FILENAME  /scripts$fastcgi_script_name;
  91.         #    include        fastcgi_params;
  92.         #}
  93.  
  94.         # deny access to .htaccess files, if Apache's document root
  95.         # concurs with nginx's one
  96.         #
  97.         #location ~ /\.ht {
  98.         #    deny  all;
  99.         #}
  100.     }
  101.  
  102.  
  103.     # another virtual host using mix of IP-, name-, and port-based configuration
  104.     #
  105.     #server {
  106.     #    listen       8000;
  107.     #    listen       somename:8080;
  108.     #    server_name  somename  alias  another.alias;
  109.  
  110.     #    location / {
  111.     #        root   html;
  112.     #        index  index.html index.htm;
  113.     #    }
  114.     #}
  115.  
  116.  
  117.     # HTTPS server
  118.     #
  119.     #server {
  120.     #    listen       443 ssl;
  121.     #    server_name  localhost;
  122.  
  123.     #    ssl_certificate      cert.pem;
  124.     #    ssl_certificate_key  cert.key;
  125.  
  126.     #    ssl_session_cache    shared:SSL:1m;
  127.     #    ssl_session_timeout  5m;
  128.  
  129.     #    ssl_ciphers  HIGH:!aNULL:!MD5;
  130.     #    ssl_prefer_server_ciphers  on;
  131.  
  132.     #    location / {
  133.     #        root   html;
  134.     #        index  index.html index.htm;
  135.     #    }
  136.     #}
  137.  
  138. }

修改之后，重新启动Keepalive+Nginx2台主备节点。

[root@nginx1 conf]#  /usr/local/nginx/sbin/nginx -s reload

我们现在就用虚拟IP192.168.43.150来访问我们刚才上传的图片，只是注意在地址栏中要记得输入fastdfs（这是我们nginx.conf文件中location /fastdfs{}规则规定的）。如下图所示，发现，我们通过虚拟IP便可以访问我们上传的图片了。这样的好处是，对用户来说，只需要访问这个虚拟IP就可以了，不用关心FastDFS集群内部的转发机制。

 

集群VIP访问截图.png

至此，分布式文件系统就搭建完成了，在通过Java访问时，只要在配置文件配置所有的Tracker节点IP信息就可以啦！

补充说明：

如果Tracker 服务、Storage服务、Nginx服务开机后没有自启动，请执行一下操作并进行重启

  1. [root@localhost ~]# chkconfig  --add fdfs_trackerd
  2. [root@localhost ~]# chkconfig  --add fdfs_storaged

编辑目录下的/etc/rc.d/rc.local,内容如下：

  1. #!/bin/bash
  2. # THIS FILE IS ADDED FOR COMPATIBILITY PURPOSES
  3. #
  4. # It is highly advisable to create own systemd services or udev rules
  5. # to run scripts during boot instead of using this file.
  6. #
  7. # In contrast to previous versions due to parallel execution during boot
  8. # this script will NOT be run after all other services.
  9. #
  10. # Please note that you must run 'chmod +x /etc/rc.d/rc.local' to ensure
  11. # that this script will be executed during boot.
  12.  
  13. touch /var/lock/subsys/local
  14. /usr/local/nginx/sbin/nginx

主要增加了Nginx的启动，之后进行文件授权，生效文件，重新启动系统

  1. [root@localhost ~]# chmod  +x /etc/rc.d/rc.local
  2. [root@localhost ~]# source /etc/rc.d/rc.local 
  3. [root@localhost ~]# reboot



作者：溯水心生
链接：https://www.jianshu.com/p/88ccae4cbd82
来源：简书

声明：本文内容由网友自发贡献，不代表【wpsshop博客】立场，版权归原作者所有，本站不承担相应法律责任。如您发现有侵权的内容，请联系我们。转载请注明出处：https://www.wpsshop.cn/w/weixin_40725706/article/detail/923292
推荐阅读
相关标签

Copyright © 2003-2013 www.wpsshop.cn 版权所有，并保留所有权利。

  

闽ICP备14008679号