There are 2 missing blocks The following files may be corrupted_there are 2 missing blocks. the following files ma

There are 2 missing blocks. The following files may be corrupted:

步骤1，检查文件缺失情况

可以看到，
/user/hive/warehouse/mid_table/part-00000-2434bd33-8a21-4249-9c0c-17e0f4ba397b-c000.snappy.parquet
/user/hive/warehouse/mid_table/part-00000-5d5247ea-8efb-4d96-850f-01fd2fb94211-c000.snappy.parquet
确实各自都丢失了1个Block， 文件已经损坏，不可恢复。

[root@s100 service]#   hadoop fsck /user/hive/warehouse | grep parquet
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.

18/05/05 10:32:30 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Connecting to namenode via http://s100:50070/fsck?ugi=root&path=%2Fuser%2Fhive%2Fwarehouse
/user/hive/warehouse/mid_table/part-00000-2434bd33-8a21-4249-9c0c-17e0f4ba397b-c000.snappy.parquet: CORRUPT blockpool BP-1561093445-172.18.18.100-1522119663560 block blk_1073901422
/user/hive/warehouse/mid_table/part-00000-2434bd33-8a21-4249-9c0c-17e0f4ba397b-c000.snappy.parquet: MISSING 1 blocks of total size 1477 B............................................................................
/user/hive/warehouse/mid_table/part-00000-4537a72d-88df-4eef-a981-fd767dd263aa-c000.snappy.parquet:  Under replicated BP-1561093445-172.18.18.100-1522119663560:blk_1073901420_160599. Target Replicas is 3 but found 2 replica(s).
/user/hive/warehouse/mid_table/part-00000-5d5247ea-8efb-4d96-850f-01fd2fb94211-c000.snappy.parquet: CORRUPT blockpool BP-1561093445-172.18.18.100-1522119663560 block blk_1073901421
/user/hive/warehouse/mid_table/part-00000-5d5247ea-8efb-4d96-850f-01fd2fb94211-c000.snappy.parquet: MISSING 1 blocks of total size 1477 B....
[root@s100 service]# 
1
2
3
4
5
6
7
8
9
10
11
12

步骤2，删除缺失文件

hadoop fsck -delete /user/hive/warehouse/mid_table/part-00000-2434bd33-8a21-4249-9c0c-17e0f4ba397b-c000.snappy.parquet
hadoop fsck -delete /user/hive/warehouse/mid_table/part-00000-5d5247ea-8efb-4d96-850f-01fd2fb94211-c000.snappy.parquet

步骤3， 检查集群健康状况