devbox
码创造者
这个屌丝很懒，什么也没留下！
关注作者
热门标签
热门文章
当前位置:   article > 正文

zstd压缩与lz4压缩比较_zstd和lz4哪个好

作者：码创造者 | 2024-07-16 14:09:02

赞

踩

zstd和lz4哪个好

最近由于业务需求需要对数据进行压缩，相关压缩算法介绍的都比较多，比较详细，笔者在这里就不赘述。本篇主要针对C语言调用zstd、lz4压缩算法的接口调用,并对其做简单的比较。下述案例中的源码也可通过该链接下载 ： 压缩算法包

ZSTD源码编译及测试

源码编译

        1、获取zstd源码，网址：https://github.com/facebook/zstd/，打开网址如下操作：

点击红色获取Releases版本源码，拉到页面最下边如下图：

        2、将源码移到自己的环境解压（tar -zxcf zstd-1.5.2.tar.gz）、编译(make)，生成zstd静态库、动态库及程序调用所需头文件。如下图所示：

 案例调用

        1、创建一个与刚解压的zstd-1.5.2目录同级的目录zstd_demo；将案例代码与Makefile文件放入目录中，如下图所示：

         2、zstd_demo.c与Makefile文件如下：

  1. /********************************************
  2. Date	:	2022-05-17 
  3. Author	:	lijd
  4. Func	:	用生产业务数据测试zstd压缩算法
  5. ********************************************/
  6.  
  7. #include <stdio.h>
  8. #include <sys/time.h>
  9. #include "zstd.h"
  10.  
  11. #include <string.h>
  12.  
  13. char g_str[] ="2323024C5A474E41374535334C583636363032330101006016050D121015020013FFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF0006D1F4A901D0C74FFFFFFFFF880002001CFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF88F001000C0100000006D1F4A901D0C74FA12323034C5A474E41374535334C583636363032330101006016050C0B012E020006FFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF0006D1F4B001D0C8EFFFFFFFFF880002001CFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF88F001000C0100000006D1F4B001D0C8EF872323034C5A474E41374535334C583636363032330101006016050C0B012F020007FFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF0006D1F4B701D0C8E7FFFFFFFF880002001CFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF88F001000C0100000006D1F4B701D0C8E7872323034C5A474E41374535334C583636363032330101006016050C0B0130020008FFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF0006D1F4B701D0C8E0FFFFFFFF880002001CFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF88F001000C0100000006D1F4B701D0C8E0972323024C5A474E41374535334C583636363032330101006016050D121017020014FFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF0006D1F4A901D0C74FFFFFFFFF880002001CFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF88F001000C0100000006D1F4A901D0C74FA42323034C5A474E41374535334C583636363032330101006016050C0B0131020009FFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF0006D1F4B701D0C8DDFFFFFFFF880002001CFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF88F001000C0100000006D1F4B701D0C8DD972323024C5A474E41374535334C583636363032330101006016050D121018020015FFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF0006D1F4A901D0C74FFFFFFFFF880002001CFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF88F001000C0100000006D1F4A901D0C74FAA2323034C5A474E41374535334C583636363032330101006016050C0B013202000AFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF0006D1F4B501D0C8D6FFFFFFFF880002001CFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF88F001000C0100000006D1F4B501D0C8D6972323034C5A474E41374535334C583636363032330101006016050C0B013302000BFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF0006D1F4B001D0C8CEFFFFFFFF880002001CFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF88F001000C0100000006D1F4B001D0C8CE97";
  14.  
  15. // 十六进制转字符串
  16. int HexToStr(char *p_hexstr, int iHexLen, char *pdststr)
  17. {
  18. 	int iret = 0;
  19. 	while(p_hexstr != NULL && pdststr != NULL && iHexLen > 1)
  20. 	{
  21. 		char cTemp = '0';
  22. 		
  23. 		// printf("1:%c, 2:%c\n", p_hexstr[0], p_hexstr[1]);
  24. 		
  25. 		// 小写统一转大写
  26. 		if(p_hexstr[0] >= '0' && p_hexstr[0] <= '9')
  27. 		{
  28. 			cTemp = p_hexstr[0] - '0';
  29. 		}
  30. 		else if(p_hexstr[0] >= 'A' && p_hexstr[0] <= 'F')
  31. 		{
  32. 			cTemp = p_hexstr[0] - 'A' + 10;
  33. 		}
  34. 		else if(p_hexstr[0] >= 'a' && p_hexstr[0] <= 'f')
  35. 		{
  36. 			cTemp = p_hexstr[0] - 'a' + 10;
  37. 		}
  38. 		else
  39. 		{
  40. 			printf("the hex str is error!\n");
  41. 			break;
  42. 		}
  43. 		
  44. 		*pdststr = cTemp * 16;
  45. 		
  46. 		if(p_hexstr[1] >= '0' && p_hexstr[1] <= '9')
  47. 		{
  48. 			cTemp = p_hexstr[1] - '0';
  49. 		}
  50. 		else if(p_hexstr[1] >= 'A' && p_hexstr[1] <= 'F')
  51. 		{
  52. 			cTemp = p_hexstr[1] - 'A' + 10;
  53. 		}
  54. 		else if(p_hexstr[1] >= 'a' && p_hexstr[1] <= 'f')
  55. 		{
  56. 			cTemp = p_hexstr[1] - 'a' + 10;
  57. 		}
  58. 		else
  59. 		{
  60. 			printf("the hex str is error!\n");
  61. 			break;
  62. 		}
  63. 		*pdststr += cTemp;
  64. 		
  65. 		// printf("---iHexLen:%d, pdststr:%c\n", iHexLen, *pdststr);
  66. 		
  67. 		iHexLen -= 2;
  68. 		p_hexstr += 2;
  69. 		pdststr++;
  70. 		iret++;
  71. 	}
  72. 	
  73. 	// printf("iret : %d\n", iret);
  74. 	
  75. 	return iret;
  76. }
  77.  
  78. // 字符串转十六进制
  79. int StrToHex(const char *p_strstr, int iStrLen, char *pdststr)
  80. {
  81. 	int index_str = 0, index_hex = 0;
  82.  
  83. 	const char cHex[] = "0123456789ABCDEF";
  84. 	while(index_str < iStrLen && p_strstr != NULL && pdststr != NULL)
  85. 	{
  86. 		pdststr[index_hex++] = cHex[((UCHAR)p_strstr[index_str])/16];
  87. 		pdststr[index_hex++] = cHex[((UCHAR)p_strstr[index_str++])%16];
  88. 	}
  89.  
  90. 	return index_hex;
  91. }
  92.  
  93. int main()
  94. {
  95. 	struct timeval curTime;
  96. 	char src[2048] = {0};
  97. 	char dst[2048] = {0}, src2[2048] = {0};
  98. 	
  99. 	int iStrlen = HexToStr(g_str, strlen(g_str), src);
  100. 	
  101. 	printf("业务数据原始长度 : %d 字节\n", iStrlen);
  102. 	
  103. 	gettimeofday(&curTime, NULL);
  104.     int time_usec = curTime.tv_usec;
  105. 	
  106. 	int cSize = ZSTD_compress(dst, 2048, src, iStrlen, 3);
  107. 	
  108. 	gettimeofday(&curTime, NULL);
  109.     time_usec = curTime.tv_usec - time_usec;
  110. 	
  111. 	printf("ZSTD 压缩所用时间 : %u 微秒, 压缩后长度 : %d 字节\n", time_usec, cSize);
  112. 	
  113. 	gettimeofday(&curTime, NULL);
  114. 	time_usec = curTime.tv_usec;
  115. 	
  116. 	int cSize2 = ZSTD_decompress(src2, 2048, dst, cSize);
  117. 	
  118. 	gettimeofday(&curTime, NULL);
  119.     time_usec = curTime.tv_usec - time_usec;
  120. 	printf("压缩后数据解压所需时间 : %u 微秒, 解压后数据长度 : %d 字节\n", time_usec, cSize2);
  121. 	
  122. 	return 0;
  123. }
  1. # Func: zstd_demo
  2. # Auth: lijd
  3. # Date: 2022/05/17
  4.  
  5. CC       := gcc
  6. TARGET   := zstd_demo
  7. INCLUDES := ../zstd-1.5.2/lib/
  8. LIBDIRS  := ../zstd-1.5.2/lib/
  9. LIBS     := zstd
  10. FLAGES   := $(addprefix -I, $(INCLUDES)) $(addprefix -L, $(LIBDIRS)) $(addprefix -l, $(LIBS))
  11. SRCS  	 := $(wildcard *.c)
  12.  
  13. $(TARGET): $(SRCS)
  14. 	$(CC) -g -Wall -o $@ $^ $(FLAGES)
  15. 	@echo "==================================== Build OK!!! ===================================="
  16.  
  17. .PHONY: clean
  18. clean:
  19. 	@rm -rf $(TARGET)
  20.

        3、编译成功后，运行可能找不到依赖的动态库，需要将环境变量设置一下，注意笔者用的这种设置方式只是暂时的。如下图：

 lz4源码编译及测试     

  源码编译

         1、获取zstd源码，网址：Index of /ubuntu/pool/main/l/lz4，打开网址如下操作：

​

          2、将源码移到自己的环境解压（tar -zxcf lz4_1.9.2.orig.tar.gz）、编译(make)，生成lz4静态库、动态库及程序调用所需头文件。如下图所示：

​

案例调用

        1、创建一个与刚解压的lz4_1.9.2目录同级的目录lz4_demo；将test.c与Makefile文件放入目录中，代码只有调用压缩解压的函数接口有变动，其余都一样，Makefile只有小的改动。这里只给出变动的main函数如下：

  1. int main()
  2. {
  3. 	struct timeval curTime;
  4. 	char src[2048] = {0};
  5. 	char dst[2048] = {0}, src2[2048] = {0};
  6. 	
  7. 	int iStrlen = HexToStr(g_str, strlen(g_str), src);
  8. 	
  9. 	printf("业务数据原始长度 : %d 字节\n", iStrlen);
  10. 	
  11. 	gettimeofday(&curTime, NULL);
  12.     int time_usec = curTime.tv_usec;
  13. 	
  14. 	int cSize = LZ4_compress_default(src, dst, iStrlen, 2048);
  15. 	
  16. 	gettimeofday(&curTime, NULL);
  17.     time_usec = curTime.tv_usec - time_usec;
  18. 	
  19. 	printf("LZ4 压缩所用时间 : %u 微秒, 压缩后长度 : %d 字节\n", time_usec, cSize);
  20. 	
  21. 	gettimeofday(&curTime, NULL);
  22. 	time_usec = curTime.tv_usec;
  23. 	
  24. 	int cSize2 = LZ4_decompress_safe(dst, src2, cSize, 2048);
  25. 	
  26. 	gettimeofday(&curTime, NULL);
  27.     time_usec = curTime.tv_usec - time_usec;
  28. 	printf("压缩后数据解压所需时间 : %u 微秒, 解压后数据长度 : %d 字节\n", time_usec, cSize2);
  29. 	
  30. 	return 0;
  31. }

        2、编译成功后运行如下图：

 总结

        笔者将相同的业务数据，用不同的压缩解压算法进行压缩、解压；得到的结构也显而易见：zstd(81%)在压缩率优于lz4(71%)；但在压缩、解压时间上lz4远远优于zstd，lz4不愧为压缩界的速度之王。

声明：本文内容由网友自发贡献，不代表【wpsshop博客】立场，版权归原作者所有，本站不承担相应法律责任。如您发现有侵权的内容，请联系我们。转载请注明出处：https://www.wpsshop.cn/w/码创造者/article/detail/834552
推荐阅读
相关标签

Copyright © 2003-2013 www.wpsshop.cn 版权所有，并保留所有权利。

  

闽ICP备14008679号