devbox
笔触狂放9
这个屌丝很懒，什么也没留下！
关注作者
热门标签
热门文章
当前位置:   article > 正文

京东商品评论数据爬虫，包含对数据的采集、清洗、可视化、分析等过程，作为数据库课程。_京东 x-api-eid-token 爬虫

作者：笔触狂放9 | 2024-04-04 19:07:46

赞

踩

京东 x-api-eid-token 爬虫

感谢大家的star和fork，为了感谢大家的关注，特意对代码进行了优化，对最新的url格式进行了更新，减少了一些冗余的参数，希望能够帮助大家入门爬虫，已经爬好的京东的商品评论数据已经存储在data目录下，可以直接用于进一步分析。后续会重新封装几个版本，主要是添加多线程、redis缓存等机制提高爬虫效率，同时也将把核心参数打包成json方便使用。 

希望你抓取顺利，同时也希望大家多多关注和支持，你们的fork是对我最大的认可，哈哈哈！

JD.item_review-获得JD商品评论接口

公共参数

名称类型必须描述
keyString是调用key（必须以GET方式拼接在URL中,获取key和secret）
secretString是调用密钥 （复制v:Taobaoapi2014 )
api_nameString是API接口名称（包括在请求地址中）[item_search,item_get,item_search_shop等]
cacheString否[yes,no]默认yes，将调用缓存的数据，速度比较快
result_typeString否[json,jsonu,xml,serialize,var_export]返回数据格式，默认为json，jsonu输出的内容中文可以直接阅读
langString否[cn,en,ru]翻译语言，默认cn简体中文
versionString否API版本

请求参数

请求参数：num_iid=71619129750&page=1

参数说明：item_id:商品ID
page:页数

 响应示例

请求示例

 响应示例

  1. {
  2. 	"items": {
  3. 		"totalpage": "100",
  4. 		"total_results": "0",
  5. 		"page_size": 10,
  6. 		"page": "1",
  7. 		"item": [
  8. 			{
  9. 				"rate_content": "鞋子的版型很好看，价格也很便宜，穿上舒适透气，非常的喜欢，值得购买",
  10. 				"rate_date": "2020-07-16 17:04:45",
  11. 				"pics": [
  12. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/143538/26/2997/98915/5f10182dE075cf6f4/3893a6ebd54bf20b.jpg",
  13. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/126308/37/7305/88222/5f10182dE2ed282fb/cfebb2e627fe3be4.jpg",
  14. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/123576/17/7322/100064/5f10182dE90877815/bb5f985a08987bc6.jpg",
  15. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/133271/17/4481/244268/5f10182dEd8ecc049/555eaa30d3599158.jpg",
  16. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/146490/36/3038/90958/5f10182dE065f71fd/12bb1e78f59309d7.jpg"
  17. 				],
  18. 				"display_user_nick": "j***X",
  19. 				"auction_sku": "MX-D01黑色(女)",
  20. 				"add_feedback": ""
  21. 			},
  22. 			{
  23. 				"rate_content": "鞋子很青春休闲，版型很好看，又百搭面料，摸着很舒服，穿着非常的舒适，很满意。",
  24. 				"rate_date": "2020-07-16 14:58:08",
  25. 				"pics": [
  26. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/126114/25/7235/113602/5f0ffa80E13a4cbd1/4bb8f80169565723.jpg",
  27. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/116245/40/12535/94358/5f0ffa80Eb718edcc/a2fa0be8e208f728.jpg",
  28. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/131138/21/4585/162381/5f0ffa80E85973f3d/95647e8bbcc82ad3.jpg",
  29. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/120553/13/7355/126975/5f0ffa80Ee8c6b756/959b3ea6f73ecb86.jpg"
  30. 				],
  31. 				"display_user_nick": "j***G",
  32. 				"auction_sku": "MX-D01黑色(女)",
  33. 				"add_feedback": ""
  34. 			},
  35. 			{
  36. 				"rate_content": "鞋子已收到，穿上不闷很透气，鞋子的图案版型都很喜欢，买的是黑色的，非常耐脏嘛，尺码很标准。",
  37. 				"rate_date": "2020-07-17 18:03:27",
  38. 				"pics": [
  39. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/125182/11/7291/418447/5f11776fE80c296f6/ce4f18132f1339d5.jpg",
  40. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/124968/39/7243/404641/5f11776fE33777d13/ed56246d66b430e1.jpg",
  41. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/129908/23/4700/412863/5f11776fEe04d86f6/a2b308efe09cf8e4.jpg",
  42. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/128096/4/7282/405527/5f11776fE9788ca8f/cafeb1a293a9813e.jpg",
  43. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/115520/15/12445/454682/5f11776fE134e0e3f/9450910b70809f2b.jpg"
  44. 				],
  45. 				"display_user_nick": "j***s",
  46. 				"auction_sku": "MX-D01黑色(女)",
  47. 				"add_feedback": ""
  48. 			},
  49. 			{
  50. 				"rate_content": "帆布鞋质量不错，穿上正合适很舒适，尺码标准，脚感很好，非常喜欢。",
  51. 				"rate_date": "2020-07-21 18:52:02",
  52. 				"pics": [
  53. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/130056/36/5089/278917/5f16c8d2E196f34fd/5ad753039b65125e.jpg",
  54. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/141143/2/3492/277303/5f16c8d2E7e0c067d/f0614a2ff7580edd.jpg",
  55. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/133845/33/4975/258500/5f16c8d2E39f1a05a/324fe698896c798b.jpg",
  56. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/130437/17/5133/258634/5f16c8d2Ee4c72f6f/12f407a4aedc1c30.jpg"
  57. 				],
  58. 				"display_user_nick": "j***T",
  59. 				"auction_sku": "MX-D01黑色(女)",
  60. 				"add_feedback": ""
  61. 			},
  62. 			{
  63. 				"rate_content": "鞋子收到了，鞋子材质很好，款式简约新颖非常喜欢，版型也好看很百搭，总体非常满意。",
  64. 				"rate_date": "2020-07-20 18:07:58",
  65. 				"pics": [
  66. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/142827/18/3375/464946/5f156cfeEd3009ae9/dc98d03cb6262314.jpg",
  67. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/147097/19/3295/466559/5f156cfeE08f4dba7/ed784fb4e453c513.jpg",
  68. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/126388/38/7636/482686/5f156cfeEee2e1160/ffd1663c5236515a.jpg"
  69. 				],
  70. 				"display_user_nick": "j***Y",
  71. 				"auction_sku": "MX-D01黑色(女)",
  72. 				"add_feedback": ""
  73. 			},
  74. 			{
  75. 				"rate_content": "鞋子收到了，特别舒服的一款帆布鞋，大小合适喜欢",
  76. 				"rate_date": "2020-07-20 18:14:39",
  77. 				"pics": [
  78. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/118301/23/12855/72815/5f156e8fEa83416e3/f92e7f5b823c8a70.jpg",
  79. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/135616/29/4848/72074/5f156e8fEc82a7d80/6484851d44574830.jpg",
  80. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/148932/1/3387/69784/5f156e8fE7ba78e9d/7b61ee6327626d78.jpg",
  81. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/150109/36/3353/66120/5f156e8eE82e25eaf/9055b98faf6a044d.jpg",
  82. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/118412/31/12839/72815/5f156e8fE721e7bfd/327582fa5d9a25b3.jpg"
  83. 				],
  84. 				"display_user_nick": "j***y",
  85. 				"auction_sku": "MX-D01黑色(女)",
  86. 				"add_feedback": ""
  87. 			},
  88. 			{
  89. 				"rate_content": "东西非常不错 颜值很高很满意  搭配上牛仔裤在夏天穿 上身白体桖  一股浓郁的学院风扑面而来  年轻了十几岁",
  90. 				"rate_date": "2020-07-25 22:09:33",
  91. 				"pics": [
  92. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/126821/34/7944/185434/5f1c3d1dE11aea5ec/689c14ef4399a439.jpg"
  93. 				],
  94. 				"display_user_nick": "三***容",
  95. 				"auction_sku": "YC-X-188米色(女)",
  96. 				"add_feedback": ""
  97. 			},
  98. 			{
  99. 				"rate_content": "这个帆布鞋的款式挺不错的，穿着也很百搭，做工很精细。",
  100. 				"rate_date": "2020-07-20 00:01:00",
  101. 				"pics": [
  102. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/119504/13/11389/520508/5f1581faEf69c5854/2377fb2e01fc79e2.jpg",
  103. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/135899/37/4958/566205/5f1581faEc5f67e4c/1bd719364ac26276.jpg",
  104. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/110797/21/15353/558212/5f1581fbE98486508/98667557f6b47c31.jpg"
  105. 				],
  106. 				"display_user_nick": "j***y",
  107. 				"auction_sku": "MX-D01黑色(女)",
  108. 				"add_feedback": "很有个性的一款鞋子，穿的舒适，样子新颖，质量也很好。"
  109. 			},
  110. 			{
  111. 				"rate_content": "这个鞋子我非常的喜欢，而且穿着特别的舒服，搭配起衣服来也特别的百搭。非常值得购买的一款鞋子。",
  112. 				"rate_date": "2020-09-16 09:18:43",
  113. 				"pics": [
  114. 					"//img30.360buyimg.com/n0/s128x96_jfs/t1/120503/26/12622/88927/5f6167efE6c9ef8ae/6fdeb847965a9acf.jpg"
  115. 				],
  116. 				"display_user_nick": "j***s",
  117. 				"auction_sku": "YC-X-188黑色(女)",
  118. 				"add_feedback": ""
  119. 			},
  120. 			{
  121. 				"rate_content": "鞋子穿着很舒服，用来搭配长裙或者是棉麻裤，都很好看，而且很合脚，走起路来一点都不会累。",
  122. 				"rate_date": "2020-07-17 17:48:04",
  123. 				"pics": [],
  124. 				"display_user_nick": "j***l",
  125. 				"auction_sku": "MX-D01黑色(女)",
  126. 				"add_feedback": ""
  127. 			}
  128. 		]
  129. 	},
  130. 	"secache": "8e3404bdf02f989d0e3164490e3945a2",
  131. 	"secache_time": 1615366119,
  132. 	"secache_date": "2021-03-10 16:48:39",
  133. 	"translate_status": "",
  134. 	"translate_time": 0,
  135. 	"language": {
  136. 		"default_lang": "cn",
  137. 		"current_lang": "cn"
  138. 	},
  139. 	"error": "",
  140. 	"reason": "",
  141. 	"error_code": "0000",
  142. 	"cache": 0,
  143. 	"api_info": "today:21 max:10000",
  144. 	"execution_time": 0.854,
  145. 	"server_time": "Beijing/2021-03-10 16:48:39",
  146. 	"client_ip": "106.60.351.144",
  147. 	"call_args": {
  148. 		"num_iid": "71619129750",
  149. 		"data": "1",
  150. 		"page": 1
  151. 	},
  152. 	"api_type": "jd",
  153. 	"translate_language": "zh-CN",
  154. 	"translate_engine": "google_cn",
  155. 	"server_memory": "3.15MB",
  156. 	"request_id": "gw-3.604887e6dc512"
  157. }

声明：本文内容由网友自发贡献，版权归原作者所有，本站不承担相应法律责任。如您发现有侵权的内容，请联系我们。转载请注明出处：【wpsshop博客】
推荐阅读
相关标签

Copyright © 2003-2013 www.wpsshop.cn 版权所有，并保留所有权利。

  

闽ICP备14008679号