Elasticsearch 去重统计 cardinality去重复_es cardinality去重

Elasticsearch 去重统计 按照deviceId 去重统计总数

相当于SQL

SELECT COUNT(DISTINCT deviceId ?) FROM log_info where userName= 'admin' and operateTime > '2020-05-18 00:00:00' and?perateTime < '2020-05-25 00:00:00'?

{
	"query": {
		"bool": {
			"must": [{
				"match": {
					"userName": "admin"
				}
			}, {
				"range": {
					"operateTime": {
						"gt": "2020-05-18 00:00:00",
						"lt": "2020-05-25 00:00:00"
					}
				}
			}],
			"must_not": [],
			"should": []
		}
	},
	"from": 0,
	"size": 0,
	"sort": [],
	"aggs": {
		"deviceId_aggs": {
			"cardinality": {
				"field": "deviceId"
			}
		}
	}
}
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32

es在使用cardinality实现count(distinct)时会在准确性和及时性上做一定的取舍

可以在使用cardinality时，配置下面的参数来增加准确性，牺牲的是时间和内存

percision_threshold : 40000