sentence_transformers加载使用预训练bert模型；向量KMeans聚类_sentencetransformer加载本地模型

sentence_transformers使用

参考：https://www.sbert.net/docs/quickstart.html

sentence_transformers 基于transformers库

from sentence_transformers import SentenceTransformer,util

## cache_folder指定保存路径
model1 = SentenceTransformer('peterchou/simbert-chinese-base',cache_folder =r"D:\simcse")


embeddings1 = model1.encode("语言模型", show_progress_bar=True)
embeddings2 = model1.encode("自然语言", show_progress_bar=True)
print(embeddings1)

cos_sim = util.cos_sim(embeddings1, embeddings2)
print("Cosine-Similarity:", cos_sim)
1
2
3
4
5
6
7
8
9
10
11
12