devbox
酷酷是懒虫
这个屌丝很懒，什么也没留下！
关注作者
热门标签
热门文章
当前位置:   article > 正文

Unity 工具 之 Azure 微软 【GPT4o】HttpClient 异步流式请求的简单封装_unity gpt4o

作者：酷酷是懒虫 | 2024-07-25 22:22:25

赞

踩

unity gpt4o

Unity 工具 之 Azure 微软 【GPT4o】HttpClient 异步流式请求的简单封装

目录

Unity 工具 之 Azure 微软 【GPT4o】HttpClient 异步流式请求的简单封装

一、简单介绍

二、实现原理

三、注意实现

四、简单效果预览

五、案例简单实现步骤

六、关键代码

一、简单介绍

Unity 工具类，自己整理的一些游戏开发可能用到的模块，单独独立使用，方便游戏开发。

本节介绍，这里在使用微软的Azure 进行语音合成的两个方法的做简单整理，这里简单说明，如果你有更好的方法，欢迎留言交流。

官网注册：

面向学生的 Azure - 免费帐户额度 | Microsoft Azure

官网技术文档网址：

技术文档 | Microsoft Learn

Azure OpenAI 一些模型介绍：

Azure OpenAI 服务模型 - Azure OpenAI | Microsoft Learn

GPT-4o 和 GPT-4 Turbo

GPT-4o 是 OpenAI 的最新模型。 GPT-4o 在单个模型中集成文本和图像，从而能够同时处理多个数据类型。 这种多模式方法提高了人机交互的准确性和响应能力。 GPT-4o 在英语文本和编码任务方面与 GPT-4 Turbo 相当，但在非英语语言和视觉任务方面具有更优越的性能，为 AI 功能设定了新的基准。

如何访问 GPT-4o 模型？

GPT-4o 可用于标准和全球标准模型部署。

需要在该模型可用的受支持标准或全球标准区域中创建或使用现有资源。

创建资源后，可以部署 GPT-4o 模型。 

发起请求的json 格式：

  1. {
  2.             "messages": [ 
  3.                 {
  4.                     "role": "system", 
  5.                     "content": "You are a helpful assistant." 
  6.                 },
  7.                 {
  8.                     "role": "user", 
  9.                     "content": [
  10. 	                    {
  11. 	                        "type": "text",
  12. 	                        "text": "Describe this picture:"
  13. 	                    },
  14. 	                    {
  15. 	                        "type": "image_url",
  16. 	                        "image_url": {
  17.                                 "url": "<image URL>"
  18.                             }
  19.                         } 
  20.                    ] 
  21.                 }
  22.             ],
  23.             "max_tokens": 100, 
  24.             "stream": false 
  25.         }

返回的格式根据是否是流式返回，略有所不同：

非流式的：

  1.  {
  2. 	"id": "chatcmpl-8X0uY6Xbv4XpU4zo0KXhVk4iTldJf",
  3. 	"object": "chat.completion",
  4. 	"created": 1702879018,
  5. 	"model": "gpt-4v",
  6. 	"prompt_filter_results": [{
  7. 		"prompt_index": 0,
  8. 		"content_filter_results": {
  9. 			"hate": {
  10. 				"filtered": false,
  11. 				"severity": "safe"
  12. 			},
  13. 			"self_harm": {
  14. 				"filtered": false,
  15. 				"severity": "safe"
  16. 			},
  17. 			"sexual": {
  18. 				"filtered": false,
  19. 				"severity": "safe"
  20. 			},
  21. 			"violence": {
  22. 				"filtered": false,
  23. 				"severity": "safe"
  24. 			}
  25. 		}
  26. 	}],
  27. 	"choices": [{
  28. 		"finish_details": {
  29. 			"type": "stop",
  30. 			"stop": "<|fim_suffix|>"
  31. 		},
  32. 		"index": 0,
  33. 		"message": {
  34. 			"role": "assistant",
  35. 			"content": "这张图片展示了一辆银灰色的跑车，停靠在一个内饰精致的展厅里。车身呈流线型，前脸上有显著的品牌标志和数字“10”。车身上的漆面光洁明亮，反射着展厅内柔和的灯光。背景中可以看到其他几辆停放整齐的高端车辆，以及墙上挂着的一些装饰性画作。整个场景显得高端大气，彰显了跑车的豪华品质。"
  36. 		},
  37. 		"content_filter_results": {
  38. 			"hate": {
  39. 				"filtered": false,
  40. 				"severity": "safe"
  41. 			},
  42. 			"self_harm": {
  43. 				"filtered": false,
  44. 				"severity": "safe"
  45. 			},
  46. 			"sexual": {
  47. 				"filtered": false,
  48. 				"severity": "safe"
  49. 			},
  50. 			"violence": {
  51. 				"filtered": false,
  52. 				"severity": "safe"
  53. 			}
  54. 		}
  55. 	}],
  56. 	"usage": {
  57. 		"prompt_tokens": 826,
  58. 		"completion_tokens": 175,
  59. 		"total_tokens": 1001
  60. 	}
  61. }

流式的根据数据内容不同，data 数据不同：

  1. data: {"choices":[],"created":0,"id":"","model":"","object":"","prompt_filter_results":[{"prompt_index":0,"content_filter_result":{"jailbreak":{"filtered":false,"detected":false},"custom_blocklists":{"filtered":false,"details":[]}}},{"prompt_index":1,"content_filter_result":{"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"},"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"custom_blocklists":{"filtered":false,"details":[]}}}]}
  2.  
  3. data: {"choices":[{"content_filter_results":{},"delta":{"content":"","role":"assistant"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  4.  
  5. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"镜"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  6.  
  7. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"腿"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  8.  
  9. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"\n"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  10.  
  11. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"眼"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  12.  
  13. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"镜"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  14.  
  15. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"框"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  16.  
  17. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"\n"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  18.  
  19. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"控制"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  20.  
  21. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"电"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  22.  
  23. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"路"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  24.  
  25. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"\n"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  26.  
  27. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"连接"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  28.  
  29. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"电"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  30.  
  31. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"路"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  32.  
  33. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"\n"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  34.  
  35. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"前"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  36.  
  37. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"顶"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  38.  
  39. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"盖"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  40.  
  41. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"\n"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  42.  
  43. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"摄"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  44.  
  45. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"像"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  46.  
  47. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"头"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  48.  
  49. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"\n"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  50.  
  51. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"投"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  52.  
  53. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"影"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  54.  
  55. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"模块"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  56.  
  57. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"\n"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  58.  
  59. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"鼻"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  60.  
  61. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"梁"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  62.  
  63. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"\n"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  64.  
  65. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"显示"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  66.  
  67. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"光"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  68.  
  69. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"学"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  70.  
  71. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"元"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  72.  
  73. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"件"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  74.  
  75. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"\n"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  76.  
  77. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"麦"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  78.  
  79. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"克"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  80.  
  81. data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"风"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  82.  
  83. data: {"choices":[{"content_filter_results":{},"delta":{},"finish_reason":"stop","index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  84.  
  85. data: [DONE]

二、实现原理

1、官网申请得到对应使用 GPT4o 模型的相关key 等信息（和之前申请GPT3.5、GPT4 类似）

2、使用 HttpClinet 进行网络 Post 请求，且使用异步请求 ，使用 cancellationToken 用于取消请求

  1. // 发送请求并获取响应
  2. HttpResponseMessage response = await client.SendAsync(request, cancellationToken);

3、根据请求流式和非流式的标志 “stream”，false 为非流式，true 为流式返回数据

4、其中 HttpClient 的异步请求也是可以打断的

 cancellationTokenSource.Cancel();

三、注意实现

1、GPT4o 支持文本和图片数据发起 Post 请求访问，其中 图片数据，可以是 url ,也可以是 Base64 ，其中 Base64 数据注意添加上前缀，例如 png 图片，前缀：data:image/png;base64,

  1.  string IMAGE_png_EXTRA_PREFIXES_BASE64 = "data:image/png;base64,";
  2.  string base64 = await ImageLoader.Instance.LoadImageAndConvertToBase64();
  3.  base64 = IMAGE_png_EXTRA_PREFIXES_BASE64 + base64;

2、这里没有添加历史数据，需要的话可以自动添加历史数据，添加到请求的 public List<Message> messages; 列表中即可，不过，提问要放到最后

  1.  public class JsonRequestStruct
  2.     {
  3.         public int max_tokens;
  4.         public bool stream;
  5.         public float temperature;
  6.         public List<Message> messages;
  7.  
  8.     }
  9.  
  10.     public class Message
  11.     {
  12.         public string role;
  13.         public object content; //这个是不规则的json 列表
  14.     }

四、简单效果预览

五、案例简单实现步骤

1、新建 Unity 工程

2、创建接口脚本，定义一些基本功能和回调

3、创建基类，HttpClient 实现数据的请求，取消请求的基本功能

4、创建实现了，填写自己的 GPT4o key 相关信息

5、测试接口，先测试非流式的文字请求

6、测试流式，图片请求的接口

六、关键代码

1、IAzureGpt4o

  1.  
  2. using System;
  3. using System.Threading.Tasks;
  4.  
  5. public interface IAzureGpt4o
  6. {
  7.     /// <summary>
  8.     /// 请求失败的回调
  9.     /// </summary>
  10.     Action<string> OnSendRequestFailed { get; set; }
  11.  
  12.     /// <summary>
  13.     /// 响应的流式数据
  14.     /// </summary>
  15.     Action<string> OnResponsingData { get; set; }
  16.     /// <summary>
  17.     /// 响应接收完的数据
  18.     /// </summary>
  19.     Action<string> OnResponseFinished { get; set; }
  20.  
  21.     /// <summary>
  22.     /// 发送请求
  23.     /// </summary>
  24.     /// <param name="askContent"></param>
  25.     /// <param name="imgData">图片数据，支持 url/base64</param>
  26.     /// <returns></returns>
  27.     Task<string> SendRequestAsync(string askContent, string imgData);
  28.  
  29.     /// <summary>
  30.     /// 发送请求(流式返回数据)
  31.     /// </summary>
  32.     /// <param name="askContent"></param>
  33.     /// <param name="imgData">图片数据，支持 url/base64</param>
  34.     /// <returns></returns>
  35.     Task<string> SendRequestStreamResponseAsync(string askContent, string imgData);
  36.  
  37.     /// <summary>
  38.     /// Helper function to cancel the ongoing request
  39.     /// </summary>
  40.     public void CancelRequest();
  41. }

2、BaseAzureGpt4o

  1. using Newtonsoft.Json;
  2. using System.Collections.Generic;
  3. using System.IO;
  4. using System.Net;
  5. using System.Text.RegularExpressions;
  6. using System.Text;
  7. using UnityEngine;
  8. using System;
  9. using System.Threading.Tasks;
  10. using System.Threading;
  11. using System.Net.Http;
  12.  
  13. /// <summary>
  14. /// GPT 4o 基类
  15. /// </summary>
  16. /// <typeparam name="T"></typeparam>
  17. public class BaseAzureGpt4o : IAzureGpt4o
  18. {
  19.     #region Data
  20.     /// <summary>
  21.     /// TAG
  22.     /// </summary>
  23.     protected virtual string TAG { get; } = "[BaseAzureGpt4o]";
  24.     /// <summary>
  25.     /// API_BASE
  26.     /// </summary>
  27.     protected virtual string API_BASE { get; } = "https://gpt4o-version.openai.azure.com/";
  28.     /// <summary>
  29.     /// DEPLOYMENT_NAME
  30.     /// </summary>
  31.     protected virtual string DEPLOYMENT_NAME { get; } = "Your_Deplyment_Name";
  32.     /// <summary>
  33.     /// API_KEY
  34.     /// </summary>
  35.     protected virtual string API_KEY { get; } = "YOur_API_Key";
  36.  
  37.     /// <summary>
  38.     /// 对应模型接口的发行版本
  39.     /// </summary>
  40.     protected virtual string MODEL_VERSION { get; } = "2024-05-01-preview";
  41.  
  42.     /// <summary>
  43.     /// 组织基础的 Url
  44.     /// </summary>
  45.     protected virtual string m_BaseUrl { get{ return $"{API_BASE}/openai/deployments/{DEPLOYMENT_NAME}"; } }  
  46.     /// <summary>
  47.     /// 组成最后访问的 Url 
  48.     /// </summary>
  49.     protected virtual string m_EndPointend { get {return $"{m_BaseUrl}/chat/completions?api-version={MODEL_VERSION}"; } } 
  50.  
  51.     /// <summary>
  52.     /// 最大的 Tokens
  53.     /// </summary>
  54.     protected virtual int MAX_TOKENS { get; } = 100;
  55.  
  56.     /// <summary>
  57.     /// 请求失败的回调
  58.     /// </summary>
  59.     public Action<string> OnSendRequestFailed { get; set; }
  60.     /// <summary>
  61.     /// 响应的流式数据
  62.     /// </summary>
  63.     public Action<string> OnResponsingData { get; set; }
  64.     /// <summary>
  65.     /// 响应接收完的数据
  66.     /// </summary>
  67.     public Action<string> OnResponseFinished { get; set; }
  68.  
  69.     /// <summary>
  70.     /// CancellationTokenSource
  71.     /// </summary>
  72.     private CancellationTokenSource cancellationTokenSource;
  73.  
  74.     /// <summary>
  75.     /// HttpClient
  76.     /// </summary>
  77.     private static readonly HttpClient client = new HttpClient();
  78.  
  79.     #endregion
  80.  
  81.     #region Inteface function
  82.  
  83.     /// <summary>
  84.     /// 发送请求(正常返回数据)
  85.     /// </summary>
  86.     /// <param name="askContent"></param>
  87.     /// <param name="imgData">图片数据，支持 url/base64</param>
  88.     /// <returns></returns>
  89.     public virtual async Task<string> SendRequestAsync(string askContent, string imgData)
  90.     {
  91.         Debug.Log(TAG + "Start HttpWebRequest m_EndPointend : " + m_EndPointend);
  92.  
  93.         cancellationTokenSource = new CancellationTokenSource();
  94.         CancellationToken cancellationToken = cancellationTokenSource.Token;
  95.  
  96.         // json 数据
  97.         string jsonData = GetJsonStr(askContent, imgData);
  98.  
  99.         /// 设置请求头
  100.         client.DefaultRequestHeaders.Clear();
  101.         client.DefaultRequestHeaders.Add("api-key", API_KEY);
  102.  
  103.         // 创建 HTTP 内容
  104.         var content = new StringContent(jsonData, Encoding.UTF8, "application/json");
  105.  
  106.         try
  107.         {
  108.             // 创建请求
  109.             var request = new HttpRequestMessage(HttpMethod.Post, m_EndPointend)
  110.             {
  111.                 Content = content
  112.             };
  113.  
  114.             // 发送请求并获取响应
  115.             HttpResponseMessage response = await client.SendAsync(request, cancellationToken);
  116.  
  117.             // 检查响应状态码
  118.             if (response.IsSuccessStatusCode)
  119.             {
  120.                 // 读取整个响应内容
  121.                 string responseText = await response.Content.ReadAsStringAsync();
  122.  
  123.                 if (cancellationToken.IsCancellationRequested)
  124.                 {
  125.                     Debug.Log(TAG + "Operation was canceled.");
  126.                     OnSendRequestFailed?.Invoke("Operation was canceled.");
  127.                     return null; // 或抛出异常，根据需要处理
  128.                 }
  129.  
  130.                 Debug.Log(TAG + " PostRequestStreamToStringAsync whole stream data : " + responseText);
  131.                 string jsonString = DecodeUnicode(responseText);
  132.  
  133.                 string parseWholeRlt;
  134.  
  135.                 // 使用 Newtonsoft.Json 将 JSON 字符串映射到对应的对象
  136.                 JsonResponseStruct data = JsonConvert.DeserializeObject<JsonResponseStruct>(jsonString);
  137.                 if (data != null)
  138.                 {
  139.                     parseWholeRlt = data.choices[0].message.content.ToString();
  140.                     Debug.Log(TAG + " PostRequestStreamToStringAsync whole stream data : " + parseWholeRlt);
  141.                 }
  142.                 else
  143.                 {
  144.                     Debug.Log(TAG + " PostRequestStreamToStringAsync whole stream data : " + jsonString);
  145.                     parseWholeRlt = jsonString;
  146.                 }
  147.  
  148.                 if (OnResponseFinished != null)
  149.                 {
  150.                     Debug.Log(TAG + " PostRequestStreamToStringAsync OnResponseFinished is  not null ");
  151.                     OnResponseFinished?.Invoke(parseWholeRlt);
  152.                 }
  153.                 else
  154.                 {
  155.                     Debug.Log(TAG + " PostRequestStreamToStringAsync OnResponseFinished is null ");
  156.                 }
  157.  
  158.                 return parseWholeRlt;
  159.             }
  160.             else
  161.             {
  162.                 // 打印错误状态码
  163.                 Debug.LogError(TAG + "Error: " + response.StatusCode);
  164.                 OnSendRequestFailed?.Invoke(response.Content.ToString());
  165.                 return null;
  166.             }
  167.         }
  168.         catch (OperationCanceledException e)
  169.         {
  170.             Debug.Log(TAG + "Operation was canceled. " + e.Message);
  171.             OnSendRequestFailed?.Invoke(e.Message);
  172.             return null; // 或抛出异常，根据需要处理
  173.         }
  174.         catch (WebException e)
  175.         {
  176.             Debug.Log(TAG + " e.Message: " + e.Message);
  177.             OnSendRequestFailed?.Invoke(e.Message);
  178.             return null;
  179.         }
  180.     }
  181.  
  182.     /// <summary>
  183.     /// 发送请求(流式返回数据)
  184.     /// </summary>
  185.     /// <param name="askContent"></param>
  186.     /// <param name="imgData">图片数据，支持 url/base64</param>
  187.     /// <returns></returns>
  188.     public virtual async Task<string> SendRequestStreamResponseAsync(string askContent, string imgData) {
  189.  
  190.         Debug.Log(TAG + "Start HttpWebRequest m_EndPointend : " + m_EndPointend);
  191.  
  192.         cancellationTokenSource = new CancellationTokenSource();
  193.         CancellationToken cancellationToken = cancellationTokenSource.Token;
  194.  
  195.         // json 数据
  196.         string jsonData = GetJsonStr(askContent, imgData, true);
  197.  
  198.         /// 设置请求头
  199.         client.DefaultRequestHeaders.Clear();
  200.         client.DefaultRequestHeaders.Add("api-key", API_KEY);
  201.  
  202.         // 创建 HTTP 内容
  203.         var content = new StringContent(jsonData, Encoding.UTF8, "application/json");
  204.  
  205.         try
  206.         {
  207.             // 创建请求
  208.             var request = new HttpRequestMessage(HttpMethod.Post, m_EndPointend)
  209.             {
  210.                 Content = content
  211.             };
  212.  
  213.             // 发送请求并获取响应头
  214.             HttpResponseMessage response = await client.SendAsync(request, HttpCompletionOption.ResponseHeadersRead, cancellationToken);
  215.  
  216.             // 检查响应状态码
  217.             if (response.IsSuccessStatusCode)
  218.             {
  219.                 // 以流的方式读取响应内容
  220.                 using (var stream = await response.Content.ReadAsStreamAsync())
  221.                 {
  222.                     using (var reader = new StreamReader(stream))
  223.                     {
  224.                         StringBuilder sb = new StringBuilder();
  225.                         string line;
  226.                         while ((line = await reader.ReadLineAsync()) != null)
  227.                         {
  228.  
  229.                             string parseRlt = HandleStreamData(line);
  230.                             if (string.IsNullOrEmpty(parseRlt) == false)
  231.                             {
  232.                                 OnResponsingData?.Invoke(parseRlt);
  233.                             }
  234.  
  235.                             sb.AppendLine(line); // 逐行读取并累积响应数据
  236.                             Debug.Log(TAG + " PostRequestStreamToStringAsync getting steam data : " + sb.ToString());
  237.  
  238.                             // Check for cancellation
  239.                             if (cancellationToken.IsCancellationRequested)
  240.                             {
  241.                                 Debug.Log(TAG + "Operation was canceled.");
  242.                                 return null; // or throw an exception, handle as needed
  243.                             }
  244.                         }
  245.  
  246.                         Debug.Log(TAG + " PostRequestStreamToStringAsync whole stream data : " + sb.ToString());
  247.                         string jsonString = DecodeUnicode(sb.ToString());
  248.  
  249.                         string parseWholeRlt = HandleStreamData(jsonString);
  250.                         Debug.Log(TAG + " PostRequestStreamToStringAsync whole stream data : " + parseWholeRlt);
  251.  
  252.                         if (OnResponseFinished != null)
  253.                         {
  254.                             Debug.Log(TAG + " PostRequestStreamToStringAsync OnResponseFinished is  not null ");
  255.                             OnResponseFinished?.Invoke(parseWholeRlt);
  256.                         }
  257.                         else
  258.                         {
  259.                             Debug.Log(TAG + " PostRequestStreamToStringAsync OnResponseFinished is null ");
  260.                         }
  261.  
  262.                         return parseWholeRlt;
  263.                     }
  264.                 }
  265.             }
  266.             else
  267.             {
  268.                 // 打印错误状态码
  269.                 Debug.LogError(TAG + "Error: " + response.StatusCode);
  270.                 OnSendRequestFailed?.Invoke(response.Content.ToString());
  271.                 return null;
  272.             }
  273.         }
  274.         catch (OperationCanceledException e)
  275.         {
  276.             Debug.Log(TAG + "Operation was canceled. " + e.Message);
  277.             OnSendRequestFailed?.Invoke(e.Message);
  278.             return null; // or throw an exception, handle as needed
  279.         }
  280.         catch (WebException e)
  281.         {
  282.             Debug.Log(TAG + " e.Message: " + e.Message);
  283.             OnSendRequestFailed?.Invoke(e.Message);
  284.             return null;
  285.         }
  286.     }
  287.  
  288.     /// <summary>
  289.     /// Helper function to cancel the ongoing request
  290.     /// </summary>
  291.     public virtual void CancelRequest()
  292.     {
  293.         if (cancellationTokenSource != null && !cancellationTokenSource.IsCancellationRequested)
  294.         {
  295.             cancellationTokenSource.Cancel();
  296.         }
  297.     }
  298.  
  299.     #endregion
  300.  
  301.     #region Protected function
  302.  
  303.     /// <summary>
  304.     /// 将 Unicode 转义字符解码为 UTF-8 字符串的方法
  305.     /// </summary>
  306.     /// <param name="input"></param>
  307.     /// <returns></returns>
  308.     protected string DecodeUnicode(string input)
  309.     {
  310.         return Regex.Replace(input, @"\\u([0-9a-fA-F]{4})", match =>
  311.         {
  312.             string hex = match.Groups[1].Value;
  313.             int codePoint = Convert.ToInt32(hex, 16);
  314.             return char.ConvertFromUtf32(codePoint);
  315.         });
  316.     }
  317.  
  318.     /// <summary>
  319.     /// 组织提问和图片数据
  320.     /// </summary>
  321.     /// <param name="askContent"></param>
  322.     /// <param name="imgBase64OrUrlg"></param>
  323.     /// <param name="isStreamResponse">是否流式响应返回数据</param>
  324.     /// <returns></returns>
  325.     protected string GetJsonStr(string askContent, string imgBase64OrUrlg, bool isStreamResponse = false)
  326.     {
  327.         List<object> contentList = new List<object>();
  328.         contentList.Add(new
  329.         {
  330.             type = "text",
  331.             text = askContent,
  332.  
  333.         });
  334.  
  335.         if (imgBase64OrUrlg != null)
  336.         {
  337.             // 创建一个包含指定数据结构的对象列表
  338.             contentList.Add(new
  339.             {
  340.                 type = "image_url",
  341.                 image_url = new
  342.                 {
  343.                     url = imgBase64OrUrlg
  344.                 },
  345.             });
  346.         }
  347.  
  348.         // 将对象列表转换为 JSON 字符串
  349.         string jsonString = JsonConvert.SerializeObject(contentList, Formatting.Indented);
  350.  
  351.         Message messageS = new Message() { role = "system", content = "You are a helpful assistant." };
  352.         Message message = new Message() { role = "user", content = contentList };
  353.         List<Message> messages = new List<Message>();
  354.         messages.Add(messageS);
  355.         messages.Add(message);
  356.  
  357.         JsonRequestStruct jsonRequest = new JsonRequestStruct() { messages = messages, max_tokens = MAX_TOKENS, stream = isStreamResponse };
  358.         jsonString = JsonConvert.SerializeObject(jsonRequest, Formatting.Indented);
  359.         Debug.Log(jsonString);
  360.  
  361.         return jsonString;
  362.     }
  363.  
  364.     #region Stream Response 数据解析
  365.  
  366.     /*
  367.      data: {"choices":[{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}},"delta":{"content":"克"},"finish_reason":null,"index":0,"logprobs":null}],"created":1718690676,"id":"chatcmpl-9bMFIE4gPNKU6Z1QyKvFsjwqNTOtw","model":"gpt-4o-2024-05-13","object":"chat.completion.chunk","system_fingerprint":"fp_abc28019ad"}
  368.      */
  369.  
  370.     /// <summary>
  371.     ///  流式处理数据
  372.     /// </summary>
  373.     /// <param name="data"></param>
  374.     /// <returns></returns>
  375.     string HandleStreamData(string data)
  376.     {
  377.         try
  378.         {
  379.             string[] dataLines = data.Split(new string[] { "data: " }, StringSplitOptions.RemoveEmptyEntries);
  380.             StringBuilder sb = new StringBuilder();
  381.             foreach (var line in dataLines)
  382.             {
  383.                 sb.Append(ProcessDataLine(line));
  384.             }
  385.  
  386.             return sb.ToString();
  387.         }
  388.         catch (Exception e)
  389.         {
  390.             return null;
  391.         }
  392.         
  393.     }
  394.  
  395.     /// <summary>
  396.     /// 处理单行数据，解析获取 content，finish_reason 数据
  397.     /// content : 回复内容
  398.     /// finish_reason : 判断流式回答是否结束
  399.     /// </summary>
  400.     /// <param name="dataLine"></param>
  401.     /// /// <returns></returns>
  402.     string ProcessDataLine(string dataLine)
  403.     {
  404.         string content = ExtractField(dataLine, "\"content\":\"", "\"},");
  405.         string finishReason = ExtractField(dataLine, "\"finish_reason\":", ",");
  406.  
  407.         Debug.Log(TAG + "ProcessDataLine():Content: " + content);
  408.         content = content == null ? "" : content;
  409.         // 排除这个情况 "delta":{"content":"","role":"assistant"},"finish_reason":null,"
  410.         if(content.Contains("\"role\":\"assistant")) content="";
  411.  
  412.         if (finishReason!=null && finishReason == "\"stop\"")
  413.         {
  414.             Debug.Log(TAG+ "ProcessDataLine(): Finish reason is stop. Stopping further processing.");
  415.             return "";  // 如果 finish_reason 是 stop，停止进一步处理
  416.         }
  417.         else
  418.         {
  419.             return content;
  420.         }
  421.     }
  422.  
  423.     /// <summary>
  424.     /// 抽取块数据
  425.     /// </summary>
  426.     /// <param name="dataLine">行数据</param>
  427.     /// <param name="fieldName">块名称</param>
  428.     /// <param name="delimiter">分割符</param>
  429.     /// <returns></returns>
  430.     string ExtractField(string dataLine, string fieldName, string delimiter)
  431.     {
  432.         int fieldIndex = dataLine.IndexOf(fieldName);
  433.         if (fieldIndex == -1)
  434.         {
  435.             return null;
  436.         }
  437.  
  438.         int startIndex = fieldIndex + fieldName.Length;
  439.         int endIndex = dataLine.IndexOf(delimiter, startIndex);
  440.         if (endIndex == -1)
  441.         {
  442.             return dataLine.Substring(startIndex).Trim(' ', '}', ']');
  443.         }
  444.  
  445.         return dataLine.Substring(startIndex, endIndex - startIndex);
  446.     }
  447.  
  448.     #endregion
  449.  
  450.     #endregion
  451.  
  452.     #region JsonRequestStruct
  453.     /* json 字符串
  454.      {
  455.         "messages": [
  456.             { "role": "system", "content": "You are a helpful assistant." }, # Content can be a string, OR
  457.             { "role": "user", "content": [       # It can be an array containing strings and images.
  458.                 "描述一下这张图，请用中文回答",
  459.                 { "image": "img_base64" }      # Images are represented like this.
  460.             ] }
  461.         ],
  462.         "max_tokens": 100
  463.     }   
  465.      */
  466.  
  467.     /* 更新 json 字符串
  468.      
  469.         {
  470.             "messages": [ 
  471.                 {
  472.                     "role": "system", 
  473.                     "content": "You are a helpful assistant." 
  474.                 },
  475.                 {
  476.                     "role": "user", 
  477.                     "content": [
  478. 	                    {
  479. 	                        "type": "text",
  480. 	                        "text": "Describe this picture:"
  481. 	                    },
  482. 	                    {
  483. 	                        "type": "image_url",
  484. 	                        "image_url": {
  485.                                 "url": "<image URL>"
  486.                             }
  487.                         } 
  488.                    ] 
  489.                 }
  490.             ],
  491.             "max_tokens": 100, 
  492.             "stream": false 
  493.         }
  494.      
  495.      */
  496.  
  497.     public class JsonRequestStruct
  498.     {
  499.         public int max_tokens;
  500.         public bool stream;
  501.         public float temperature;
  502.         public List<Message> messages;
  503.  
  504.     }
  505.  
  506.     public class Message
  507.     {
  508.         public string role;
  509.         public object content; //这个是不规则的json 列表
  510.     }
  511.  
  512.     #endregion
  513.  
  514.     #region JsonResponseStruct
  515.     /* json 字符串
  516.      {
  517. 	"id": "chatcmpl-8X0uY6Xbv4XpU4zo0KXhVk4iTldJf",
  518. 	"object": "chat.completion",
  519. 	"created": 1702879018,
  520. 	"model": "gpt-4v",
  521. 	"prompt_filter_results": [{
  522. 		"prompt_index": 0,
  523. 		"content_filter_results": {
  524. 			"hate": {
  525. 				"filtered": false,
  526. 				"severity": "safe"
  527. 			},
  528. 			"self_harm": {
  529. 				"filtered": false,
  530. 				"severity": "safe"
  531. 			},
  532. 			"sexual": {
  533. 				"filtered": false,
  534. 				"severity": "safe"
  535. 			},
  536. 			"violence": {
  537. 				"filtered": false,
  538. 				"severity": "safe"
  539. 			}
  540. 		}
  541. 	}],
  542. 	"choices": [{
  543. 		"finish_details": {
  544. 			"type": "stop",
  545. 			"stop": "<|fim_suffix|>"
  546. 		},
  547. 		"index": 0,
  548. 		"message": {
  549. 			"role": "assistant",
  550. 			"content": "这张图片展示了一辆银灰色的跑车，停靠在一个内饰精致的展厅里。车身呈流线型，前脸上有显著的品牌标志和数字“10”。车身上的漆面光洁明亮，反射着展厅内柔和的灯光。背景中可以看到其他几辆停放整齐的高端车辆，以及墙上挂着的一些装饰性画作。整个场景显得高端大气，彰显了跑车的豪华品质。"
  551. 		},
  552. 		"content_filter_results": {
  553. 			"hate": {
  554. 				"filtered": false,
  555. 				"severity": "safe"
  556. 			},
  557. 			"self_harm": {
  558. 				"filtered": false,
  559. 				"severity": "safe"
  560. 			},
  561. 			"sexual": {
  562. 				"filtered": false,
  563. 				"severity": "safe"
  564. 			},
  565. 			"violence": {
  566. 				"filtered": false,
  567. 				"severity": "safe"
  568. 			}
  569. 		}
  570. 	}],
  571. 	"usage": {
  572. 		"prompt_tokens": 826,
  573. 		"completion_tokens": 175,
  574. 		"total_tokens": 1001
  575. 	}
  576. }
  577.      */
  578.     public class JsonResponseStruct
  579.     {
  580.         public string id { get; set; }
  581.         public string @object { get; set; }
  582.         public long created { get; set; }
  583.         public string model { get; set; }
  584.         public Usage usage { get; set; }
  585.         public List<Choice> choices { get; set; }
  586.         public List<PromptFilterResult> prompt_filter_results { get; set; }
  587.     }
  588.  
  589.     public class Usage
  590.     {
  591.         public int prompt_tokens { get; set; }
  592.         public int completion_tokens { get; set; }
  593.         public int total_tokens { get; set; }
  594.     }
  595.  
  596.     public class Choice
  597.     {
  598.         public RMessage message { get; set; }
  599.         public FinishDetails finish_details { get; set; }
  600.         public int index { get; set; }
  601.         public ContentFilterResult content_filter_results { get; set; }
  602.     }
  603.  
  604.     public class RMessage
  605.     {
  606.         public string role;
  607.         public string content; //这个是不规则的json 列表
  608.     }
  609.  
  610.     public class FinishDetails
  611.     {
  612.         public string type { get; set; }
  613.         public string stop { get; set; }
  614.     }
  615.  
  616.     public class PromptFilterResult
  617.     {
  618.         public int index { get; set; }
  619.         public ContentFilterResult content_filter_results { get; set; }
  620.  
  621.     }
  622.  
  623.     public class ContentFilterResult
  624.     {
  625.         public FilterReuslt hate { get; set; }
  626.         public FilterReuslt self_harm { get; set; }
  627.         public FilterReuslt sexual { get; set; }
  628.         public FilterReuslt violence { get; set; }
  629.     }
  630.  
  631.     public class FilterReuslt
  632.     {
  633.         public bool filtered { get; set; }
  634.         public string severity { get; set; }
  635.     }
  636.  
  637.     #endregion
  638. }

3、AzureGPT4o

  1.  
  2.  
  3. public class AzureGPT4o : BaseAzureGpt4o
  4. {
  5.     /// <summary>
  6.     /// TAG
  7.     /// </summary>
  8.     protected override string TAG { get; } = "[AzureGPT4o]";
  9.     /// <summary>
  10.     /// API_BASE
  11.     /// </summary>
  12.     protected override string API_BASE { get; } = "https://gpt4o-version.openai.azure.com/";
  13.     /// <summary>
  14.     /// DEPLOYMENT_NAME
  15.     /// </summary>
  16.     protected override string DEPLOYMENT_NAME { get; } = "Your_Deployment_Name";
  17.     /// <summary>
  18.     /// API_KEY
  19.     /// </summary>
  20.     protected override string API_KEY { get; } = "Your_API_Key";
  21.  
  22.     /// <summary>
  23.     /// 对应模型接口的发行版本
  24.     /// </summary>
  25.     protected override string MODEL_VERSION { get; } = "2024-05-01-preview";
  26.  
  27.     /// <summary>
  28.     /// 最大的 Tokens
  29.     /// </summary>
  30.     protected override int MAX_TOKENS { get; } = 300;
  31. }

4、TestAzureGPT4o

  1. using System.Collections;
  2. using System.Collections.Generic;
  3. using UnityEngine;
  4.  
  5. public class TestAzureGPT4o : MonoBehaviour
  6. {
  7.     string TAG = "[TestAzureGPT4o] ";
  8.  
  9.     IAzureGpt4o m_AzureGpt4o;
  10.  
  11.     // Start is called before the first frame update
  12.     void Start()
  13.     {
  14.         //TestGPT4o_Text();
  15.         TestGPT4o_Image();
  16.     }
  17.  
  18.     // Update is called once per frame
  19.     void Update()
  20.     {
  21.         if (Input.GetKeyDown(KeyCode.Space)) {
  22.             m_AzureGpt4o?.CancelRequest();
  23.         }
  24.     }
  25.  
  26.     async void TestGPT4o_Text()
  27.     {
  28.         m_AzureGpt4o = new AzureGPT4o();
  29.         m_AzureGpt4o.OnSendRequestFailed = (err) => { Debug.Log(TAG + "TestGPT4o_Text(): OnSendRequestFailed err " + err); };
  30.         m_AzureGpt4o.OnResponseFinished = (str) => { Debug.Log(TAG + "TestGPT4o_Text(): OnResponseFinished str " + str); };
  31.         m_AzureGpt4o.OnResponsingData = (str) => { Debug.Log(TAG + "TestGPT4o_Text(): OnResponsingData str " + str); };
  32.         string rlt = await m_AzureGpt4o.SendRequestAsync(
  33.             "你好呀，你是谁?", 
  34.             null);
  35.         Debug.Log(TAG + "TestGPT4o_Text(): rlt " + rlt);
  36.     }
  37.  
  38.     async void TestGPT4o_Image()
  39.     {
  40.         m_AzureGpt4o = new AzureGPT4o();
  41.         m_AzureGpt4o.OnSendRequestFailed = (err) => { Debug.Log(TAG + "TestGPT4o_Image(): OnSendRequestFailed err " + err); };
  42.         m_AzureGpt4o.OnResponseFinished = (str) => { Debug.Log(TAG + "TestGPT4o_Image(): OnResponseFinished str " + str); };
  43.         m_AzureGpt4o.OnResponsingData = (str) => { Debug.Log(TAG + "TestGPT4o_Image(): OnResponsingData str " + str); };
  44.         string rlt = await m_AzureGpt4o.SendRequestStreamResponseAsync(
  45.             "描述一下",
  46.             "https://d1.faiusr.com/4/AAEIABAEGAAggOra9AUooNDeiAEwoAY45gM.png");
  47.         Debug.Log(TAG + "TestGPT4o_Image(): rlt " + rlt);
  48.     }
  49. }

声明：本文内容由网友自发贡献，转载请注明出处：【wpsshop】
推荐阅读
相关标签

Copyright © 2003-2013 www.wpsshop.cn 版权所有，并保留所有权利。

  

闽ICP备14008679号