Git Product home page Git Product logo

zhipuai-sdk-python's Issues

希望用一个asyncio的API

就类似 OPENAI那样

async def create_chat_completion():
    chat_completion_resp = await openai.ChatCompletion.acreate(model="gpt-3.5-turbo", messages=[{"role": "user", "content": "Hello world"}])

是否需要OpenAI SDK的 ChatCompletion 包装?方便兼容其他LangChain等基于openai体系的应用?

是否需要OpenAI SDK的 ChatCompletion 包装?类似本地LLM那样通过替换api_base/api_key完成智普API的访问?
之前通过自己包装zhipuai的SDK还比较方便,但想利用一些其他库时会比较困难。目前设想的是实现类似下面的bridge,对相关请求进行统一包装翻译:

# import openai
import zhipuai.openai_bridge as openai
openai.api_key = "zhipu token"

completion = openai.ChatCompletion.create(
  model="chatglm_pro",
  messages=[{"role": "user", "content": "你好,请自我介绍并说明你能给我提供的帮助"}]
)
print(completion.choices[0].message.content)

实现方式类似 one-api 里的映射方式:
https://github.com/songquanpeng/one-api/blob/f0d5e102a3dc22289e00860f63ebd0f125531641/controller/relay-text.go#L252

async_invoke输出如何获取content

async_invoke获取的输出不像invoke一样有content,请问我该如何获取模型返回内容?输出为:
{'code': 200, 'msg': '操作成功', 'data': {'request_id': '8037945188998056719', 'task_id': '16903673447268037945188998056721', 'task_status': 'PROCESSING'}, 'success': True}

def async_invoke_example():
    response = zhipuai.model_api.async_invoke(
        model="chatglm_pro",
        prompt=[{"role": "user", "content": "人工智能"}],
        top_p=0.7,
        temperature=0.9,
    )
    print(response)

async_invoke_example()

zhipuai.core._errors.APITimeoutError: Request Timeout

zhipuai.core._errors.APITimeoutError: Request Timeout这个错误是为什么产生的?代码并没有变化,时隔几天再次调用的时候就报错了。请问一下有什么解决办法吗?还是类似openai通过设置代理来进行解决?

API 启动报错 401

我在尝试使用 OpenAI 风格的 API 接入智谱AI,但遇到了一些问题。使用 Python 包可以成功地访问智谱AI,然而,当我尝试集成到其他项目中时,遇到了鉴权失败的问题。

具体地,我尝试了以下 Python 代码:

from llama_index.llms import OpenAI
chat = OpenAI(api_key=api_key, api_base="https://open.bigmodel.cn/api/paas/v4")
chat.complete("hello")

API 文档提供了 Python 包的调用方法,没有给出 curl 的示例。尽管使用 zhipuai 能够正常访问,但不好做扩展迁移。

提问题前,我用 APIfox 做了调试,但仍存在 401 鉴权错误。以下是我尝试的 curl 命令:

curl --location --request POST 'https://open.bigmodel.cn/api/paas/v4/chat/completions' \
--header 'Authorization: Bearer <真实密钥>' \
--header 'Content-Type: application/json; charset=UTF-8' \
--header 'Accept: */*' \
--header 'Host: open.bigmodel.cn' \
--header 'Connection: keep-alive' \
--data-raw '{"model": "glm-3-turbo", "messages": [{"role": "system", "content": "say hi"}]}'

感谢读到这里!希望能提供更详细 API 示例的文档!或者能否兼容 OpenAI 的模式。

劳烦给出异步调用后,如何接受真实的response

response = zhipuai.model_api.async_invoke。。。。。。
print(response)

async_invoke 返回值结构如下:

{'code': 200, 'msg': '操作成功', 'data': {'request_id': '8107267232470178304', 'task_id': '113516996052348378107267232470178305', 'task_status': 'PROCESSING'}, 'success': True}

怎么接受具体的返回值呢?劳烦给出具体的代码示例。

AttributeError: module 'zhipuai' has no attribute 'model_api'

import zhipuai

response = zhipuai.model_api.invoke(
model=model,
messages=messages,
temperature=0.5,
top_p=0.7,
incremental=True
)

IDE:
pycharm

error:
AttributeError: module 'zhipuai' has no attribute 'model_api'

已看:
Successfully installed zhipuai-1.0.7
pip list里面也是zhipuai-1.0.7
不知道为什么显示没有model_api???

API有支持的Function Call的计划吗

如题。
关注到ChatGLM3-6B的开源模型已经支持了function call。请问像是ChatGLM-130B这类模型的API有支持的Function Call的计划吗?

AttributeError: partially initialized module 'zhipuai' has no attribute 'model_api' (most likely due to a circular import)

在执行官方示例时,报这个错误

import zhipuai

zhipuai.api_key = "my key"
response = zhipuai.model_api.sse_invoke(
    model="chatglm_lite",
    prompt=[
        {"role": "user", "content": "你好"},
        {"role": "assistant", "content": "我是人工智能助手"},
        {"role": "user", "content": "你叫什么名字"},
        {"role": "assistant", "content": "我叫chatGLM"},
        {"role": "user", "content": "你都可以做些什么事"},
    ]
)

报错信息:

Traceback (most recent call last):
  File "/mnt/e/Projects/pythonProject/langchain-app/zhipuai.py", line 1, in <module>
    import zhipuai
  File "/mnt/e/Projects/pythonProject/langchain-app/zhipuai.py", line 4, in <module>
    response = zhipuai.model_api.sse_invoke(
AttributeError: partially initialized module 'zhipuai' has no attribute 'model_api' (most likely due to a circular import)

依赖:
zhipuai = 1.0.7

pydantic 依赖冲突

安装pypi官方zhipuai-sdk后,会默认安装pydantic v2导致原有的v1应用发生问题。

zhipuai api 如何获取接口调用时间?

有没有类似openai的 client.chat.completions.with_raw_response.create?
response = client.chat.completions.with_raw_response.create()
duration_in_ms = response.elapsed.total_seconds() * 1000

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.