Codes
Register Sign In
English
English 简体中文
openoker
/
chatgpt_academic
1
0
Fork 0
Files Issues 0 Wiki
Branch: binary-husky-patch-1
Branches Tags
hongyi-zhao 2bc65a99ca Update bridge_all.py (#1472) 9 months ago
..
README.md 480516380d re-format code to with pre-commit 9 months ago
bridge_all.py 2bc65a99ca Update bridge_all.py (#1472) 9 months ago
bridge_chatglm.py b9b7bf38ab 修复插件导入时的pytorch加载问题 11 months ago
bridge_chatglm3.py b9b7bf38ab 修复插件导入时的pytorch加载问题 11 months ago
bridge_chatglmft.py 527f9d28ad change get_conf 1 year ago
bridge_chatglmonnx.py 2b917edf26 修复本地模型在windows上的兼容性 11 months ago
bridge_chatgpt.py 5c7499cada compat with some third party api 10 months ago
bridge_chatgpt_vision.py b470af7c7b 遵循PEP 328优化太长的import 11 months ago
bridge_chatgpt_website.py f75e39dc27 修复本地模型在Windows下的加载BUG 11 months ago
bridge_claude.py f75e39dc27 修复本地模型在Windows下的加载BUG 11 months ago
bridge_deepseekcoder.py 3c03f240ba move token limit conf to bridge_all.py 10 months ago
bridge_google_gemini.py 60ba712131 use legacy image io for gemini 9 months ago
bridge_internlm.py 2d91e438d6 修正internlm输入设备bug 11 months ago
bridge_jittorllms_llama.py 527f9d28ad change get_conf 1 year ago
bridge_jittorllms_pangualpha.py 527f9d28ad change get_conf 1 year ago
bridge_jittorllms_rwkv.py 527f9d28ad change get_conf 1 year ago
bridge_llama2.py fd72894c90 修复错误的class命名 11 months ago
bridge_moss.py b9b7bf38ab 修复插件导入时的pytorch加载问题 11 months ago
bridge_newbingfree.py 527f9d28ad change get_conf 1 year ago
bridge_qianfan.py 5192d316f0 Merge branch 'frontier' 11 months ago
bridge_qwen.py 2c7bba5c63 change dash scope api key check behavior 10 months ago
bridge_qwen_local.py 7606f5c130 name fix 10 months ago
bridge_spark.py e3e9921f6b correct the misuse of spark image understanding 10 months ago
bridge_stackclaude.py 9a1aff5bb6 修复get_conf接口 11 months ago
bridge_tgui.py cf085565a7 rename folder 1 year ago
bridge_zhipu.py e6716ccf63 添加zhipuai依赖安装提醒 11 months ago
chatglmoonx.py cf085565a7 rename folder 1 year ago
com_google.py 37744a9cb1 jpeg type align for gemini 9 months ago
com_qwenapi.py 2c7bba5c63 change dash scope api key check behavior 10 months ago
com_sparkapi.py e3e9921f6b correct the misuse of spark image understanding 10 months ago
com_zhipuapi.py 127385b846 接入新模型 1 year ago
edge_gpt_free.py cf085565a7 rename folder 1 year ago
key_manager.py 527f9d28ad change get_conf 1 year ago
local_llm_class.py d169fb4b16 fix typo 10 months ago
queued_pipe.py 09857ea455 解除本地模型的若干并发问题 11 months ago
requirements_chatglm.txt 480516380d re-format code to with pre-commit 9 months ago
requirements_chatglm_onnx.txt 8c7569b689 修复protobuf版本错误 10 months ago
requirements_jittorllms.txt 480516380d re-format code to with pre-commit 9 months ago
requirements_moss.txt 480516380d re-format code to with pre-commit 9 months ago
requirements_newbing.txt cf085565a7 rename folder 1 year ago
requirements_qwen.txt 480516380d re-format code to with pre-commit 9 months ago
requirements_qwen_local.txt 480516380d re-format code to with pre-commit 9 months ago
requirements_slackclaude.txt 480516380d re-format code to with pre-commit 9 months ago

README.md

P.S. 如果您按照以下步骤成功接入了新的大模型，欢迎发Pull Requests（如果您在自己接入新模型的过程中遇到困难，欢迎加README底部QQ群联系群主）

如何接入其他本地大语言模型

  1. 复制request_llms/bridge_llama2.py，重命名为你喜欢的名字

  2. 修改load_model_and_tokenizer方法，加载你的模型和分词器（去该模型官网找demo，复制粘贴即可）

  3. 修改llm_stream_generator方法，定义推理模型（去该模型官网找demo，复制粘贴即可）

  4. 命令行测试

    • 修改tests/test_llms.py（聪慧如您，只需要看一眼该文件就明白怎么修改了）
    • 运行python tests/test_llms.py

  5. 测试通过后，在request_llms/bridge_all.py中做最后的修改，把你的模型完全接入到框架中（聪慧如您，只需要看一眼该文件就明白怎么修改了）

  6. 修改LLM_MODEL配置，然后运行python main.py，测试最后的效果

如何接入其他在线大语言模型

  1. 复制request_llms/bridge_zhipu.py，重命名为你喜欢的名字

  2. 修改predict_no_ui_long_connection

  3. 修改predict

  4. 命令行测试

    • 修改tests/test_llms.py（聪慧如您，只需要看一眼该文件就明白怎么修改了）
    • 运行python tests/test_llms.py

  5. 测试通过后，在request_llms/bridge_all.py中做最后的修改，把你的模型完全接入到框架中（聪慧如您，只需要看一眼该文件就明白怎么修改了）

  6. 修改LLM_MODEL配置，然后运行python main.py，测试最后的效果