Kai Mei fd6810aeeb fix agent dependencies and add verification of Query and Response (#263) 2 周之前
..
llm_classes fd6810aeeb fix agent dependencies and add verification of Query and Response (#263) 2 周之前
README.md 2a3142a43b fix: mv vllm to cuda-enable requirement file and update Dockerfile (#160) 3 月之前
llms.py fd6810aeeb fix agent dependencies and add verification of Query and Response (#263) 2 周之前

README.md

aios/llm_core/

This directory contains wrapper classes that abstract the LLMs into a single class called LLMKernel. Currently, the following models are supported:

  1. GPT
  2. ollama
  3. Gemini
  4. Claude
  5. huggingface open source models

In the future, greedy token generation and lm types other than casual will be supported.