LiteLLMModel
leverages LiteLLM to support over 100 LLMs from various providers. Here’s how to use it:
TransformersModel
allows you to load and run Hugging Face models locally using the transformers
library. Ensure that both transformers
and torch
are installed before use.
AzureOpenAIServerModel
enables integration with any Azure OpenAI deployment. Below is an example of how to configure and use it: