LiteLLM

LiteLLM is a LLM gateway that lets you Call all LLM APIs using the OpenAI format [Bedrock, Huggingface, VertexAI, TogetherAI, Azure, OpenAI, Groq etc.]. Support for missing a providers or LLM Platform can be requested via a feature request. — Read More

#devops