LLMs

Обновлено 24 мая 2024

Large Language Models (LLMs) are a core component of LangChain. LangChain does not serve its own LLMs, but rather provides a standard interface for interacting with many different LLMs. To be specific, this interface is one that takes as input a string and returns a string.

There are lots of LLM providers (OpenAI, Cohere, Hugging Face, etc) - the LLM class is designed to provide a standard interface for all of them.

Quick Start

Check out this quick start to get an overview of working with LLMs, including all the different methods they expose

How-To Guides

We have several how-to guides for more advanced usage of LLMs. This includes:

• How to write a custom LLM class
• How to cache LLM responses
• How to stream responses from an LLM
• How to track token usage in an LLM call