NodesLLM Nodes
Edit Page on GitHubCustom Chat
Chat with custom OpenAI-API-compatible LLMs
llmchatbotHard10
Description
The Custom Chat node allows you to connect to any OpenAI-compatible LLM API endpoint. This provides flexibility to use custom-deployed models, open-source models, or specialized LLMs that aren't directly supported by other nodes.
Common Use Cases
- Connecting to self-hosted open-source models
- Using specialized domain-specific LLMs
- Integrating with custom-fine-tuned models
- Working with models that require specific API configurations
Inputs
The input connections this node accepts:
NameDescriptionTypeFlowThe flow of the workflowFlowEndpointThe endpoint of the OpenAI compatible LLM APITextQueryChat text to sendTextToolsList of tools that the LLM can useTool[]System PromptSystem prompt for the LLMTextTemperatureCreativity of the LLMNumberRAGRAG Knowledge baseRagSave ContextSave chat as context for LLMBooleanOutputs
The output connections this node provides:
NameDescriptionTypeoutputThe response of the LLMTextFields
The configurable fields this node provides:
NameDescriptionTypeEndpointThe endpoint of the OpenAI compatible LLM APIValue:https://api.openai.com/v1TextModelThe LLM modelValue: gpt-4oTextQueryChat text to sendValue: Enter text here...TextAreaToolsList of tools that the LLM can useTool[]System PromptSystem prompt for the LLMValue: You are a helpful assistantTextAreaTemperatureCreativity of the LLMValue: 0.5Min: 0Max: 1Step: 0.01SliderSave ContextSave chat as context for LLMValue: trueCheckBoxLLM_API_KEYApi Key for the custom LLMDefaultValue: your-api-key-hereenvLast updated on