Vercel AI Gateway Chat Model node
Use the Vercel AI Gateway Chat Model node to use AI Gateway chat models with conversational agents.
On this page, you'll find the node parameters for the Vercel AI Gateway Chat Model node and links to more resources.
Credentials: You can find authentication information for this node here.
Node parameters
Model
Select the model to use to generate the completion.
n8n dynamically loads models from the AI Gateway and you'll only see the models available to your account.
Node options
Use these options to further refine the node's behavior.
Frequency Penalty
Use this option to control the chance of the model repeating itself. Higher values reduce the chance of the model repeating itself.
Maximum Number of Tokens
Enter the maximum number of tokens used, which sets the completion length.
Response Format
Choose Text or JSON. JSON ensures the model returns valid JSON.
Presence Penalty
Use this option to control the chance of the model talking about new topics. Higher values increase the chance of the model talking about new topics.
Sampling Temperature
Use this option to control the randomness of the sampling process. A higher temperature creates more diverse sampling, but increases the risk of hallucinations.
Timeout
Enter the maximum request time in milliseconds.
Max Retries
Enter the maximum number of times to retry a request.
Top P
Use this option to set the probability the completion should use. Use a lower value to ignore less probable options.
Related resources
As the Vercel AI Gateway is API-compatible with OpenAI, you can refer to LangChains's OpenAI documentation (opens in a new tab) for more information about the service.