temperature | number | no | 1.0 | Sampling temperature. 0 is deterministic and 2 is maximum randomness. · Range: 0 – 2 |
top_p | number | no | 0.95 | Nucleus sampling probability mass. Lower values make outputs more focused. · Range: 0 – 1 |
max_tokens | integer | no | 4096 | Maximum output tokens. · Range: 1 – 32768 |
stop | string | no | - | Up to 4 strings where the model will stop generating further tokens. |
enable_thinking | boolean | no | true | Enable reasoning before answering. |
reasoning_effort | enum | no | "xhigh" | Reasoning effort level. none disables thinking. low, medium, and xhigh select discrete thinking depths. There is no token budget control. · Allowed: none, low, medium, xhigh |
top_k | integer | no | 20 | Limit sampling to the top K candidate tokens when supported. · Range: 1 – 200 |
min_p | number | no | 0 | Minimum probability threshold for token sampling. · Range: 0 – 1 |
frequency_penalty | number | no | 0 | Penalty based on how often a token has already appeared. · Range: -2 – 2 |
presence_penalty | number | no | 0 | Penalty for tokens that already appeared in the generated text. · Range: -2 – 2 |
repetition_penalty | number | no | 1 | Penalty used by SGLang to reduce repeated text. · Range: 0.1 – 2 |
seed | integer | no | - | Optional random seed for reproducible sampling. · Range: 0 – 2147483647 |
logprobs | boolean | no | false | Return token log probabilities when supported. |
top_logprobs | integer | no | - | Return up to this many top token log probabilities. · Range: 0 – 20 |
logit_bias | object | no | - | Bias token IDs by adding positive or negative values before sampling. |
tools | array | no | - | OpenAI-compatible function tool definitions. |
tool_choice | object | no | - | OpenAI-compatible function tool selection. |
stream | boolean | no | false | Stream response deltas using server-sent events. |
response_format | enum | no | - | Constrain the output to valid JSON. Use JSON mode for any JSON object, or supply a JSON Schema to force an exact response shape. |
web_search_linkup | boolean | no | false | Optional web search powered by Linkup. When enabled, recent web sources are retrieved using your latest user message as the query and provided to the model as additional context. Adds $0.013 per call when invoked on top of the model’s normal token cost. Disabled by default. |
disable_formatting | boolean | no | false | When enabled, the gateway will not append the “Sources” footer to assistant responses that used Linkup web search. Useful when the model output is piped to another system that expects no decoration. |