Raon
Docs
Chat Completions

Create a chat completion

POST
/v1/chat/completions

OpenAI-compatible chat completion with Raon-run web search, storage disabled, and opt-in streaming usage.

Authorization

bearerAuth
headerAuthorizationBearer <token>

Raon API key. A Bearer credential takes precedence when both authentication headers are sent.

Request Body

application/json
  1. body

OpenAI-compatible chat request. Other backend extensions are forwarded, not validated or guaranteed by this contract. The organization safety prompt, if configured, is prepended to system content.

model*string

Public model ID from the model catalog.

Length1 <= length
messages*array<>
stream?boolean

Return SSE instead of a JSON completion.

Defaultfalse
stream_options?
max_completion_tokens?integer

Maximum generated tokens including reasoning; takes precedence over max_tokens for gateway quota accounting.

Range1 <= value
max_tokens?integerDeprecated

Legacy output cap.

Range1 <= value
temperature?|

Sampling temperature. Raon models always use temperature=1.0, regardless of supplied values, null or omission. Other providers use their own parameter behavior.

Range0 <= value <= 2
top_p?|

Nucleus sampling probability. Raon models always use top_p=0.95, regardless of supplied values, null or omission. Other providers use their own parameter behavior.

Range0 <= value <= 1
top_k?|

Top-k sampling cutoff. Raon models always use top_k=20, regardless of supplied values, null or omission. Other providers use their own parameter behavior.

min_p?|

Minimum relative token probability. Raon models always use min_p=0, regardless of supplied values, null or omission. Other providers use their own parameter behavior.

repetition_penalty?|

Token repetition penalty. Raon models always use repetition_penalty=1.0, regardless of supplied values, null or omission. Other providers use their own parameter behavior.

n?integer

Number of choices. Web search rejects values greater than 1.

Range1 <= value
Default1
stop?|array<string>|

One or more stop strings sent to the model server. Generation stops when one is produced. By default, the matching stop string is not included in the returned text.

frequency_penalty?|

Token frequency penalty. Raon models always use frequency_penalty=0, regardless of supplied values, null or omission. Other providers use their own parameter behavior.

Range-2 <= value <= 2
presence_penalty?|

Topic repetition penalty. Raon models always use presence_penalty=1.5, regardless of supplied values, null or omission. Other providers use their own parameter behavior.

Range-2 <= value <= 2
seed?integer

Backend-dependent deterministic sampling seed.

logprobs?boolean

Request output token log probabilities.

top_logprobs?integer

Number of alternatives per token.

Range0 <= value <= 20
logit_bias?

Token ID to logit adjustment.

tools?array<>

Client-executed functions. Do not use the name web_search alongside web_search_options.

tool_choice?|

Tool-use policy: none disables tool calls, auto lets the model decide, and required requests at least one tool call. An object with type function selects a function by name.

parallel_tool_calls?boolean

Allow multiple client tool calls in a turn.

response_format?||

Request the answer as text, a JSON object, or JSON constrained by json_schema. Reasoning remains separate. Check the completion status before parsing potentially truncated output.

web_search_options?

Enables Raon-run web search. Requires n = 1 and no caller function named web_search. A disabled search service or organization policy returns 400 unsupported_tool.

store?boolean

Accepted, but any supplied value is overwritten with false. Raon provides no stored-completion retrieval.

Defaultfalse
metadata?

Caller metadata passed to the serving backend; this does not enable response storage.

user?string

Caller identifier passed through to the backend.

reasoning_effort?string

Accepted but ignored on Raon. Reasoning is always enabled and its effort cannot be configured.

Value in"none""minimal""low""medium""high""xhigh"
chat_template_kwargs?

Serving template options. Raon always enables thinking on all three inference APIs.

Response Body

Generated output as JSON, or server-sent events when stream is true. Additional backend fields may be returned.

  1. response

Ordinary responses are forwarded from the serving backend. Hosted web search reports the usage of its last internal turn, which already holds the whole conversation and every search result, and can attach URL citations.

id*string
object*string
created*integer

Unix timestamp in seconds.

model*string

Model ID returned by the serving backend, preserved by the gateway. It can differ from the public ID in the request. Use GET /v1/models IDs for subsequent requests.

Length1 <= length
choices*array<>
usage?
system_fingerprint?string|null
curl -X POST 'https://raon-api.krafton.ai/v1/chat/completions' \  -H 'Content-Type: application/json' \  -d '{  "model": "raon-1-mini",  "messages": [    {      "role": "user",      "content": "Explain why the sky is blue."    }  ],  "max_completion_tokens": 1024}'
Example Response
{  "id": "string",  "object": "chat.completion",  "created": 0,  "model": "raon",  "choices": [    {      "index": 0,      "message": {        "role": "assistant",        "content": "string",        "reasoning": "string",        "tool_calls": [          {            "id": "string",            "type": "function",            "function": {              "name": "string",              "arguments": "string"            }          }        ],        "refusal": "string",        "annotations": [          {            "type": "url_citation",            "url_citation": {              "start_index": 0,              "end_index": 0,              "title": "string",              "url": "string"            }          }        ]      },      "finish_reason": "stop",      "logprobs": {}    }  ],  "usage": {    "prompt_tokens": 0,    "completion_tokens": 0,    "total_tokens": 0,    "prompt_tokens_details": {      "cached_tokens": 0    },    "completion_tokens_details": {      "reasoning_tokens": 0    }  },  "system_fingerprint": "string"}