Question 1

Toi dung duoc nhung mo hinh nao?

Accepted Answer

Route Key hien thi cac mo hinh da bat trong pricing backend, gom GPT, Claude, Gemini, DeepSeek, Qwen va kenh tuy chinh tuong thich. Hay xem trang Models de so sanh nha cung cap, context, endpoint, group duoc phep va dung model ID truoc khi gui traffic production.

Question 2

Co can viet lai SDK khong?

Accepted Answer

Thuong la khong. Giu request body va SDK theo format OpenAI, thay base URL bang endpoint tuong thich Route Key, dat API key Route Key va chon dung model ID. Hay thu mot request ngan khong streaming truoc, sau do moi them streaming, tools va context dai.

Question 3

Uu dai hoat dong the nao?

Accepted Answer

Gateway so sanh route theo group ratio, gia token input/output, cache, latency va health. Ban co the co dinh model hoac de policy chon route khoe co chi phi thap hon. Trong Usage Logs, hay doi chieu model, token, group va chi phi de do dung muc tiet kiem.

Question 4

API key va log duoc xu ly the nao?

Accepted Answer

Key duoc an trong console. Tuy theo privacy control, Usage Logs hien thi trang thai, model, chi phi, token input/output, latency va thoi gian. Dung key rieng cho tung ung dung hoac coding agent de de xoay quyen va gan dung chi phi cho tung workload.

Question 5

Routing co lam cham response khong?

Accepted Answer

Routing duoc quyet dinh truoc dispatch nen co the loai route dang loi truoc khi gui request. Streaming endpoint van giu response SSE. Sau khi deploy, hay theo doi latency va loi, dong thoi dat fallback ro rang cho su co provider thay vi retry vo han trong moi client.

Question 6

Chi dung cho thu nghiem?

Accepted Answer

Khong. Tao API key rieng trong Dashboard, dat endpoint tuong thich va model ID chinh xac, sau do gui request ngan de thu. Kiem tra response, quota, model, token, latency va chi phi trong Usage Logs roi moi them streaming, concurrency, retry va fallback tung buoc de thay doi production co the quan sat va quay lui.

Mot khoa AI. Moi mo hinh.

catalog

developer title