LLM Model Routing
Create a routing endpoint
Configure the serving name, routing strategy and destinations clients will use.
Build the route set
Choose the mode, add healthy destinations and define priority. Intent mode also needs a classifier and a default route.
Test before enabling
Call the endpoint with representative prompts and confirm the selected route, latency and fallback behavior before directing production traffic to it.