Skip to main content
Refer to Pools for routing strategies and membership. Add model connections first, then group them here. All tools require workspace context.

Pools

dome_model_pool_list

List LLM pools in the active workspace.
Requires gateway.view.

dome_model_pool_get

Get a pool with its members.
Requires gateway.view.

dome_model_pool_create

Create an LLM pool.
Requires gateway.manage.

dome_model_pool_update

Update a pool. Only provided fields change.
Requires gateway.manage.

dome_model_pool_set_default

Set the workspace’s default pool. Replaces any prior default.
Requires gateway.manage.

dome_model_pool_move

Reposition a pool in its workspace’s match_when evaluation order. Pools with non-empty predicates evaluate in ascending sort_key; the first match wins. Exactly one of before or after is required.
Requires gateway.manage.

dome_model_pool_remove

Remove an LLM pool. Marked destructive.
Requires gateway.manage.

Pool members

Members are model connections inside a pool, each with a priority and weight. Failover walks ascending priority; within a priority bucket, requests distribute by weight.

dome_model_pool_member_list

List members of a pool.
Requires gateway.view.

dome_model_pool_member_add

Add a model to a pool.
Requires gateway.manage.
Add a member with failover

dome_model_pool_member_update

Update a pool member’s priority, weight, or enabled flag.
Requires gateway.manage.

dome_model_pool_member_remove

Remove a model from a pool. Marked destructive.
Requires gateway.manage.

Next steps

  • Models to add the connections a pool routes across
  • Quotas to cap spend and drive spillover
  • Pools how-to for the full workflow