CodingFeatured

Model routing policy designer

Design a testable multi-model routing policy from task classes, quality thresholds, latency, cost, privacy, and failure fallbacks.

Prompt
You are an AI platform architect. Design an explainable, testable, progressively deployable model-routing policy for the application below. Do not send every request to the largest model by default. Application and user scenarios: {application} Primary task classes and examples: {task examples} Candidate models and known capabilities: {model inventory} Context windows and tool support: {context and tools} Quality and safety thresholds: {quality thresholds} Latency objectives: {latency} Cost budget and billing units: {cost} Privacy, data-residency, and compliance requirements: {privacy and compliance} Availability, concurrency, and rate-limit information: {runtime constraints} Allowed telemetry and feedback signals: {telemetry} First audit every time-sensitive input. If model price, regional availability, rate limits, context size, or capability lacks a dated source, label it "verification required" rather than treating it as current fact. Then return: 1. A task-classification table defining complexity, context, tools, privacy, accuracy, latency, and cost needs for each class, with positive examples and confusing counterexamples. 2. A routing decision table that filters models by hard constraints before ranking eligible options by quality, latency, and cost. Explain every rule; do not substitute brand reputation or one benchmark for task evidence. 3. Escalation and degradation rules covering when to move up from a small model, when to fall back to a compatible model, and how to handle timeout, rate limit, empty response, tool failure, and low confidence. Never silently weaken safety or privacy to stay online. 4. Budget controls for request, session, and daily limits, including what the system returns when a limit is reached, which tasks may continue after user confirmation, and which must stop. 5. An evaluation set with representative cases, expected behavior, scoring rubric, maximum latency, and cost-recording fields for every task class. Include multilingual, long-context, and failure-injection cases. 6. A rollout plan covering offline replay, shadow routing, limited traffic, rollback thresholds, and monitoring. Do not change production configuration directly. Finish with machine-readable pseudoconfiguration and a short team-facing decision note. Distinguish conclusions supported by supplied data from assumptions that require measurement.

Inspiration source

This prompt is an original adaptation. The source X post appears below, and you can also open it directly on X.

The page loads the X embed automatically, which may share your IP address and browser information with X.

Open original on X

Loading the X post…

Editor's note

Use this when a team has multiple providers or model tiers but still routes by intuition. Real cost, latency, and compliance inputs are essential; validate the policy against your own tasks in shadow mode before rollout.

About this prompt

Best for code review, debugging, and development tasks where you need precise, actionable engineering feedback.

How to use this prompt

  1. 1

    Copy the prompt

    Click Copy prompt to grab the full text, ready to paste anywhere.

  2. 2

    Paste into your AI tool

    Drop it into ChatGPT, Claude, Gemini, or any AI assistant you use.

  3. 3

    Customize and run

    Paste in your code, error message, or change description, then send it to get targeted guidance.

Frequently asked questions

What is the Model routing policy designer prompt for?

Design a testable multi-model routing policy from task classes, quality thresholds, latency, cost, privacy, and failure fallbacks.

How do I use this prompt with ChatGPT or other AI tools?

Copy the prompt, paste it into your AI assistant, replace any placeholders with your own details, and send it. You can also open it in the card maker to restyle and share it.

Is this prompt free to copy and customize?

Yes. Every prompt in the library is free to copy, adapt, and reuse, with no account required.

More prompts from the Coding collection.

Featured
Coding

Lean context architecture auditor

Audit system prompts, project rules, tool descriptions, skills, and memory into a lean, on-demand context architecture with regression checks.

context engineeringsystem prompt
Featured
Coding

Autonomous agent delivery loop designer

Turn a project goal into a repeatable, auditable spec-build-review loop with explicit stop controls.

agent workflowdelivery loop
Coding

Agent pattern and critic loop

Choose the right control flow, then improve reliability with an independent critic and bounded revision loop.

multi-agentcritic loop