The outcome

Select a serverless model with evidence for quality, latency, context, safety, and price.

Step by step

A workflow you can repeat.

  1. 01

    Define representative inputs, expected outputs, safety cases, context requirements, latency targets, and a scoring rubric.

  2. 02

    Shortlist models currently marked Serverless and inspect model documentation, limits, pricing, and deprecation conditions.

  3. 03

    Test in the playground, then reproduce the same fixed configuration through the API with a securely stored key.

  4. 04

    Record quality, latency, token use, cost, rate-limit behavior, and malformed outputs across normal and adversarial cases.

  5. 05

    Pin the chosen model identifier, add compatible fallbacks, and schedule regression tests for model or prompt changes.

Working standard

What good use looks like.

  • Confirm the Serverless tag.
  • Reproduce playground tests in code.
  • Plan for model deprecation.

Official references

Check the current product documentation.