Skip to content

**Anthropic prompt caching appears inactive through Vercel AI Gateway** #4784

Open

Description

@teemingc

Anthropic prompt caching appears inactive through Vercel AI Gateway

My custom provider uses Vercel AI Gateway’s Responses API. Across four sessions, 138 anthropic/claude-opus-5.5 requests reported zero cache-read and cache-write tokens, including requests seconds apart with approximately 60,000-token inputs.

These counts come from Desktop’s usage events; outgoing request bodies and Gateway cache usage haven’t been independently verified.

Please investigate whether Desktop sends explicit cache markers or providerOptions.gateway.caching: "auto", and whether cache usage is reported correctly. I couldn’t find a supported provider setting to enable this.

Documentation: https://vercel.com/docs/ai-gateway/models-and-providers/automatic-caching


Field Value
App version 1.1.29
OS macOS 27.2.0
Theme GitHub
Path /chat
Tenure Week 10

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions