Zurück zum Katalog
TToken saver logo

Token saver

Self-hosted caching proxy that cuts LLM API costs

3.8editorial
Freemium
Gestartet im 2026

Über

TokenSaver is a self-hosted caching proxy that sits between your app and the LLM API. It deduplicates prompts using SHA256 for exact matches and sentence-transformers embeddings for near-identical queries. Catch retries, refreshes, and the same question from different users before they reach the API. Includes per-user budgets, Slack/email alerts, rate limiting, per-model cost analytics, and anomaly detection. Free for up to 5 users (MIT).

Vorteile

  • +Deduplica prompts exatos e semelhantes, economizando custos de API
  • +Oferece alertas via Slack e email para anomalias
  • +Inclui análise de custos por modelo e limites de taxa

Nachteile

  • Versão gratuita limitada a 5 usuários
  • Requer auto-hospedagem e configuração técnica

Häufig gestellte Fragen

O que é o Token saver?
O Token saver é uma ferramenta de inteligência artificial especializada em open-source e developer-tools. TokenSaver is a self-hosted caching proxy that sits between your app and the LLM API. It deduplicates prompts using SHA256 for exact matches and sentence-transformers embeddings for near-identical queries. Catch retries, refreshes, and the same question from different users before they reach the API. Includes per-user budgets, Slack/email alerts, rate limiting, per-model cost analytics, and anomaly detection. Free for up to 5 users (MIT).
O Token saver tem versão gratuita?
Sim, o Token saver oferece um plano gratuito com funcionalidades básicas.
Quais são as melhores alternativas ao Token saver?
As principais alternativas ao Token saver são: -ludr-ai-understand-any-screen, session-bridge-ai, speakcli. Compare todas as opções no FindMyAI para escolher a ideal para o seu caso de uso.

Das könnte Ihnen auch gefallen