FloTorch
AI gateway and evaluation platform for LLM and agent workflows
About FloTorch
FloTorch provides tools to benchmark models, evaluate agentic workflows and manage LLM routing, caching and guardrails through a unified gateway. It emerged from Fission Labs.
Common use cases
- Compare models
- Control LLM cost
- Evaluate agents
Products and services
Unified Gateway
Routing, caching and cost control for LLMs
Evaluations
Benchmarking of models and agents
Nocode workflows
Workflow management
Key features
- LLM routing
- Evaluations
- Cache management
- Guardrails
- Usage analytics
- RAG pipeline tools
Integrations
- Amazon Bedrock
FloTorch alternatives
- POPortkey
- LILiteLLM
- HEHelicone
- ARArize
FAQs
What does it do?
LLM gateway and evaluation.
Where is it from?
Fission Labs.
Security?
Includes guardrails.
Work at FloTorch? Request updates to this profile. Update this profile
Compare with similar providers
All ML Operations providersModelOpAI lifecycle governance and enterprise AI command center
TrueFoundryEnterprise control plane for LLMs, MCP servers and AI agents
Actualyze AIAI governance gateway between applications and model providers
AlationData catalog and governance platform for trusted enterprise data and AIALERT AIAI governance, security and cost control inside the customer's VPC
AlignAIAI program management and governance platform for intake and risk review
AnyscaleManaged platform for running Ray-based AI workloads at scale
ArthurControl plane for governing, monitoring and securing enterprise AI agents