Kong AI Gateway 3.11 Introduces New Method for Reducing Token Costs
Summary by SD Times
2 Articles
2 Articles
Kong AI Gateway 3.11 introduces new method for reducing token costs
Kong has introduced the latest update to Kong AI Gateway, a solution for securing, governing, and controlling LLM consumption from popular third-party providers. Kong AI Gateway 3.11 introduces a new plugin that reduces token costs, several new generative AI capabilities, and support for AWS Bedrock Guardrails. The new prompt compression plugin that removes padding and redundant words or phrases. This approach preserves 80% of the intended sem…
Coverage Details
Total News Sources2
Leaning Left0Leaning Right0Center0Last UpdatedBias DistributionNo sources with tracked biases.
Bias Distribution
- There is no tracked Bias information for the sources covering this story.
Factuality
To view factuality data please Upgrade to Premium