Secure On-Premises AI Governance Solutions with APERION SmartFlow SDK

Post Views: 111

APERION Launches SmartFlow SDK for Secure On-Premises AI Governance

Amidst growing concerns following a recent supply chain attack on LiteLLM, a widely used open-source Language Model Proxy, APERION has introduced its SmartFlow SDK (Software Development Kit). This SDK provides a secure, on-premises path for enterprises to migrate away from compromised cloud-based AI gateways.

According to Craig Alberino, CEO of APERION:”The LiteLLM supply chain attack serves as a wake-up call for the industry. It highlights the importance of regulated enterprises governing their AI from within their own premises.”

The launch coincides with a significant increase in web traffic since the March 24 LiteLLM supply chain attack, which compromised an estimated 36% of all cloud environments. This attack was attributed to a supply chain attack by the threat actor group TeamPCP, who breached Aqua Security’s Trivy vulnerability scanner.

The compromised LiteLLM package, with approximately 95 million monthly downloads, has forced enterprises across various industries, including financial services and healthcare, to reassess their AI infrastructure dependencies.
APERION’s flagship product, SmartFlow, is an on-premises, Kubernetes-native AI governance control plane that remained unaffected by the incident.
SmartFlow is designed to be deployed as a software appliance behind the enterprise firewall, with no dependency on public package registries, no cloud data transit, and no external Continuous Integration/Continuous Deployment (CI/CD) pipelines in the customer deployment path.

“The recent supply chain attack was not an isolated incident; it highlighted the risks associated with relying on public package registries and unaudited CI/CD pipelines,” said Scott Ancheta, CTO of APERION. “Our Rust-based infrastructure ensures sub-5 millisecond routing overhead, while our MetaCache semantic caching achieves 55% to 75% hit rates at p95 latency on production hardware.”

DDA, a leading AI-powered commercial real estate investment due diligence platform, has successfully implemented SmartFlow, achieving 99.999% uptime over four months of continuous operation. Multiple Fortune 500 institutions in financial services are currently evaluating the platform.

APERION has filed 22 patent applications covering enterprise AI governance, sovereign model deployment, and autonomous AI control plane architecture.

Key Features of SmartFlow SDK:

A Python library that allows developers to configure their systems to use either a full-fledged SmartFlow appliance or a standalone software gateway with feature parity to LiteLLM and OpenRouter, depending on the availability of the appliance.
Supports secure, on-premises AI governance for enterprises looking to migrate away from compromised cloud-based AI gateways.
Enables production-grade AI governance solutions with features such as Kubernetes-native integration, MetaCache semantic caching, and sub-5 millisecond routing overhead.