Feat: Enable Barewire Integration for Enhanced AI Agent Observability & Control

[sh8kme]

Feature: Optional Barewire Integration for Enhanced AI Agent Management

This Pull Request introduces an optional, non-breaking integration with Barewire, an agentic proxy designed to provide comprehensive observability, control, and compliance capabilities for LLM interactions. This enhancement will empower developers using SambaNova AI Starter Kits to build more robust, secure, and production-ready AI agents.

Problem Statement

As AI agent development matures, the need for advanced tooling to manage LLM interactions becomes critical. Developers require solutions for:

• Deep Observability: Understanding the full lifecycle of LLM requests and responses for debugging, performance tuning, and usage analysis.
• Granular Control: Implementing policies for request/response modification, rate limiting, and cost management at a centralized layer.
• Compliance & Security: Ensuring LLM interactions adhere to regulatory requirements (e.g., PII redaction, data residency) and maintaining a strong security posture.
• Environment Management: Seamlessly managing different LLM configurations and policies across development, staging, and production environments.

Solution

This PR modifies the SambaNovaCloudAPI client in benchmarking/src/llmperf/sambanova_client.py to optionally route LLM calls through a Barewire proxy. This integration is designed to be seamless: if Barewire environment variables are not set, the client behaves exactly as before, making direct calls to the SambaNova Cloud API.

Key Benefits for SambaNova Developers

1. Full Observability: Gain unprecedented visibility into every LLM request and response, including prompts, completions, token counts, and latency metrics, all captured and stored by Barewire without altering your core application logic.
2. Enhanced Control: Implement powerful, centralized policies such as:
   • Request/Response Modification: Dynamically transform prompts or completions.
   • Rate Limiting: Protect your LLM APIs from abuse and manage costs.
   • PII Redaction: Automatically identify and redact sensitive information.
   • Cost Management: Monitor and control spending across different models and teams.
3. Compliance & Security by Design: Easily enforce critical compliance rules, such as data residency or content filtering, and add an essential layer of security for sensitive LLM interactions, crucial for enterprise deployments.
4. Simplified Environment Management: Define and manage distinct LLM configurations and security policies for your development, staging, and production environments from a single Barewire control plane.
5. Non-Breaking & Optional Integration: The feature is activated only when specific environment variables are set, ensuring existing workflows remain unaffected for users who do not require Barewire.

How to Enable (Optional)

To leverage Barewire's capabilities, follow these simple steps:

1. Sign Up for Barewire: Obtain your Barewire API Base URL and API Key from the Barewire platform.
2. Set Environment Variables: Add the following to your .env file (or set them in your environment where your application runs):

   BAREWIRE_API_BASE="https://api.barewire.io/v1" # Your Barewire API endpoint
   BAREWIRE_API_KEY="sk_bw_..." # Your Barewire API Key

3. Run Your Application: All LLM calls will now be automatically routed through Barewire, providing you with enhanced management and insights.

Impact

This integration significantly enriches the SambaNova AI Starter Kits by offering enterprise-grade features for LLM management. It makes it easier for developers to build, deploy, and manage production-ready AI agents with greater confidence, control, and compliance, aligning perfectly with SambaNova's mission to facilitate AI-driven use cases.

[snova-rodrigom]

hi @sh8kme I'd like to try it myself but your barewire io link isn't working for me, could you confirm the link please?

[sh8kme]

Hi, sorry should be barewire ai

…

________________________________ From: snova-rodrigom ***@***.***> Sent: Tuesday, 14 July 2026 15:03:07 To: sambanova/ai-starter-kit ***@***.***> Cc: Strawbird ***@***.***>; Mention ***@***.***> Subject: Re: [sambanova/ai-starter-kit] Feat: Enable Barewire Integration for Enhanced AI Agent Observability & Control (PR #839) [https://avatars.githubusercontent.com/u/166079432?s=20&v=4]snova-rodrigom left a comment (sambanova/ai-starter-kit#839)<#839 (comment)> hi @sh8kme<https://github.com/sh8kme> I'd like to try it myself but your barewire io link isn't working for me, could you confirm the link please? — Reply to this email directly, view it on GitHub<#839?email_source=notifications&email_token=AABUFVW2GEN2BXLUUDX2VS35E2UZTA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTIOJXGQ2DANRSHAY2M4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-4974406281>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AABUFVTWTPPZUDK5YTCWTB35E2UZTAVCNFSNUABFKJSXA33TNF2G64TZHM3TAMJUGQZTAMBWHNEXG43VMU5TIOBYGA3DQOJYGUYKC5QC>. Triage notifications, keep track of coding agent tasks and review pull requests on the go with GitHub Mobile for iOS<https://github.com/notifications/mobile/ios/AABUFVXTBW2F747ZAOO7BLD5E2UZTA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTIOJXGQ2DANRSHAY2M4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJKTGN5XXIZLSL5UW64Y> and Android<https://github.com/notifications/mobile/android/AABUFVQT4QXZEU5ZYI2MZPD5E2UZTA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTIOJXGQ2DANRSHAY2M4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLTGN5XXIZLSL5QW4ZDSN5UWI>. Download it today! You are receiving this because you were mentioned.Message ID: ***@***.***>

[snova-rodrigom]

@sh8kme I can't make it work. I'm getting
HTTPSConnectionPool(host='api.barewire.io', port=443): Max retries exceeded with url: /v1/chat/completions (Caused by SSLError(SSLError(1, '[SSL: SSLV3_ALERT_HANDSHAKE_FAILURE] ssl/tls alert handshake failure (_ssl.c:1016)')))
I'm currently using
SAMBANOVA_API_BASE="https://api.sambanova.ai" SAMBANOVA_API_KEY=$SAMBANOVA_API_KEY BAREWIRE_API_BASE="https://api.barewire.io/v1" BAREWIRE_API_KEY=$BAREWIRE_API_KEY
Did you do something different to test your changes?