Arch
Build fast, hyper-personalized agents with intelligent infra
Listed in categories:
Open SourceDeveloper ToolsArtificial Intelligence
Description
Arch is an intelligent Layer 7 gateway designed to protect, observe, and personalize LLM applications, agents, assistants, and copilots with your APIs. It handles critical tasks related to prompt processing, including detecting and rejecting jailbreak attempts, intelligently calling backend APIs, and managing observability of prompts and LLM interactions.
How to use Arch?
To use Arch, install the CLI, configure it with your application settings, and integrate it with your LLM providers. Follow the quickstart guide for detailed steps.
Core features of Arch:
1️⃣
Function Calling for fast Agentic and RAG apps
2️⃣
Prompt Guard to prevent jailbreak attempts
3️⃣
Traffic Management for smart retries and resilient connections
4️⃣
Standards-based Observability for complete request tracing
5️⃣
Centralized management of LLMs and API integrations
Why could be used Arch?
| # | Use case | Status | |
|---|---|---|---|
| # 1 | Build a weather forecasting service using Arch's function calling capabilities | ✅ | |
| # 2 | Create a full insurance agent application with Arch | ✅ | |
| # 3 | Develop a networking copilot agent with Arch | ✅ | |
Who developed Arch?
Arch is built by the core contributors of Envoy Proxy, focusing on secure handling, robust observability, and seamless integration of prompts with APIs, all outside business logic.