QWED performance and cost benchmarks

• Hardware: AWS EC2 t3.medium (2 vCPU, 4GB RAM)
• Python: 3.11
• QWED: v1.1.0
• Date: December 2025

​

Performance benchmarks (latency)

​

Verification engine latency

​

Key observations

• ✅ Most verifications < 100ms - Suitable for real-time applications
• ⚠️ Symbolic execution slow - Use only for simple functions
• ⚠️ Consensus expensive - 3× LLM API calls required

​

Cost comparison

​

Scenario: financial calculator application

​

Scenario: SQL query generation (RAG application)

​

Scenario: code security scanning

​

API pricing (QWED Cloud)

​

Free tier

• 1,000 verifications/month
• All 8 engines
• No credit card required

​

Pro ($49/month)

• 50,000 verifications/month
• Custom timeout limits
• Priority support
• SLA: 99.9% uptime

​

Enterprise (custom)

• Unlimited verifications
• On-premise deployment
• Custom SLA
• Dedicated support

​

Pay-as-you-go

• $0.0005 per verification (beyond free tier)
• Volume discounts available

​

ROI calculator

​

Example: finance application

• 10,000 calculations/day
• LLM cost: $0.50 per 1K calls
• Error rate without QWED: 5%
• Average error cost: $1,000 per error

​

Latency optimization tips

​

1. Enable Redis caching

from qwed_sdk import QWEDClient

client = QWEDClient(
    cache_enabled=True,
    redis_url="redis://localhost:6379"
)

# Repeated verifications: 0.5ms (99% faster)

​

2. Async verification

import asyncio

async def verify_batch(items):
    tasks = [client.verify_async(item) for item in items]
    return await asyncio.gather(*tasks)

# 10× throughput improvement

​

3. Selective engines

# Only enable engines you need
client = QWEDClient(engines=["math", "code"])  # Faster startup

​

4. Timeout tuning

# Reduce timeout for simple operations
result = engine.verify_math(expr, timeout_ms=1000)  # 1s max

​

Throughput benchmarks

​

Comparison with alternatives

​

vs Guardrails AI

​

vs self-consistency

​

vs manual review

​

Production scaling

​

Architecture for 1M verifications/day

Load Balancer
    ├── API Server 1 (8 workers)
    ├── API Server 2 (8 workers)
    ├── API Server 3 (8 workers)
    └── Redis Cluster (3 nodes)

Estimated cost: $200/month (AWS)
Handles: 1.2M verifications/day
Latency: p95 < 100ms

​

Summary