ChattyPatty
Decentralized compute marketplace for LLM inference with a Sonic-first trust plane. The architecture pairs an OpenAI-compatible gateway, a scheduler for lease assignment and receipt verification, and provider nodes publishing heartbeat and attestation evidence.
- Gateway
- Normalize and meter
- Scheduler
- Assign leases and verify receipts
- Provider
- Run inference and publish attestations
Receipt commitments bind request, result, and metering. Sonic contracts govern escrow, challenge, and settlement.
On this page
Use
- Deterministic receipts and hash commitments create auditable settlement trails.
- Scheduler-driven leasing and routing keep capacity and assignment predictable.
- Provider heartbeat and attestation flows strengthen liveness and trust scoring.
- OpenAI-compatible gateway enforces canonical request validation, token accounting, and rate controls.
Engineering frame
- Constraint
- Independent providers cannot be authoritative for their own capacity, token count, or completion of a paid job.
- Boundary
- The gateway normalizes and meters; the scheduler selects providers and leases; the runtime executes; Sonic contracts govern escrow, challenge, and settlement.
- Verification
- Canonical commitments bind request, response, model, runtime, tokenizer, and metering. A job cannot complete without a previously committed receipt.
Programming Notes
Current State
In the lab: protocol and specs are locked, contract interfaces and canonical schemas are in place, and gateway/scheduler/provider services are scaffolded and testable.