Extensions
The specification defines the envelope, the manifest, capability dispatch and the registry. Each extension adds to it: a media class the sink rebuilds, a receipt or another signed record, a way to deliver envelopes, or a contract for what a decode reproduces. Every extension here is in the standard's main branch, and each page shows the status its text declares.
Mirrored from the canonical text at commit 498e6b88 ().
The specification
Draft Standard.WAI™ — Web AI Media Transport & Execution
The container, the manifest, capability dispatch, the mandatory floor and the registered capabilities. Read it first; every extension builds on it.
Read the specificationReceipts and energy
What arrived, what ran and what it cost, signed so that a third party can check it.
-
JWP Receipt Chain
DraftSigned receipts for each delivered object, built from content hashes, per-group Merkle roots and group signatures, which relays forward unaltered.
Read the extension -
Bearer Receipts
DraftThe same publisher receipts on every bearer, two-way or broadcast, beside a publisher's claim of what it sent and a sink's later claim of what it received.
Read the extension -
OER Receipts (outcome and energy)
DraftA receipt for one unit of work: what it was, what it cost, how that cost is graded, and what it rests on.
Read the extension -
Energy Measurement
DraftHow a joule figure is acquired and classed, so the same field means the same thing in independent implementations; unmetered work reads as not metered.
Read the extension -
Sink Energy
DraftWhat decoding cost at the sink, per stream and per segment, with its acquisition class and uncertainty, and how a viewing session's energy splits between origin, relay, decode and display.
Read the extension -
Energy Binding
DraftBinds the energy a reconstruction cost to that reconstruction, written into a signed C2PA manifest.
Read the extension -
Asset Provenance
DraftA signed, energy-accounted lineage for captured content that WAI carries as opaque bytes rather than rebuilding.
Read the extension -
Reproducible-Reconstruction Binding
DraftA cryptographic binding over the deterministically decoded pixels of a neural-coded asset, rather than over its compressed bytes.
Read the extension -
Transparency Emission
DraftAn external encoding for receipts, so a party with no WAI tooling can check them, and registration with a transparency service so their existence is witnessed.
Read the extension -
Hybrid Signatures (Ed25519 with ML-DSA-65)
DraftA second, post-quantum ML-DSA-65 signature beside the Ed25519 one on WAI's signed records, so a record stays verifiable while either algorithm holds.
Read the extension -
Conformance Results
DraftThe signed outcome of running one of WAI's conformance corpora against an implementation, which anyone checks offline.
Read the extension -
Certification
DraftWhat a certifier publishes when it runs another party's build against WAI's conformance corpora: the submission's runs held together, a signed refusal for one that did not pass, and a signed manifest of every file, which a relying party checks whole offline.
Read the extension -
Energy Methods
DraftWAI's signed energy records mapped onto the methods the media and ICT industry uses to measure and report energy and emissions, method by method, with what a record cannot supply stated as not supplied and never estimated.
Read the extension -
C2PA Binding of a Stored Envelope
DraftA C2PA Manifest Store bound to a stored envelope that is left byte for byte as it is, naming the envelope's content hash and the group receipt it was delivered under.
Read the extension
Media classes
Content carried as instructions or state. The sink rebuilds it and checks the result by hash.
-
Interactive Worlds
DraftMedia that consumes input: a deterministic world and a signed op log that every sink replays to the same state.
Read the extension -
Linear Film
DraftA film carried as the sealed world that generates it, a camera track and a frame schedule; the sink renders the frames.
Read the extension -
Avatars (Digital Humans)
DraftMotion carried as a signed stream of joint transforms that the sink uses to skin a mesh.
Read the extension -
State-Feeds
DraftTyped state, such as a scoreboard or telemetry, carried as signed updates that every sink replays to the same state.
Read the extension -
Object-Based Spatial Audio
DraftSound objects and a scene, mixed for the listener's own layout, with a mixdown that is exact for a declared layout.
Read the extension -
Score (Music as Instructions)
DraftMusic carried as note events that the sink synthesizes to a canonical mixdown.
Read the extension -
Haptics
DraftTouch carried as a keyframed intensity and sharpness envelope that the sink rebuilds into actuator samples.
Read the extension -
Volumetric / 4D Splats
DraftA moving Gaussian-splat scene carried as per-Gaussian keyframed tracks that the sink interpolates at any frame.
Read the extension -
Exact Splats
DraftA Gaussian splat set carried in a glTF 2.0 asset as an integer-coded object, with a renderer whose frames are the same bytes on every machine, so a frame can be signed.
Read the extension -
Vector Graphics (wai.graphics.vector)
DraftTitles, credits and other authored graphics carried as integer drawing instructions that the sink rasterises into an overlay layer.
Read the extension -
Scene Carriage
DraftA world, an audio scene, the assets a world names and timed media, mapped onto two scene-description formats and back, with the WAI bytes carried exactly.
Read the extension -
Integer Neural Fields
DraftA volumetric scene held as an integer neural field, a feature grid and a small integer network, which the sink decodes and renders by integer ray marching to the same bytes on every machine.
Read the extension
Dispatch, delivery and transport
What a sink checks before it decodes, and how envelopes travel to it.
-
Capability Constraints
DraftSupport is not binary: a capability can publish constraint sets, such as a resolution, frame rate or profile, and a sink checks an object against them before dispatch, not at decode.
Read the extension -
Derived Tracks
DraftTracks that carry a process the receiver evaluates rather than its result: the derivation operations of ISO/IEC 23001-16, each registered with its own determinism tier.
Read the extension -
Staged Delivery
DraftA base first and refinements after, as separate objects linked to the base by hash, with a determinism tier for every stage and bounds on what a sink holds.
Read the extension -
Staged-Delivery Measurement
DraftHow a figure about staged delivery is measured and published: the bytes counted, quality per prefix, what “first presentable” means, layering overhead, decode time, energy and deduplication.
Read the extension -
Packaging
DraftA packager turns sources into WAI objects under a declared policy, and this extension fixes what a verifier recomputes from them.
Read the extension -
HTTP Delivery
DraftEnvelopes over HTTP: content-addressed immutable objects, a verified byte-range fetch of one component, receipt, key and playlist sidecars, cache rules and deadlines, beside HLS and DASH for on-demand and live.
Read the extension -
MoQ Streaming Format
DraftWAI carried over Media over QUIC under the MOQT Streaming Format: one whole envelope per object, with catalog fields and an optional receipt property that relays preserve.
Read the extension -
LOC Carriage
DraftAn envelope and its receipt carried as one object of a Low Overhead Media Container track: a subscriber that reads only LOC decodes the payload as a chunk, and one that reads WAI rebuilds the envelope byte for byte.
Read the extension -
Frame Streams
DraftInter-frame video carried one frame an object, each frame naming its predecessor by content hash, so a sink refuses a lost, reordered or altered frame instead of decoding past it.
Read the extension -
Unidirectional Delivery
DraftBearers with no return path, such as broadcast, satellite and multicast, where a receipt attests what was sent, never what was received.
Read the extension -
Carousel Schedule
DraftA publisher's signed schedule of when each object of a group passes on a bearer, and with which forward error correction.
Read the extension
Nodes, holdings and delivery records
What a node holds, serves and derives, and on whose authority; when an object is of use; and what a stream did, recomputed from signed records.
-
Holdings
DraftA node's signed statement, for its neighbours, of which objects of which groups it holds now.
Read the extension -
Timeliness
DraftA publisher's signed statement of when each object is of use: from when, by which deadline, how its value falls after it, and what a receiver presents in its place.
Read the extension -
Cache Authority
DraftThe authority to place a cache or a peer that serves objects another key signed, and its signed claim of what it sent over a bearer of its own with no path back.
Read the extension -
Cache Metadata
DraftWAI's cache rules handed to a cache another party runs, in the CDNI metadata that delegation already uses, with a reader that refuses a configuration that states anything else.
Read the extension -
Peer Delivery
DraftA sink fetching objects from neighbours that hold them before it spends the backhaul, taking nothing until it verifies under the publisher's receipts and signing for what it verified.
Read the extension -
Fleet
DraftThe nodes an organisation runs, enrolled by their signing keys, and a report of what they did that anyone holding their records recomputes.
Read the extension -
Deriving Edge
DraftAn edge that derives new objects from delivered ones, such as a lower rung for a sink that lacks a capability, signs each under receipts of its own and chains it to its source.
Read the extension -
Route Record
DraftWhat a router considered for one media job, and why it chose what it chose.
Read the extension -
Stream Termination
DraftA sink's signed account of one stream it received, from its start to the moment it stopped, and why it stopped.
Read the extension -
Stream Audit
DraftEvidence a content owner gathers from the players of a stream it already distributes over HTTP, with no change to the service that packages and delivers it.
Read the extension -
HLS Windows and Clips
DraftWhat a holder of an HLS presentation kept of it, each change to its window signed as a revision linked to the one before, and the clips it cut from that window, each playlist rendered from its record so a verifier compares the bytes.
Read the extension -
Delivery Telemetry
DraftAn unsigned, advisory observation of delivery from a sink, edge or origin, mapped onto the CMCD and CMSD keys with what each key reveals.
Read the extension -
QoE Aggregation
DraftQuality-of-experience figures the service receives only as sums, never as any one session's.
Read the extension
Channels, ads and settlement
A linear channel's lineup, its ad breaks and what each player presented, and what each party is owed, computed from signed records.
-
Channel Lineup and Guide
DraftA linear channel's signed lineup: each programme's title, description, rating, artwork and rights holder, and where each programme of the guide begins.
Read the extension -
Cue Injection
DraftBroadcast automation's SCTE 104 messages, translated to SCTE 35 sections and signed as a room's cue events.
Read the extension -
Live Ads
DraftAd breaks in rooms, mapped alike onto HLS and DASH by every edge so the manifests stay shared, with each viewer's decision made behind the one URI a break names.
Read the extension -
Ad Presentation
DraftA player's signed claim that it presented one impression of a break, with what it measured while it did.
Read the extension -
Stitched Presentation
DraftA player's signed claim that it presented an ad another party stitched into an HLS or DASH stream or served as an interstitial, beside the record signed for each ad decision.
Read the extension -
Impression Aggregates
DraftAd presentations counted over a bearer with no return path, each reported later into an aggregation that the service receives only as sums.
Read the extension -
Opportunity Report
DraftThe ad opportunities a linear channel's own signed records prove, per content owner and period, checked against the figures a platform reports.
Read the extension -
Revenue Share
DraftWhat each content owner of a linear channel is owed from the ads sold in its breaks, as a statement anyone holding the public records recomputes.
Read the extension -
Delivery Settlement
DraftDelivery paid on what the party that received it signed, not on what the party that sent it logged.
Read the extension -
Receipt Ledger
DraftInvoice lines a customer recomputes from the signed records WAI already defines.
Read the extension -
Rung Price
DraftA seller's signed list of what it charges to deliver a rung, and one rule for comparing delivery options with it.
Read the extension -
Price Document
DraftA publisher's signed prices for the endpoints it routes to, part of them held back as a commitment, so the public view and the full view verify to the same digest.
Read the extension -
Audience Decisions and Territories
DraftA decider's signed record of whether the sessions in one region may be shown a programme under the blackouts in force, with each session's location reduced to one listed region before it leaves the session.
Read the extension -
Sink-Evaluated Predicates
DraftA source's signed blackouts and ad slots, evaluated by the sink from its own location and its own record of exposures, so nothing about the device leaves it.
Read the extension -
Shoppable Events
DraftOffers a room presents, an item, a price and a window, that a viewer can act on, with every step on a signed record so that who is owed what recomputes.
Read the extension
Live rooms
Rooms where several people publish and many watch: who may do what, what was said and shown, what it cost, and what was kept.
-
Live Rooms
DraftThe signed room descriptor that fixes a room, its clock and its roles, and the grants under which each participant takes part, exchanged on the room clock and revoked through the key log.
Read the extension -
Live Events
DraftOne signed, chained and time-stamped record for every event of a room: metadata, cues, chat, reactions, polls, markers, commands, captions, decisions and lifecycle.
Read the extension -
Live Composition
DraftA room's layout and audio mix as integer functions of a signed descriptor, so every sink composes alike and a compositor's output can be checked.
Read the extension -
Live Ingest and Egress
DraftWHIP into a room's tracks and WHEP out of them: each frame an envelope on a MoQ track, and every object checked against its receipt.
Read the extension -
Live Contribution over SRT and RIST
DraftSRT and RIST contribution, with retransmission, profiled onto a room's tracks through the ingest gateway.
Read the extension -
Uncompressed Essence Contribution
DraftUncompressed SMPTE ST 2110 video, sound and ancillary data brought into a room through the ingest gateway, each stream held to its description.
Read the extension -
Telephony Bridge
DraftCallers on the telephone network joining a room as audio participants, and hearing it, through a bridge to one configured SIP peer.
Read the extension -
Live HTTP Egress
DraftA room's CMAF tracks served over low-latency HLS and DASH while the room is live, each part held to its group's signed receipts, or to a running receipt while the group grows, and served beside them.
Read the extension -
Signal Health
DraftA monitor's signed statement of what it measured on one input over a window: black and frozen pictures, silence, captions and cues last seen, and transport-stream indicators, each recomputable from the media.
Read the extension -
Capture Binding
DraftA device's master recording bound to the room while it is captured, so the upload proves it is one continuous take.
Read the extension -
Live Recording
DraftA finished session as one package, and clips that prove they are exact spans of a take.
Read the extension -
Live Provenance
DraftC2PA live video provenance for a room's CMAF tracks and a device's take, bound to the same bytes as the group receipts, so one verification establishes both.
Read the extension -
Timed Text and Live Captions
DraftCues that map exactly onto WebVTT, IMSC1, the MoQ caption timelines, CTA-608 and HLS, and live captions that carry their origin.
Read the extension -
Access Services
DraftCaption latency, stability and accuracy that any verifier recomputes from the signed revisions, and audio description and sign language carried as tracks of their own.
Read the extension -
Live Metering
DraftWhat a room session cost, in units and in joules per hop, recomputed from the records each hop signed.
Read the extension -
Energy-Aware Content Steering
DraftEach client steered to the pathway that delivers for the fewest joules within the operator's limits, decided from the hops' signed records.
Read the extension -
Live Moderation
DraftA signed review policy, decisions with their statements, notices and complaints, and a statement-of-reasons export.
Read the extension -
Confidentiality (end-to-end encrypted rooms)
DraftEnd-to-end encrypted rooms: every media object sealed as an MoQ secure object under keys from one MLS group per room, so relays route and meter ciphertext they cannot read.
Read the extension
Together in a room
What people do together in a room: talk, watch, perform, take part as a whole venue, sound as a crowd, share a world or share a screen.
-
Live Messaging (conversations and calls on live rooms)
DraftConversations and calls as end-to-end encrypted rooms: each message a signed record on its member's own track, with membership, delivery and reading signed too.
Read the extension -
Co-watch
DraftPeople in different places watching one programme together in a room, with shared control and their sync measured.
Read the extension -
Co-performance
DraftPeople and AI participants performing together in a room, and an audience joining in.
Read the extension -
Ensemble timing
DraftPerformers in different places playing together in a room, the delay between each two of them measured, signed and judged, and a whole-bar delay for those too far apart to play in time.
Read the extension -
Spaces
DraftVenues joined into one room, each a crowd behind one sound system and one camera, all playing the room after one shared delay so that every venue hears it at the same instant.
Read the extension -
Crowd Sound
DraftA remote audience's applause, cheers and singing along returned to a show as signed aggregates, never as any person's voice, with too few reports stated as too few, not as silence.
Read the extension -
Live Worlds (a shared world in a room)
DraftA shared world in a room: the room authority's signed statement of which world its operations replay in, and the bounds every operation holds to.
Read the extension -
World Voices (each voice heard from where its speaker stands)
DraftEach voice in a shared world heard from where its speaker stands, by integer rules, so that two sinks holding the same world and the same decoded sound mix the same samples.
Read the extension -
World Cells (a shared world that scales to a crowd)
DraftA shared world's floor split into square cells, each replayed from its own track, so that a participant follows only the cells around it and sees and hears the crowd beyond as signed aggregates.
Read the extension -
Remote Desktop
DraftA participant's screen shared into a room and controlled from it.
Read the extension
Works, rights and royalties
What names a recording, a work and a party, the release notifications that carry those names, who holds what share of each work, and what a service's plays give each holder of a share.
-
Music Rights
DraftRecordings, works and parties named by their ISRC, ISWC and ISNI and checked, a signed works document beside a package, and the works performed in a live show reported with the evidence for each.
Read the extension -
Right Shares
DraftWho holds what share of which right in a package's works, in integer millionths, a share not known left unknown rather than zero, and statements that disagree shown as a conflict, never resolved.
Read the extension -
Release Messages
DraftThe music industry's release notification, ERN 4.3.2, written from a package's works document and read back within a profile, each DPID, ISRC, ISWC and ISNI held to its published syntax and any check character it carries.
Read the extension -
Play Royalties
DraftWhat a service's plays of recordings give each holder of a share in the works recorded, from play receipts each listener's device signs, as a statement anyone holding the records recomputes.
Read the extension
Keys, ratings and removal
Licence keys, per-viewer watermark sessions, ratings and age thresholds, usage preferences, and removal, each as a signed record.
-
Key Release
DraftA signed receipt for every licence request a proxy in front of a licence server answers, release or refusal, decided from signed inputs a verifier recomputes; the proxy never holds a key.
Read the extension -
Forensic Watermark Sessions
DraftA signed record of each session in which an edge chose per-viewer watermark variants for a viewer of a room, as ETSI TS 104 002 has an edge choose them.
Read the extension -
Age Assurance
DraftContent ratings, admission by an age threshold without identity, and a profile for rooms in which a minor publishes.
Read the extension -
AI Usage Preferences and Consumption Claims
DraftAI usage preferences bound to the bytes they govern, and the signed statement of an agent that consumed media.
Read the extension -
Takedown
DraftThe removal of an item and of everything WAI derived from it, from every party that held it, timed against the clock of the regime the service runs under.
Read the extension
Accounts and their records
What a service that holds an account changed, handed over and deleted, each checkable by the account's holder without the service.
-
Audit Chain
DraftAn account's log of who may do what, each entry linked to the one before and the head signed at every export, so an entry changed, removed or reordered breaks the chain.
Read the extension -
Data Export
DraftAn account's records as one bundle signed whole by the service that held them, so the holder can show what it was handed: nothing left out, changed or added, and in which order.
Read the extension -
Data Deletion
DraftWhat a service deleted of a subject's records and what it kept and why, checked against the final export the subject holds rather than taken on the service's word.
Read the extension
Sinks, platforms and formats
How a sink reports what it can do, the codecs a device already has, and the formats WAI identifies, probes and computes exactly.
-
Browser Sink
DraftHow a sink in a web page reports which capabilities it has, and what the frames it decodes can be checked against.
Read the extension -
Native Sink
DraftAn app that plays a stream through its platform's own player, verifying the stream where it carries receipts and evidencing playback as a page does.
Read the extension -
Player Integration
DraftCode between an HLS or DASH player and its media pipeline that holds what the player fetched to the receipts served beside it: verify, then present, and refuse a mismatch.
Read the extension -
Deployment
DraftA project's built tree named by the digest of its build record, the API every host that holds deployments serves, and the receipt it signs for each answer.
Read the extension -
Platform Decode Capabilities
DraftThe web platform's Media Capabilities and WebCodecs answers, mapped onto a browser sink's capability report.
Read the extension -
Platform and Hardware Encoding
DraftAVC and HEVC renditions made by an encoder the device already has, with a signed record of who encoded what, from what source, with which settings and at what measured cost.
Read the extension -
Media Identification
DraftWhat a file is, from its bytes alone: the formats they fit, each with the bytes that say so.
Read the extension -
ISCC Content Identifiers
DraftThe International Standard Content Code of ISO 24138 computed from the standard's public texts, and the matching of an ISCC soft binding against an asset.
Read the extension -
Format Probes
DraftA header probe for each format the registry names that WAI does not decode itself: it identifies the payload and reads its parameters, or refuses it with a stated code.
Read the extension -
Projection Descriptor
DraftA 40-byte descriptor that says how a video's pictures map onto what a viewer sees, and how its two views are arranged.
Read the extension -
Exact Tone Mapping
DraftHDR gain maps and dynamic metadata applied in integer arithmetic, so every sink at one display headroom presents the same pixels.
Read the extension -
Opus Deep Redundancy, Decoded Exactly
DraftOpus deep redundancy decoded through an integer profile, so a stream under loss has one reconstruction, named by a digest a verifier recomputes.
Read the extension
Determinism, models and integrity
What a decode reproduces, which model it ran against, and how a claim about it is stated.
-
Determinism Tiers for Neural Decode
DraftNames what a neural decode reproduces, the entropy decode alone or the whole decode to the final medium, so a verifier knows what it may check.
Read the extension -
Integer Payloads
DraftThe binary payloads of the integer codecs: their formats, the refusals in a stated order, and the cost a sink reads from the header before it decodes.
Read the extension -
Integer Operators (wai-ops/1)
DraftThe integer operator set the integer-exact capabilities decode through: each operator's exact arithmetic, accumulator profiles, a bounds certificate that decides which one a parameter set meets, and a graph form.
Read the extension -
Neural Dispatch
DraftWhich unit of a sink's device, its neural processor, its GPU or its CPU, runs a neural capability's networks under the tier the decode needs; a floating-point path never runs a decode that needs decode-equivalence.
Read the extension -
Model Governance
DraftAn operator's signed policy of which parameter sets each class of its sinks may run and at which tier, and the sinks' signed record of what they ran.
Read the extension -
WA²ISM™, the Deterministic Module Profile
DraftA checked subset of standard WebAssembly, run by unmodified engines, and what a sink may state about a module's output: at its integer level, the same on every engine.
Read the extension -
The Verifier Module
DraftWAI's verifiers as one pinned WebAssembly module with an interface that needs no generated glue, so every embedder runs the same checks with the same bytes.
Read the extension -
Prior Carriage
DraftThe wire forms a pinned model's digest may cover, including a parameter-set listing and the NNC bitstream of ISO/IEC 15938-17.
Read the extension -
Task Fidelity
DraftThe contract for media judged by a downstream model's behaviour rather than by its bytes, with the evidence graded.
Read the extension -
Balanced-Ternary MPS Transform (wai.ternary.tt)
Draft / reference prototypeA classical tensor-network transform whose reconstruction is byte-exact, portable and receiptable; registered for provenance, not for rate.
Read the extension
Quantum
Quantum computations carried as instructions and simulated classically, receipts for quantum operations, and the jobs, answers and devices around them.
-
Quantum-Circuit Simulation
DraftA quantum circuit carried as a gate op log and simulated classically in fixed point, so the reconstructed state vector hashes the same on every machine.
Read the extension -
Quantum-Operations Attestation (wai.quantum.calibration · wai.quantum.job · wai.quantum.mitigate · wai.quantum.decode · wai.quantum.compile · wai.quantum.rearrange)
DraftSigned receipts over calibration runs and jobs that a third party can check from the bytes alone, each with its measured energy and acquisition class.
Read the extension -
Energy-Landscape Jobs (wai.quantum.landscape/1)
DraftA job that states an energy over three-state variables and asks for a state of low energy, settled by a classical reference in software or on a GPU, its answer naming what ran it and its joules.
Read the extension -
Energy-Landscape Jobs, Second Version (wai.quantum.landscape/2)
DraftThe second version of energy-landscape jobs: a cost of either sign for each variable, so one-hot and exactly-K constraints can be written, kernels of its own, and joules priced only at a rate with evidence behind it, or stated unpriced.
Read the extension -
Quantum Answer Views
DraftView statements beside an OpenQASM 3 program, each bound to an engine call, so the numbers in a model's answer about the program are numbers the engine computed.
Read the extension -
Quantum Providers (wai.quantum.provider/1)
DraftThe protocol a person's own quantum device or simulator speaks so that it works without a client written for it: six JSON operations, with programs in the device's native gates.
Read the extension -
Quantum Compile Certificates
DraftA certificate for each compile that chains every pass from the program's text to the compiled program's text, with the distance each adds, checked without running anything.
Read the extension -
Hybrid Quantum-Classical Execution (wai.quantum.wasmq)
DraftHybrid quantum programs: the classical functions an OpenQASM 3 program calls, as WebAssembly modules in one envelope, run with the same results and the same fuel on every runner.
Read the extension
Each page here is the canonical text as it stands at the mirrored commit, under a line that names the commit. Only its links change: references between the specification and its extensions point to their pages here, and references to code and corpora point to the repository at that commit. The specification and its extensions are Apache-2.0 in the open-standards repository.
See the status page for what is in the standard, what is being built and the roadmap, and the demonstrations for the extensions that run in the browser.