ai-native-medicalv0.2.0
← AI-Native Medical
Transmit
Appendix A

The Cloud Egress Trap: The Physics and Economics of Multimodal Data

Hyperscaler infrastructure is priced on an asymmetric model: inbound data transfer (ingress) is aggressively subsidized or free, while outbound data transfer (egress) is metered and billed. For most enterprise software workloads — transactional APIs, document storage, asynchronous batch processing — this pricing structure is manageable. The cost asymmetry becomes a significant architectural constraint when the workload shifts to continuous, uncompressed multimodal telemetry. The organizations that encounter this constraint are not making avoidable errors; they are running into a structural mismatch between a pricing model designed for one class of workload and an infrastructure requirement defined by a fundamentally different one.

The Physics of Ambient Data Generation

A traditional enterprise software environment relies on users consciously submitting structured data packets via keyboards or asynchronous API calls. An AI-Native Medical operates continuously, capturing ambient human interaction as raw, uncompressed data. This environment utilizes real-time spatial audio, uncompressed WebRTC video streaming, SIP telephony mapping, and continuous screen telemetry. The physics of this data generation scale exponentially and cannot be mitigated by standard compression algorithms without destroying the granular context required by advanced machine learning models.

Consider the bandwidth requirements for a standard real-time communication protocol utilized in a localized collaboration space. LiveKit, an open-source WebRTC-based Selective Forwarding Unit (SFU) designed for real-time applications, demonstrates the staggering network load required to process multimodal streams. [1] Benchmarking a single large video room with 150 publishers and 150 subscribers at a standard 720p resolution—even with adaptive bitrate streaming (ABR) and simulcast enabled—generates incoming throughput of 50 MBps and outgoing throughput of 93 MBps. [1]

When evaluating the data footprint of an ambiently recorded enterprise environment across a standard workday, the continuous flow of packets requires dedicated processing power. A single 16-core compute-optimized server managing this WebRTC traffic will experience 85% CPU utilization simply to handle the decryption, packet processing, and re-encryption required to forward these media tracks. [1]

The equation for daily data generation is unforgiving. A single WebRTC session utilizing standard H.264 codecs at 1280x720 resolution demands 1.25 Mbps per stream. [5] If a corporate office runs twenty concurrent multimodal collaboration nodes, the data generated is measured in terabytes per day. Furthermore, processing this data via cloud architecture introduces a severe physical limitation: the latency horizon.

The glass-to-glass latency in video applications, or mouth-to-ear latency in audio, represents the time required for a media packet to travel from the source device, undergo encryption, traverse the public internet, reach the cloud SFU, undergo decryption, processing, re-encryption, and travel back to the edge. [2] Every geographic hop, every transit ISP network boundary, and every encryption layer adds milliseconds to the round trip. For real-time autonomous agents interacting dynamically with human speech, any latency exceeding 200 milliseconds destroys the determinism of the interaction. True AI-native architectures cannot tolerate network jitter or packet loss; the computational engine must reside adjacent to the sensor.

The Economics of the Egress Constraint

The physical latency limitations of multimodal AI are compounded by the financial architecture of public cloud egress pricing. When multimodal data is processed in the cloud, inference APIs, model weights, and continuous WebRTC streams constantly move data out of the provider's infrastructure. [6] This creates a pricing structure that compounds significantly on continuously streaming, GPU-heavy workloads. [6]

The egress pricing schedules across major hyperscalers reflect the cost structure enterprises encounter when routing multimodal AI workloads through centralized infrastructure:

Cloud ProviderTier LevelInternet Egress Cost per GB (USD)Source Notes
AWS (EC2)First 10 TB / Month$0.090
AWS (EC2)Next 40 TB / Month$0.085
Microsoft AzureFirst 10 TB / Month (Zone 1)$0.087
Microsoft Azure10 TB - 50 TB / Month$0.083
Google Cloud (GCP)Premium Tier First 1 TB$0.120
Google Cloud (GCP)10 TB - 50 TB / Month$0.060

If an enterprise office generates merely 5 terabytes of raw multimodal data daily and transmits it to an AWS-hosted inference pipeline, the return trip of processed data, augmented video, and localized knowledge graphs will aggressively trigger these egress tiers. At 150 TB of egress per month, an organization will incur over $13,000 in pure transit costs on AWS, exclusive of the actual cost of the GPU compute itself. Moving data across inter-continental boundaries via Microsoft's Premium Global Network scales up to $0.181 per GB depending on the region. [9]

The architectural conclusion is clear. When continuous multimodal ingestion is the baseline operational requirement, the cost-optimal path is to localize the inference engine. By deploying sovereign compute nodes on-premises, the data never traverses a public network boundary. The cloud egress cost is reduced to exactly zero. This is not a position against centralized infrastructure — it is a recognition that different workload classes have different optimal architectures, and that ambient multimodal AI inference belongs at the edge.

Normative

Requirements formalizing this section

The narrative above is non-normative. The clauses below state the same architecture as testable requirements, and a conformance claim is evaluated against them rather than against the prose.

  • ANM-3.1MUST NOT · Class A, B

    A conforming deployment MUST NOT transmit inference payloads — prompts, retrieved context, intermediate representations, embeddings, or generated outputs — across its demarcation boundary during normal operation.

  • ANM-3.2MUST · Class A, B

    The absence of an egress path for inference payloads MUST be a structural property of a conforming deployment rather than a policy, feature flag, or configuration setting that a privileged operator could reverse.

  • ANM-3.3MUST NOT · Class A, B

    A conforming deployment MUST NOT send tenant-derived telemetry, usage analytics, error payloads, or diagnostic samples to any party outside its demarcation boundary.

  • ANM-3.4MAY · Class A, B

    A conforming deployment MAY transmit aggregate operational counters that contain no tenant-derived content, provided each such counter is enumerated under ANM-2.2 and disclosed to the tenant.

  • ANM-3.5MUST · Class A, B

    Model weights, container images, and software updates entering a conforming deployment MUST be verified against a cryptographic signature before installation, and the verification MUST be performed inside the demarcation boundary.

  • ANM-3.6SHOULD NOT · Class A, B

    A conforming deployment SHOULD NOT depend on an external service for any function on the critical path of inference, including authentication, license validation, model retrieval, or rate authorization.

  • ANM-3.7MUST · Class A, B

    A conforming deployment MUST implement the administrative, physical, and technical safeguards required by 45 CFR §§ 164.308 and 164.312 within the demarcation boundary, and MUST NOT rely on the absence of an egress path as a substitute for them. At minimum this includes unique user identification with role-based access control, encryption of Protected Health Information at rest, mutually authenticated encryption in transit across intra-enclave hops, append-only audit logging, integrity verification of stored artifacts and model weights, a hardware root of trust with measured boot, and a documented risk analysis naming the enclave in scope.

  • ANM-3.8MUST NOT · Class A, B, C

    An implementation MUST NOT represent zero-egress architecture, on-premises siting, or tenant hardware ownership as establishing HIPAA compliance, and MUST NOT describe compliance as an architectural property of the real estate.

  • ANM-3.9MUST · Class A, B

    An implementation claiming reduced Business Associate Agreement exposure MUST scope that claim to the elimination of third-party hyperscaler data processors and their subprocessor chains, and MUST maintain Business Associate Agreements with every party that creates, receives, maintains, or transmits Protected Health Information on the covered entity's behalf, including managed-service providers, integrators holding privileged access, local software vendors with support access, and property personnel whose maintenance role reaches systems processing Protected Health Information.

  • ANM-3.10MUST · Class A, B

    A conforming deployment MUST distinguish minimization of raw ambient capture from retention of generated artifacts, and MUST treat clinical documentation, finalized reports, triage outputs, structured observations, and audit records as persistent Protected Health Information subject to ANM-3.7, the tenant's retention schedule, and applicable breach-notification obligations. An implementation MUST NOT claim that no persistent Protected Health Information exists.

All 79requirements & conformance classes →