Close Menu
Techy101 –

    Subscribe to Updates

    Get the latest creative news from FooBar about art, design and business.

    What's Hot

    Genesis AI Raises $500M Series A to Accelerate Robot Deployment – Unite.AI

    November 17, 2026

    Quorum Cyber Closes Ontinue Acquisition to Expand Agentic AI Defense – Unite.AI

    November 17, 2026

    Q&A: Why building math muscles remains important in the AI era | MIT News

    November 17, 2026
    Facebook X (Twitter) Instagram
    Trending
    • Genesis AI Raises $500M Series A to Accelerate Robot Deployment – Unite.AI
    • Quorum Cyber Closes Ontinue Acquisition to Expand Agentic AI Defense – Unite.AI
    • Q&A: Why building math muscles remains important in the AI era | MIT News
    • MiTAC Proposes Two-Server AI Inference Architecture at SC26 – Unite.AI
    • Learning the language of machine learning | MIT News
    • Sabre Announces Grok Bot Travel Connector and Proactive Agentic APIs – Unite.AI
    • Genpact Makes Onyx Available to Build and Govern Enterprise AI Agents – Unite.AI
    • The Inference Economics Scorecard Challenges GPU Utilization as an AI Performance Metric – Unite.AI
    Facebook X (Twitter) Instagram Pinterest YouTube LinkedIn TikTok
    Techy101 –Techy101 –
    • Home
    • Laptops
    • Mobiles
    • Gaming
    • Gadgets
    • Apps
    • AI
    • How To
    • Reviews
    Techy101 –
    Home»AI»MiTAC Proposes Two-Server AI Inference Architecture at SC26 – Unite.AI
    AI

    MiTAC Proposes Two-Server AI Inference Architecture at SC26 – Unite.AI

    By RepublisherNovember 17, 2026No Comments3 Mins Read
    Share Facebook Twitter Pinterest LinkedIn Tumblr Reddit Telegram Email
    MiTAC Proposes Two-Server AI Inference Architecture at SC26 – Unite.AI
    Share
    Facebook Twitter LinkedIn Pinterest Email



    MiTAC Computing unveiled a two-server AI inference architecture with Skymizer at SC26 in a November 17, 2026 announcement, proposing 2 TB of decode-side accelerator memory for a system designed to run models such as the 2.8-trillion-parameter Kimi K3 on premises.

    The architecture is part of a wider portfolio spanning software orchestration, high-density liquid cooling, storage and an upcoming AMD rack. Some supporting systems are being demonstrated live at SC26, while others remain proposed or in development, making the announcement a mix of current demonstrations and future infrastructure designs.

    Separate Servers for Prefill and Decode

    The proposed prefill platform is the 8U G8825Z5, using AMD EPYC 9575F or 9755 processors and Instinct MI350X GPUs. It would transfer the resulting key-value cache to the decode server over high-speed networking. For decode, the proposed air-cooled 4U G4520G6 configuration combines Intel Xeon 6 processors with eight Skymizer HTX301-4S accelerator cards, each carrying 256 GB of memory.

    Prefill is the compute-intensive stage, while decode is memory-intensive, so separating them is intended to let enterprises provision each for its own workload. MiTAC says the on-premises decode system is designed for complex, deep-reasoning agentic workloads. The architecture shifts part of the scaling problem from adding GPUs to balancing accelerator memory with the network connection between stages.

    Live Cooling and Data Density at SC26

    MiTAC’s live demonstrations address the physical demands around that inference design. A 52U liquid-cooled rack integrates 12 G4826Z5 servers and 96 AMD Instinct MI355X GPUs, a configuration the company says delivers 50% higher GPU density than conventional deployments.

    A proof of concept with ZutaCore uses waterless two-phase direct liquid cooling on the G4826Z5, vaporizing dielectric fluid directly at the chip. MiTAC reports support for thermal design powers above 4,000W, heat flux above 250W/cm² and an annualized partial power usage effectiveness of 1.03. The demonstration targets the thermal limits created by concentrating high-power accelerators inside dense racks.

    The storage demonstration combines DDN Infinia with seven GC68C-B8056 1U storage servers and is designed to supply continuous AI data streams without I/O bottlenecks. That addresses a different constraint from cooling: reducing the risk that accelerators wait for data instead of processing inference and agent workloads.

    Software and the Upcoming Helion Rack

    Canonical Ubuntu supplies the certified operating-system layer, Rafay adds dynamic GPU-as-a-Service orchestration across distributed workloads, and MiTAC’s MiCoreView software provides pod-level telemetry and unified data-center visibility. Together with Infinia, those components cover operating systems, data delivery, GPU allocation and monitoring within the same infrastructure stack.

    MiTAC is also collaborating with AMD on an upcoming ORv3 44OU Helion Agentic AI Rack. MiTAC says it will scale to 32,768 AMD Zen 6 CPU cores for hyperscale and enterprise environments.

    AMD’s Helion documentation describes an open rack-scale reference design built on Open Compute Project (OCP) standards, with CPU-only hyperscale configurations and enterprise versions that mix CPU and GPU blades. Its air-cooled inference version supports up to 16 Instinct MI350P GPUs, and customers can mix blade types to match different agent workloads. The enterprise configuration is intended to combine agent execution and inference in one rack, unlike Helios, which is built for frontier-scale training and large-scale inference with a unified scale-up GPU domain.

    The practical implication is that deployable on-premises inference depends on the decode memory working in concert with the prefill network, storage throughput, rack cooling and orchestration; MiTAC’s proposal makes those connections part of the capacity calculation alongside the GPUs themselves.



    Source link

    Architecture Inference MiTAC Proposes SC26 TwoServer Unite.AI
    Share. Facebook Twitter Pinterest LinkedIn Tumblr Email
    Previous ArticleLearning the language of machine learning | MIT News
    Next Article Q&A: Why building math muscles remains important in the AI era | MIT News
    Republisher
    • Website

    Related Posts

    AI

    Genesis AI Raises $500M Series A to Accelerate Robot Deployment – Unite.AI

    November 17, 2026
    AI

    Quorum Cyber Closes Ontinue Acquisition to Expand Agentic AI Defense – Unite.AI

    November 17, 2026
    AI

    Q&A: Why building math muscles remains important in the AI era | MIT News

    November 17, 2026
    Add A Comment
    Leave A Reply Cancel Reply

    Top Posts

    Genesis AI Raises $500M Series A to Accelerate Robot Deployment – Unite.AI

    November 17, 2026

    AMD is apparently gearing up to raise GPU prices right after Nvidia’s steep hike

    August 1, 2026

    LanceDB Vector Database Guide: Features anndPython Demo

    August 1, 2026
    Stay In Touch
    • Facebook
    • YouTube
    • TikTok
    • WhatsApp
    • Twitter
    • Instagram
    Latest Reviews

    Subscribe to Updates

    Get the latest tech news from FooBar about tech, design and biz.

    Latest Post

    Genesis AI Raises $500M Series A to Accelerate Robot Deployment – Unite.AI

    November 17, 2026

    AMD is apparently gearing up to raise GPU prices right after Nvidia’s steep hike

    August 1, 2026

    LanceDB Vector Database Guide: Features anndPython Demo

    August 1, 2026
    Recent Posts
    • Genesis AI Raises $500M Series A to Accelerate Robot Deployment – Unite.AI
    • Quorum Cyber Closes Ontinue Acquisition to Expand Agentic AI Defense – Unite.AI
    • Q&A: Why building math muscles remains important in the AI era | MIT News
    • MiTAC Proposes Two-Server AI Inference Architecture at SC26 – Unite.AI
    • Learning the language of machine learning | MIT News

    Subscribe to Updates

    Get the latest creative news from FooBar about art, design and business.

    Facebook X (Twitter) Instagram Pinterest YouTube LinkedIn TikTok
    • About Us
    • Contact Us
    • Privacy Policy
    • Terms & Conditions
    • Disclaimer
    © 2026 techy101. Designed by Pro.

    Type above and press Enter to search. Press Esc to cancel.