Agentic AI: AMD EPYC™ 9005 CPUs Wins Today, EPYC 9006, formerly code-named "Venice", Takes It to a New Level
AMD ·
9xx6-043: Retrieve Context and Similarity Search tier comparison based on AMD internal testing as of 07/11/2026. FAISS IVF4096,PQ128x4fs index, sift1m dataset, k=10, aggregate QPS across pinned instances. Configurations Intel Xeon 6980P (128C/256T, 1P), SMT ON, 64GB DDR5-6400 RDIMM, SNC3, SuperMicro SYS-222HA-TN, BIOS v1.5, Ubuntu 24.04.4 LTS kernel 6.17.0-29-generic, performance governor. AWS Graviton5 (192C/192T, 1P), DDR5-8800, AWS m9gd.metal-48xl, Ubuntu 24.04.4 LTS kernel 6.17.0-29-generic, performance governor. Since cloud, all default BIOS and system config. AMD EPYC 9755 (128C/256T, 1P), SMT ON, 64GB DDR5-6400 RDIMM, AMD reference platform, BIOS RVOT1006C, Ubuntu 24.04.4 LTS kernel 6.17.0-29-generic, performance governor. AMD EPYC 9965 (192C/384T, 1P), SMT ON, 64GB DDR5-6400 RDIMM, AMD reference platform, BIOS RVOT1006C, Ubuntu 24.04.4 LTS kernel 6.17.0-29-generic, performance governor. AMD EPYC 9996 (256C/512T, 1P), SMT ON, 64GB DDR5-8000 RDIMM, AMD reference platform, BKC10.3 90RC4, Default CPU Power 600W cppc on power determinism, SMT ON, Ubuntu 24.04.4 LTS kernel 6.17.0-29-generic, performance governor. Summary results (aggregate QPS (mean)): Intel Xeon 6980P = 316069; AWS Graviton5 = 119179; AMD EPYC 9755 = 369252; AMD EPYC 9965 = 472079; AMD EPYC 9996 = 751453. Results for AWS Graviton5 were obtained from a publicly available cloud instance. Results compare AMD internal testing of the listed AMD and Intel systems against testing performed on the listed AWS EC2 Graviton5 bare-metal instance. Cloud instance results may be affected by cloud service configuration, instance availability, regional deployment, hypervisor/Nitro behavior, storage/network configuration, and other cloud provider variables. Starting with the 6th Gen AMD EPYC™ server processor family, AMD uses Default CPU Power to describe processor power consumption, succeeding AMD's historical TDP reference. Default CPU Power reflects total power consumed across the processor's compute and I/O dies for the stated performance target. Default CPU Power and TDP may both serve as processor power references for product comparison, platform planning, and performance-per-watt analysis. Results may not be directly comparable to physical server configurations due to differences in platform implementation, firmware, operating environment, memory configuration, and system tuning. 9xx6-044: Enterprise Tools tier comparison based on AMD internal testing as of 07/11/2026. TPC-H and TPC-C derivatives on MySQL, Redis benchmark, MongoDB-YCSB in 32-vCPU VMs; per-VM geometric mean of 5x subsets. Results are based on TPC-H and TPC-C derived workloads and are not comparable to published TPC benchmark results. System Configuration: Intel Xeon 6980P (128C/256T, 1P), SMT ON, 64GB DDR5-6400 RDIMM, SNC3, SuperMicro SYS-222HA-TN, BIOS v1.5, Ubuntu 24.04.4 LTS kernel 6.17.0-29-generic, performance governor. AWS Graviton5 (192C/192T, 1P), DDR5-8800, AWS m9gd.metal-48xl, Ubuntu 24.04.4 LTS kernel 6.17.0-29-generic, performance governor. Since cloud, all default BIOS and system config. AMD EPYC 9755 (128C/256T, 1P), SMT ON, 64GB DDR5-6400 RDIMM, AMD reference platform, BIOS RVOT1006C, Ubuntu 24.04.4 LTS kernel 6.17.0-29-generic, performance governor. AMD EPYC 9965 (192C/384T, 1P), SMT ON, 64GB DDR5-6400 RDIMM, AMD reference platform, BIOS RVOT1006C, Ubuntu 24.04.4 LTS kernel 6.17.0-29-generic, performance governor. AMD EPYC 9996 (256C/512T, 1P), SMT ON, 64GB DDR5-8000 RDIMM, AMD reference platform, BKC10.3 90RC4, Default[BP1.1][ZP1.2] CPU Power=600w cppc on power determinism, SMT ON, Ubuntu 24.04.4 LTS kernel 6.17.0-29-generic, performance governor. Summary results (geomean throughput): Intel Xeon 6980P = 2284701; AWS Graviton5 = 2982203; AMD EPYC 9755 = 2546290; AMD EPYC 9965 = 3867149; AMD EPYC 9996 = 6054748. Results for AWS Graviton5 were obtained from a publicly available cloud instance. Results compare AMD internal testing of the listed AMD and Intel systems against testing performed on the listed AWS EC2 Graviton5 bare-metal instance. Cloud instance results may be affected by cloud service configuration, instance availability, regional deployment, hypervisor/Nitro behavior, storage/network configuration, and other cloud provider variables. Starting with the 6th Gen AMD EPYC™ server processor family, AMD uses Default CPU Power to describe processor power consumption, succeeding AMD's historical TDP reference. Default CPU Power reflects total power consumed across the processor's compute and I/O dies for the stated performance target. Default CPU Power and TDP may both serve as processor power references for product comparison, platform planning, and performance-per-watt analysis. Results may not be directly comparable to physical server configurations due to differences in platform implementation, firmware, operating environment, memory configuration, and system tuning. 9xx6-045: Ephemeral Tools tier comparison based on AMD internal testing as of 07/11/2026. Multi-persona literal replay (Development, Context Compaction, Security, Media, RAG Ingestion); raw geometric mean of five per-persona throughput rates. System configurations: Intel Xeon 6980P (128C/256T, 1P), SMT ON, 64GB DDR5-6400 RDIMM, SNC3, SuperMicro SYS-222HA-TN, BIOS v1.5, Ubuntu 24.04.4 LTS kernel 6.17.0-29-generic, performance governor. AWS Graviton5 (192C/192T, 1P), DDR5-8800, AWS m9gd.metal-48xl, Ubuntu 24.04.4 LTS kernel 6.17.0-29-generic, performance governor. Since cloud, all default BIOS and system config. AMD EPYC 9755 (128C/256T, 1P), SMT ON, 64GB DDR5-6400 RDIMM, AMD reference platform, BIOS RVOT1006C, Ubuntu 24.04.4 LTS kernel 6.17.0-29-generic, performance governor. AMD EPYC 9965 (192C/384T, 1P), SMT ON, 64GB DDR5-6400 RDIMM, AMD reference platform, BIOS RVOT1006C, Ubuntu 24.04.4 LTS kernel 6.17.0-29-generic, performance governor. AMD EPYC 9996 (256C/512T, 1P), SMT ON, 64GB DDR5-8000 RDIMM, AMD reference platform, BKC10.3 90RC4, Default CPU Power 600W cppc on power determinism, SMT ON, Ubuntu 24.04.4 LTS kernel 6.17.0-29-generic, performance governor. Summary results (geomean throughput): Intel Xeon 6980P = 1.779; AWS Graviton5 = 2.505; AMD EPYC 9755 = 2.317; AMD EPYC 9965 = 2.970; AMD EPYC 9996 = 4.451. Results for AWS Graviton5 were obtained from a publicly available cloud instance. Results compare AMD internal testing of the listed AMD and Intel systems against testing performed on the listed AWS EC2 Graviton5 bare-metal instance. Cloud instance results may be affected by cloud service configuration, instance availability, regional deployment, hypervisor/Nitro behavior, storage/network configuration, and other cloud provider variables. Starting with the 6th Gen AMD EPYC™ server processor family, AMD uses Default CPU Power to describe processor power consumption, succeeding AMD's historical TDP reference. Default CPU Power reflects total power consumed across the processor's compute and I/O dies for the stated performance target. Default CPU Power and TDP may both serve as processor power references for product comparison, platform planning, and performance-per-watt analysis. Results may not be directly comparable to physical server configurations due to differences in platform implementation, firmware, operating environment, memory configuration, and system tuning. 9xx6-046: Gateway and Stream Response tier comparison based on AMD internal testing as of 07/11/2026. NGINX 1.24.0 with the WRK 4.2.0 load generator, aggregate max requests/sec across pinned instances. System configurations: Intel Xeon 6980P (128C/256T, 1P), SMT ON, 64GB DDR5-6400 RDIMM, SNC3, SuperMicro SYS-222HA-TN, BIOS v1.5, Ubuntu 24.04.4 LTS kernel 6.17.0-29-generic, performance governor. AWS Graviton5 (192C/192T, 1P), DDR5-8800, AWS m9gd.metal-48xl, Ubuntu 24.04.4 LTS kernel 6.17.0-29-generic, performance governor. Since cloud, all default BIOS and system config. AMD EPYC 9755 (128C/256T, 1P), SMT ON, 64GB DDR5-6400 RDIMM, AMD reference platform, BIOS RVOT1006C, Ubuntu 24.04.4 LTS kernel 6.17.0-29-generic, performance governor. AMD EPYC 9965 (192C/384T, 1P), SMT ON, 64GB DDR5-6400 RDIMM, AMD reference platform, BIOS RVOT1006C, Ubuntu 24.04.4 LTS kernel 6.17.0-29-generic, performance governor. AMD EPYC 9996 (256C/512T, 1P), SMT ON, 64GB DDR5-8000 RDIMM, AMD reference platform, BKC10.3 90RC4, Default CPU Power 600W cppc on power determinism, SMT ON, Ubuntu 24.04.4 LTS kernel 6.17.0-29-generic, performance governor. Summary results (max requests/sec): Intel Xeon 6980P = 10162179; AWS Graviton5 = 15331108; AMD EPYC 9755 = 17906196; AMD EPYC 9965 = 24320476; AMD EPYC 9996 = 28789170. Results for AWS Graviton5 were obtained from a publicly available cloud instance. Results compare AMD internal testing of the listed AMD and Intel systems against testing performed on the listed AWS EC2 Graviton5 bare-metal instance. Cloud instance results may be affected by cloud service configuration, instance availability, regional deployment, hypervisor/Nitro behavior, storage/network configuration, and other cloud provider variables. Starting with the 6th Gen AMD EPYC™ server processor family, AMD uses Default CPU Power to describe processor power consumption, succeeding AMD's historical TDP reference. Default CPU Power reflects total power consumed across the processor's compute and I/O dies for the stated performance target. Default CPU Power and TDP may both serve as processor power references for product comparison, platform planning, and performance-per-watt analysis. Results may not be directly comparable to physical server configurations due to differences in platform implementation, firmware, operating environment, memory configuration, and system tuning. 9xx6-048: Geometric mean across the five CPU-centric Agentic AI pipeline tiers (Gateway and Stream Response; Assemble Context, Plan and Route, and Verification; Retrieve Context and Similarity Search; Enterprise Tools; Ephemeral Tools) based on AMD internal testing as of 07/11/2026. Intel Xeon 6980P (128C/256T, 1P), SMT ON, 64GB DDR5-6400 RDIMM, SNC3, SuperMicro SYS-222HA-TN, Ubuntu 24.04.4 LTS kernel 6.17.0-29-generic, performance governor. AWS Graviton5 (192C/192T, 1P), DDR5-8800, AWS m9gd.metal-48xl, Ubuntu 24.04.4 LTS kernel 6.17.0-29-generic, performance governor. AMD EPYC 9755 (128C/256T, 1P), SMT ON, 64GB DDR5-6400 RDIMM, AMD reference platform, Ubuntu 24.04.4 LTS kernel 6.17.0-29-generic, performance governor. AMD EPYC 9965 (192C/384T, 1P), SMT ON, 64GB DDR5-6400 RDIMM, AMD reference platform, Ubuntu 24.04.4 LTS kernel 6.17.0-29-generic, performance governor. AMD EPYC 9996 (256C/512T, 1P), SMT ON, 64GB DDR5-8000 RDIMM, AMD reference platform, Ubuntu 24.04.4 LTS kernel 6.17.0-29-generic, performance governor. Per-tier ratios vs Intel Xeon 6980P = 1.00: Gateway and Stream Response (AMD EPYC 9755 = 1.76x, AMD EPYC 9965 = 2.39x, AMD EPYC 9996 = 2.83x, AWS Graviton5 = 1.51x); Assemble Context, Plan and Route, and Verification (AMD EPYC 9755 = 1.54x, AMD EPYC 9965 = 2.01x, AMD EPYC 9996 = 3.45x, AWS Graviton5 = 1.41x); Retrieve Context and Similarity Search (AMD EPYC 9755 = 1.17x, AMD EPYC 9965 = 1.49x, AMD EPYC 9996 = 2.38x, AWS Graviton5 = 0.38x); Enterprise Tools (AMD EPYC 9755 = 1.11x, AMD EPYC 9965 = 1.69x, AMD EPYC 9996 = 2.65x, AWS Graviton5 = 1.31x); Ephemeral Tools (AMD EPYC 9755 = 1.30x, AMD EPYC 9965 = 1.67x, AMD EPYC 9996 = 2.50x, AWS Graviton5 = 1.41x). Consolidated geometric mean normalized to Intel Xeon 6980P = 1.00: AMD EPYC 9755 = 1.36x, AMD EPYC 9965 = 1.82x, AMD EPYC 9996 = 2.74x, AWS Graviton5 = 1.08x. See 9xx6-042, 9xx6-043, 9xx6-044, 9xx6-045, 9xx6-046 for more info. Results compare AMD internal testing of the listed AMD and Intel systems against testing performed on the listed AWS EC2 Graviton5 bare-metal instance. Cloud instance results may be affected by cloud service configuration, instance availability, regional deployment, hypervisor/Nitro behavior, storage/network configuration, and other cloud provider variables. Results may vary due to factors including system configurations, software versions and BIOS settings. Corp VP, Datacenter Ecosystems and Application Engineering, Server BU Related Blogs View All Blogs AMD Launches Helios™: The Highest Performing Rackscale AI Infrastructure Solution AMD Launches Helios™: The Highest Performing Rackscale AI Infrastructure Solution AMD launches Helios, an open rack-scale AI platform connecting 72 AMD Instinct™ MI455X GPUs for frontier AI inference and training Agentic AI Workflows Simplified Agentic AI Workflows Simplified Rocm.ai simplifies how developers build and serve with ROCm on AMD GPU’s July 23, 2026 AI Networking Built for Scale AI Networking Built for Scale AMD AI networking unifies front-end, scale-up, and scale-out infrastructure to accelerate training, inference, and agentic AI. July 23, 2026 AMD Helios™: Resilient Scale-Up Networking for AI AMD Helios™: Resilient Scale-Up Networking for AI Discover how AMD Helios™ delivers resilient scale-up networking for production AI with UALoE, AFM, AFOS, and vPods. July 23, 2026 AMD Pensando™ Vulcano 800 AI NIC: Built to Scale-Out and Across AMD Pensando™ Vulcano 800 AI NIC: Built to Scale-Out and Across How AMD Pensando™ Vulcano 800 AI NIC addresses scale-out and scale-across connectivity demands for modern AI training and inference deployments. July 23, 2026 AMD AI NIC™ Technology and the Future of AI Networking AMD AI NIC™ Technology and the Future of AI Networking Learn five key AI networking lessons from IDC and discover how AMD AI NIC™ technology supports scalable, open AI infrastructure. July 23, 2026 The Agentic Era Runs on a CPU Foundation — and It's Called AMD EPYC™ 9006 Series Server CPUs The Agentic Era Runs on a CPU Foundation — and It's Called AMD EPYC™ 9006 Series Server CPUs Agentic AI needs more than GPUs and AMD EPYC™ 9006 Server CPUs power planning, orchestration, and enterprise workloads at scale efficiently. July 23, 2026 Advancing Agentic Workflows With AMD EPYC™ 9006 Series Server CPUs Advancing Agentic Workflows With AMD EPYC™ 9006 Series Server CPUs AMD EPYC™ 9006 Server CPUs power agentic AI with purpose-built CPUs for agent sandboxes, AI host nodes, and enterprise workloads at scale. July 23, 2026
DYAX Investor Sentiment
Bullish (Long) 41% · Bearish (Short) 59%
508 participants
Related News
- The hidden victims of drug abuse: The ripple effect on families and friends
- Crypto industry to contribute $55B to US economy in 2026: NCA study
- Robinhood CEO Vlad Tenev's X Account Hacked to Shill Fake 'Vladhood' Token
- Trump's Crypto Corruption Puts Centrist Democrats in Bind
- Bitcoin May Have Already Bottomed—If the Fed Helps, Says Grayscale
- CoinRabbit and GoMining Report: Managing Bitcoin Matters More Than Mining Volume
