CloudTech is part of the TechForge Publications seriesView AllAI NewsDeveloperIoT NewsMarketing TechTechHQTech Wire AsiaTelecomsView AllAI NewsDeveloperIoT NewsMarketing TechTechHQTech Wire AsiaTelecomsTechForge SearchCategoriesCloud in ActionCloud MigrationCloud ROI & CostInternal Change ManagementMissteps & LessonsSME & Startup CloudEditorial DeskAnnouncements & AnalysisForecasts & TrendsMigrations: Behind the ScenesTechEx EventsFeaturesInterviewsPodcastsSponsored ContentVideosWebinarsFuture of CloudAI & CloudCloud EthicsEdge & Distributed CloudOpen CloudQuantum & CloudServerless ArchitectureSustainable CloudIndustry PerspectivesEducation & ResearchFinanceHealthcare & Life SciencesLegal & HRMedia, Gaming & CreativePublic SectorRetail & ConsumerMarket IntelligenceCloud StartupsEarnings & Market ShareEvent CoverageMergers & AcquisitionsVendor Roadmaps & LeadershipSecurity, Privacy & TrustCloud CybersecurityCyber Security & Cloud ExpoEncryption & Data PrivacyGovernance, Risk & ComplianceIdentity & AccessStrategy & Decision-MakingChoosing a Cloud StrategyFinOps & BudgetsLock-In & ExitMulti- & Hybrid CloudProcurement & ContractsSkills & HiringTechnology StackBig VendorsContainers & KubernetesDatabases & Data PlatformsInfrastructure as CodeObservability & MonitoringXaaS ModelsEventsResourcesVideo InterviewsPodcastsAll ResourcesMoreEditorial OpportunitiesAbout UsContact Us SearchCategoriesCloud in ActionCloud MigrationCloud ROI & CostInternal Change ManagementMissteps & LessonsSME & Startup CloudEditorial DeskAnnouncements & AnalysisForecasts & TrendsMigrations: Behind the ScenesTechEx EventsFeaturesInterviewsPodcastsSponsored ContentVideosWebinarsFuture of CloudAI & CloudCloud EthicsEdge & Distributed CloudOpen CloudQuantum & CloudServerless ArchitectureSustainable CloudIndustry PerspectivesEducation & ResearchFinanceHealthcare & Life SciencesLegal & HRMedia, Gaming & CreativePublic SectorRetail & ConsumerMarket IntelligenceCloud StartupsEarnings & Market ShareEvent CoverageMergers & AcquisitionsVendor Roadmaps & LeadershipSecurity, Privacy & TrustCloud CybersecurityCyber Security & Cloud ExpoEncryption & Data PrivacyGovernance, Risk & ComplianceIdentity & AccessStrategy & Decision-MakingChoosing a Cloud StrategyFinOps & BudgetsLock-In & ExitMulti- & Hybrid CloudProcurement & ContractsSkills & HiringTechnology StackBig VendorsContainers & KubernetesDatabases & Data PlatformsInfrastructure as CodeObservability & MonitoringXaaS ModelsEventsResourcesVideo InterviewsPodcastsAll ResourcesMoreEditorial OpportunitiesAbout UsContact Us Subscribe Subscribe SearchCategoriesCloud in ActionCloud MigrationCloud ROI & CostInternal Change ManagementMissteps & LessonsSME & Startup CloudEditorial DeskAnnouncements & AnalysisForecasts & TrendsMigrations: Behind the ScenesTechEx EventsFeaturesInterviewsPodcastsSponsored ContentVideosWebinarsFuture of CloudAI & CloudCloud EthicsEdge & Distributed CloudOpen CloudQuantum & CloudServerless ArchitectureSustainable CloudIndustry PerspectivesEducation & ResearchFinanceHealthcare & Life SciencesLegal & HRMedia, Gaming & CreativePublic SectorRetail & ConsumerMarket IntelligenceCloud StartupsEarnings & Market ShareEvent CoverageMergers & AcquisitionsVendor Roadmaps & LeadershipSecurity, Privacy & TrustCloud CybersecurityCyber Security & Cloud ExpoEncryption & Data PrivacyGovernance, Risk & ComplianceIdentity & AccessStrategy & Decision-MakingChoosing a Cloud StrategyFinOps & BudgetsLock-In & ExitMulti- & Hybrid CloudProcurement & ContractsSkills & HiringTechnology StackBig VendorsContainers & KubernetesDatabases & Data PlatformsInfrastructure as CodeObservability & MonitoringXaaS ModelsEventsResourcesVideo InterviewsPodcastsAll ResourcesMoreEditorial OpportunitiesAbout UsContact Us Hamburger Toggle Menu AI & Cloud, Announcements & Analysis, Big Vendors, Cloud Computing, Cloud in Action, Features, Procurement & ContractsIBM Cloud and Together AI expand AI infrastructure with NVIDIAMuhammad Zulhusni13th August 2026 Share this story: Tags:AIai infrastructurecloudIBMinferenceNVIDIACategories::AI & CloudAnnouncements & AnalysisBig VendorsCloud ComputingCloud in ActionFeaturesProcurement & ContractsIBM is preparing to deploy a large NVIDIA-based AI computing cluster on IBM Cloud under a multiyear agreement with Together AI worth $240 million.The cluster is expected to become available in the first quarter of 2027 and will use NVIDIA HGX B300 systems connected through NVIDIA Spectrum-X Ethernet networking.Together AI plans to use the infrastructure to run inference workloads for open-source AI models.The initial deployment will include about 2,000 NVIDIA Blackwell 300 GPUs and will be located in the US, Together AI chief revenue officer Kai Mak told .Mak said Together AI expects the capacity to be fully committed two to three months before it becomes available.The deployment will be IBM Cloud’s first dedicated large-scale inference cluster built around HGX B300 systems.
According to NVIDIA, the HGX B300 and Spectrum-X configuration is built to deliver 30 times more AI factory output than previous generations.The cluster is being built primarily for inference, where trained models process requests and generate outputs.Reuters reported that inference has become one of the largest drivers of demand for computing capacity, prompting cloud providers and chipmakers to expand AI infrastructure.Together AI provides infrastructure and software for AI inference, training, fine-tuning, and agent-based workloads.The company recently raised $800 million in a Series C funding round that valued it at $8.3 billion.Together AI is also securing computing resources outside the IBM agreement.
Alongside the funding round, the company said it had secured commitments for more than 500 MW of compute capacity, which will be financed independently by new investors to support its expected infrastructure requirements.Together AI says its inference service currently processes more than 400 trillion tokens each month.The company said in July that monthly token volume across its APIs had increased from 30 billion to more than 400 trillion in nine months.The company has also introduced a different way for customers to reserve inference capacity.Together AI launched a Provisioned Throughput service in July that allows customers to reserve a defined rate of model processing measured in tokens per minute, rather than managing the underlying GPU capacity themselves.Customers purchase Provisioned Throughput Units, or PTUs, with each unit representing a fixed slice of guaranteed throughput for a selected model or model family.
Together AI manages the supporting infrastructure, while customers receive reserved token-processing capacity through the same API used for its other inference services.The IBM agreement adds another dedicated pool of computing resources to that infrastructure.Together AI selected IBM and NVIDIA based partly on the available GPU capacity and their respective infrastructure roadmaps.“Enterprises want the performance of the best frontier models without the closed-model price tag, and that only works if the infrastructure underneath is fast and reliable at scale,” Together AI CEO Vipul Ved Prakash said.“Working alongside IBM with NVIDIA gives us that foundation.
This cluster lets us bring production-grade inference to more companies, faster, and it’s a big step in our push to make open-source AI the obvious choice for enterprises.”Together AI’s platform supports open models including DeepSeek, MiniMax, and Kimi.Reuters reported that businesses using open models have been weighing both AI costs and cybersecurity concerns associated with proprietary model services.The deployment brings together different parts of the AI infrastructure stack.IBM will provide the cloud environment and deploy the cluster, NVIDIA will supply the HGX B300 computing systems and Spectrum-X networking, and Together AI will use that capacity to operate inference services for open models.“Enterprises are in a race to adopt agentic AI at scale to drive real business outcomes,” IBM Cloud general manager Alan Peacock said.
“IBM and NVIDIA are delivering scalable, economical, enterprise-grade AI infrastructure that can help Together AI accelerate innovation for the next generation of AI infrastructure.”IBM expands its NVIDIA infrastructure partnershipThe agreement extends IBM’s existing work with NVIDIA rather than establishing a new infrastructure relationship between the companies.IBM expanded that collaboration in March 2026, when it announced plans to make NVIDIA Blackwell Ultra GPUs available through IBM Cloud.IBM said the infrastructure would support workloads including large-scale model training, high-throughput inference, and AI reasoning.The two companies are also working across other parts of IBM’s infrastructure portfolio.NVIDIA selected IBM Storage Scale System 6000 to provide 10 PB of high-performance storage for its GPU-based analytics systems, while IBM Storage Scale 6000 has been certified and validated for NVIDIA DGX platforms.IBM and NVIDIA have also been exploring the integration of IBM Sovereign Core with NVIDIA infrastructure and Nemotron models for GPU-intensive AI workloads that need to operate within regional boundaries because of data residency or regulatory requirements.
Their wider work also covers Red Hat AI infrastructure and enterprise consulting.The Together AI deployment adds another workload to that existing relationship, this time centred on dedicated inference capacity running on IBM Cloud.IBM is not the only cloud provider combining internally developed infrastructure with NVIDIA technology.AWS agreed this year to buy one million NVIDIA GPUs by the end of 2027 and plans to deploy NVIDIA ConnectX and Spectrum-X networking equipment in its data centres while continuing to develop its own processors and networking hardware.AI capacity is contracted ahead of deploymentTogether AI expects the IBM cluster to be committed before it enters service.Other AI infrastructure providers are also reporting large commitments for capacity that is still being deployed.CoreWeave reported a $104.2 billion revenue backlog for the second quarter, up from $99.4 billion in the first quarter.
The company also said it had secured more than $25 billion in net new customer commitments so far in the current quarter.Nebius separately reported more than $40 billion in customer commitments and four AI cloud agreements averaging more than $1 billion each.The figures are not directly comparable with Together AI’s $240 million IBM contract because the companies use different commercial models, but they provide additional examples of computing capacity being sold or committed ahead of full deployment.Nebius also said it expects more than $9 billion in customer prepayments during 2026 and has raised its contracted power target for the year to 5 GW.It plans to deploy more than 1 GW of capacity annually beginning in 2027.Together AI’s agreement differs from those contracts in its focus on dedicated inference capacity.The company will use the NVIDIA systems deployed on IBM Cloud to provide open-model inference to customers when the cluster becomes available in 2027.“AI factories are becoming essential enterprise infrastructure—like electricity and telecommunications—turning compute and data into intelligence,” NVIDIA senior director Dion Harris said.
“With NVIDIA HGX B300 systems and NVIDIA Spectrum-X Ethernet networking on IBM Cloud, IBM and Together AI will deliver an accelerated computing platform to help enterprises deploy open-source AI with the performance, efficiency and scale required for real-time AI services.”See also: IBM moves to buy Confluent in an $11 billion cloud and AI dealWant to learn more about Cloud Computing from industry leaders? Check out Cyber Security & Cloud Expo taking place in Amsterdam, California, and London.The comprehensive event is part of TechEx and is co-located with other leading technology events, click here for more information.Cloud Computing News is powered by TechForge Media.Explore other upcoming enterprise technology events and webinars here.About the Author Muhammad ZulhusniJournalist As a tech journalist, Zul focuses on topics including cloud computing, cybersecurity, and disruptive technology in the enterprise industry.
He has expertise in moderating webinars and presenting content on video, in addition to having a background in networking technology.Related Oracle brings Quantinuum quantum computing to OCI12th August 2026 What Happens When a Code-Signing Key Is Stolen?11th August 2026 Microsoft opens fourth cloud region in India10th August 2026 Azure Just Crossed $100 Billion, and Enterprise IT Teams Are Feeling the Strain10th August 2026 Oracle brings Quantinuum quantum computing to OCI12th August 2026 What Happens When a Code-Signing Key Is Stolen?11th August 2026 Microsoft opens fourth cloud region in India10th August 2026 Azure Just Crossed $100 Billion, and Enterprise IT Teams Are Feeling the Strain10th August 2026 Join our CommunitySubscribe now to get all our premium content and latest tech news delivered straight to your inbox Click here Popular XaaS ModelsSoftLayer beefs up its bare metal offering, available on hourly basis 25470 view(s)Cloud ROI & Cost, Interviews, Sponsored Content, Sustainable CloudRipple effect: Xylem’s sustainable water solutions for Europe’s data centres 20635 view(s)Cloud Computing, XaaS ModelsConcern over cloud storage security remains says Spiceworks – but good news for OneDrive 12679 view(s)Big Vendors, Cloud Computing, Cloud Cybersecurity, Market Intelligence, Security, Privacy & Trust10 real-life cloud security failures and what we can learn from them 6934 view(s)XaaS ModelsSoftLayer beefs up its bare metal offering, available on hourly basis 25470 view(s)Cloud ROI & Cost, Interviews, Sponsored Content, Sustainable CloudRipple effect: Xylem’s sustainable water solutions for Europe’s data centres 20635 view(s)Cloud Computing, XaaS ModelsConcern over cloud storage security remains says Spiceworks – but good news for OneDrive 12679 view(s)Big Vendors, Cloud Computing, Cloud Cybersecurity, Market Intelligence, Security, Privacy & Trust10 real-life cloud security failures and what we can learn from them 6934 view(s) See all Latest View All Latest Cloud Computing10th August 2026Microsoft opens fourth cloud region in India Sponsored Content10th August 2026Azure Just Crossed $100 Billion, and Enterprise IT Teams Are Feeling the Strain AI & Cloud5th August 2026Volta lands $10B AI cloud deal as GPU clouds expand Cloud Computing10th August 2026Microsoft opens fourth cloud region in India Sponsored Content10th August 2026Azure Just Crossed $100 Billion, and Enterprise IT Teams Are Feeling the Strain AI & Cloud5th August 2026Volta lands $10B AI cloud deal as GPU clouds expand SubscribeAll our premium content and latest tech news delivered straight to your inbox Subscribe ExploreAbout UsContact UsNewsletterPrivacy PolicyCookie PolicyAbout UsContact UsNewsletterPrivacy PolicyCookie PolicyReach Our AudienceAdvertisePost a Press ReleaseContact UsAdvertisePost a Press ReleaseContact UsCategoriesCloud in ActionEditorial DeskFeaturesFuture of CloudIndustry PerspectivesMarket IntelligenceSecurity, Privacy & TrustTechnology StackStrategy & Decision-MakingAll CategoriesCloud in ActionEditorial DeskFeaturesFuture of CloudIndustry PerspectivesMarket IntelligenceSecurity, Privacy & TrustTechnology StackStrategy & Decision-MakingAll CategoriesOther PublicationsExplore AllAI NewsDeveloperIoT NewsMarketing TechTechHQTech Wire AsiaTelecomsExplore AllAI NewsDeveloperIoT NewsMarketing TechTechHQTech Wire AsiaTelecomsCloudTech News is part of TechForge SubscribeAll our premium content and latest tech news delivered straight to your inbox
Read More
