Nvidia Advances AI Stack: Expands From Cloud To Colocation

Nvidia | June 23, 2021

Nvidia Advances AI Stack: Expands From Cloud To Colocation
Every organization wants to build a modern platform for its business. When it comes to AI, some organizations want to merge their platform, either from self-developed software or to use open-source software and commodity hardware as possible. Every AI platform buyer has an AI platform vendor. It is known to everyone that while Nvidia provides components to the hyper scaler platform, public clouds, the OEMs, and ODMs, to build an AI platform to promote, it also wants to be a leading AI platform provider.

It has the total capacity to lead the AI industry because it skillfully enhanced the AI frameworks that support its own business. Additionally, it had to build the distributed systems that its in-house researchers and developers utilize to meet the state quality of services. As a result, Nvidia became a system supplier in its own right, and now it is returning to control planes for training and inference frameworks.

Nvidia rolled out more of its software stack just before the Mobile World Congress 2021 and International Supercomputing 2021 events, which will start within a few days from now at the Equinix Analyst Day. At the same time, it announced the AI Launchpad services to expand its AI hardware from the public clouds. The hyper scaler platform controls the hardware designs and co-locates the datacenters that resemble a cloud but requires the customers to buy and install Nvidia DGX servers and host and manage by a third party with cloud-like pricing.

Equinix, the world’s biggest co-lo operator, is the first AI launchpad creator with high-performance pipes into all of the big public clouds and its Metro Edge locations. Undoubtedly, the public cloud, for others, is an expensive platform to perform production workloads over time, regardless of its scalable attribute.

You may think that having all of the primary public clouds structure and installing a GPU-accelerated framework would be adequate for Nvidia to control AI training workloads and get a robust platform to expand the use of GPUs for AI inference. However, to save the cost, enterprises worldwide adopt cloud technology and deploy data centers to protect critical data that offers a lower price, data security, and workload isolation. Enterprises want the cloud experience of reasonable pricing and easily expandable capacity without abandoning all control to a third-party cloud vendor. We all know that 50% of real-time utilization for cloud capacity is more sensible than renting or buying your infrastructure, which involves high investment. 

The process of investing in infrastructure is cumbersome and time-consuming. All the OEMs are trying to implement cloud infrastructure to turn all of their hardware cloudy regarding its consumption. They also wish to turn it into a physical asset that allows customers to control either on-premises or in a co-lo facility. In addition, the co-Los from Equinix connects immensely to the Internet support of the world, the backbones of the hyper-scalers, and the cloud builders (who transfer 70 percent of the world’s Internet traffic). A co-lo is a much better remedy than setting up your infrastructure.

Justin Boitano, the General Manager of Enterprise and Edge Computing at Nvidia, says, “Instead of in our customers saying,‘I have to buy servers. Hence, I will return post two or three months to get started,’ they can get started promptly. They can set up the infrastructure instantly and get the workload going rather than trying to build the infrastructure themselves. That is going to be helpful for the customers to get started on this journey quickly and add value to internal stakeholders before making higher capital investments.”

Companies should practice using the AI platform as soon as possible, and not everyone wants to deploy AI in the public cloud. Nvidia does not want to have the massive public clouds have so much leverage over it, either. Development and production are two completely different aspects; colocations have a much cleaner pricing model than clouds, which absorb customers with their high networking fees even if their compute and storage seems relatively inexpensive.

The pricing for AI Launchpad services intended to be in the “dollars per hour.” The Nvidia software stack is running controls to all these things. Additionally, with a VMware layer inclusion here, most enterprises are already paying for the VMware virtual infrastructure and using the same for computing, storage, and networking facility in the AI Launchpad service they are familiar with on-premises data centers. In the future, we predict that the VMware layer can be removed and replaced with a bare-metal container environment. Nevertheless, it may be an expensive option, and enterprises will pay it because they don’t have the opportunity to build their own AI container platform.

As a part of the AI Launchpad program, both Nvidia and Equinix are making investments in it. Equinix will own the hardware that customers deploy, including Nvidia, Dell, Hewlett Packard Enterprise, and Lenovo, which are OEM partners with Equinix and Nvidia. Thus, the OEMs will follow suit, and some of the ODMs may also take part in the AI launchpad program.

As per Boitano, “Equinix will roll out its AI Launchpad services in the late summer. It is starting in the United States and focusing on regions dominated by large enterprises, who want to start implementing AI in production and roll out globally.

As part of the announcement, Nvidia is rolling out its Base Command software, which is part of its enterprise AI stack. Nvidia could do its data preparation, and machine learning programs run on its supercomputers with this invention. The software costs $90,000 per month to run on Nvidia’s DGX systems. Boitano says that the company is working on getting it certified and available on OEM machines. For edge use cases, Nvidia is declaring the availability of Fleet Command in general, which is revealed at the GTC 2021 event earlier this year. The AI Enterprise is the Nvidia commercial runtime for evolving models and transforming them into inference engines. It orchestrates and manages GPU-accelerated systems at the edge that are running AI workloads. There was no disclosure on the pricing for Fleet Management.


Keyless SSL lets sites use Cloudflare’s SSL service while retaining on-premise custody of their private keys. Companies are able to get all of the benefits of the cloud (DDoS attack mitigation, load balancing, WAN optimization), without having to choose between encrypting web traffic or giving their SSL private keys to a 3rd party cloud provider.

Other News

Hitachi Vantara Tackles Cloud Cost Paradox with New Cloud FinOps Services

Hitachi Vantara | September 24, 2021

Hitachi Vantara, the digital infrastructure, data management and analytics, and digital solutions subsidiary of Hitachi Ltd., introduced Hitachi Cloud FinOps Services. This new offering provides a portfolio of services designed to help organizations optimize cloud economics. The end goal: help organizations save money as they deploy their hybrid, multicloud or distributed cloud services - while still maintaining the proper agility and scale to deliver their business and IT results. The Cloud Cost Paradox Cloud is essential to almost every enterprise in every industry because it accelerates innovation, agility, and growth. However, as companies operating at scale deploy more cloud services, they often find that ungoverned on-demand consumption, and unexpected management and operational costs, are eating up promised cost savings and quickly driving budgets to overrun. Indeed, IDC predicts increased investment in public cloud cost management through 2022 as enterprises seek to cut cloud waste by 50%.1 The challenges from inadequate automation, the lack of visibility across cloud accounts, and duplicate and idle resources from poor application architectural design can add up to thousands or even millions of dollars in wasted expenditures every year. New Cloud FinOps Services for Cloud Cost Optimization and Management Hitachi Cloud FinOps Services addresses the cloud cost paradox by optimizing cloud cost and investments by providing visibility and management across a client's cloud environments, enabling them to: Gain control over cloud spend with real-time visibility, right architectural choice and predictable usage. Get more value from the cloud by balancing cost, speed, and quality. Future-proof the organization with best-in-breed cloud services. Customers, on average receive a 30% saving through our cloud cost optimization services. "Managing cloud costs and investments across multiple cloud environments is complex, and it's easy to overspend on cloud services with limited visibility and predictability on utilization," said Roger Lvin, president, Digital Solutions Business Unit, Hitachi Vantara. "Hitachi Cloud FinOps Services addresses this complexity and lowers the total cost of ownership through mapping spend data, tagging, allocating shared costs equitably, and recommending data-driven cost take-out measures." Hitachi Vantara's service portfolio is built on decades of expertise in cloud, application, data, and infrastructure modernization. The services are delivered through a unique E3 methodology, which is a comprehensive application and data modernization approach that enables clients to envision, evaluate and execute a FinOps-led program to address the complexity of managing cloud environments. With Hitachi Cloud FinOps Services customers receive a turnkey solution that provides the following outcomes: Assess the customer's current cloud cost relative to benchmarks, industry standards and provide a recommendation on where costs can be optimized. Implement changes that will take out costs from cloud platforms and enable the effective use of real-time cloud cost decision support. Cloud experts map spending data to the business, define budgets and forecasts, set tagging strategy and compliance, build AI-enabled cost anomaly detection, budget alerts for cost visibility, cost recovery and predictability. For enterprises that need continuous as-a-Service support for managing cloud costs, Hitachi Vantara offers an always-on, managed service to optimize and govern cloud spend against business objectives. This includes automated enterprise-wide cloud consumption reporting, resource tracking, cost monitoring and continuous cost optimization through right-sizing and usage of correct cloud services. Hitachi Vantara delivers automation and integration for managing cloud cost metrics and supports cloud service lifecycle management through financial analysis and cost management. Deluxe, a Trusted Payments and Business Technology™ company, that supports millions of small businesses, thousands of financial institutions, and hundreds of the world's most valuable brands recently turned to Hitachi Vantara. The company operates at significant scale processing more than $2.8 trillion in annual payment volume. "Hitachi Vantara's services have helped to streamline our journey to becoming a nimble technology company," said Deluxe Chief Information Officer Michael Mathews. "In addition to providing ongoing, yearly cost reductions across cloud environments and other savings, they've helped us right-size our core infrastructure based on actual consumption, increase our budget capacity for new workloads in cloud, and improve the operational and financial transparency into our technology and cloud operating environments." If not managed properly, the cloud cost paradox will cost organizations significantly in wasted expenditures. Hitachi Cloud FinOps Services gives customers the data, insight and expertise to know better, allowing them to do their cloud, their way. About Hitachi Vantara Hitachi Vantara, a wholly-owned subsidiary of Hitachi, Ltd., guides our customers from what's now to what's next by solving their digital challenges. Working alongside each customer, we apply our unmatched industrial and digital capabilities to their data and applications to benefit both business and society. More than 80% of the Fortune 100 trust Hitachi Vantara to help them develop new revenue streams, unlock competitive advantages, lower costs, enhance customer experiences, and deliver social and environmental value.

Read More


Kaltura Selects Oracle as a Strategic Cloud Infrastructure Provider in Push to Expand Video Services

Oracle, Kaltura | September 23, 2021

Oracle announced that Kaltura, the Video Experience Cloud with millions of active users, selected Oracle Cloud Infrastructure (OCI) to support its growth and accelerate its global expansion. To meet fast-growing demand in the enterprise video market, Kaltura will deliver its Video Experience Cloud on OCI to power real-time, live, and on-demand video experiences to customers around the world. In addition, Kaltura and Oracle are extending their strategic OEM partnership to make the full range of Kaltura video capabilities and experiences such as video content management, live streaming, real-time conferencing, interactive video paths, and visual marketing available across Oracle Cloud. Organizations around the world rely on Kaltura's video products and solutions to work smarter, collaborate, learn better, and engage their audiences with the broadest set of video experiences. Driven by a cloud-first approach and a focus on delivering an exceptional SaaS-based customer experience, Kaltura selected OCI for its superior price-performance, high availability, built-in security, and increased automation. Kaltura will develop its complete enterprise video experience on OCI to deliver market leading enterprise video, Cloud TV, education video, virtual events, and media services, including extensible video APIs for developers. With Oracle networking infrastructure, which is fast, predictable, and inexpensive, Kaltura will be able to achieve substantial savings on network egress costs and deliver a low total cost of ownership across all regions. "Video experiences have surged dramatically over the past year, and they have provided organizations with an important platform to engage with customers and employees across the world. We're excited to broaden our partnership with Oracle and provide even more advanced video capabilities to customers both through delivering our video solutions on OCI, and by infusing our video capabilities into Oracle products that customers know and love," said Ron Yekutiel, co-founder, chairman and CEO, Kaltura. "With 30 Cloud regions, OCI is well suited to help us support our global operation. Through the expansion of our partnership with Oracle, we expect to jointly launch new innovative video products to enterprise, education and media customers. Additionally, the cost and performance benefits of OCI will help support our growing scale and velocity needs, as Oracle will help us mobilize a multi-year technical effort to accelerate our adoption of OCI." Oracle has been a Kaltura customer since 2012. In 2019, Oracle and Kaltura announced an OEM partnership, which originally utilized Kaltura's video-on-demand services and is now being extended to leverage all Kaltura media services. With the expansion of the strategic partnership, Cloud customers will be able to manage their on-demand, live, and real-time video content in Oracle's universal content hub, and enrich that content with Kaltura's tools. Customers can easily deliver video across any channel from email and social media to their own website and blogs and obtain detailed engagement analytics related to viewership, drop-offs, interactions, and more. "Video has vastly changed how we work from home, learn, consume entertainment, and engage with one another. We're excited to expand our longstanding and valued partnership with the Kaltura team to help them deliver higher performance, better security, improve operational efficiency and scale even faster on OCI. Oracle's commitment to powering the Kaltura Video Experience Cloud, coupled with a global go-to-market, underscores our mutual commitment to the future of video technology," said Dave Profozich, senior vice president, ISV Ecosystem, Oracle. Additionally, Oracle and Kaltura will jointly market and sell all Kaltura products and solutions in an alliance that will accelerate Kaltura's global expansion and provides real-time access to data at scale. Kaltura is a member of Oracle PartnerNetwork (OPN) and will expand its go-to-market reach with Oracle. Kaltura solutions will be available in the Oracle Cloud Marketplace, where customers can search for available applications and services to find the best-suited business solutions for their organization. About Oracle Oracle offers integrated suites of applications plus secure, autonomous infrastructure in the Oracle Cloud. AboutKaltura Kaltura provides live and on-demand video SaaS solutions to thousands of organizations around the world, engaging hundreds of millions of viewers at home, at work, and at school.Our off-the-shelf SaaS products are known for their unparalleled flexibility, modularity, extendibility, and ease of integration. They are all built on top of hundreds of open APIs for video ingestion, transcoding, metadata management, distribution, publishing, engagement, monetization, and analytics.

Read More


Netlify Web Development Cloud Now Available in AWS Marketplace

Netlify | September 22, 2021

Netlify, the most popular way to build, deploy and scale modern web applications, is now available via the AWS Marketplace, a digital catalog to find, test, buy, and deploy software that runs on Amazon Web Services (AWS). AWS customers can streamline procurement and consolidate web infrastructure billing by purchasing Netlify with their existing AWS account and spending commitments. Netlify provides automation and intuitive development workflows that enable frontend engineering teams to ship optimal customer experiences on the web at scale, faster, without having to manage servers. Netlify Enterprise, available in the AWS Marketplace, offers a complete web development platform with the highest level of availability, control and security: Netlify Git-Centric Workflows: Simple, yet powerful Git-based workflows unite the landscape of JavaScript frameworks, developer tools and APIs making it possible for frontend teams to build full-stack web applications. Netlify High-Performance Build: A fully automated frontend CI/CD, optimized for modern Jamstack web architecture and easily extended with a plugin ecosystem. Netlify supports all JavaScript frameworks, including popular technologies like React, Next.js, Vue.js, Gatsby and Angular. Netlify High-Performance Edge: A fast, reliable and secure SLA-backed network Edge to run all of an organization's web experiences. Netlify Edge is multi-cloud, leveraging top cloud providers in each region, like AWS. Netlify Functions: The most intuitive way for frontend teams to use AWS Lambda functions in their preferred workflow. Frontend code and serverless functions are deployed, versioned, previewed and reverted together as a part of Netlify's Git-based workflow. Level 1, Production Support: Access to Netlify support engineers with an SLA-backed response time so teams can get to market faster and protect the integrity of the critical infrastructure that powers their web applications. "At Netlify, we want to enable frontend engineers to use the tools they love, and ship faster without bottlenecks, backed by the performance and reliability expected by enterprise teams. Making Netlify available on the AWS Marketplace expands this opportunity to more customers and partners that already run on AWS," said Sarfaraz Rydhan, senior director of business development, Netlify. "We look forward to working with AWS to give fast, flexible access to joint customers looking to create better web experiences on proven cloud infrastructure, fully managed by Netlify." Now more than 310,000 active AWS Marketplace customers can customize and purchase Netlify Enterprise plans via the catalog. About Netlify Netlify is the most popular way to build, deploy and scale modern web applications. Developers love Netlify for its powerful, yet simple workflows, which make it easy to integrate their choice of tools and collaborate with their team to deliver the best online experiences, faster

Read More


Tencent Cloud Strengthens Collaboration with Grafana Labs

Tencent Cloud, Grafana Labs | September 21, 2021

Tencent Cloud, the cloud business of global technology company Tencent, announced the expansion of its successful collaboration with Grafana Labs, the company behind the world's most ubiquitous open and composable operational dashboards. The two parties are now set to begin developing and validating a new first-party offering called Grafana Managed Services, which will combine open-source Grafana software with additional integrations from Tencent Cloud – designed for users to visualize and monitor their cloud monitoring data. In April 2021, Grafana Labs and Tencent Cloud collaborated to add the Tencent Cloud Monitor Plugin to the Grafana catalog. The Grafana Tencent Cloud Monitor plugin provides Grafana users with load and performance monitoring metrics for multiple Tencent Cloud products, including Cloud Virtual Machine (CVM) and Cloud Databases (Tencent DB). With the introduction of Grafana Managed Services, more than five million Grafana users will be able to run Grafana on Tencent Cloud with the safety, security, and ease of a cloud managed service. Grafana Managed Services users will be able to connect to their existing data sources while leveraging native Tencent Cloud integrations such as Cloud SSO. Poshu Yeung, Senior Vice President, Tencent Cloud International, said, "After receiving positive feedback regarding our collaboration earlier this year, we look forward to further serving Grafana users by elevating our joint efforts and introducing Grafana Managed Services. This new service now enables users to visualize their cloud monitoring data with Grafana's leading time series data visualization capabilities, thus opening more avenues for users to maximize the usage of their cloud data and reduce the need for infrastructure management." Raj Dutt, Co-founder and CEO at Grafana Labs, said, "We've received an overwhelmingly positive response from our users since we first announced the beginning of our partnership with Tencent Cloud, and we're eager to build on that strong foundation with the introduction of Grafana Managed Services. This new collaboration takes our partnership one step further by jointly developing and offering the first-party Grafana Managed Services, providing Tencent Cloud and Grafana users a native solution so they can focus their time on use cases rather than managing infrastructure." About Tencent Cloud Tencent Cloud is Tencent's cloud services brand, providing industry-leading cloud products and services to organizations and enterprises across the world. Leveraging its robust data center infrastructures around the world, Tencent integrates cloud computing, big data analytics, AI, Internet of Things, security and other advanced technologies with smart enterprise scenarios. At the same time, we provide a holistic smart enterprise solution for sectors including finance, education, healthcare, retail, industry, transport, energy and radio & television. About Grafana Labs Grafana Labs provides an open and composable monitoring and observability stack built around Grafana, the leading open source technology for dashboards and visualization. There are over 1,500 Grafana Labs customers including Bloomberg, JP Morgan Chase, eBay, PayPal, and Sony, and more than 750,000 active installations of Grafana around the globe. Grafana Labs helps companies manage their observability strategies with full-stack offerings that can be run fully managed with Grafana Cloud, or self-managed with Grafana Enterprise Stack, both featuring extensive enterprise data source plugins, dashboard management, alerting, reporting and security, scalable metrics (Prometheus & Graphite), logs (Grafana Loki) and tracing (Grafana Tempo). Grafana Labs is backed by leading investors Lightspeed Venture Partners, Lead Edge Capital, GIC, Sequoia Capital, and Coatue.

Read More


Keyless SSL lets sites use Cloudflare’s SSL service while retaining on-premise custody of their private keys. Companies are able to get all of the benefits of the cloud (DDoS attack mitigation, load balancing, WAN optimization), without having to choose between encrypting web traffic or giving their SSL private keys to a 3rd party cloud provider.