Nvidia’s H100 A.I. chips costing more than $40,000 on eBay

0
181
Google chip manufacturing takes aim at Nvidia's generative A.I.

Revealed: The Secrets our Clients Used to Earn $3 Billion

Jen-Hsun Huang, president and president of Nvidia Corp., reveals the EGX Edge Supercomputing Platform throughout the business’s occasion at Mobile World Congress Americas in Los Angeles, California,Oct 21, 2019.

Patrick T. Fallon|Bloomberg|Getty Images

Nvidia’s most-advanced graphics cards are costing more than $40,000 on eBay, as need skyrockets for chips required to train and release expert system software application.

The rates for Nvidia’s H100 processors were kept in mind by 3D video gaming leader and previous Meta seeking advice from innovation chief John Carmackon Twitter On Friday, a minimum of 8 H100 s were noted on eBay at rates varying from $39,995 to simply under $46,000 Some sellers have actually provided it in the past for around $36,000

The H100, revealed in 2015, is Nvidia’s most current flagship AI chip, being successful the A100, an approximately $10,000 chip that’s been called the “workhorse” for AI applications.

Developers are utilizing the H100 to construct so-called big language designs (LLMs), which are at the heart of AI applications like OpenAI’s ChatGPT. Running those systems is pricey and needs effective computer systems to churn through terabytes of information for days or weeks at a time. They likewise depend on large computing power so the AI design can create text, images or forecasts.

Training AI designs, particularly big ones like GPT, needs numerous high-end Nvidia GPUs collaborating.

Microsoft invested numerous countless dollars on 10s of countless Nvidia A100 chips to assist construct ChatGPT. Nvidia manages the large bulk of the marketplace for AI chips.

Nvidia likewise provides a supercomputer with 8 GPUs collaborating called the DGX. Earlier this year, the business revealed brand-new services that would permit business to lease access to DGX computer systems for $37,000 each month. At that rate, the system would utilize Nvidia’s older A100 processors.

Nvidia states the H100 is the very first chip to be enhanced for the particular AI architecture underpinning a number of the current advances in AI, called transformers. Industry specialists state the more effective chips will be required to construct even larger and more data-hungry designs than those that are presently readily available.

VIEW: Google chip production takes objective at Nvidia’s generative A.I.