Dejkala
No Result
View All Result
  • Home
  • Tech
  • Banking & loan
  • Games
  • Car’s & Bike’s
  • Home
  • Tech
  • Banking & loan
  • Games
  • Car’s & Bike’s
No Result
View All Result
Dejkala
No Result
View All Result
Home Latest update

AI is running out of computing power. IBM says the answer is this new chip- Dejkala

by hasibul
November 1, 2022
in Latest update
0
AI is running out of computing power. IBM says the answer is this new chip- Dejkala
0
VIEWS
Share on FacebookShare on Twitter


close up of the IBM Artificial Intelligence Unit chip

A close up of the IBM Artificial Intelligence Unit chip.

Image: IBM

The hype suggests that artificial intelligence (AI) is already everywhere, but in reality the technology that drives it is still developing. Many AI applications are powered with chips that weren’t designed for AI – instead, they rely on general-purpose CPUs and GPUs created for video games. That mismatch has led to a flurry of investment – from tech giants such as IBM, Intel and Google, as well as from startups and VCs – into the design of new chips expressly designed for AI workloads. 

As the technology improves, enterprise investment will surely follow. According to Gartner, AI chip revenue totaled more than $34 billion in 2021 and is expected to grow to $86 billion by 2026. Additionally, the research firm said, less than 3% of data center servers in 2020 included workload accelerators, while more than 15% are expected to by 2026. 

IBM Research, for its part, just unveiled the Artificial Intelligence Unit (AIU), a prototype chip specialized for AI. 

“We’re running out of computing power. AI models are growing exponentially, but the hardware to train these behemoths and run them on servers in the cloud or on edge devices like smartphones and sensors hasn’t advanced as quickly,” said IBM.

Also: Can AI help solve education’s big data problems?

The AIU is the first complete system-on-a-chip (SoC) from the IBM Research AI Hardware Center designed expressly to run enterprise AI deep-learning models. 

IBM argues that the “workhorse of traditional computing”, otherwise known as CPU, was designed before deep learning arrived. While CPUs are good for general-purpose applications, they aren’t so good at training and running deep-learning models that require massively parallel AI operations.

“There’s no question in our minds that AI is going to be a fundamental driver of IT solutions for a long, long time,” Jeff Burns, director of AI Compute for IBM Research, told ZDNET. “It’s going to be infused across the computing landscape, across these complicated enterprise IT infrastructures and solutions in a very broad and diffuse way.”

For IBM, it makes the most sense to build complete solutions that are effectively universal, Burns said, “so that we can integrate those capabilities into different compute platforms and support a very, very broad variety of enterprise AI requirements.”

The AIU is an application-specific integrated circuit (ASIC), but it can be programmed to run any type of deep-learning task. The chip features 32 processing cores built with 5 nm technology and contains 23 billion transistors. The layout is simpler than that of a CPU, designed to send data directly from one compute engine to the next, making it more energy efficient. It’s designed to be as easy to use as a graphics card and can be plugged into any computer or server with a PCIe slot.

To conserve energy and resources, the AIU leverages approximate computing, a technique IBM developed to trade computational precision in favor of efficiency. Traditionally, computation has relied on 64- and 32-bit floating point arithmetic, to deliver a level of precision that’s useful for finance, scientific calculations and other applications where detailed accuracy matters. However, that level of precision isn’t really necessary for the vast majority of AI applications. 

“If you think about plotting the trajectory of an autonomous driving vehicle, there’s no exact position in the lane where the car needs to be,” Burns explains. “There’s a range of places in the lane.”

Neural networks are fundamentally inexact – they produce an output with a probability. For instance, a computer vision program might tell you with 98% certainty that you’re looking at a picture of a cat. Even so, neural networks were still initially trained with high-precision arithmetic, consuming significant energy and time. 

Also: I tested out an AI art generator and here’s what I learned

The AIU’s approximate computing technique allows it to drop from 32-bit floating point arithmetic to bit-formats holding a quarter as much information. 

To ensure the chip is truly universal, IBM has focused on more than just hardware innovations. IBM Research has put a huge emphasis on foundation models, with a team of somewhere between 400 and 500 people working on them. In contrast to the AI models that are built for a specific task, foundation models are trained on a broad set of unlabeled data, creating a resource akin to a gigantic database. Then, when you need a model for a specific task, you can retrain the foundation model using a relatively small amount of labeled data. 

Using this approach, IBM intends to tackle different verticals and different AI use cases. There are a handful of domains for which the company is building foundation models – those use cases cover areas such as chemistry and time series data. Time series data, which simply refers to data that’s collected over regular intervals of time, is critical for industrial companies that need to observe how their equipment is functioning. After building foundation models for a handful of key areas, IBM can develop more specific, vertical-driven offerings. The team has also ensured the software for the AIU is completely compatible with IBM-owned Red Hat’s software stack. 


Related

ShareTweetShare

Related Posts

Sources: FTC to file a complaint against Amazon alleging that Alexa-powered speakers collect data about kids under 13 without parental consent, violating COPPA (Josh Sisco/Politico)- Dejkala
Latest update

Sources: FTC to file a complaint against Amazon alleging that Alexa-powered speakers collect data about kids under 13 without parental consent, violating COPPA (Josh Sisco/Politico)- Dejkala

April 1, 2023
Q&A with Epic Games CEO Tim Sweeney and EVP Sax Persson on an open metaverse, walled gardens, user-generated content, a metaverse programming language, and more (Dean Takahashi/VentureBeat)- Dejkala
Latest update

Q&A with Epic Games CEO Tim Sweeney and EVP Sax Persson on an open metaverse, walled gardens, user-generated content, a metaverse programming language, and more (Dean Takahashi/VentureBeat)- Dejkala

April 1, 2023
GM kills more than CarPlay support, it kills choice- Dejkala
Latest update

GM kills more than CarPlay support, it kills choice- Dejkala

March 31, 2023
Twitter posts the code it claims determines which tweets people see, and why- Dejkala
Latest update

Twitter posts the code it claims determines which tweets people see, and why- Dejkala

March 31, 2023
Hackers exploit WordPress plugin flaw that gives full control of millions of sites- Dejkala
Latest update

Hackers exploit WordPress plugin flaw that gives full control of millions of sites- Dejkala

March 31, 2023
The best travel gadgets of 2023: Expert travel tech- Dejkala
Latest update

The best travel gadgets of 2023: Expert travel tech- Dejkala

March 31, 2023
Next Post
Twitter disrupts a China-based influence campaign ahead of the US midterms, spanning nearly 2,000 accounts; two networks skewed right and another left (Washington Post)- Dejkala

Twitter disrupts a China-based influence campaign ahead of the US midterms, spanning nearly 2,000 accounts; two networks skewed right and another left (Washington Post)- Dejkala

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Categories

  • Earn Money Online
  • Game news and review
  • Laptops
  • Latest update
  • Smartphone Reviews & News
  • TODAY Tech News
  • Upcoming Technology
  • Wordpress plugin
  • WordPress themes
  • World Wide Bike Reviews and News
  • World Wide Car News

Recommended

Teachers are using ChatGPT more than students. Here’s how- Dejkala

Teachers are using ChatGPT more than students. Here’s how- Dejkala

March 8, 2023
A developer runs Meta's 13B LLaMA model, considered to be competitive with GPT-3, on his laptop, showing local language models are feasible on consumer hardware (Simon Willison/Simon Willison's Weblog)- Dejkala

A developer runs Meta's 13B LLaMA model, considered to be competitive with GPT-3, on his laptop, showing local language models are feasible on consumer hardware (Simon Willison/Simon Willison's Weblog)- Dejkala

March 13, 2023
A reporter says he used an AI-generated replica of a voice to get past the voice verification system of UK's Lloyds bank and accessed an account's information (Joseph Cox/VICE)- Dejkala

A reporter says he used an AI-generated replica of a voice to get past the voice verification system of UK's Lloyds bank and accessed an account's information (Joseph Cox/VICE)- Dejkala

February 23, 2023
ULA targets May 4th for Vulcan Centaur rocket’s inaugural flight- Dejkala

ULA targets May 4th for Vulcan Centaur rocket’s inaugural flight- Dejkala

February 24, 2023
MSI is bringing fresh designs and big performance to its Raider and Stealth Studio laptops- Dejkala

MSI is bringing fresh designs and big performance to its Raider and Stealth Studio laptops- Dejkala

January 4, 2023
The Hisense 55-inch U8H QLED TV is $500 off- Dejkala

The Hisense 55-inch U8H QLED TV is $500 off- Dejkala

February 9, 2023
Sources: FTC to file a complaint against Amazon alleging that Alexa-powered speakers collect data about kids under 13 without parental consent, violating COPPA (Josh Sisco/Politico)- Dejkala

Sources: FTC to file a complaint against Amazon alleging that Alexa-powered speakers collect data about kids under 13 without parental consent, violating COPPA (Josh Sisco/Politico)- Dejkala

April 1, 2023
Q&A with Epic Games CEO Tim Sweeney and EVP Sax Persson on an open metaverse, walled gardens, user-generated content, a metaverse programming language, and more (Dean Takahashi/VentureBeat)- Dejkala

Q&A with Epic Games CEO Tim Sweeney and EVP Sax Persson on an open metaverse, walled gardens, user-generated content, a metaverse programming language, and more (Dean Takahashi/VentureBeat)- Dejkala

April 1, 2023
GM kills more than CarPlay support, it kills choice- Dejkala

GM kills more than CarPlay support, it kills choice- Dejkala

March 31, 2023

Categories

  • Earn Money Online
  • Game news and review
  • Laptops
  • Latest update
  • Smartphone Reviews & News
  • TODAY Tech News
  • Upcoming Technology
  • Wordpress plugin
  • WordPress themes
  • World Wide Bike Reviews and News
  • World Wide Car News

Pages

  • About Us
  • Banking & loan
  • Car’s & Bike’s
  • Contact Us
  • Games
  • Home
  • Home 2
  • Privacy Policy
  • Tech

© 2022 Dejkala

No Result
View All Result
  • Homepages
    • Home – Layout 1
    • Home – Layout 2

© 2022 Dejkala