ChatGPT costs $700,000 per day to run, which is why Microsoft wants to make its own AI chips
Searching the internet with AI costs a lot more than normal searches.
When you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.
What you need to know
AI is all the craze currently, with millions of users utilizing ChatGPT on a daily basis. With such high demand, it’sno surprise to hear that ChatGPT costs quite a bit of money to run.Chief Analyst at research firmSemiAnalysis, Dylan Patel, estimates that ChatGPT currently costs OpenAI $700,000 per day, or 36 cents per query.
That’s a lot of money, and it’s not helped by the fact that AI companies, including Microsoft, need to buy GPUs from the likes of NVIDIA in bulk orders to help maintain their AI services as demand continues to increase. Industry analysts estimate that OpenAI may need to order 30,000 additional NVIDIA GPUs this year to aid its commercial efforts.
Building your own AI chip can help decrease costs, and that looks to be exactly what Microsoft is doing.Microsoft’s own AI chip is codenamed Athena, and is reportedly already in a good enough spot that it’s being tested with select groups internally at Microsoft. The company plans to distribute its own AI chip among its Azure AI services next year.
Industry insiders say they don’t expect Microsoft to outright replace NVIDIA, but rather lessen their dependence on them. Since ChatGPT runs on Azure services, reducing costs will help OpenAI run ChatGPT for cheaper too, as well as other AI services that choose Azure as a host.
Microsoft has been onan aggressive AI pushthese last few months, after Google fumbled its own AI product launch in the form of Bard. Just recently, reports stated that someGoogle employees have no confidence in Bard, feeling that Google rushed the product to market in response to Microsoft’s Bing AI efforts.
Get the Windows Central Newsletter
All the latest news, reviews, and guides for Windows and Xbox diehards.
Zac Bowden is a Senior Editor at Windows Central. Bringing you exclusive coverage into the world of Windows on PCs, tablets, phones, and more. Also an avid collector of rare Microsoft prototype devices! Keep in touch onTwitterandThreads
