‘Absolutely crazy’ symbolic use tests bosses’ bet on AI


In the program 8×8 company, used by employees Claude Anthropy to craft emails, analyze customer feedback, and write code, but so far, their increasing reliance on an AI-powered chatbot hasn’t bothered the finance team. While other Silicon Valley companies, such as Meta, Uber, and Salesforce, have publicly expressed concerns about the rising cost of generative AI tools and begun imposing usage caps in some cases, 8×8 says it finds itself stymied.

Over the past 18 months, the company estimates it has saved about $5 million in annual costs by canceling subscriptions for dozens of educational programs and tools it deemed unnecessary in part because Cloud can provide similar capabilities. So far, 8×8’s annual bill to Claude is “significantly less” than that number, says Joel Neib, the company’s chief transformation and business operations officer.

Knipp expects the savings and costs will eventually equalize, as the 8×8 initiative encourages more employees to adopt AI and integrate the technology into more complex work. But for now, there’s still a big gap, which “makes the CFO happy,” he told WIRED. He declined to share exact total spending on generative AI.

While companies are collectively pouring hundreds of millions of dollars into AI tools CodingMarketing, and Customer serviceA new obsession has emerged in the technology industry: the “token economy,” or how to manage the high cost of using artificial intelligence. (Tokens represent the amount of content the AI ​​model analyzes and creates.)

Last month, the CEO of Royal Bank of Canada revealed that token usage had increased by 500 percent over the past six months. At Cisco, a third of employees use an internal AI chatbot on a daily basis, so “tokenization has become very cool,” CEO Chuck Robbins said on an earnings call. Some senior engineers at analytics software developer Amplitude are “spending thousands of dollars a month or more on tokens,” according to its CEO Spenser Skates. “The token budget conversation has certainly become one of the most important,” said Aaron Levin, CEO of Box.Hot“Topics.

Nearly 300 companies addressed questions or concerns about AI tokens during their earnings calls or in public discussions with financial analysts in April or May, according to a WIRED review of transcripts from data provider AlphaStreet. This is a small fraction of the thousands of calls made during this period, but only 93 companies mentioned the “token” in April and May last year.

Executives at several companies said they are developing or looking to purchase systems to help monitor token usage and choose the lowest-priced model for a particular router. Others said they were still trying to find the balance between hiring more people and increasing their token budgets to achieve their goals.

Software is rarely cheap, but the latest generation of AI tools is causing extraordinary stress in executives for several reasons. Prices continue to fluctuate. New models Which is stronger and more expensive than the latest version that is released every month. Engaging entire organizations in new ways of working has been a challenge, so AI-fueled productivity gains for one team can create bottlenecks for another.

20 percent

However, some companies are still encouraging their employees to use AI more without worrying about the tab. In April, Long Island, New York-based clothing brand Baseball Lifestyle 101, which expects to generate $250 million in sales this year, asked about 50 of its senior managers to spend the equivalent of about 20 percent of their salaries on AI codes each month.

Bill Rome, co-founder and chief strategy officer at Baseball Lifestyle 101, tells WIRED that the cost will likely exceed $100,000 per month by the end of the year, but it’s already starting to pay off. Claude recently helped secure a million-dollar order by determining that a retailer was in short supply of some sizes of the company’s popular ice cream-patterned shorts. “That’s a day and a half of work that could now happen in an hour or two that could earn me eight figures in extra income over the course of 12 months,” says Romm.

Leave a Reply

Your email address will not be published. Required fields are marked *