Bitget App
Trade smarter
Buy cryptoMarketsTradeFuturesEarnWeb3SquareMore
Trade
Spot
Buy and sell crypto with ease
Margin
Amplify your capital and maximize fund efficiency
Onchain
Going Onchain, without going Onchain!
Convert & block trade
Convert crypto with one click and zero fees
Explore
Launchhub
Gain the edge early and start winning
Copy
Copy elite trader with one click
Bots
Simple, fast, and reliable AI trading bot
Trade
USDT-M Futures
Futures settled in USDT
USDC-M Futures
Futures settled in USDC
Coin-M Futures
Futures settled in cryptocurrencies
Explore
Futures guide
A beginner-to-advanced journey in futures trading
Futures promotions
Generous rewards await
Overview
A variety of products to grow your assets
Simple Earn
Deposit and withdraw anytime to earn flexible returns with zero risk
On-chain Earn
Earn profits daily without risking principal
Structured Earn
Robust financial innovation to navigate market swings
VIP and Wealth Management
Premium services for smart wealth management
Loans
Flexible borrowing with high fund security
Tensormesh secures $4.5 million to boost AI server efficiency for greater inference capacity

Tensormesh secures $4.5 million to boost AI server efficiency for greater inference capacity

Bitget-RWA2025/10/23 16:33
By:Bitget-RWA

As the demand for AI infrastructure skyrockets, organizations are under increasing pressure to maximize the inference output from their available GPUs. For those with specialized knowledge in certain methods, this environment presents an excellent opportunity to secure investment.

This is one of the main reasons behind the emergence of Tensormesh, which has just come out of stealth mode after raising $4.5 million in seed capital. The round was headed by Laude Ventures, with additional backing from angel investor and database innovator Michael Franklin.

Tensormesh intends to use these funds to develop a commercial offering based on the open-source LMCache tool, which was created and is maintained by co-founder Yihua Cheng. When implemented effectively, LMCache can cut inference expenses by up to a factor of ten—a capability that has made it popular in open-source projects and attracted collaborations with major players like Google and Nvidia. Now, Tensormesh aims to transform its academic achievements into a sustainable business.

At the core of this technology is the key-value cache (KV cache), a memory architecture that streamlines the processing of complex inputs by summarizing them into key values. In most conventional systems, the KV cache is discarded after each query, but Tensormesh CEO Juchen Jiang believes this practice leads to significant inefficiency.

“It’s comparable to a brilliant analyst who reviews all the information but forgets everything after answering each question,” explains Tensormesh co-founder Junchen Jiang.

Rather than deleting the cache, Tensormesh’s approach preserves it, making it available for reuse when the model encounters a similar task in a future query. Since GPU memory is a limited resource, this often involves distributing data across multiple storage solutions, but the payoff is a substantial boost in inference capacity without increasing server demands.

This improvement is especially impactful for chat-based applications, where models must repeatedly access an expanding conversation history. Agentic systems face a similar challenge, as their logs of actions and objectives continually grow.

While, in principle, AI firms could implement these changes themselves, the technical hurdles make it a formidable undertaking. Given the Tensormesh team’s expertise and the complexity involved, the company is confident there will be strong interest in a ready-made solution.

“Storing the KV cache in secondary storage and reusing it efficiently without degrading system performance is a tough technical challenge,” Jiang notes. “We’ve observed teams hiring dozens of engineers and spending several months to build such a system. Alternatively, they can leverage our product and achieve the same results much more efficiently.”

0

Disclaimer: The content of this article solely reflects the author's opinion and does not represent the platform in any capacity. This article is not intended to serve as a reference for making investment decisions.

PoolX: Earn new token airdrops
Lock your assets and earn 10%+ APR
Lock now!

You may also like

Bitcoin News Update: Analyst Highlights How MSTR's Convertible Bonds Prevent Forced Bitcoin Sales

- MSTR's convertible debt structure allows debt repayment via cash, stock, or both, avoiding Bitcoin sales during market downturns. - The company raised €350M through a 10% dividend-bearing euro-denominated preferred stock offering to fund Bitcoin purchases. - Q3 results showed $3.9B operating income from Bitcoin gains, driving a 7.6% stock surge to $273.68 post-earnings. - Risks persist if Bitcoin fails to rally in 2028, potentially forcing partial liquidation amid $1.01B 2027 debt obligations. - MSTR hol

Bitget-RWA2025/11/05 04:50
Bitcoin News Update: Analyst Highlights How MSTR's Convertible Bonds Prevent Forced Bitcoin Sales

Solana News Today: Solana ETFs Surpass Bitcoin as Staking Returns Attract Institutional Investments

- U.S. spot Solana ETFs (BSOL/GSOL) attracted $199M in 4 days, outperforming Bitcoin/Ethereum ETF outflows. - 7% staking yields drive institutional inflows as investors rotate capital from major crypto assets. - Despite ETF success, SOL price fell below key support levels, raising concerns about $120 price floor. - Strategic staking and treasury purchases boosted Solana's institutional appeal, with $397M in staked assets. - Market remains cautious as ETF competition intensifies, with Bitwise's BSOL outpaci

Bitget-RWA2025/11/05 04:50
Solana News Today: Solana ETFs Surpass Bitcoin as Staking Returns Attract Institutional Investments

Bitcoin News Today: Bitcoin’s Fourth Quarter Surge: Impact of Trade Disputes, Stronger Dollar, and Evolving Global Economic Strategies

- Bitcoin fell nearly 15% in October 2024, its worst quarterly start since 2022, driven by U.S.-China trade tensions, dollar strength, and macroeconomic caution. - A 100% U.S. tariff on Chinese imports and Fed rate-cut delays exacerbated selloffs, triggering $1.3B in liquidations during a flash crash below $103,000. - Key support levels at $107,000 and $101,150 face retests as traders warn of further declines, with market cap dropping below $3.6T amid fragile liquidity. - Wintermute denied Binance lawsuit

Bitget-RWA2025/11/05 04:50
Bitcoin News Today: Bitcoin’s Fourth Quarter Surge: Impact of Trade Disputes, Stronger Dollar, and Evolving Global Economic Strategies

BNB News Today: AI and Blockchain Unite to Transform the Industry Through Decentralized Innovations

- ChainOpera, an AI-powered blockchain project, raised $40M+ in funding to expand decentralized infrastructure, highlighting growing investor confidence in AI-blockchain convergence. - FedEx partners with ServiceNow to implement AI-driven supply chain analytics, aiming to boost operational efficiency through real-time disruption prediction and automation. - BNB Chain emerges as an AI innovation hub with Avalon Labs' AI-MaaS marketplace and AEON's autonomous payment SDK, enabling decentralized AI model depl

Bitget-RWA2025/11/05 04:36
BNB News Today: AI and Blockchain Unite to Transform the Industry Through Decentralized Innovations