Bitget App
Trade smarter
Buy cryptoMarketsTradeFuturesEarnSquareMore
Tensormesh secures $4.5 million to boost AI server efficiency for greater inference capacity

Tensormesh secures $4.5 million to boost AI server efficiency for greater inference capacity

Bitget-RWA2025/10/23 16:33
By:Bitget-RWA

As the demand for AI infrastructure skyrockets, organizations are under increasing pressure to maximize the inference output from their available GPUs. For those with specialized knowledge in certain methods, this environment presents an excellent opportunity to secure investment.

This is one of the main reasons behind the emergence of Tensormesh, which has just come out of stealth mode after raising $4.5 million in seed capital. The round was headed by Laude Ventures, with additional backing from angel investor and database innovator Michael Franklin.

Tensormesh intends to use these funds to develop a commercial offering based on the open-source LMCache tool, which was created and is maintained by co-founder Yihua Cheng. When implemented effectively, LMCache can cut inference expenses by up to a factor of ten—a capability that has made it popular in open-source projects and attracted collaborations with major players like Google and Nvidia. Now, Tensormesh aims to transform its academic achievements into a sustainable business.

At the core of this technology is the key-value cache (KV cache), a memory architecture that streamlines the processing of complex inputs by summarizing them into key values. In most conventional systems, the KV cache is discarded after each query, but Tensormesh CEO Juchen Jiang believes this practice leads to significant inefficiency.

“It’s comparable to a brilliant analyst who reviews all the information but forgets everything after answering each question,” explains Tensormesh co-founder Junchen Jiang.

Rather than deleting the cache, Tensormesh’s approach preserves it, making it available for reuse when the model encounters a similar task in a future query. Since GPU memory is a limited resource, this often involves distributing data across multiple storage solutions, but the payoff is a substantial boost in inference capacity without increasing server demands.

This improvement is especially impactful for chat-based applications, where models must repeatedly access an expanding conversation history. Agentic systems face a similar challenge, as their logs of actions and objectives continually grow.

While, in principle, AI firms could implement these changes themselves, the technical hurdles make it a formidable undertaking. Given the Tensormesh team’s expertise and the complexity involved, the company is confident there will be strong interest in a ready-made solution.

“Storing the KV cache in secondary storage and reusing it efficiently without degrading system performance is a tough technical challenge,” Jiang notes. “We’ve observed teams hiring dozens of engineers and spending several months to build such a system. Alternatively, they can leverage our product and achieve the same results much more efficiently.”

0

Disclaimer: The content of this article solely reflects the author's opinion and does not represent the platform in any capacity. This article is not intended to serve as a reference for making investment decisions.

PoolX: Earn new token airdrops
Lock your assets and earn 10%+ APR
Lock now!

You may also like

The Xerox Campus Revitalization in Webster, NY: A Prime Prospect for Industrial Property and Development Investments

- Webster , NY's Xerox campus redevelops 300 acres of brownfield land with $9.8M FAST NY grant, targeting 2025 as a hub for advanced manufacturing and logistics. - Infrastructure upgrades include road realignment, sewer expansion, and electrical modernization to meet demands of semiconductor and food processing industries. - Tax incentives and PPPs attract firms like fairlife® (1M sq ft, 250 jobs) and Ranger Design, leveraging low 2% vacancy vs. national 7.4% average. - EPA-compliant remediation and sustai

Bitget-RWA2025/11/30 11:00
The Xerox Campus Revitalization in Webster, NY: A Prime Prospect for Industrial Property and Development Investments

AI-Powered Hybrid Staking Approach Connects Web2 and Web3, Enhancing Accessibility

- IntelliQuant's Lumint platform introduces a hybrid node staking model combining AI with blockchain to simplify operations for institutional and retail users. - The model uses account abstraction and gas fee sponsorship to lower entry barriers while integrating Web2/Web3 technologies for familiar user experiences. - An AI-powered investment platform with robo-advisory and crypto trend analysis is in development, supported by OKX partnership for global expansion. - The hybrid-incentive system aims to creat

Bitget-RWA2025/11/30 10:46
AI-Powered Hybrid Staking Approach Connects Web2 and Web3, Enhancing Accessibility

XRP News Update: Institutional Dominance Drives CoinShares to Adjust Its Crypto Approach

- CoinShares abandoned U.S. XRP/Solana/LTC ETF plans due to a crowded market dominated by institutional giants like BlackRock and Fidelity. - The firm will pivot to high-margin thematic crypto products and active strategies, exiting leveraged Bitcoin futures ETF BTFX . - Institutional dominance in crypto ETFs now exceeds 90% of inflows, with BlackRock's IBIT controlling $70B+ in assets and 3% of Bitcoin's supply. - XRP ETFs saw $179.6M inflows this week, but CoinShares cited "low margins and slow growth" c

Bitget-RWA2025/11/30 10:46
XRP News Update: Institutional Dominance Drives CoinShares to Adjust Its Crypto Approach

Ethereum Updates Today: Fed's QT Conclusion and FUSAKA Enhancement May Drive Ethereum's Upcoming Surge

- Ethereum tests $2,850 support as ETF inflows and FUSAKA upgrade boost institutional confidence. - FUSAKA upgrade introduces PeerDAS, boosting data capacity eightfold and cutting L2 fees by 90%. - Fed’s December QT end and rate cut expectations fuel liquidity and bullish sentiment. - Technical indicators show consolidation near $2,800–$3,080, with potential for $3,550 by mid-2026 if upgrades align with liquidity.

Bitget-RWA2025/11/30 10:32
Ethereum Updates Today: Fed's QT Conclusion and FUSAKA Enhancement May Drive Ethereum's Upcoming Surge