Google Releases TurboQuant Algorithm: 3-bit KV Cache Quantization With No Accuracy Loss, Inference Speed Boosted Up to 8x

Gate News reports that on March 25, Google Research Institute released the quantization compression algorithm TurboQuant, which can compress large language model KV caches to 3 bits, reducing memory usage by at least 6 times without training or fine-tuning and without loss of model accuracy. In 4-bit mode, the attention computation speed on NVIDIA H100 GPUs is up to 8 times faster than the 32-bit unquantized baseline. The research team validated TurboQuant using models like Gemma and Mistral on long-context benchmarks such as LongBench, Needle In A Haystack, and ZeroSCROLLS, achieving optimal performance in all tests. The algorithm consists of two sub-algorithms: PolarQuant, which eliminates traditional quantization memory overhead through polar coordinate transformation, and QJL, which corrects residual errors with only 1 bit. Led by Amir Zandieh and Vice President and Google Fellow Vahab Mirrokni at Google Research, in collaboration with KAIST in Korea and New York University, the study will be published at ICLR 2026. Google states that one of the main applications of this technology is to address KV cache bottlenecks in models like Gemini.

Disclaimer: The information on this page may come from third parties and does not represent the views or opinions of Gate. The content displayed on this page is for reference only and does not constitute any financial, investment, or legal advice. Gate does not guarantee the accuracy or completeness of the information and shall not be liable for any losses arising from the use of this information. Virtual asset investments carry high risks and are subject to significant price volatility. You may lose all of your invested principal. Please fully understand the relevant risks and make prudent decisions based on your own financial situation and risk tolerance. For details, please refer to Disclaimer.

Related Articles

BitMine’s quarterly net loss was $3.81 billion, with ETH’s unrealized losses accounting for 99%

BitMine Immersion Technologies filed its financial report with the SEC on April 15, 2026, showing that the company’s quarterly net loss as of February 28 totaled $3.81B, mainly due to unrealized losses from its Ethereum holdings. The company holds about 4.87 million ETH, with an average purchase cost of $3,794 per ETH. Its recent market value exceeded $10.7 billion. The BMNR stock has been upgraded to the New York Stock Exchange, and the current quote is $21.69.

MarketWhisper36m ago

Only 4% of Danes Hold Crypto, Below European Peers Like Norway and Finland, Central Bank Study Shows

A Danish National Bank report shows only 4% of Danes own cryptocurrency, unchanged since 2023 and below other European nations. Most holders invest small amounts, with adoption hindered by cautious banks and risk concerns, mainly among younger, wealthier individuals.

GateNews5h ago

World Silver Institute: Global Silver Market to Face Sixth Consecutive Year of Supply Deficit

The World Silver Institute forecasts a widening supply shortage in the silver market, projecting a 46.3 million ounce deficit by 2026. While demand for silver bars and coins will rise, other sectors will decline, leading to an overall consumption decrease. Despite near-term challenges, a positive outlook for silver remains.

GateNews18h ago

Bitmine Immersion Technologies Reports $3.82B Quarterly Loss Despite Revenue Surge to $11M

Bitmine Immersion Technologies (BMNR) reported a $3.82 billion net loss for Q1 2026, primarily from unrealized digital asset losses. Despite this, it continues to accumulate Ethereum, now holding 4.87 million ETH worth $10.7 billion. Quarterly revenue increased to $11.04 million, mainly from staking rewards.

GateNews23h ago

Swiss Crypto Valley Sees 37% Growth in Blockchain Funding in 2025, TON Network Dominates

Switzerland's Crypto Valley received $728 million in blockchain funding in 2025, a 37% increase, dominating Europe's market. Key contributions included TON network's $400 million. Overall, global blockchain funding reached $15.5 billion, despite a drop in deal volume.

GateNews04-15 06:16

TrendForce Cuts 2026 Server Shipment Forecast to 13% YoY Growth Amid Component Shortages

TrendForce has lowered its 2026 server shipment growth forecast to 13% from 20%, citing extended lead times for general-purpose server components as suppliers focus on high-margin AI servers, affecting general server delivery and market demand.

GateNews04-15 04:41
Comment
0/400
No comments