{"id":275860,"date":"2026-06-19T06:40:00","date_gmt":"2026-06-19T10:40:00","guid":{"rendered":"https:\/\/news-you-need.com\/index.php\/2026\/06\/19\/a-startup-claims-it-broke-through-a-bottleneck-thats-holding-back-llms\/"},"modified":"2026-06-19T07:10:14","modified_gmt":"2026-06-19T11:10:14","slug":"a-startup-claims-it-broke-through-a-bottleneck-thats-holding-back-llms","status":"publish","type":"post","link":"https:\/\/news-you-need.com\/index.php\/2026\/06\/19\/a-startup-claims-it-broke-through-a-bottleneck-thats-holding-back-llms\/","title":{"rendered":"A startup claims it broke through a bottleneck that\u2019s holding back LLMs"},"content":{"rendered":"

A startup claims it broke through a bottleneck that\u2019s holding back LLMs<\/a><\/p>\n

https:\/\/www.technologyreview.com\/2026\/06\/19\/1139313\/a-startup-claims-it-broke-through-a-bottleneck-thats-holding-back-llms\/<\/a><\/p>\n

Publish Date: 2026-06-19 06:40:00<\/a><\/p>\n

Source Domain: www.technologyreview.com<\/a><\/p>\n

SubQ won\u2019t replace existing top models across the board, but it could offer huge increases in speed at a fraction of the typical cost for certain tasks. Subquadratic insists that in the long run, though, its breakthrough could change how LLMs are built. \u201cWe hope we\u2019re kicking off a new age of efficiency,\u201d says Justin Dangel, the firm\u2019s cofounder and CEO. \u201cWe don\u2019t think anybody will be building on transformers in a few years.\u201d<\/p>\n

Attention!<\/strong><\/h3>\n

To understand why Subquadratic\u2019s claims are a big deal, let\u2019s dig into how most LLMs work. The key mechanism inside an LLM is a type of neural network called a transformer, which runs a process known as dense attention. Today\u2019s LLMs typically chain together multiple transformers. (The foundational paper of the LLM era, published by researchers at Google in 2017, was titled \u201cAttention Is All You Need.\u201d)<\/p>\n

Dense attention works like this: When a transformer processes a chunk of text, it first encodes each word (or part of a word, known as a token) with a number. To capture the meaning of the full text, it then multiplies each of those numbers with every other number for that text. For example, a piece of text 10,000 words long would kick off almost 50 million individual multiplications. That\u2019s a lot of computation and the main reason that LLMs are notorious power hogs.<\/p>\n

\u201cIf you want to summarize The Great Gatsby, you have to look at the first word and the last word together, and then you have to look at every other combination,\u201d says Dangel.<\/p>\n

As the length of the text increases, the number of computations skyrockets. That\u2019s because each additional number must be multiplied by all other previous numbers. Double the number of words, and you roughly quadruple the number of computations, a rate of increase known as a quadratic expansion.<\/p>\n

(You can picture this yourself: Draw a circle and mark dots around its edge. Each dot is a token. Then draw lines between pairs of dots to represent the…<\/p>\n

Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

A startup claims it broke through a bottleneck that\u2019s holding back LLMs https:\/\/www.technologyreview.com\/2026\/06\/19\/1139313\/a-startup-claims-it-broke-through-a-bottleneck-thats-holding-back-llms\/ Publish Date:…<\/p>\n","protected":false},"author":1,"featured_media":275861,"comment_status":"closed","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/wp.technologyreview.com\/wp-content\/uploads\/2026\/06\/cheetah-speed2a.jpg?resize=1200,600","fifu_image_alt":"","footnotes":""},"categories":[14],"tags":[17],"class_list":["post-275860","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artificial-intelligence","tag-llm"],"_links":{"self":[{"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/posts\/275860"}],"collection":[{"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/comments?post=275860"}],"version-history":[{"count":1,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/posts\/275860\/revisions"}],"predecessor-version":[{"id":275862,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/posts\/275860\/revisions\/275862"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/media\/275861"}],"wp:attachment":[{"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/media?parent=275860"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/categories?post=275860"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/tags?post=275860"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}