Google Titans architecture, helping AI have long-term memory

(research.google)

504 points | by Alifatisk 22 hours ago

25 comments

  • okdood64
    20 hours ago
    From the blog:

    https://arxiv.org/abs/2501.00663

    https://arxiv.org/pdf/2504.13173

    Is there any other company that's openly publishing their research on AI at this level? Google should get a lot of credit for this.

    • Palmik
      14 hours ago
      DeepSeek and other Chinese companies. Not only do they publish research, they also put their resources where their mouth (research) is. They actually use it and prove it through their open models.

      Most research coming out of big US labs is counter indicative of practical performance. If it worked (too) well in practice, it wouldn't have been published.

      Some examples from DeepSeek:

      https://arxiv.org/abs/2405.04434

      https://arxiv.org/abs/2502.11089

      • abbycurtis33
        11 hours ago
        [flagged]
        • CGMthrowaway
          11 hours ago
          Is there evidence that DeepSeek was stolen from the US? Or is that just a talking point like "covid leaked from a lab in china" ?
          • elmomle
            10 hours ago
            Your comment seems to imply "these views aren't valid" without any evidence for that claim. Of course the theft claim was a strong one to make without evidence too. So, to that point--it's pretty widely accepted as fact that DeepSeek was at its core a distillation of ChatGPT. The question is whether that counts as theft. As to evidence, to my knowledge it's a combination of circumstantial factors which add up to paint a pretty damning picture:

            (1) Large-scale exfiltration of data from ChatGPT when DeepSeek was being developed, and which Microsoft linked to DeepSeek

            (2) DeepSeek's claim of training a cutting-edge LLM using a fraction of the compute that is typically needed, without providing a plausible, reproducible method

            (3) Early DeepSeek coming up with near-identical answers to ChatGPT--e.g. https://www.reddit.com/r/ChatGPT/comments/1idqi7p/deepseek_a...

            • nl
              3 hours ago
              > Large-scale exfiltration of data from ChatGPT when DeepSeek was being developed, and which Microsoft linked to DeepSeek

              This is not the same thing at all. Current legal doctrine is that ChatGPT output is not copyrightable, so at most Deepseek violated the terms of use of ChatGPT.

              That isn't IP theft.

              To add to that example, there are numerous open-source datasets that are derived from ChatGPT data. Famously, the Alpaca dataset kick-started the open source LLM movement by fine tuning Llama on a GPT-derived dataset: https://huggingface.co/datasets/tatsu-lab/alpaca

            • tim333
              10 hours ago
              And slightly off topic but it's interesting Shi Zheng-Li et al are still cooking up gain of function viruses in BSL-2 labs https://x.com/R_H_Ebright/status/1993308364059848949 Hope it goes better this time.
            • grafmax
              10 hours ago
              That’s an argument made about training the initial model. But the comment stated that DeepSeek stole its research from the US which is a much stronger allegation without any evidence to it.
              • epsteingpt
                9 hours ago
                Again - comments like these ignore the continuous, directed, state sponsored and large scale IP theft operation ongoing by the CCP in critical technology areas.

                Anyone suggesting that sensitive models don't have a secret pipeline of employee knowledge and IP from the U.S. to China has simply not been paying attention to the dozens of documented cases and convictions, along with the wider spread 'common knowledge' to Western firms that have operated in China.

                Both can be true - you can steal IP and you can innovate - but don't assume you'd have 'cracked it' without the stealing.

                You simply cannot be sure.

              • elmomle
                10 hours ago
                That's a fair point. I suspect that to one outside the field, their touting major breakthroughs while trying to conceal that their first model was a distillation may cause a sense of skepticism as to the quality of their research. From what I've gathered, their research actually has added meaningfully to understandings of optimal model scaling and faster training.
              • FpUser
                9 hours ago
                For starters ChatGPT was pretty much trained on "stolen" data. However I actually do support it. I think both cases - ChatGPT preying on world wide data and Deepseek using such data by partially "borrowing" it from ChatGPT are fair game.
            • orbital-decay
              6 hours ago
              >Your comment seems to imply "these views aren't valid" without any evidence for that claim.

              No, your comment seems to be a deflection. You made an outstanding claim, that DS stole some IP, and have been asked for outstanding evidence, or at least some evidence. You need to provide it if you want to be taken seriously.

              >Large-scale exfiltration of data from ChatGPT when DeepSeek was being developed, and which Microsoft linked to DeepSeek

              Where's the evidence for that? I also have a claim that I can't back up with anything more than XLab's report: before the release of R1, there were multiple attempts to hack DS's systems, which nobody noticed. [1]

              You really seem to have no idea what you're talking about. R1 was an experiment on teaching the model to reason on its own, exactly to avoid large amounts of data in post-training. It also partially failed, they called the failed snapshot R1-Zero. And it's pretty different from any OpenAI or Anthropic model.

              >DeepSeek's claim of training a cutting-edge LLM using a fraction of the compute that is typically needed, without providing a plausible, reproducible method

              DeepSeek published a lot more about their models than any top tier US lab before them, including their production code. And they're continuing doing so. All their findings in R1 are highly plausible and most are replicated to some degree and adopted in the research and industry. Moonshot AI trained their K2 on DeepSeek's architecture with minor tweaks (not to diminish their novel findings). That's a really solid model.

              Moreover, they released their DeepSeek-Math-7B-RL back in April 2024. [2] It was a tiny model that outperformed huge then-SOTA LLMs like Claude 3 Opus in math, and validated their training technique (GPRO). Basically, they made the first reasoning model worth talking about. Their other optimizations (MLA) can be traced back to DeepSeek v2.

              >Early DeepSeek coming up with near-identical answers to ChatGPT--e.g. https://www.reddit.com/r/ChatGPT/comments/1idqi7p/deepseek_a...

              That's n=1 nonsense, not evidence. GPT contamination was everywhere, even Claude used to claim to be GPT-3 occasionally, or Reddit Anti-Evil Team. (yes, really) All models have overlapping datasets that are also contaminated with previous models outputs, and mode collapse makes them converge on similar patterns which seem to come and go with each generation.

              [1] https://www.globaltimes.cn/page/202501/1327676.shtml

              [2] https://huggingface.co/deepseek-ai/deepseek-math-7b-rl

          • moralIsYouLie
            24 minutes ago
            corporate espionage was my first thought back then. unfolding events since indicate that it wasn't theft but part of a deal. the magic math seems to check out, too
        • pylotlight
          10 hours ago
          which of the 5-10~ papers DS published were stolen exactly..?
          • epsteingpt
            9 hours ago
            Industrial-scale national government-sponsored IP theft is one of the most well-documented phenomenon in modern business, and comments like these appear all the time...

            c.f. - https://www.bbc.com/news/world-asia-china-64206950

            Cursory searches provide ample evidence of the ongoing commitment: * The House Homeland Security Committee's February 2025 China Threat Snapshot reports over 60 CCP-linked espionage cases from 2021-2024 across 20 states, with FBI data showing 80% of U.S. economic espionage prosecutions benefiting China and a China nexus in 60% of trade secret thefts, equating to $4,000-6,000 per American family. Rock-solid 2024-2025 examples include Ji Wang's November 2025 conviction for stealing DARPA fiber laser trade secrets worth millions for Chinese entities; Linwei Ding's March 2024 indictment for pilfering Google's AI algorithms to launch a PRC startup; and the Pangang Group's April 2025 Ninth Circuit ruling upholding charges for economic espionage in stealing DuPont's titanium dioxide production secrets.

            Each of these cases requires meticulous and expensive documentation to prove, in a court of law with people tasked in defending their innocence.

            You can be absolutely sure there is IP theft going on - even if the U.S. can't 'prove' it

    • mapmeld
      19 hours ago
      Well it's cool that they released a paper, but at this point it's been 11 months and you can't download a Titans-architecture model code or weights anywhere. That would put a lot of companies up ahead of them (Meta's Llama, Qwen, DeepSeek). Closest you can get is an unofficial implementation of the paper https://github.com/lucidrains/titans-pytorch
      • alyxya
        18 hours ago
        The hardest part about making a new architecture is that even if it is just better than transformers in every way, it’s very difficult to both prove a significant improvement at scale and gain traction. Until google puts in a lot of resources into training a scaled up version of this architecture, I believe there’s plenty of low hanging fruit with improving existing architectures such that it’ll always take the back seat.
        • p1esk
          15 hours ago
          Until google puts in a lot of resources into training a scaled up version of this architecture

          If Google is not willing to scale it up, then why would anyone else?

          • 8note
            9 hours ago
            chatgpt is an example on why.
        • tyre
          14 hours ago
          Google is large enough, well-funded enough, and the opportunity is great enough to run experiments.

          You don't necessarily have to prove it out on large foundation models first. Can it beat out a 32b parameter model, for example?

          • swatcoder
            14 hours ago
            Do you think there might be an approval process to navigate when experiments costs might run seven or eight digits and months of reserved resources?

            While they do have lots of money and many people, they don't have infinite money and specifically only have so much hot infrastructure to spread around. You'd expect they have to gradually build up the case that a large scale experiment is likely enough to yield a big enough advantage over what's already claiming those resources.

            • dpe82
              3 hours ago
              I would imagine they do not want their researchers unnecessarily wasting time fighting for resources - within reason. And at Google, "within reason" can be pretty big.
              • howdareme
                28 minutes ago
                I mean looking antigravity, jules & gemini cli, they have have no problem with their developers fighting for resources
        • m101
          10 hours ago
          Prove it beats models of different architectures trained under identical limited resources?
        • nickpsecurity
          12 hours ago
          But, it's companies like Google that made tools like Jax and TPU's saying we can throw together models with cheap, easy scaling. Their paper's math is probably harder to put together than an alpha-level prototype which they need anyway.

          So, I think they could default on doing it for small demonstrators.

        • UltraSane
          17 hours ago
          Yes. The path dependence for current attention based LLMs is enormous.
          • patapong
            15 hours ago
            At the same time, there is now a ton of data for training models to act as useful assistants, and benchmarks to compare different assistant models. The wide availability and ease of obtaining new RLHF training data will make it more feasible to build models on new architectures I think.
      • root_axis
        15 hours ago
        I don't think the comparison is valid. Releasing code and weights for an architecture that is widely known is a lot different than releasing research about an architecture that could mitigate fundamental problems that are common to all LLM products.
      • SilverSlash
        10 hours ago
        The newer one is from late May: https://arxiv.org/abs/2505.23735
      • informal007
        19 hours ago
        I don't think model code is a big deal compared to the idea. If public can recognize the value of idea 11 months ago, they could implement the code quickly because there are so much smart engineers in AI field.
        • jstummbillig
          19 hours ago
          If that is true, does it follow this idea does not actually have a lot of value?
          • fancy_pantser
            17 hours ago
            Student: Look, there’s hundred dollar bill on the ground! Economist: No there isn’t. If there were, someone would have picked it up already.

            To wit, it's dangerous to assume the value of this idea based on the lack of public implementations.

            • dotancohen
              1 hour ago
              In my opinion, a refined analogy would be:

              Student: Look, a well known financial expert placed what could potentially be a hundred dollar bill on the ground, other well-known financial experts just leave it there!

            • lukas099
              16 hours ago
              If the hundred dollar bill was in an accessible place and the fact of its existence had been transmitted to interested parties worldwide, then yeah, the economist would probably be right.
            • NavinF
              13 hours ago
              That day the student was the 100th person to pick it up, realize it's fake, and drop it
        • mapmeld
          17 hours ago
          Well we have the idea and the next best thing to official code, but if this was a big revelation where are all of the Titan models? If this were public, I think we'd have a few attempts at variants (all of the Mamba SSMs, etc.) and get a better sense if this is valuable or not.
      • mupuff1234
        6 hours ago
        > it's been 11 months

        Is that supposed to be a long time? Seems fair that companies don't rush to open up their models.

      • innagadadavida
        14 hours ago
        Just keep in mind it is performance review time for all the tech companies. Their promotion of these seems to be directly correlated with that event.
      • AugSun
        9 hours ago
        Gemini 3 _is_ that architecture.
        • FpUser
          8 hours ago
          I've read many very positive reviews about Gemini 3. I tried using it including Pro and to me it looks very inferior to ChatGPT. What was very interesting though was when I caught it bullshitting me I called its BS and Gemini expressed very human like behavior. It did try to weasel its way out, degenerated down to "true Scotsman" level but finally admitted that it was full of it. this is kind of impressive / scary.
    • bluecoconut
      18 hours ago
      Bytedance is publishing pretty aggressively.

      Recently, my favorite from them was lumine: https://arxiv.org/abs/2511.08892

      Here's their official page: https://seed.bytedance.com/en/research

    • govping
      2 hours ago
      Working with 1M context windows daily - the real limitation isn't storage but retrieval. You can feed massive context but knowing WHICH part to reference at the right moment is hard. Effective long-term memory needs both capacity and intelligent indexing.
    • Hendrikto
      20 hours ago
      Meta is also being pretty open with their stuff. And recently most of the Chinese competition.
      • okdood64
        20 hours ago
        Oh yes, I believe that's right. What's some frontier research Meta has shared in the last couple years?
        • markisus
          20 hours ago
          Their VGGT, Dinov3, and segment anything models are pretty impressive.
        • robrenaud
          20 hours ago
          Anything with Jason Weston as a coauthor tends to be pretty well written/readable and often has nice results.
        • colesantiago
          20 hours ago
          Take a look at JEPAs (Video Joint Embedding Predictive Architecture), SAM (Segment Anything), etc for Meta's latest research.

          https://ai.meta.com/vjepa/

          https://ai.meta.com/sam2/

          https://ai.meta.com/research/

        • UltraSane
          17 hours ago
          Meta just published Segment Anything 3 and along with a truly amazing version that can create 3D models posing like the people in a photo. It is very impressive.
        • tonyhart7
          20 hours ago
          "What's some frontier research Meta has shared in the last couple years?"

          the current Meta outlook is embarassing tbh, the fact they have largest data of social media in planet and they cant even produce a decent model is quiet "scary" position

          • nl
            3 hours ago
            Llama 4 wasn't great, but Llama 3 was.

            Do we all forget how bad GPT 4.5 was?

            OpenAI got out of that mess with some miraculous post-training efforts on their older GPT-4o model.

            But in a different timeline we are all talking about how great Llama 4.5 is and how OpenAI needs to recover from the GPT 4.5 debacle.

          • johnebgd
            19 hours ago
            Yann was a researcher not a productization expert. His departure signals the end of Meta being open about their work and the start of more commercial focus.
          • mirekrusin
            19 hours ago
            Just because they are not leading current sprint of maximizing transformers doesn't mean they're not doing anything.

            It's not impossible that they asses it as local maximum / dead end and are evaluating/training something completely different - and if it'll work, it'll work big time.

          • astrange
            18 hours ago
            Just because they have that doesn't mean they're going to use it for training.
            • bdangubic
              18 hours ago
              oh man… just because they have data doesn’t mean they will serve you ads :) Geeeez
            • tonyhart7
              17 hours ago
              "Just because they have that doesn't mean they're going to use it for training."

              how noble is Meta upholding a right moral ethic

              /s

              • astrange
                14 hours ago
                A very common thing people do is assume a) all corporations are evil b) all corporations never follow any laws c) any evil action you can imagine would work or be profitable if they did it.

                b is mostly not true but c is especially not true. I doubt they do it because it wouldn't work; it's not high quality data.

                But it would also obviously leak a lot of personal info, and that really gets you in danger. Meta and Google are able to serve you ads with your personal info /because they don't leak it/.

                (Also data privacy laws forbid it anyway, because you can't use personal info for new uses not previously agreed to.)

          • DrewADesign
            19 hours ago
            I’ve long predicted that this game is going to be won with product design rather than having the winning model; we now seem to be hitting the phase of “[new tech] mania” where we remember that companies have to make things that people want to pay more money for than it costs to make them. I remember (maybe in the mid aughts) when people were thinking Google might not ever be able to convert their enthusiasm into profitability…then they figured out what people actually wanted to buy, and focused on that obsessively as a product. Failing to do that will lead to failure go for the companies like open AI.

            Sinking a bazillion dollars into models alone doesn’t get you shit except a gold star for being the valley’s biggest smartypants, because in the product world, model improvements only significantly improve all-purpose chatbots. The whole veg-o-matic “step right up folks— it slices, it dices, it makes julienne fries!” approach to product design almost never yields something focused enough to be an automatic goto for specific tasks, or simple/reliable enough to be a general purpose tool for a whole category of tasks. Once the novelty wears off, people largely abandon it for more focused tools that more effectively solve specific problems (e.g. blender, vegetable peeler) or simpler everyday tools that you don’t have to think about as much even if they might not be the most efficient tool for half your tasks (e.g. paring knife.) Professionals might have enough need and reason to go for a really great in-between tool (e.g mandolin) but that’s a different market, and you only tend to get a limited set of prosumers outside of that. Companies more focused on specific products, like coding, will have way more longevity than companies that try to be everything to everyone.

            Meta, Google, Microsoft, and even Apple have more pressure to make products that sanely fit into their existing product lines. While that seems like a handicap if you’re looking at it from the “AI company” perspective, I predict the restriction will enforce the discipline to create tools that solve specific problems for people rather than spending exorbitant sums making benchmark go up in pursuit of some nebulous information revolution.

            Meta seems to have a much tougher job trying to make tools that people trust them to be good at. Most of the highest-visibility things like the AI Instagram accounts were disasters. Nobody thinks of Meta as a serious, general-purpose business ecosystem, and privacy-wise, I trust them even less than Google and Microsoft: there’s no way I’m trusting them with my work code bases. I think the smart move by Meta would be to ditch the sunk costs worries, stop burning money on this, focus on their core products (and new ones that fit their expertise) and design these LLM features in when they’ll actually be useful to users. Microsoft and Google both have existing tools that they’ve already bolstered with these features, and have a lot of room within their areas of expertise to develop more.

            Who knows— I’m no expert— but I think meta would be smart to try and opt out as much as possible without making too many waves.

            • raw_anon_1111
              15 hours ago
              My thesis is the game is going to be won - if you define winning as a long term profitable business - by Google because they have their own infrastructure and technology not dependent on Nvidia, they have real businesses that can leverage AI - Google Search, YouTube and GCP - and they aren’t burning money they don’t have.

              2nd tier winner is Amazon for the same reasons between being able to leverage AI with both Amazon Retail and AWS where they can sell shovels. I’ve also found their internal Nova models to be pretty good for my projects.

              Microsoft will be okay because of Azure and maybe Office if they get their AI story right.

              I just don’t see any world where OpenAI comes out ahead from a business standpoint as long as they are sharecroppers on other people’s hardware. ChatGPT alone will never make it worth the trillion dollar capitalization long term unless it becomes a meme stock like Tesla

              • DrewADesign
                10 hours ago
                Yeah that’s also about where I land.
            • robotresearcher
              17 hours ago
              If I was a Meta shareholder I might well agree with you. But as someone with very little interest in their products so far, I’m very happy for them to sink huge amounts of money into AI research and publishing it all.
              • DrewADesign
                11 hours ago
                I’m just calling balls and strikes. For all I care, the whole lot of them can get sucked down a storm drain. Frankly I think there’s way too much effort and resources being put into this stuff regardless of who’s doing it. We’ve got a bunch of agentic job stealers, a bunch of magic spam/slop generators, and a bunch of asinine toys with the big name LLM stuff: I don’t think that’s a net gain for humanity. Then there’s a bunch of genuinely useful things made by people who are more interested in solving real problems. I’ll care about the first category when it consistently brings more value than garbage “content” and job anxiety to average people’s lives.
            • tonyhart7
              17 hours ago
              never seen I say this but X(twitter) has more success in integrate their business product with AI (Grok)

              I know I know that Elon is crazy etc but Grok example and way to integrate with core product is actually the only ways I can even came up tbh (other than character.ai flavor)

              • DrewADesign
                11 hours ago
                Actually haven’t used it at all so that’s a big blind spot in my understanding of the ecosystem.
    • embedding-shape
      19 hours ago
      > Is there any other company that's openly publishing their research on AI at this level? Google should get a lot of credit for this.

      80% of the ecosystem is built on top of companies, groups and individuals publishing their research openly, not sure why Google would get more credit for this than others...

    • asim
      20 hours ago
      It was not always like this. Google was very secretive in the early days. We did not start to see things until the GFS, BigTable and Borg (or Chubby) papers in 2006 timeframe.
      • okdood64
        20 hours ago
        By 2006, Google was 8 years old. OpenAI is now 10.
      • vlovich123
        18 hours ago
        Google publishes detailed papers of its architecture once it’s built the next version.

        AI is a bit different.

      • rcpt
        16 hours ago
        Page Rank
    • hiddencost
      17 hours ago
      Every Google publication goes through multiple review. If anyone thinks the publication is a competitor risk it gets squashed.

      It's very likely no one is using this architecture at Google for any production work loads. There are a lot of student researchers doing fun proof of concept papers, they're allowed to publish because it's good PR and it's good for their careers.

      • hustwindmaple
        8 hours ago
        The amazing thing about this is the first author has published multiple high-impact papers with Google Research VPs! And he is just a 2nd-year PhD student. Very few L7/L8 RS/SWEs can even do this.
      • Balinares
        3 hours ago
        I mean, they did publish the word2vec and transformers papers, which are both of major significance to the development of LLMs.
      • jeffbee
        17 hours ago
        Underrated comment, IMHO. There is such a gulf between what Google does on its own part, and the papers and source code they publish, that I always think about their motivations before I read or adopt it. Think Borg vs. Kubernetes, Stubby vs. gRPC.
    • cubefox
      19 hours ago
      The author is listed as a "student researcher", which might include a clause that students can publish their results.

      Here is a bit more information about this program: https://www.google.com/about/careers/applications/jobs/resul...

    • nickpsecurity
      12 hours ago
      Arxiv is flooded with ML papers. Github has a lot of prototypes for them. I'd say it's pretty normal with some companies not sharing for perceived, competitive advantage. Perceived because it may or may not be real vs published prototypes.

      We post a lot of research on mlscaling sub if you want to look back through them.

      https://www.reddit.com/r/t5_3bzqh1/s/yml1o2ER33

    • timzaman
      16 hours ago
      lol you don't get it. If it's published it means it's not very useful
      • okdood64
        9 hours ago
        What about the Attention paper?
    • HarHarVeryFunny
      17 hours ago
      Maybe it's just misdirection - a failed approach ?

      Given the competitive nature of the AI race, it's hard to believe any of these companies are really trying to help the competition.

  • doctor_blood
    14 hours ago
    "At long last, we have created the Torment Nexus from the classic novel Don't Create the Torment Nexus"

    (In Eclipse Phase, TITAN - the Total Information Tactical Awareness Network - mulched humanity when it went rogue.)

    • esperent
      9 hours ago
      Hey it was my turn to post this quote today!
  • voodooEntity
    19 hours ago
    When i first read the papers for titans for me it was a "this will be a big step forward".

    While i have no "AI" title or work in the respective AI industry, ive spend many years thinking about AI concepts, even long before the whole NN/LLM hype started.

    Maybe because of that i was always really annoyed that LLM are called AI because in my years of thinking about how an actual "human like" thinking AI might work, the things an LLM does was far below what my minimum definition was.

    But when i stumbled accross the Titans paper, while it still is not an "AI" as i would call it, from my POV its a massive step towarsd the right direction.

    Sometimes i consider to write all my ideas/thoughts about AI down in my blog, but than i think nobody would care anyway since im not a known figure shrug - so if not to say "look i wrote it years ago!" theres no actual point in doing so i guess.

    However - im looking forward to see titans in action, and i guess it will impress us all.

    • chr15m
      12 hours ago
      Sharing it in your blog over a period of months or years is how you become a known figure eventually.
      • voodooEntity
        5 hours ago
        Well, prolly kinda true. Seems like should have started 10 years ago haha
        • Barbing
          3 hours ago
          Second best time today!
    • ocrow
      17 hours ago
      A lot of LLM/AI writing these days can feel lost in the weeds – the specifics of very detailed techniques are interesting undoubtedly, but writing that steps back and looks at the big picture, informed by those details, could be very useful for people who want to think about where this all may be going.
      • voodooEntity
        3 hours ago
        Thanks, and i gonne think about going for a writeup. As i mentioned in another comment, reading my previous comment back from yesterday i dont even know why i mentioned it - probably because i think so much about the topic but than i think "well your just a guy in a shed" type of thing and decide that prolly noone would care about what i would write. At all - if its just something i can look back onto im some years, prolly worth it.
    • Barbing
      17 hours ago
      Are you curious to see whether a blog post shared here might gain any traction and perhaps some valuable feedback?
      • voodooEntity
        5 hours ago
        Tbh, if i read back my comment from yesterday i don't even know exactly why i did mention that part. Sounds even to me like a "look at my blog" thingy which it definitely should not. Maybe some day ill give it a try and write something about my 'ideas' and drop it here. Tho not today (w0rk w0rk) ^
  • kgeist
    20 hours ago
    >The model uses this internal error signal (the gradient) as a mathematical equivalent of saying, "This is unexpected and important!" This allows the Titans architecture to selectively update its long-term memory only with the most novel and context-breaking information

    So one can break a model by consistently feeding it with random, highly improbable junk? Everything would be registered as a surprise and get stored, impacting future interactions

    • andy12_
      17 hours ago
      This is an oversimplification of what Titans does. The model performs nested learned, where the model learns during inference, and during training the model weights learn _how and what_ to learn during inference. If the input contains junk of irrelevant information, the model most likely learned during training to assign low surprise query and key embeddings to those tokens, because learning those junk tokens would have hurt the overall ability of the model to predict subsequent next tokens (and thus, it would have had increased the training loss).
    • pmichaud
      20 hours ago
      I’m guessing that this is the first thing they thought of and the problem only exists in the superficial gloss you’re responding to?
    • bethekidyouwant
      19 hours ago
      In what world can you not always break the response of an AI by feeding it a bunch of random junk?
      • xnx
        11 hours ago
        Indeed. In what world can you not break any tool when deliberately misusing it?
      • kgeist
        18 hours ago
        I mean, currently LLMs are stateless and you can get rid of all the poisoned data by just starting a new conversation (context). And OP introduces "long-term memory" where junk will accumulate with time
        • soerxpso
          15 hours ago
          I believe you're misunderstanding what the OP means about "long-term" memory. From what I can tell, it's not actively modifying the weights of the underlying model, it just "remembers" things from a high number of tokens into the past of its context. The point is that this allows it to remember something it read ~200 pages ago in a very long context window, not that it can remember something from one session into another clean session.
          • AlexCoventry
            10 hours ago
            This model has fast weights, which actually are modified during inference.
            • energy123
              9 hours ago
              Marketplace for fast weights inbound
        • dmix
          18 hours ago
          In something like Cursor if it messes something up your can click 'undo'. I'd imagine a small snapshot would only persisted to the memory if you keep it's output and even then it's mostly just a summary.

          There's probably lots of small signals of "the user is happy with the output" plus the longer the history the more it will converge on the middle of being what you want. Including when the user says "don't do [x]" which override past stuff.

      • CooCooCaCha
        18 hours ago
        I mean ideally AI would be resilient to junk, don't you think?
        • vlovich123
          18 hours ago
          Humans are pretty vulnerable to junk so I’m not sure.
        • amarant
          15 hours ago
          Ideally, you'd run your own instance of this, I think.

          I can see a product where you purchase a model that has basic training, and then, using the features outlined in the paper, it learns on the fly from your usage.

          I can also see there being a secondary market for specially trained models, long-term memory filled with some specific skill, done in some specific way. To make a silly example, imagine buying a licence to Torvald's OS coding assistant, ready to insult your prs before you even commit them!(And possibly help you write code in Torvald's style too)

          This would of course require Linus to use the model enough for it to learn,I won't comment on the likelihood of that happening: it's just a silly example after all

    • idiotsecant
      19 hours ago
      The is the start of what I always thought an AI should have - a limbic system. Humans don't store memory based on novelty, they store it based on emotional content. This is where I was afraid of the tiger, this is where I smelled delicious food, this was what it felt like when I was victorious in the hunt.

      AI needs an internal emotional state because that's what drives attention and memory. AI needs to want something.

      • luckydata
        19 hours ago
        That would be the biggest mistake anyone could do. I hope nobody goes down this route. AI "wanting" things are an enormous risk to alignment.
        • idiotsecant
          13 hours ago
          At some point I think we'll have to face the idea that any AI more intelligent than ourselves will by definition be able to evade our alignment tricks.
          • luckydata
            12 hours ago
            equating more intelligent to "wanting things" is a fallacy. You can have a hyper intelligent computer that simply waits for you to ask it to do a job, or you can endow it with the digital equivalent of hunger and reproductive instincts and it will behave completely differently.

            We would be INSANE to pursue giving that type of instincts to AIs.

            • drdeca
              3 hours ago
              For some senses of “wanting things”, I think it might be hard to make a powerful AI that couldn’t be easily modified to produce one that “wants things” in some sense.

              So, if it would be bad thing for one to be made that “wants things” in any reasonable sense of the phrase, then it would probably be bad for J Random to be able to take a copy of a powerful AI and modify it in some way, because someone is likely to try doing that.

              Of course, perhaps the best way to make sure that J Random doesn’t have the ability to do that, is to make sure no one does.

        • pixl97
          18 hours ago
          I mean setting any neural net with a 'goal' is really just defining a want/need. You can't just encode the entire problemspace of reality, you have to give the application something to filter out.
    • photochemsyn
      17 hours ago
      This is no different from what happens to humans if they're locked into cult programming situations, they'll start believing and regurgitating all kinds of nonsense if their information stream is tightly curated,

      Practically, for use with a codebase development effort, if the model remembers the original design decisions, the discussions about costs and benefits, then can remember all that much later in the process, it's going to start getting really good at thinking about what the next step is, or even to make decisions about when a major refactor is neede, etc.

  • nasvay_factory
    16 hours ago
    I wrote about that a while ago: https://paxamans.github.io/blog/titans/
    • moffkalast
      12 hours ago
      Are there any pretrained models with this architecture yet or is it all still completely theoretical beyond Google's unverifiable claims? They published the original Titans paper last year and nobody seems to have built on the idea.
  • olegjose
    32 minutes ago
    if you need a loan or a job , contact : lavingtonfinance@gmail.com
  • albert_e
    1 hour ago
    Amazon has a foundation model named Titan - mostly recommended for creating embeddings. Possible confusion in this space.
  • jonplackett
    20 hours ago
    I’m curious if this makes them more or less susceptible to prompt injection?

    On the one hand can learning on the job allow better training of what not to be influenced by, but on the other hand can an injected prompt have an even deeper effect on them long term.

  • dmix
    18 hours ago
    > The Transformer architecture revolutionized sequence modeling with its introduction of attention, a mechanism by which models look back at earlier inputs to prioritize relevant input data

    I've always wanted to read how something like Cursor manages memory. It seems to have developed a long history of all of prompts and understands both the codebase and what I'm building slightly more over time, causing less errors.

    • russdill
      18 hours ago
      That's not what they are talking about here. This is just a description of what goes on with a transformer and the context window
      • dmix
        18 hours ago
        Ah so 'long-term memory' in this case is just really large context windows with a long series of user inputs. That makes sense.
  • nubg
    20 hours ago
    Very interesting. Is it correct for me to imagine it as some kind of "LoRA" thats continuously adapted as the model goes through its day?

    If so, could there perhaps be a step where the LoRA is merged back into the main model?

    That would be like sleeping :-)

    • robrenaud
      20 hours ago
      I don't think that's a great analogy.

      LoRAs tend to be adapters bolted onto to systems by people other than the system designers, and they are low rank factorizations.

      There is nothing low rank or adapter here.

    • andy12_
      16 hours ago
      Kind-of. You could theoretically use LoRA for this, in fact, but it probably wouldn't have enough capacity to make it a proper substitute of the attention mechanism. Instead a full MLP is trained as input chunks get processed.
  • Alifatisk
    22 hours ago
    Titans: Learning to Memorize at Test Time https://arxiv.org/abs/2501.00663
  • bentt
    19 hours ago
    This just feels like a tremendous missing piece to LLMs. Looking forward to seeing it in action.
  • willangelo
    19 hours ago
    Very very interesting, definitely a missing piece in current AI space.

    Small typo where the text “Virtually all successful existing sequence models rely on mean squared error…” is repeated twice within the same paragraph. Happens to the best of us.

  • 6r17
    14 hours ago
    Would this also allow to align it furthermore with user's prompt ? notably due to the surprise factor and how it may understand it ?
  • cubefox
    19 hours ago
    It's interesting that they publish a blog post about the Titans and MIRAS papers only now, while the blog post about the new follow-up paper (Nested Learning), all by the same main author(!), came out a month ago: https://research.google/blog/introducing-nested-learning-a-n...
  • themgt
    20 hours ago
    See also Hope:

    In the previous sections, we first discussed Continuum Memory System (CMS) that allows for more persistent storage of memories and defines memory as a spectrum of blocks with different frequencies of update. Due to the larger capacity and constraints for scaling the parameters, often CMS requires simple learning rule but higher capacity to store more persistent knowledge. On the other hand, in the previous section, we discussed the design of a self-modifying Titans, where it can generate its own keys and so learning update to better adapt to the context. Contrary to CMS, the self-modifying Titans has a small capacity but is using a complex and expressive learning rule. Accordingly, these two systems seem to be complementary and their combination can enhance the model expressiveness from different aspects.

    To this end, we present Hope architecture: A neural learning module that incorporates self-modifying Titans followed by Continuum Memory System.

    https://research.google/blog/introducing-nested-learning-a-n...

    • killerstorm
      19 hours ago
      For most papers, the main idea can be described in 1-2 sentences, sort of "we did X using Y".

      That doesn't work for HOPE - a short summary can't explain what it actually does besides "self-modifying" and "continuum memory".

      So it seems to be an innovation of Transformers calibre, really big (if true). It's definitely not "transformer but with such-and-such modification".

      Gemini came up with a following visual metaphor for the difference:

      > Transformer is a series of frozen glass panes (the weights) and a scratchpad (the attention) where it writes notes about the current text.

      > The HOPE architecture involves no scratchpad. Instead, the glass panes themselves are made of smart liquid. As the data flows through, the first pane reshapes itself instantly. The second pane reshapes itself slowly. And the mechanism deciding how to reshape them is itself a tiny, intelligent machine, not just a basic math rule.

      • chrisweekly
        17 hours ago
        +1 Insightful.

        This comment was illuminating -- and IMHO an excellent example of why it's important to avoid rigid rules against posting any AI-generated content in HN comments. You gained insights by asking Gemini, and shared them, noting the source. Thank you!

  • photochemsyn
    17 hours ago
    Long-term memory on top of the base model, but is this idea for local users or for the data-center hosted model used by many different people?

    P.S. This quote from the paper sounds just like LLM output:

    > "This memory module provides significantly higher expressive power, allowing the model to summarize large volumes of information without losing important context. The model isn't simply taking notes; it's understanding and synthesizing the entire story. Crucially, Titans doesn’t just passively store data. It actively learns how to recognize and retain important relationships and conceptual themes that connect tokens across the entire input."

  • bilsbie
    17 hours ago
    I submitted this exact url yesterday. What’s the criteria for when hn creates a new post vs going to the existing?
    • fancy_pantser
      17 hours ago
      Mods usually apply [Dupe] to later submissions if a recent (last year or so) one had a fair amount of discussion.
      • bilsbie
        14 hours ago
        So if mine got no discussion they just allow a new one to be posted?
        • airstrike
          13 hours ago
          Sometimes they'll merge the two. What shows up on the FP is hit or miss. One might even say it's stochastic.
          • xlbuttplug2
            11 hours ago
            I wonder if someone's looked into the optimal time of day and day of the week to post for maximum traction.

            If I had to guess it would be monday morning pacific time when people would rather be doing anything than working.

            • pylotlight
              10 hours ago
              Surely there's already stats on this or even a whole paper :P Could pull all dupe posts over time and see which ones are more popular etc.
  • riku_iki
    18 hours ago
    Post starts with wrong statement right away:

    "The Transformer architecture revolutionized sequence modeling with its introduction of attention"

    Attention was developed before transformers.

    • Alifatisk
      12 hours ago
      > Attention was developed before transformers.

      I just looked this up and it’s true, this changes the timeline I had in my mind completely! I thought the paper on Transformers is what also introduced the attention mechanism, but it existed before too and was applied on RNN encoder-decoder. Wow

  • shevy-java
    13 hours ago
    Skynet kind of sucks ...
  • AceJohnny2
    14 hours ago
    "Titans", huh?

    ... anyone here familiar with the RPG Eclipse Phase?

    • cess11
      14 hours ago
      I'm not, but I'm familiar with the mythology of the eastern Mediterranean they're likely getting the word from.

      There the titans did incest, birthed the olympians, then the youngest of the titans castrated his dad and took all power for himself, and then Zeus and the olympians waged a decade long war against him which they won.

  • ivape
    12 hours ago
    So what happens if I write a book and on the last page write "Everything in this book was a lie and should not be cared about"? Will this be surprising enough for Titan? A regular LLM may ignore it completely if it's a massive book (massive book + 1 line contradiction).
  • jtrn
    14 hours ago
    Here is my amateur understanding of the architecture: Fine-tune on the fly by using degrees of surprise to update a separate/new memory network that matches the base model, and just call that network for each token iteration.

    So if we are viewing this through the needle in hey stack lens: The needle was very surprising for the base model, so going forward, when it see anything of the same nature, the memory module will not just give you hay, but the needle, because it made a special note of it when it went through the haystack 1 million tokens ago, because the needle was surprising.

    The Transformer's normal attention mechanism is already secretly trying to be a long-term memory system. Every time it writes a new KV pair into the cache, it’s desperately trying to “remember” that token forever.

    But it’s doing it in the dumbest possible way: by hoarding an ever-growing pile of raw vectors, then frantically dot-product searching through the pile every single step. It’s like a hoarder who never throws anything away and has to rummage through mountains of junk to find the one receipt they need. Of course it chokes at long contexts.

    Titans/MIRAS looks at that mess and says: “Why store memory in a growing garbage pile of vectors? Store it in the weights of a deep neural network instead — and let that network keep training itself in real time, but only on the stuff that actually surprises it.” That’s literally it.

    Using the Tim Cook Martian example: The model is cruising through boring financial numbers → attention is doing its normal thing, KV cache is growing, but nothing is really sticking.

    Suddenly: “Tim Cook is a Martian.”

    Normal attention would just add one more KV pair to the pile and pray it doesn’t get drowned out later.

    Titans instead goes: “Holy shit, reconstruction error off the charts → this does NOT fit my current memory at all → massive gradient → actually rewrite huge chunks of the memory MLP’s weights right now so this fact is burned in forever.”

    From that moment on, the memory MLP has physically changed its internal wiring. Any future query that even vaguely smells like “Tim Cook” or “Martian” will make the activations explode through the newly rewired paths and spit out a vector screaming “MARTIAN” at the frozen attention layers.

    The frozen attention (which is still doing its normal job on the short window) suddenly sees this one extra “virtual token” in its context that is confidently yelling the surprising fact → it attends hard to it → the model answers as if the Martian revelation happened one token ago, even if it was 2 million tokens back.

    It looks exactly like a super-attention mechanism that only “primes” or “locks in” the surprising needles and deliberately forgets or ignores the hay. And it is also a way to fine tune one the fly permanently for the current context.

    I think…

  • YouAreWRONGtoo
    14 hours ago
    [dead]
  • Mistletoe
    20 hours ago
    This is the one thing missing from my interactions with AI. If successful, this will change everything. If you thought people were getting AI boyfriends and girlfriends before, wait until you see this.
    • astrange
      18 hours ago
      One important thing missing from AI boyfriends is they aren't capable of paying half your rent.
      • pixl97
        17 hours ago
        Na, we'll get micro cube houses first with shared bathrooms/kitchens and everyone will just be in their room with their VR helmet on not reacting with anyone else real.
        • astrange
          14 hours ago
          I think it's interesting that people associate being in VR with being unable to interact with other people. I personally think it promotes living with other people because it reduces conflict.

          Like, if you and your kids want to watch different movies on the living room TV then you can just give it to them and use XR glasses for yourself.

          • fredrikholm
            14 hours ago

              unable to interact with other people
            
              just give it to them and use XR glasses for yourself
            • astrange
              12 hours ago
              Fighting with your kids is not the appropriate kind of interaction to have with your kids.
              • fredrikholm
                2 hours ago
                As an adult you have the luxury of not living in a false dichotomy where the only two options are VR or fighting.

                As a parent you have the responsibility of spending time with the kids when they're young. You can watch your shows later.

          • airstrike
            13 hours ago
            Reducing conflict to zero is not a goal we should pursue.
            • astrange
              12 hours ago
              Ever tried sleeping in bed while someone next to you is on their phone? It's not the kind of conflict you should promote. XR glasses are better in that case because the glare doesn't affect other people.
              • airstrike
                7 hours ago
                we usually both agree it's time to go to bed and put phones away

                but either way, giving up our humanity to browse longer without disturbing others is not exactly a wonderful trade

        • Barbing
          17 hours ago
          Catch me on Veelox
      • DoctorOetker
        18 hours ago
        They could help figure out a way to earn money with a webcam...
        • astrange
          14 hours ago
          If it's AGI they could just get a regular job, I think.