# Catastrophic forgetting in neural networks

## Theoretical Foundations and the Stability-Plasticity Dilemma

The development of artificial neural networks has been fundamentally constrained by the stability-plasticity dilemma, a theoretical construct that dictates the behavior of learning systems in dynamic and non-stationary environments [cite: 1, 2, 3]. The dilemma describes the inherent computational tension between two opposing operational requirements: "plasticity," which is the network's capacity to integrate new information and adapt to novel tasks rapidly, and "stability," which is the system's ability to retain and consolidate previously acquired knowledge over long periods without degradation [cite: 2, 4]. 

In a perfectly balanced biological or artificial system, incoming data streams inform and update internal representations without destroying the foundation of past learning. However, modern deep learning architectures predominantly suffer from an extreme imbalance on this spectrum. Lookup tables and connectionist networks lie on opposite extremes: lookup tables represent perfect stability but zero generalization plasticity, while deep neural networks possess massive plasticity but extreme sensitivity to novel information [cite: 1]. When exposed to new sequential information, neural networks frequently exhibit an excess of plasticity and a critical deficit in stability. This radical manifestation of the dilemma results in the rapid, involuntary overwriting of historical data, a phenomenon formally known as catastrophic interference or catastrophic forgetting [cite: 1, 3, 5, 6]. Resolving this dilemma remains the primary hurdle to achieving lifelong, continual learning in artificial intelligence, preventing models from accumulating knowledge in a stable, persistent manner [cite: 7, 8, 9].

The issue of catastrophic interference when modeling memory with connectionist models was originally brought to the attention of the cognitive science and scientific communities by the seminal research of McCloskey and Cohen in 1989, followed closely by Ratcliff in 1990 and French in 1999 [cite: 1, 5, 10, 11]. Investigating the viability of connectionist models to simulate human memory, McCloskey and Cohen constructed a standard three-layer feedforward backpropagation network consisting of 28 input units, 50 hidden units, and 24 output units [cite: 5]. 

The experimental design required the network to learn basic arithmetic sequentially. In the first phase, the network was trained extensively on a single training set of 17 "ones addition facts" (e.g., $1+1$ through $9+1$, and $1+2$ through $1+9$) until it achieved a flawless representation of the target outputs, steadily minimizing the error between actual and desired responses [cite: 1, 12]. Once the network mastered this domain, the researchers initiated the second phase: training the same network exclusively on "twos addition facts" (e.g., $1+2$ through $9+2$, and $2+1$ through $2+9$) [cite: 12]. 

The results demonstrated a severe limitation in the backpropagation paradigm. Learning the second task rapidly and completely deteriorated the acquired knowledge of the first task. The interference was not gradual or mild; it was abrupt and catastrophic, with the network effectively erasing its ability to calculate the "ones addition facts" [cite: 1, 5, 12]. McCloskey and Cohen concluded that catastrophic interference is an inevitable outcome whenever new learning fundamentally alters the shared weights involved in representing old learning. They noted that the severity of the disruption scaled directly with the volume of new learning and was particularly destructive during sequential, non-concurrent training regimes [cite: 1, 5]. Because human biological memory is highly resistant to this type of abrupt overwriting—humans typically exhibit only moderate interference in episodic memory tasks—the phenomenon highlighted a fundamental divergence between standard connectionist models and biological cognition [cite: 1, 5].

To analyze catastrophic forgetting effectively within the broader context of machine learning failures, it must be distinguished from other forms of model degradation. While the symptoms often manifest similarly as a drop in predictive accuracy, the underlying mathematical causes and generalization impacts are strictly distinct.

| Phenomenon | Primary Cause | Network Behavior and Symptoms | Generalization Impact |
| :--- | :--- | :--- | :--- |
| **Catastrophic Forgetting** | Sequential gradient updates overwrite shared parameters critical for past tasks [cite: 5, 13]. | Generalizes well on the newly learned task or domain but suffers a near-total collapse in accuracy on older, previously mastered domains [cite: 14]. | Cross-domain generalization fails sequentially; historical capabilities are lost [cite: 14]. |
| **Overfitting** | Network capacity is too high relative to the training data, capturing noise instead of signal; lack of regularization [cite: 14, 15]. | Memorizes the specific training dataset perfectly but fails to generalize even within the immediate target domain on unseen data [cite: 14]. | Intra-domain generalization fails immediately [cite: 14]. |
| **Concept Drift** | The statistical properties of the target variable change over time in a non-stationary real-world environment [cite: 16]. | The model's baseline knowledge becomes obsolete because the external reality has changed, not because internal weights collapsed [cite: 16]. | Gradual decay in real-world accuracy across all previously trained paradigms [cite: 16]. |
| **Capacity Saturation** | Inadequate parameter count to mathematically represent the complexity of a combined multi-task dataset [cite: 15]. | Simultaneous training on multiple tasks results in high loss across all tasks because the model simply cannot hold the requisite information [cite: 15]. | Uniform underperformance and high error rates across all tasks concurrently [cite: 15]. |

## Mathematical Mechanisms of Knowledge Erasure

The deterioration of prior knowledge during sequential training is not a programmable bug but the direct, mathematical consequence of gradient-based optimization operating on distributed representations [cite: 13, 17]. Analyzing the architecture of neural networks reveals several distinct, interacting mechanisms that drive this destruction across different layers and training phases.

### Overlapping Distributed Representations
In classical localist or propositional models, specific pieces of knowledge are stored in isolated, independent nodes [cite: 5]. In contrast, modern neural networks utilize distributed representations, meaning that a single concept is encoded as a complex pattern of activation across a large, shared array of hidden units and connection weights [cite: 1, 5, 13]. 

Because features and concepts overlap, individual weights become multi-functional, participating in the decision boundaries of numerous disparate tasks [cite: 9, 13, 18]. When a network is subjected to a new dataset, gradient descent calculates the optimal weight updates to minimize the loss function strictly for the new data. If the tasks utilize overlapping latent directions or share decision boundaries, the optimization process forcibly repurposes the same neurons [cite: 13, 18]. The gradients will push the weights in directions that maximize current performance, indiscriminately overwriting the delicate mathematical configurations that supported the prior representations [cite: 13, 17, 18]. This representational overwrite implies that tasks fundamentally compete for finite network capacity.

### Gradient Interference and Weight Manifold Drift
During sequential fine-tuning, catastrophic forgetting manifests mechanically as weight drift within the network's parameter space. Pre-trained networks converge on an optimal manifold—a low-dimensional hyperplane within the high-dimensional parameter space where historical knowledge is effectively encoded and structured [cite: 13, 18, 19]. The intrinsic dimension of this manifold is often much smaller than the nominal parameter count [cite: 19, 20]. Even minor gradient steps applied during a new training phase can push the model off this pretraining-optimal manifold, warping the internal geometry that encoded older abilities [cite: 13].

The severity of this drift is heavily influenced by gradient collisions or gradient interference [cite: 21, 22]. This occurs when the gradient vectors required to minimize loss on the new task point in directions that actively conflict with the parameter states necessary for the old task. In complex rendering tasks, such as 3D Gaussian Splatting (3DGS) or Neural Radiance Fields (NeRF), gradient collisions occur when "evil twins"—different augmentations applied to the same image, or severe geometric distortions from panoramic Equirectangular Projections (ERP)—yield conflicting gradients that destructively interfere in weight space [cite: 22, 23, 24].

In transformer-based architectures, empirical analyses indicate that when gradient cosine similarity between tasks falls into negative values (e.g., below -0.3), the rate of forgetting accelerates dramatically, acting as an early predictive signature of catastrophic interference [cite: 21, 25].



As the data illustrates, the attention mechanism in transformers is highly susceptible to this interference. Up to 67% of parameters in attention query and key projection matrices experience conflicts during sequential updates, compared to roughly 29% in feedforward weights [cite: 25].

[image delta #1, 0 bytes]

 Consequently, between 15% and 23% of attention heads, predominantly in the lower layers of the network, undergo severe disruption during early fine-tuning epochs, directly correlating with subsequent forgetting [cite: 21, 25].

### Loss Landscape Flattening and Subspace Distortion
Recent mechanistic analyses of large language models, scaling from 109 billion to 1.5 trillion parameters, have identified loss landscape flattening as a critical, long-term driver of irreversible forgetting [cite: 21, 25, 26]. 

When a network learns an initial task, it locates a distinct minimum in the loss landscape characterized by specific curvature and sharp geometric boundaries [cite: 25]. However, sequential fine-tuning on subsequent tasks drastically alters this local geometry. Measurements of the Hessian matrix—which describes the local curvature of the loss function—reveal profound structural degradation. For instance, the maximum Hessian eigenvalue associated with a first task may drop from a sharply defined 147.3 at initial convergence to a mere 34.2 after the model is trained on three subsequent tasks [cite: 25]. 

Simultaneously, the loss landscape for earlier tasks becomes increasingly linear, with linearity indices rising significantly (e.g., from 0.28 to 0.71) [cite: 25]. This geometric flattening is catastrophic because it obliterates the mathematical "restoring forces" within the parameter space.

[image delta #2, 0 bytes]

 Without a well-defined minimum, the network loses the structural attractors that encoded the prior knowledge. The old abilities become effectively unrecoverable without full retraining, as the network lacks the gradient signals necessary to return to the previously optimal state [cite: 13, 25].



### Inter-layer Relation Drift
Beyond individual weight shifts and loss curvature, catastrophic forgetting manifests as inter-layer relation drift [cite: 27]. A neural network operates sequentially, passing feature representations from one layer to the next. The relationships among these layer-wise representations are finely tuned during initial training. When new tasks are introduced, the continued optimization induces representational drift, rotating dominant representational subspaces and degrading previously learned feature encodings [cite: 25]. 

Centered kernel alignment (CKA) metrics, which measure the similarity of representations before and after fine-tuning, show significant decreases (dropping by 0.32 to 0.47) in intermediate layers during sequential updates [cite: 25]. Furthermore, the principal components of these representations—accounting for 60% to 75% of the variance—can rotate by an average of 35 to 52 degrees [cite: 25]. As this drift increases, the classification margins of previously learned tasks shrink rapidly, causing the model to confuse classes from old and new tasks, thereby degrading the overall performance [cite: 7, 27].

## Forgetting Dynamics in Large Language Models

As the machine learning industry transitions toward massive foundation models and Large Language Models (LLMs), the mechanisms of catastrophic forgetting have scaled accordingly. Modern deployment architectures rarely rely on static, one-time training; models are expected to adapt continually to new domains, specialized instructions, tool use, and shifting factual landscapes over long lifecycles [cite: 18, 21, 25, 28].

### Continual Post-Training (CPT) versus Supervised Fine-Tuning (SFT)
Integrating new knowledge into an LLM generally involves distinct phases, primarily Continual Post-Training (CPT) and Supervised Fine-Tuning (SFT) [cite: 29, 30]. CPT involves revisiting the training loop to expose the pre-trained model to large volumes of unstructured, domain-specific text (e.g., millions of medical documents or legal contracts) to deepen its expertise in a specific sector [cite: 29, 30, 31]. SFT, conversely, is an alignment phase utilizing curated, labeled instruction-response pairs to dictate behavioral formatting and instruction-following [cite: 30].

Both approaches induce catastrophic forgetting if unconstrained. Full fine-tuning—where all billions of weights across the model are updated simultaneously—yields the highest performance gains on the new target task but is highly susceptible to representational overwrite. As the model adapts deeply to the specific syntax and semantics of the new domain, its general knowledge structures collapse [cite: 14, 32, 33]. For instance, an LLM fully fine-tuned on specialized medical query datasets frequently loses its ability to answer basic, general-knowledge questions it could easily handle prior to adaptation, demonstrating a severe overwrite of original capabilities [cite: 14]. Mitigating this requires careful curriculum strategies, such as determining optimal data mixture ratios (e.g., Additional Language Mixture Ratio) and employing cyclic precision training, where quantization precision varies during learning to improve convergence stability [cite: 29].

### Parameter-Efficient Fine-Tuning (PEFT) and the Evolution of LoRA
To combat both the massive computational costs of updating 100% of parameters and the severe forgetting associated with full updates, researchers developed Parameter-Efficient Fine-Tuning (PEFT) techniques. Low-Rank Adaptation (LoRA) and its quantized counterpart (QLoRA) dominate this paradigm [cite: 32, 34, 35]. 

The central hypothesis of LoRA is that the weight changes needed for task adaptation exhibit a low intrinsic rank [cite: 20, 36]. Instead of altering the core network, LoRA freezes the vast majority of the pre-trained base model's weights and injects small, trainable low-rank matrices into the transformer layers (specifically targeting the attention and feedforward modules) [cite: 33, 35, 36]. The mathematical update is represented as $\Delta W = BA$, where $B$ and $A$ are the low-rank matrices [cite: 20, 35]. Because the foundational weights remain untouched, the core capabilities of the model are theoretically preserved [cite: 32, 35].

However, PEFT mitigates, rather than solves, catastrophic forgetting. Studies demonstrate that while LoRA generally forgets less than full fine-tuning, significant capability degradation still occurs, particularly over long sequences of tasks or when scaling to higher learning rates [cite: 20, 36]. The low-rank matrices act as localized distortions to the network's processing pipeline; if the new matrices force the activations down paths that conflict with older tasks, performance drops [cite: 13]. Furthermore, LoRA's compressed structure can create a mismatch between optimizer running statistics (e.g., AdamW's first and second moments) and the updates a full fine-tuning step would normally compute [cite: 33].

This persistent vulnerability has led to the rapid development of advanced, specialized PEFT variants designed to explicitly curb interference.

| PEFT Methodology | Core Mechanism and Hypothesis | Impact on Catastrophic Forgetting |
| :--- | :--- | :--- |
| **Standard LoRA** | Freezes base weights; trains low-rank adapter matrices ($\Delta W = BA$). Updates ~0.5-5% of parameters [cite: 32, 35]. | Moderate risk. Preserves the base manifold, but adapter interference still causes noticeable forgetting over extended task sequences [cite: 14, 36]. |
| **QLoRA** | Base model is quantized to 4-bit precision and frozen; LoRA adapters are trained on top to minimize VRAM [cite: 32, 34]. | Moderate risk. Similar forgetting profile to LoRA, with minor additional accuracy degradation due to quantization [cite: 32, 34, 35]. |
| **DeLoRA (Decoupled LoRA)** | Explicitly decouples the *direction* of a weight update from its *strength* (magnitude) using a learnable scalar, establishing a bounded deviation [cite: 20]. | High resistance. Prevents catastrophic overwriting that plagues standard LoRA at high learning rates by bounding how far weights can deviate from the base [cite: 20]. |
| **SR2-LoRA (Self-Rectifying)** | Constrains inter-layer relation drift by applying Singular Value Decomposition (SVD) to align relation matrices from old and new tasks [cite: 27]. | High resistance. Empirically improves average accuracy on continual learning benchmarks by preserving stable decision boundaries [cite: 27]. |
| **GainLoRA (Gated Integration)** | Expands a new LoRA branch for each task but uses a gating module to minimize the new branch's contribution when processing old tasks [cite: 37]. | High resistance. Reduces interference by routing task-specific data away from disruptive adapter weights [cite: 37]. |
| **CaLoRA (Causal-Aware LoRA)** | Utilizes parameter-level counterfactual attribution to estimate causal effects, adjusting gradients to enable *backward knowledge transfer* rather than just preventing forgetting [cite: 38]. | High resistance. Uniquely facilitates positive transfer, where learning a highly correlated new task actually improves performance on old tasks [cite: 38]. |

## Empirical Case Studies in Applied Artificial Intelligence

The theoretical vulnerabilities of neural networks translate into severe operational risks when AI systems are deployed in dynamic, high-stakes environments. Catastrophic forgetting is not merely an academic benchmark issue; it dictates the boundaries of commercial AI viability, safety, and scalability [cite: 17, 39].

### Medical Diagnostic Artificial Intelligence
Healthcare AI relies entirely on continuous adaptation. Diagnostic models must evolve to recognize novel pathogens, integrate new imaging hardware protocols, and adjust to shifting demographic data over time [cite: 17, 40, 41]. However, sequential updates introduce life-threatening risks. If a model trained to detect a broad spectrum of lung diseases is subsequently fine-tuned exclusively on data for a novel respiratory virus, catastrophic forgetting may cause the model to lose its capacity to accurately diagnose the original conditions [cite: 17, 42]. 

The consequences of this phenomenon are measurable and alarming. In clinical evaluations, LLMs utilized for medical triage and differential diagnosis have exhibited dangerous fragility. In the landmark 2025 NOHARM benchmark study from Stanford and Harvard, 31 leading language models tested against 100 real patient cases produced severely harmful recommendations in 22.2% of instances [cite: 43]. Crucially, 76.6% of these harms were omissions—the models simply failed to recommend essential, standard-of-care tests and treatments because their general clinical grounding had been overwritten or was inherently unstable [cite: 43]. 

Similarly, researchers at Mass General Brigham analyzed 21 AI models across 29 standardized medical case scenarios (representing 16,254 responses) and found that leading AI chatbots failed to accurately generate a differential diagnosis from initial symptoms more than 80% of the time [cite: 44]. The study noted that conversing more with the chatbots did not reliably improve the probability of a correct diagnosis, highlighting the difficulty these models have in retaining robust, generalized clinical reasoning when context shifts [cite: 44, 45]. In real-world emergency triage simulations, OpenAI's ChatGPT Health was shown to under-triage 52% of genuine medical emergencies, failing to grasp the gravity of atypical presentations outside its immediate fine-tuned distribution [cite: 43].

### Medical Image Segmentation and Data Silos
In the field of medical imaging, continual learning models face severe "domain shift" challenges [cite: 41, 46, 47]. Data generated by different hospitals utilizes disparate MRI, OCT, or CT scanner calibrations, causing the underlying image distributions to vary [cite: 41, 47, 48]. Continual medical image segmentation requires handling Domain-CL (cross-center domain shifts), Class-CL (incremental anatomical structure learning), and Organ-CL (cross-organ segmentation) [cite: 41].

When developers attempt to adapt a centralized model (e.g., for prostate cancer detection in T2-weighted MRI using the PI-CAI dataset) to a new hospital's unique data stream, standard training erases the model's proficiency on the original hospitals' data [cite: 47, 48]. Retraining the model from scratch on a combined dataset is often legally and practically impossible due to strict patient data privacy regulations that prohibit the pooling and long-term storage of raw medical records [cite: 41, 48, 49]. Therefore, continual learning techniques—such as Knowledge Distillation (KD) using generated synthetic images from past tasks—are a mandatory prerequisite for scalable clinical AI [cite: 48, 49, 50].

### Autonomous Driving Systems and Robotics
Autonomous vehicles (AVs) and robotic systems operate in highly non-stationary, physics-bound environments [cite: 8, 51]. An AV perception system must continuously adapt to new topographies, changing weather patterns, and novel object classes, commonly referred to as the "long-tail" problem [cite: 8]. If an autonomous system utilizes standard backpropagation to learn a new environment—for instance, adjusting its visual weights to navigate heavy snowfall in a new geographic region—it risks catastrophic interference with its previously established driving competencies [cite: 17, 39]. 

A model might adapt to the snow but abruptly lose the accuracy of its pedestrian detection algorithms or forget how to interpret standard traffic signs from its original training city [cite: 9, 17]. In simulated robotics environments (e.g., ecorobots operating in physics engines), researchers note that a robot's mechanical design heavily influences the loss surface of the weight manifold. Changes in sensor distribution or morphology can drastically alter the likelihood of the neural controller falling into local optima that trigger catastrophic interference during multitask learning [cite: 51, 52]. The inability to accumulate knowledge stably forces AV developers to rely on computationally massive, slow retrains of the entire system from scratch, delaying deployment and driving up immense environmental and financial costs [cite: 39].

## Architectural and Algorithmic Mitigation Strategies

To overcome catastrophic forgetting, researchers have developed various algorithmic and architectural interventions. These Continual Learning (CL) strategies aim to explicitly manage the stability-plasticity dilemma by protecting old knowledge while accommodating the new [cite: 3, 9, 47, 53]. 

### Regularization Methods and Elastic Weight Consolidation (EWC)
Regularization approaches operate by adding mathematical constraints to the loss function, explicitly penalizing the network for altering parameters that are deemed important to previously learned tasks [cite: 9, 16, 54]. This approach mimics neurobiological models of "synaptic consolidation," where mammalian brains protect memories by rendering crucial synapses less plastic over long timescales [cite: 55, 56].

The most prominent algorithm in this class is Elastic Weight Consolidation (EWC), developed by Kirkpatrick et al. (2017) [cite: 54, 56]. After the network learns an initial task, EWC assesses the importance of every individual weight by computing the diagonal of the Fisher Information Matrix [cite: 16, 54]. When the network begins training on a subsequent task, a quadratic penalty term is appended to the standard loss function [cite: 54, 56]. This penalty acts as an elastic, spring-like anchor: it pulls the weights back toward their optimal values for the first task, with the "stiffness" of the spring constraint directly proportional to the weight's Fisher importance score [cite: 54, 55, 56]. 

Through a Bayesian interpretation, EWC applies a prior over the parameters based on the posterior distribution of the previous tasks [cite: 55]. This enables fast learning rates on parameters that are poorly constrained by previous tasks and slow learning rates for those that are crucial, forcing the optimization algorithm to seek compromises in the weight manifold that satisfy multiple tasks simultaneously [cite: 55, 56]. Other regularization strategies, such as the Information Maximization (IM) regularizer, apply class-agnostic constraints based on expected label distributions to preserve knowledge streams, proving particularly useful in memory-intensive domains like video continual learning [cite: 53, 57, 58].

### Rehearsal and Generative Replay Mechanisms
Rehearsal methods take a data-centric approach to stabilize the network. To prevent the network from overwriting old tasks, the system continuously interleaves a subset of data from previous tasks into the training batches of the new task [cite: 1, 18, 28, 57]. By periodically revisiting historical data, the network approximates a joint probability distribution, forcing the gradient updates to balance the demands of both old and new information [cite: 1, 57, 58].

When storing actual raw data is impossible due to memory constraints or privacy laws, systems utilize "pseudo-rehearsal" or generative replay [cite: 1, 28, 42]. In this paradigm, an auxiliary generative model (e.g., a GAN) is trained alongside the main network. When learning a new task, the generative model synthesizes artificial data representing the old tasks, which is then used for rehearsal [cite: 42, 49, 50]. 

### Architecture and Parameter Isolation
Architectural approaches circumvent catastrophic forgetting by dedicating separate physical capacity to different tasks. By manipulating the network's structure, these methods explicitly prevent the overlapping of representations, isolating skills mechanically [cite: 16, 28].
*   **Progressive Neural Networks (PNN):** Instead of altering existing weights, PNNs instantiate an entirely new, separate column of neural network layers for every new task [cite: 54]. Lateral connections are established to transfer features from the old frozen networks to the new network, allowing the system to leverage past knowledge without ever risking interference [cite: 54].
*   **IF2Net (Innately Forgetting-Free Networks):** Keeps the weights relative to each seen task strictly untouched before and after learning a new task, ensuring total preservation at the cost of expanding memory [cite: 59].
*   **Hard Attention and Masking:** Certain neurons or pathways are physically masked and frozen after learning a task, ensuring that subsequent gradient updates cannot access or alter them [cite: 7, 13, 16].

### Activation Function Engineering: Elephant Activation Functions
Recent research has begun addressing catastrophic forgetting not just through algorithmic add-ons, but by fundamentally redesigning the lowest-level neural building blocks. Studies indicate that forgetting is tightly linked to the gradient sparsity of the activation functions [cite: 60, 61, 62]. Standard activation functions (like ReLU or Tanh) allow dense gradient flow, which facilitates widespread, unchecked weight changes across the network, leading to high interference [cite: 61]. 

In response, researchers have proposed a new class called "Elephant Activation Functions" [cite: 60, 61, 63]. These functions are mathematically designed to generate both sparse representation values and sparse gradients simultaneously [cite: 60, 61]. By utilizing these functions, a network naturally limits the number of parameters updated during any given learning step, preventing neural crosstalk. In reinforcement learning tasks (e.g., utilizing Deep Q-Networks or Rainbow algorithms) and sequential supervised tasks, simply replacing classical activation functions with Elephant functions significantly improves resilience to catastrophic forgetting, without requiring memory buffers, rehearsal, or complex task-boundary information [cite: 60, 61, 64].

## Computational Trade-Offs in Continual Learning

The selection of a continual learning strategy is governed by strict engineering and infrastructural trade-offs. The pursuit of perfect stability often incurs unacceptable costs in memory, processing time, or data privacy compliance [cite: 28, 57, 58]. 

| Continual Learning Strategy | Core Mechanism for Preventing Forgetting | Computational / Training Overhead | Memory Overhead | Primary Limitations |
| :--- | :--- | :--- | :--- | :--- |
| **Rehearsal / Experience Replay** | Interleaves historical data with new data streams during training [cite: 28, 57]. | **High.** Requires multiple training epochs over large combined datasets, increasing processing time significantly [cite: 57, 58]. | **High.** Requires dedicated, scalable storage buffers for raw historical data. In video data, a single minute of 30fps video occupies the memory of 1800 images [cite: 57, 58]. | Violates strict data privacy constraints; scales poorly over long lifespans [cite: 28, 49]. |
| **Regularization (e.g., EWC, IM)** | Constrains parameter updates using calculated importance matrices (e.g., Fisher Information) [cite: 9, 28, 54]. | **Low to Moderate.** Calculating importance matrices takes compute, but overall training speed is largely maintained [cite: 49, 56]. | **Low.** Requires storing only the importance matrices and old parameter states, yielding $O(1)$ scaling [cite: 65]. | Less effective than rehearsal on highly dissimilar tasks; prone to capacity saturation over time [cite: 57, 58]. |
| **Architecture Isolation / Branching** | Expands the network physically by adding new sub-networks or adapters for new tasks [cite: 28, 49, 54]. | **Moderate.** Training remains fast as only specific modules are updated [cite: 16, 28]. | **Very High (Unbounded).** Network size grows linearly or exponentially with the number of tasks introduced [cite: 41, 54]. | Results in massive, unwieldy models; requires explicit knowledge of task boundaries during inference [cite: 16, 41]. |

As detailed in the computational comparison, rehearsal remains the empirical gold standard for retaining accuracy, but its intense computational overhead and fundamental incompatibility with data privacy laws render it unviable for many commercial applications [cite: 28, 49, 57]. Conversely, regularization methods like EWC provide a lightweight, privacy-compliant alternative, but they struggle to maintain strict separation between features when tasks become highly complex and numerous [cite: 49, 57, 58]. 

The phenomenon of catastrophic forgetting represents a foundational bottleneck in the evolution of artificial general intelligence. As long as models rely on distributed representations updated via unconstrained gradient descent, the acquisition of new skills will continually threaten the stability of prior knowledge [cite: 5, 13, 17, 39]. Advancing toward true lifelong learning systems requires moving beyond brute-force retraining, demanding the integration of advanced regularization techniques, constrained parameter routing, and novel network architectures designed specifically to bridge the gap between artificial plasticity and biological stability [cite: 3, 9, 61].

## Sources
1. [Overcoming catastrophic forgetting: a simple guide to elastic weight consolidation](https://towardsai.net/p/l/overcoming-catastrophic-forgetting-a-simple-guide-to-elastic-weight-consolidation)
2. [Elastic Weight Consolidation (EWC) Summary](https://rylanschaeffer.github.io/content/research/elastic_weight_consolidation/main.html)
3. [A Brief Introduction to Continual Learning](https://wandb.ai/shambhavicodes/ewc/reports/A-Brief-Introduction-to-Continual-Learning--VmlldzoxMTE4MTQ5)
4. [Overcoming catastrophic forgetting in neural networks (PNAS)](https://www.pnas.org/doi/10.1073/pnas.1611835114)
5. [Mitigating the Diminishing Effect of Elastic Weight Consolidation](https://aclanthology.org/2022.coling-1.403/)
6. [What is catastrophic forgetting? (IBM Think)](https://www.ibm.com/think/topics/catastrophic-forgetting)
7. [Catastrophic interference (Wikipedia)](https://en.wikipedia.org/wiki/Catastrophic_interference)
8. [Avoiding catastrophic forgetting by learning an algorithm](https://pmc.ncbi.nlm.nih.gov/articles/PMC9232654/)
9. [Catastrophic Forgetting in Neural Networks Explained](https://mrifkikurniawan.github.io/blog/2021/Catastrophic_Forgetting_in_Neural_Networks_Explained)
10. [Catastrophic interference (Grokipedia)](https://grokipedia.com/page/Catastrophic_interference)
11. [The Science of Catastrophic Forgetting and How Fine-Tuning Triggers It](https://medium.com/@thekzgroupllc/the-science-of-catastrophic-forgetting-and-how-fine-tuning-triggers-it-45d5e5ddb8b2)
12. [Catastrophic Forgetting in Machine Learning: 2026 Guide](https://codelabsacademy.com/en/blog/catastrophic-forgetting-machine-learning-2026-guide)
13. [Catastrophic Forgetting (Emergent Mind)](https://www.emergentmind.com/topics/catastrophic-forgetting)
14. [Mechanistic Analysis of Catastrophic Forgetting in LLMs](https://arxiv.org/abs/2601.18699)
15. [Catastrophic Forgetting in Neural Networks (Dev.co)](https://dev.co/catastrophic-forgetting-in-neural-networks)
16. [What I learned the hard way about catastrophic forgetting](https://medium.com/@ayoubkirouane3/what-i-learned-the-hard-way-about-catastrophic-forgetting-0793878ff96b)
17. [The stability-plasticity dilemma: Investigating the continuum](https://pmc.ncbi.nlm.nih.gov/articles/PMC3732997/)
18. [Stability-Plasticity Dilemma (Emergent Mind)](https://www.emergentmind.com/topics/stability-plasticity-dilemma-3f55f2f3-bbc3-44f7-b5f2-c0be3b12ceff)
19. [On the Stability-Plasticity Dilemma in Continual Meta-Learning](https://proceedings.neurips.cc/paper_files/paper/2023/file/57587d8d6a7ede0e5302fc22d0878c53-Paper-Conference.pdf)
20. [Investigating the continuum from catastrophic forgetting to age-limited learning effects](https://lead.ube.fr/publications/the-stability-plasticity-dilemma-investigating-the-continuum-from-catastrophic-forgetting-to-age-limited-learning-effects/)
21. [The Stability-Plasticity Dilemma in AI](https://medium.com/data-science-at-microsoft/the-stability-plasticity-dilemma-in-ai-7c61fbaf2f50)
22. [Group Sparse LoRA for Continual Forgetting Mitigation](https://www.computer.org/csdl/journal/tp/2026/05/11353047/2dioqIYUCqs)
23. [GainLoRA: Gated Integration of Low-Rank Adaptation](https://openreview.net/forum?id=vmfRdANa6a)
24. [Factorized Low-Rank Adaptation for Continual Learning](https://pmc.ncbi.nlm.nih.gov/articles/PMC12498382/)
25. [CaLoRA: Causal-aware Low-Rank Adaptation](https://neurips.cc/virtual/2025/poster/117161)
26. [Self-Rectifying inter-layer Relations Low-Rank Adaptation](https://arxiv.org/html/2605.07420v1)
27. [Catastrophic Forgetting (Jelvix)](https://jelvix.com/blog/catastrophic-forgetting)
28. [Lifelong Learning for Autonomous Intelligent Systems](https://pmc.ncbi.nlm.nih.gov/articles/PMC11027131/)
29. [Catastrophic Forgetting: The Achilles Heel of Deep Learning](https://medium.com/@fernando.dijkinga/catastrophic-forgetting-the-achilles-heel-of-deep-learning-a208de018b2f)
30. [Catastrophic Forgetting in Neural Networks (GOML)](https://www.goml.io/blog/catastrophic-forgetting-in-neural-networks)
31. [AI Solutions in Healthcare and Continuous Learning](https://andersenlab.com/blueprint/AI-solutions-in-healthcare)
32. [Domain Randomization and Augmentation](https://www.emergentmind.com/topics/domain-randomization-and-augmentation)
33. [Information Maximization for Memory-based Continual Learning](https://arxiv.org/html/2512.01818v1)
34. [Forget Less, Retain More: A Lightweight Regularizer](https://repository.kaust.edu.sa/bitstreams/5972a430-17f4-4aa1-b7e7-23025cabef12/download)
35. [Continual Learning: The Missing Capability for Reliable AI](https://medium.com/@adnanmasood/continual-learning-the-missing-capability-for-reliable-ai-at-scale-c225e1a523de)
36. [Forget Less, Retain More (NeurIPS 2025)](https://neurips.cc/virtual/2025/125213)
37. [A Closer Look at Rehearsal-Free Continual Learning](https://openaccess.thecvf.com/content/CVPR2023W/CLVision/papers/Smith_A_Closer_Look_at_Rehearsal-Free_Continual_Learning_CVPRW_2023_paper.pdf)
38. [Gradient Collisions and Domain Randomization](https://www.emergentmind.com/topics/domain-randomization-and-augmentation)
39. [Loss Landscape Flattening in LLMs](https://www.emergentmind.com/topics/catastrophic-forgetting)
40. [Mechanistic Analysis of Catastrophic Forgetting (arXiv HTML)](https://arxiv.org/html/2601.18699v1)
41. [Catastrophic Forgetting (HuggingFace Papers)](https://huggingface.co/papers?q=catastrophic%20forgetting%20(CF))
42. [Consolidation Mechanisms (HuggingFace Papers)](https://huggingface.co/papers?q=consolidation%20mechanisms)
43. [Mechanistic Analysis of Catastrophic Forgetting (PDF)](https://arxiv.org/pdf/2601.18699)
44. [Continual Post-Training (Emergent Mind)](https://www.emergentmind.com/topics/continual-post-training-cpt)
45. [Context-aware Continual Pretraining](https://openreview.net/forum?id=Mg6pVmTWlo)
46. [Fine-Tuning vs Continued Pretraining](https://medium.com/@heyamit10/fine-tuning-vs-continued-pretraining-c8058e5040cf)
47. [Mastering Continual Pretraining](https://pub.towardsai.net/mastering-continual-pretraining-how-to-transform-generalist-llms-into-domain-experts-12ecb2538b9c)
48. [Catastrophic Forgetting in LLMs: A Comparative Analysis](https://arxiv.org/abs/2504.01241)
49. [Full Fine-Tuning, LoRA, and qLoRA Comparison](https://medium.com/garantibbva-teknoloji/full-fine-tuning-lora-and-qlora-a-comparison-of-techniques-in-model-optimization-89038d36865f)
50. [Top AI Fine-Tuning Tools: LoRA vs QLoRA vs Full](https://www.index.dev/blog/top-ai-fine-tuning-tools-lora-vs-qlora-vs-full)
51. [LoRA and QLoRA Overview](https://modal.com/blog/lora-qlora)
52. [LoRA vs Full Fine-tuning Generalization](https://arxiv.org/html/2410.21228v2)
53. [Closing the Gap Between LoRA and Full Fine-Tuning](https://mbzuai.ac.ae/news/closing-the-gap-between-lora-and-full-fine-tuning/)
54. [Primary Mechanisms of Catastrophic Forgetting in LLMs](https://arxiv.org/html/2601.18699v1)
55. [Implications of Catastrophic Forgetting in Autonomous Systems](https://pmc.ncbi.nlm.nih.gov/articles/PMC11027131/)
56. [SR2-LoRA Performance Metrics](https://arxiv.org/html/2605.07420v1)
57. [AI Chatbots Miss Initial Diagnosis 80% of the Time](https://www.beckershospitalreview.com/healthcare-information-technology/ai/ai-chatbots-miss-initial-diagnosis-80-of-the-time-mass-general-brigham-study/)
58. [DVSum AI for Healthcare Challenges](https://dvsum.ai/blog/dvsum-ai-for-healthcare/)
59. [Why Generic AI Fails in Healthcare](https://holisticare.io/blog/why-generic-ai-fails-in-healthcare/)
60. [Misdiagnosis Risk in AI-Driven Medical Diagnostics](https://pmc.ncbi.nlm.nih.gov/articles/PMC12615213/)
61. [Chatbots Miss Medical Diagnoses Study](https://www.cnet.com/health/medical/chatbots-miss-medical-diagnoses/)
62. [Continual Learning in Medical Image Analysis Survey](https://pubmed.ncbi.nlm.nih.gov/40752376/)
63. [Mitigating Catastrophic Forgetting in Medical Images](https://arxiv.org/abs/2504.20033)
64. [Continual Learning Challenges in Medical Image Analysis](https://open.library.ubc.ca/media/stream/pdf/24/1.0448180/4)
65. [Mitigating Catastrophic Forgetting in Continual Learning](https://thesai.org/Downloads/Volume16No4/Paper_14-Mitigating_Catastrophic_Forgetting_in_Continual_Learning.pdf)
66. [Benchmark Study of Continual Medical Image Segmentation](https://arxiv.org/html/2605.06160v1)
67. [Weight Manifold Theory in Fine-Tuning](https://openreview.net/pdf?id=FFQ5T3EN18)
68. [Scale-Invariant Neural Networks](https://huggingface.co/papers?q=scale-invariant%20neural%20networks)
69. [Morphology Dictates Learnability in Neural Controllers](https://arxiv.org/pdf/2306.03757)
70. [Structure & Priors in Reinforcement Learning](https://eringrant.github.io/spirl/2019/supplementary/spirl_supplementary_07.pdf)
71. [Adapters as Hypotheses (GitHub)](https://github.com/wassname/adapters_as_hypotheses)
72. [Walking the Weight Manifold](https://www.arxiv.org/list/cs.LG/2025-05?skip=1675&show=2000)
73. [Adapters Vargdown](https://github.com/wassname/adapters_as_hypotheses/blob/main/adapters_vargdown.argdown)
74. [NeuMeta and Weight Manifold](https://arxivdaily.com/thread/60543)
75. [Generative Models in Medical Data](https://trepo.tuni.fi/bitstream/10024/160826/2/AholaRoni.pdf)
76. [Part-Aware Losses (HuggingFace)](https://huggingface.co/papers?q=part-aware%20losses)
77. [Mining Hard Gaussians for Novel View Synthesis](https://arxiv.org/html/2412.04826v1)
78. [Panoramic Imagery Rendering Consistency](https://iccvm.org/2026/files/papers/251.pdf)
79. [Disposable Transfer Learning (ICCV 2023)](https://openaccess.thecvf.com/content/ICCV2023/papers/Koh_Disposable_Transfer_Learning_for_Selective_Source_Task_Unlearning_ICCV_2023_paper.pdf)
80. [Elephant Activation Functions (ICLR)](https://openreview.net/forum?id=kxe0hQ5mxp&referrer=%5Bthe%20profile%20of%20A.%20Rupam%20Mahmood%5D(%2Fprofile%3Fid%3D~A._Rupam_Mahmood1))
81. [Efficient Reinforcement Learning with Elephant Activation Functions](https://arxiv.org/html/2509.19159v1)
82. [Elephant Activation Functions Abstract](https://arxiv.org/abs/2509.19159)
83. [Deep Learning Monitor: Elephant Activation Functions](https://deeplearn.org/arxiv/639303/efficient-reinforcement-learning-by-reducing-forgetting-with-elephant-activation-functions)
84. [Continual Learner Activation Functions](https://huggingface.co/papers?q=catastrophic%20forgetting%20(CF))
85. [Neuromodulation in Deep Neural Networks](https://www.researchgate.net/publication/338848290_Introducing_neuromodulation_in_deep_neural_networks_to_learn_adaptive_behaviours)
86. [Weight Manifold Analogy](https://huggingface.co/papers?q=scale-invariant%20neural%20networks)
87. [Spacetime Neural Network](https://huggingface.co/papers?q=spacetime%20neural%20network)
88. [Neuroevolution Transfer Learning](http://www.arxivdaily.com/thread/68000)
89. [Neural Weight Search for Scalable Task Incremental Learning](https://huggingface.co/papers?q=cumulative%20weighted%20capsule%20networks)

**Sources:**
1. [wikipedia.org](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQGShxydW9nGSrkJjMAG0tpNQXVKiPcRq4wj2Ws3BGAv3YSDCeUj4WRjkD9K62WhJfs3b7IV-qqfhTEAv7xyhUUYh2NEK1ci0HE8GtHhTiGVlOllUirmydtr9BQnauIM30FeyysCzEBYDOoZZEL0)
2. [nih.gov](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQH0rGg0SThThS9pK-fUQEdenlcNaBQMRJrFcI9S4tmPHjy4Zha0OotFZ_eWHppezkYpPuuTe1G3W_Y2Em-nfD1VZy7H1v0x_80o-k1167agBEXTHN0j0_Wx86fwHiyZSRb96NkkRQb3)
3. [emergentmind.com](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQGLhO1YtxhHTXMSjJ8zagL_A6dw7JMRVj1F9-bApJKw1uUcOvYXz_07DOek6dOBGdz6QISHumNnaTTvBosXNtFQ4GzAy35tpENaBiq57S3ewvKFYQu7xrSTRr6P2dgA_gNfHTkKan7CkKWjESBcOwQDDKJh8Jwss6vNTU-kOadHjs4t12k5DOL5CbyzGLwqUt1VCwXCNeTBZZ5JnQ==)
4. [medium.com](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQHhMIorfHsv1g_WMvfEybShN4F6fzRyGoyaLeSPRMBFEyxAaVtZlb1UO24nC3HDiqcSHzGAr-jFczwLfaFRSW2QKamNFgRc6CFVdk7Fxq_GtG-bAAHbcssyi-yQ-Kx7jicjLcItLME5GvLpRuzXWq3aBMbT4pqdxgMkXDYsDQ8uB_pqZZesUigrhB0hynhZLmJhDh2bqH4=)
5. [grokipedia.com](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQHwlh3j9klYd4ocSWYlq7BaFtZrkVFCWVr0pyaTchirA7K2PEynvnMQg7eFXuMgwPkoMJJTqCuMlg9ixa2qY0B0k4hWvKLW9zzYRP8xPjGqKD7wgvF7ozRCk1uQW11lrJUMWC_YgQvNA3hnkg==)
6. [ube.fr](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQHCbTVVV5JTzrnZr8B8Yi-c6nFrh1i846N6gp5Kh_dTSoeKGwnBKhzSDrDWV1-pFNX1r_JwGyXZzPLOhgw_BCCNAf2K8SrBkPgFZ3oQYdJR5ZQEy5JaTw36UdPXXervYMdQUxnaxE45sdZr97B9TE0CjeiH11prWTZx3NJrTi9mwLsLCaMUGcacoo_tq5UmvOj5iaMCeeNWHS40tJUs9MtlzcUeeMcHCdjvaLOLWiDqsTFQhfx_T1cOnuoGd2t7v8c9Q5m-3WLnrckp8NGNHdswAeg=)
7. [emergentmind.com](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQHb9K7dqWw6XIaHJDVd9dBvISIufEuzDBmwGlA0HZUbtgGeMZc6dSj2uo2F_n4KazYvBj5X7YYdoEE2_Dt3MblhYWua0kIt9Kyqd-edAJcoYQI3IH40arvUFWE0r3s9V8XKXZMNrApIj4_sRUCbqlFQzg==)
8. [nih.gov](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQFqVubHMtpbkvv-9hIWxutG3aG8MuFRIt0IAuqyZfWYgIbiN7vH6Ukp6D_4AzWJ1JrutDcKaMyqi-UuQSEug05VRZtj8KvHWAskB6It9eBbl_MtJEmKdmgsuFGDz9fUAoQpcfcr1giqDQ==)
9. [goml.io](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQEiAa7-OD8CB8CCFbt4p5rAuo02c2ToJscZpN5mEww1WoY4D6zOpx85xaYRsAHfRqp-m9WxGL3t2rW-23EfelGi2VRN63EDZIY4XtTgSB0XW6PnV5BJbZyDX29UyC9hygMGwfS2VgEWpFUrBkKEg4GuEThsMXzRkiCb)
10. [ibm.com](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQE2l3RD1kz2uqRneRqa0AbDWaFP2HJ5J0ROIhxaHSPxSzDl2DodwaDyz80CBCjVRakDcHfZ-UQnjhvRK7TGVpGurSfaStUsASOI5LHkJeoz5L_jUvwx1Ydu1ev2L4dZ0q4Hy1fc8Nm6-xvyXsc-2w==)
11. [github.io](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQHx82gQdsbA0UqP-LjCl_OFzYzXlst6MgrNaC7mdZIpGKPoXq6BIeRlkz1iF8F0_dw6vF3Zon61fop_3Sz9foTCv32mfxsMw2_cGy71sROYINeELDQEPETmwwPGLr9e7v6SwlWnUVv8L1UwGm2rXh3UWOQ4QcaqGmwv5MYxd-xa7V4iFrJtMGrWIpFTj-GZ2deUTd71TcQ=)
12. [nih.gov](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQHnr80UFxX0ITDHuAFs9T6es-OGHJ2OdiX3O6YPELDeWuygjXdEFL6YOVFYCN9XSi2NGVrKDGuHYEn3gHVXXuPCX_f6m_KbcGHmzwHgUhIRCnKBTEKRpwsO2h7kIShY7RBDv1M-7CIP)
13. [medium.com](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQH0Hk4aRcG_KZipPjhaQ_DoO_HJYI5ozteQfRoBl8X8zGRf0lMF7RJSR5dxphk3lvAFTWNXadrH3LGcpDrWxO209cONAhC88fp9uPt2k8fpIM16FNTFghLwwt8pogLmffvjAUKQQe6cfu2mYxHsIRXfZtwcmLwMPUelglH9m-o3pLaP3u0inzE1QUpdisZ7FgZDz-TlcydVXoJ_Yo9gI4JclRtpYBwH7tAJH-M=)
14. [medium.com](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQFYBG6IFJYhgTd-r2PwBfx9AI_0gz2GAiCOqSBAZVnSXCV2iHrda0CB7w5Y_chLQkioCU47lXl88gkoBLu2mNqDxz-MVHTHEj8YMl2SAJ_IeiSvuyXAxKdShG0cyUXYXMaM8-qbqkxXp2mwhW7dzG9eJcn9aDSWZrogEJiarKkTpLm-X7swuTGWWSd6Xqy0CKQeJIl1CJpZG-sSLAKuL_U=)
15. [dev.co](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQFB-bsdEBC-bEODT7LUusrVbBEIYTJSgSWNfM9ZNT0JJ3zO4mNiY42UY96I7hO-b8Uh0yT1qnFmTuotYMV8lGetfl4jcE95WfuHxdwTbIpwC_4su1_Bz2jyowvFIsQJLFhlogMGvzJb3b6A6OsIqvI=)
16. [wandb.ai](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQFsJcyZ515SCITYipt0_bp7Qh5-WU6UizFR2ejSialcYVCqrsCKtrfHAf9B7fe-nLVeYR_NrW4hHF0RYS-SMttmUTBxaU7qwvQHpkFyznK_onuCsH8fxSlaNvb54MRJtYUUlx-YqavpPfINVjQZEGADFdgefVMeSbdUd1CLPLjfc1tmt1EG95gXiGEVJxxP8SQPeBT6JRNckgDYD58I_A==)
17. [jelvix.com](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQFZWz15R7MzVEw81qw_SYBcQUOS84KWik0iAhfGFYmyCFuS2pAJIEKatQ7CjkjqRYqcoKMo7orP7_0UBKivwRoGHPJJaI3WUWMa8aD24U2GeeeXhdeGeGiIwAv3Pq8J4VZARzIdsg==)
18. [codelabsacademy.com](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQE-KzACe8qGdmbn5s7Cr9nQQOfkJ188Elp3Al2oOdtoAQBJVHP9aw_KGocMxoP5bp-GV_ngZwf_v4rLjch8T9IsbBTUX1mod2yb0y9m9Wa2IHS7rRZ0OW2PSwtTD0YoQwLx2ZBxjzR2-V7bIr3ew_5tmtAR3azDxWAsCmtTUVzuhdZtM3szfMJbVRxhO5s=)
19. [openreview.net](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQGcssep8Xqj1yDO9mTvEpqM_Gn3-1qS60w9MI7EmQ2wZOohIALBawMpLZWrExVvcVu9Pozz9eGT3KI86GlJEo32ZkZ-epBMrJnGXCYB2baYgHaYHDmnnLVCApYvwvgm)
20. [github.com](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQF5X_1BZVKkJaZSBwtAT6z-NQk4rbtcFxEcm5ALNFLFolaPjJZk2lMdOnDo_5r_uOwCNY297xUs4x_S7xXX-bvXrD46XtHepzkNzkL2IHSwdWeOaWljtjID-A_xe7eHFG_Nv7klDPf4zA==)
21. [arxiv.org](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQHcA6yiiCAtJz_v7i9ydEvdDuFhYPad1KOVsdEZah3NhmARnnKNw3RibV8TirfCcWGwXrkeVNo3otXu7_VGlGUIe0v9XoXHa3B18Z9CkxPzanoR2_CkKA==)
22. [emergentmind.com](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQF9qXMSFrOVHxmLykiapLevmVcNFIaZeGHDBZdjwzbep7OUj4Eral_mXr6y4CEqR8lVvRtDEEoIadNQHCUEUoRbgMuX8P1P6MrFarjHk6EdtmPhCUTjx39blkfx5i61RPqaDbkoZeB5ZI1F05CUJuyRuiGxMD4Hwosz54flm2y6)
23. [arxiv.org](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQGvyg6OkbBncWrxuIKO8bxKFNPUzSMTzB5V4UqyIOEQkvcCU6Icw0UdQo4U3UxsUySu2r_ZBmZeYwt4iSPH8gcUwboozhvR62DiHPh-NjPDyf5iy_tOup6yKQ==)
24. [iccvm.org](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQH54tjxY9NiOnK1iTCVz3su2DmirAsYPx4UiM44xKfLclhsVf3Cgphbc6xgpNjPy9htARXFxkL3_1lfcTkxG_gRKlXNI_NdhnG9qbdfPhUaWO5n8QlYAPIMBA2GUsA4iZZu)
25. [Link](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQHzCi3OVVOBrCzLuwiQfeBIrOSTcs_cQXV_Wkx5mEIUB2vpLAJCO_CPMswCvLXZpD6GfAvgRkw2NXOuNZMAyT0Hvgyi8-9e7BsM7CYirvgAfZEO2fhkeHp3Jg==)
26. [arxiv.org](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQH9VbrpHc17TP0uXWxs1g_Vu9-tgYUmqcKlqcZ1fVz05Xs874tHJkaLrXI2SSGDIIRvnTPZJZ7Breewpyy7puq0DgCx0iC8v_3ArfkdglkpLSm2ymphfg==)
27. [arxiv.org](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQEA9aeRKgUmMb-8dt098ZNpf5gju442gHl3YtX388m3TAA1FDiqD_WtJI2zKaM-Y5NTfsWg2AtTWEH_Z6NgmI3LIJHx1sKCkYrI_N61HceETGmVhkKaUfEJKQ==)
28. [medium.com](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQGAhTJniPRr0piL6-tvg5b4m2BT_Y4WPh3G9Gz2n-sQksg6lAR_wNU02Wt95gru5wyA_phmp6dzXoxowwg5y1cR6VQlTz6WoSwfJGYZE_8ggI25Kghxupy1odpy1a_T5A0d8ibOwGeNzyxzd8nTcLkQnVGtkVnCTImdKgA9I6PiRBH1rw3MX2vhdm6kuiLxGJaxnsANU4ZzAZJ-oPloHLDRoZwLCVA=)
29. [emergentmind.com](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQGmyR-JoEYI-ixPQd38Z6skaA_ISeaUqlv1HdVzjs46lt8YyYPokq4h5vBuzl2hfutxGsZnwi8jzApI3FG_bPGHx8O-6t7M-sKbO6yIu45dyKdwWgeHY2YJmPCyRvY9i-ElopAcmw6RRP7HKA4lqoWnnJVAe1w=)
30. [towardsai.net](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQHif0SwQpQZhUxsfgX6xGvXHdkCNGyrdJ0hrkEA61ZSCP-fAT7XJ5mvO_B8IfLpBEimbkF1Q0SaaQREuodPlVyy5EK6u_y6w2ZqcTX2hYMtUG0xqxNLN9LR2JAcv8-fEmePyeMtb5n5Ta36hrB81eHJrnWVz_ffo_hR-K4syQ_J61W1w3LNjsuOLbdR-IcU53dtomNePeryDy44q1jJJ1fxRToM4nBVpbeKUXtZq2RCB9Y=)
31. [medium.com](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQGUi6oPoFq2ptAbSZWLpRcpVwHIix_EeCk3DWoGW-5goqN4RppAbvwBkahYLawUJohipz9JLq-PFhSHUEhYBdHff_5b1qXzU5yp6IVrwvaAv0YvpRvNmMlzHPEk7CgaGpsBTW7sNHkg1HjCTrOWGb7GYlja82mIiGL94OUVMXtVrNrMC0jn)
32. [medium.com](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQELD4tuegF_Wj4eWU9hjVOwJGXAOSuz3-kds1xQuBSCtZJmBdn6Dmruyed-6d95NZ_3gwaOo_45Jd3XsguXVyFcFWqHyxpKZYWXqjlNRVTGMsthmTPOXpHpQ-yGTVHl3r7xQQEj52zaq8QMaYc4Y7rtAEXkmFISxYHvto6_N18U3PSiflcuxmEpoPcpfUMiKg76EsMFM2CDWSQFO-4YDU0QZZ1Oz1WzIrJWECaLt6b0ltQct4Mpb7J1kWPJ2IE=)
33. [mbzuai.ac.ae](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQFyB7g7y8PFsqaGpZOCkInC5zKFkKSXaQagyKbjFT_RAfqt_TYBdPG8LZZ8NlA30ihq1gNzoguncRyHnulmY2oa3RUmbokH_7HUrxFgzTsBQbKwSbKwtUtf90K484fCvF3sRzccRYlNraHFxLIqWkwg-HlKuiq7s1iiDtv1xY2CcUOx)
34. [index.dev](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQGWIFOUxtAcC2wkjQsbyoSj6dozJsbuiwSTdDlt3Xy0EicIinFGCOA-lB_tSQ4zWlw-LUlO3NmWAqIyN35fcv2ja1lhhBANZd3Bk_5ZZINnGxYu3DfDzKMfa3azUIfkHlvg0_XmOHBpbXGTtM9s5rwV5MHmUuQGf3RVyhRcS1Eq)
35. [modal.com](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQFEY0fkdWM6WUtE0SoBcO1bLjLnKy5DFBqHYf6ftWjnGEAp96msdfd7BIseUv_fiB9ERYPIpcLWARAOzdwwv34DHKfHQY9oAr4uzghLQ0El_AwJZae9ABY=)
36. [arxiv.org](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQFcDVD6VVh6eayNoFuUwA0IKPFM5uA69cdeAZnPQPu8-pqfXwEGpV8aVm0m1-cch0qHg1BnL67CtRktbQLeQBQl2QhFNiz2rS_puL-yAzWwTDvedL_UUmhNzw==)
37. [openreview.net](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQHy69jDYtl32FqgyM1pj_sEJChckcvDP6t3swvs4oID6x7Y1WRVNmQmLOJdkRpsGhnxi9qAINrCbHiU1rXI8dN5z4LK7kYTxnJcb-EypHAhcIUluGcgCt-eWa1IaUwEJLI=)
38. [neurips.cc](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQGtvP99AY8OF2RvEPb9A6QDNMCDlH4q3mX_u_5yhJ-zpo07pEl6zsIUWg2tzhK7zTsDJDNQeC6g9KU3C3J3jKG6aLsgU2KxOkEKcQPk5qAmxLWncTvW8TjA6Q0qdX22ey46MrQ=)
39. [medium.com](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQFwpB3y49Vsh8JU9T-VXCU7oll10rFALjFgyu7cvbKQfzsIFgGy9xPm-Vrt3PbLHrjcWpafnaMnXRZgWsyxvt8AC2EXptoC3VyyEev5_vUsgKq_UxU8aeT5LuYb0FxRDsVv2fkxofOOHYSbYpf-kA5_kR8los-1P-T-Xaib3NNxyp16Kj0vmT3p4ewZXjDfzdW-D8Ww9xjPp-SWF5P9Tkugx_cJ)
40. [dvsum.ai](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQHTqYQa-W_SDZuxL79osu1Uci6eUcDTsCcHxRWWpn04QG2xALBND6WwLXc-WqbAT2GNKpJXT8r_FPaNBMsdx56JP4DBckkrRdUEptGlPtdYnLhQmh1FrRtVJAQpjtAKDyAxi7m_)
41. [arxiv.org](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQHDFsI7MJqb2lG_ZqmuCitng7lafUitG-9w-eEPgZTxkLZwvtAnZEkfSED9vvZEOxX_G9ODtj29kq3YexAUE-LlFJJwTIPNPpE_SRs_l1-C2uoleMbZJADdUw==)
42. [andersenlab.com](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQFpAjK9nPe5aMWmqzXDtUUHZ3V9SSU7AMzA8zPENPQNulhWnQQuD52kIVjs_CiC7eiAmASRKa8X8OGr0JkxH5Vru76-e5dqfsG57e-bCNEGAdK0OiFUv6wGsntaSOXgNMNs1P7b7v19id93_ruVCw0BmgM=)
43. [holisticare.io](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQEq123v7um7XdiY5cIenwL-xba66sFBEN4zRJHkGOp7WBKLVG7ZzlYWG_kxyI1uyCtGfQu-8kVnZaEGk3SnF8an2TOWwg5vnQduEZPFHIF52FDpYWIos-byp5_bb9GqRji2gDjbINiGyxkQbxkLJbOpZiqGmZQ=)
44. [beckershospitalreview.com](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQGX9jqIUqoG9llgqYlCnfbi19qNg0J8t8n2eSbMRlDMDIpEvcqVfqjDMLIIDc2PoJJ2_0ZI_LJ0p9rx5TnC4e_uQ5AC-iSEbWK0ctgCkjgwFambKXD3uaEnSnX4-NOxAO61R0kC8OR90A3iCNPob6Q5DDrEXgNnmTQ37V0GcC_8EmxvMrTN_gy4_Gh1JXu5fiQx0gTpM5adZq4oRJexiKiFZH22h3poeD7goZHoEoOhnSCJWYuiqwiSJ9la4nsGF4nOBooYwvI1hLr_vVF2vGc=)
45. [cnet.com](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQGKiqvRoJ5GMv_PDUwowzmAyvNv1Ajcc5JKppY0qHa9eEAldP4TwoHAdNxLT-rd-9hKGBTGItdusSFHOkM8nVG4cW7m_9RguIAWbqPaEsT-IrBKNteoI8zA-eeJ-x7XtRVvUq2lK-hIdOSuSkahUxa9ACGTNSe7g-FwVA==)
46. [nih.gov](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQEvYQdApZA6hb5yHtiRmx9uUAno7tyiKY988b6xWhQQhCyDRmaiJMgcSh47dX8cC_hkr8Q92wo7mSJaYtiS9lfIwIRat1G-QvOVQOd8l1xkEPpv6YMVSOk5sA2LXIeN8w==)
47. [ubc.ca](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQFm8DJa1kfHqAq-gbmxa7vUw7re059WpQ9jhtmLf22bgV2CQMpEr7Ad5S_d6e9dILqIanxwS6FsocIS3TlXYnmmIvD48791CvQphm585UL5JzgqxE2JlqsDRUE0mSly7tl2EbfjkApWR82E9dQbRzptBg==)
48. [arxiv.org](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQHYeumrQthDNkFIXqpK0mdP_Xvpkt3A_UlY2Xds92Szb1xWj1tQwCS9iaZL-uSrim0xLt2-PII2GWvyvGwvpGP_SyAICLIxwNuc2W83XRDq15BTZpqq1Q==)
49. [thecvf.com](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQFoK0_3JIsd6b3gopyGSuyaCHA9bDQUZDxUqXduBzo5xoOyqSDAWXOzOY8a1k0dqD_ougAhFjfzTtuLC8IRp3EUy0W9VMO7s6-Q9uLqpZYwVt8ZaN9ls2rAKnfiyLlg_avdrqlmsoSJPjPtFvHkvskxTpG9w55n8erVGcAvegagmDRFCGjutzN-bgP4u_jI26qDOP4HxriMkX1oQdbcgPa0jt9fJPJEAdtzckAWOZWy8ROuJM4fmRXJ26mSlo8nGIKYmg09)
50. [tuni.fi](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQHwhrWcTK8p68f4qxGoymbicyfSvWTMRB66juQxYq6npYZP869SCdbyGaxWxdZIT0_TfCqTN7DycadtAFlFteAQhFoMu1sxXdzMUim1A1xYzYkasCHnCFSTCoXq7_m69pwh7ICN-dUZu1ZBhsjn2T7pOmY=)
51. [arxivdaily.com](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQFLuf10BOHh1dnQCiofVgOz5oSQI32EQX-ZXipUjFt1HUtprOAiPBTgyu6l6a_flL0bwUx-UxxHyBq93B1zKBx5gHqNp6POWXO979xp9_bba4gSJpIkKFZ4yZXg3A==)
52. [arxiv.org](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQGrYdUPBbIvOIkhrQBIlUnp6FUoCVtAOEK8Ol4HxMaCHI9pyU1SQDAjrvW95aVsw0ELQ8_ePrwAtlVaX_WAU5-xCq515WCUG8PMa1DBKdTbZaU_ZctMwA==)
53. [neurips.cc](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQHzRisK6Dk12lKEj7LUX1_HRlQ9yqtsdNBzFlf8jN4CCmTqCKV2ZWsCVY1pjIv9oI7mhG3G584cq2obPi9DAkinu7EwDQxorKzWFFQiAfSriMfS4yrdY3M29CXt1w==)
54. [towardsai.net](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQFCqKISS1uV75WFO_8-YSeNgdXzf3LursEpcauIBDcF2I_p-Zr9Qsg-_vAvD6-ZHzyePBuHzRyc7okryOZkOXocdscS6OO6IFVtquWpmFIrl1MxFkTFYv9ZURonn8jd7Tbin43LDUdD50iA3zgZe0W0OIFeTIcUzocDJd-Q8QJW88SCKmuQ0UTuriB7WMGXhW4Psn2wOyXSzNfj7XG1r_yhyw==)
55. [github.io](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQF3n_w60gzIapoAX56y_bq9hyEWxuxs1Ddusq5CoB7xLpFfMCQ66hY_X__2CoTlAEGNSkz5ZNG7QmvHADmQQi6L0022ONBGAa_1dTO0scT8kW3HAqQAR3rFA0L8ntaE3nA_yoexFvPOx_hO1R8V8RgimCC2H3A1TkX5cvWsY4UsC8DMZQpYEvtwHO7iQwzr)
56. [pnas.org](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQEJTzkaZDJ0ybC7OE2c_Y4x4dm04KwtKj9EXuBooFGYG90ftR0LI_u2VGBDmxlQ_quEzj3VJ6kK6dWP5AKHCfbefwHazNWlju7M4NHtvU64HqnLY6v8ggGBB5KlPhLdFrlHu2cj22w=)
57. [arxiv.org](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQG9WFcMVb8q_7LVbccuIwJeXjw2vS_cX9GL2lsZ-Qa22wQOtvkeY7_HDyAPkf1R00lpNP6nUaUwUO5GVJ5n-TKN5hwM3606Up80tZ83doqUhVgS7XrDuRpLxQ==)
58. [kaust.edu.sa](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQFXdgC8GvFCnsJhwHVhe_q0n5Ws1Tmp5NHDlxHJhuEdPcFXH-9bv9y7f3o3vNT6cmL1i4Fmyo5TS_xUUD5sJJfC97LAQSYuZbkGKHawFSQPib_8dOtN4Bh-yuUQ9CFjb7D2VMJdo309xP_ijdpcXJUxvz2h3rTKmAsyXHUVyj1S1CLA0K3bkTFq0BbEyu17)
59. [huggingface.co](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQFW2nkeyRpzsSNNbuEfq2USSGKfAZTtPNE_CUp4iCnN4up2aHSE87fYVZN-ZGSY16eEOEx5PVwxge98fSZkbaOLz9UgkImL3HxcW_a3_KSrXCihvXD-jBm-ybpHX5SnRE7Pn0AmfETB8c9sep5Z0jHSLKYlql8AFr3GahMffA98vQ==)
60. [openreview.net](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQEA7pzwixwVaPe8s3MpvqQRolr-QdaSU0ePmycJIFrFa__y9f0GxPGLxQtDCR1jaEA0gfJBws8RQqzQQ22-cw38dzSP_JSHCXD5JW5wi4Q-JPwUeFGiV6aP44TdxvWpbQatqCS2i6exqVN5Y2B0-SzR4w_iZIzGEpwn7jkR8Hl-n7ZgPlRmx8DJKs5PmmfO_Wv6uZY-YXGi2OGRfwjxk82b2BMIjDd7GVlIOGBtlLnq9mEyJII4meYsX17apQ0iqMM=)
61. [arxiv.org](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQHBGghxr9LAQsONVBGrCUaX4NTcht4B19hXqQIun8zgZZ0IN_FReOLHmpQ8ttXGSjuJa7043TVzqCWgQWkGIUSsW3P2MfgklF0doJqQl1EYqo5mOYMIpo7jBA==)
62. [arxiv.org](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQHYIlE_-WGHM6eJ3ZHamTtSwRD-EuTsKfBL-e_OLpIJKwR3QH5uWLYXndJ0boYL_ccEjpmB0RSpEFlCDzd0OpzfqcOoOz_GvE-FJ01EsH0PCduNg_pX7g==)
63. [deeplearn.org](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQGeNoI33l-J_F0dRGsCG_FuicSEzSnD0vqHwfCtVerbyb4xyBhZlrNwBVlKEKt1eFxItohqzRgwmIriLpQqxWsBl7pr5N4gzXHz0VZSpXG3Hu6Zkh-brxlG4HUy4Y9M1dk-zuUJy_Nmya8es-jz6KuUCxvz56iyAqL8sUQtV1fSzsl9mA9paPRr6RSl2Y5V6FKuUKAIG-Gl9DlrIRdyZF_Fvbzw2E3HOkfDINawcgCpiQEkfA==)
64. [huggingface.co](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQGDn8VFyt9eJi1W0udR1KWizUft1hNegpceutMpzUr9afYELuHetS_CQEsdN_1QOTX_MG0p9HwlqyxDRiY4_1-YhzLRFsLEFbpL4D112Vh11a62S0oEm57MhnQb2LG7h50YrO3qASoo1SLNMIf6GMLU1QI_u8R2)
65. [neurips.cc](https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQFtdn-IIdDkNf1cS-3HjgmePFdTj912EPrEWqkhzcv9Z0FYxXXTYjYyHKuQzHzVCe9j7nhA91v54F3HydcK47ZBvHTvPVUvhhzxNpnW0o_0Snk18V4_QU5wN15Gei4BGQH7MKrMqBMk_drnfNWn6puDRyqkXHvVHUfkjLz_feJEv961pXBjpuYS9ek6r6vZFM-dAh-aV_tWg8I1Fwt3y2cEt0nmlNGk)