Sequoia: A Software Framework to Unify Continual Learning Research

by   Fabrice Normandin, et al.

The field of Continual Learning (CL) seeks to develop algorithms that accumulate knowledge and skills over time through interaction with non-stationary environments and data distributions. Measuring progress in CL can be difficult because a plethora of evaluation procedures (ettings) and algorithmic solutions (methods) have emerged, each with their own potentially disjoint set of assumptions about the CL problem. In this work, we view each setting as a set of assumptions. We then create a tree-shaped hierarchy of the research settings in CL, in which more general settings become the parents of those with more restrictive assumptions. This makes it possible to use inheritance to share and reuse research, as developing a method for a given setting also makes it directly applicable onto any of its children. We instantiate this idea as a publicly available software framework called Sequoia, which features a variety of settings from both the Continual Supervised Learning (CSL) and Continual Reinforcement Learning (CRL) domains. Sequoia also includes a growing suite of methods which are easy to extend and customize, in addition to more specialized methods from third-party libraries. We hope that this new paradigm and its first implementation can serve as a foundation for the unification and acceleration of research in CL. You can help us grow the tree by visiting


page 9

page 10

page 17

page 18


Avalanche RL: a Continual Reinforcement Learning Library

Continual Reinforcement Learning (CRL) is a challenging setting where an...

A Study of Continual Learning Methods for Q-Learning

We present an empirical study on the use of continual learning (CL) meth...

Continuum: Simple Management of Complex Continual Learning Scenarios

Continual learning is a machine learning sub-field specialized in settin...

Ex-Model: Continual Learning from a Stream of Trained Models

Learning continually from non-stationary data streams is a challenging r...

Continual Novelty Detection

Novelty Detection methods identify samples that are not representative o...

The Animal ID Problem: Continual Curation

Hoping to stimulate new research in individual animal identification fro...

Please sign up or login with your details

Forgot password? Click here to reset