Bayesian Structure Adaptation for Continual Learning. A non-parametric Bayesian approach on continual learning that learns the sparse deep substructure for each task by selecting weights to be used by the deep neural network.