Stable recovery of the factors from a deep matrix product and application to convolutional network - ANITI - Artificial and Natural Intelligence Toulouse Institute Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2017

Stable recovery of the factors from a deep matrix product and application to convolutional network

Résumé

We study a deep matrix factorization problem. It takes as input a matrix $X$ obtained by multiplying $K$ matrices (called factors). Each factor is obtained by applying a fixed linear operator to a short vector of parameters satisfying a model (for instance sparsity, grouped sparsity, non-negativity, constraints defining a convolution network\ldots). We call the problem deep or multi-layer because the number of factors is not limited. In the practical situations we have in mind, we can typically have $K=10$ or $100$. This work aims at identifying conditions on the structure of the model that guarantees the stable recovery of the factors from the knowledge of $X$ and the model for the factors. We provide necessary and sufficient conditions for the identifiability of the factors (up to a scale rearrangement). We also provide a necessary and sufficient condition called Deep Null Space Property (because of the analogy with the usual Null Space Property in the compressed sensing framework) which guarantees that even an inaccurate optimization algorithm for the factorization stably recovers the factors. We illustrate the theory with a practical example where the deep factorization is a convolutional network.
Fichier principal
Vignette du fichier
identifiable3.pdf (223.02 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01494267 , version 1 (23-03-2017)
hal-01494267 , version 2 (03-07-2018)
hal-01494267 , version 3 (22-10-2018)
hal-01494267 , version 4 (01-02-2023)

Identifiants

Citer

François Malgouyres, Joseph Landsberg. Stable recovery of the factors from a deep matrix product and application to convolutional network. 2017. ⟨hal-01494267v1⟩
384 Consultations
544 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More