Section: Research Program

Inverse problems in Neuroimaging

Many problems in neuroimaging can be framed as forward and inverse problems. For instance, the neuroimaging inverse problem consists in predicting individual information (behavior, phenotype) from neuroimaging data, while the forward problem consists in fitting neuroimaging data with high-dimensional (e.g. genetic) variables. Solving these problems entails the definition of two terms: a loss that quantifies the goodness of fit of the solution (does the model explain the data reasonably well ?), and a regularization schemes that represents a prior on the expected solution of the problem. In particular some priors enforce some properties of the solutions, such as sparsity, smoothness or being piece-wise constant.

Let us detail the model used in the inverse problem: Let $𝐗$ be a neuroimaging dataset as an $(n_{subj},n_{voxels})$ matrix, where $n_{subj}$ and $n_{voxels}$ are the number of subjects under study, and the image size respectively, $𝐘$ an array of values that represent characteristics of interest in the observed population, written as $(n_{subj},n_f)$ matrix, where $n_f$ is the number of characteristics that are tested, and $\beta$ an array of shape $(n_{voxels},n_f)$ that represents a set of pattern-specific maps. In the first place, we may consider the columns ${𝐘}_1,..,{𝐘}_{n_f}$ of $Y$ independently, yielding $n_f$ problems to be solved in parallel:

where the vector contains ${\beta }_i$ is the $i^{th}$ row of $\beta$. As the problem is clearly ill-posed, it is naturally handled in a regularized regression framework:

where $\Psi$ is an adequate penalization used to regularize the solution:

with ${\lambda }_1,{\lambda }_2,{\eta }_1,{\eta }_2\ge 0$ (this formulation particularly highlights the fact that convex regularizers are norms or quasi-norms). In general, only one or two of these constraints is considered (hence is enforced with a non-zero coefficient):

• When ${\lambda }_1>0$ only (LASSO), and to some extent, when ${\lambda }_1,{\lambda }_2>0$ only (elastic net), the optimal solution $\beta$ is (possibly very) sparse, but may not exhibit a proper image structure; it does not fit well with the intuitive concept of a brain map.

• Total Variation regularization (see Fig. 1 ) is obtained for (${\eta }_1>0$ only), and typically yields a piece-wise constant solution. It can be associated with Lasso to enforce both sparsity and sparse variations.

• Smooth lasso is obtained with (${\eta }_2>0$ and ${\lambda }_1>0$ only), and yields smooth, compactly supported spatial basis functions.

The performance of the predictive model can simply be evaluated as the amount of variance in ${𝐘}_i$ fitted by the model, for each $i\in \{1,..,n_f\}$. This can be computed through cross-validation, by learning ${\widehat{\beta }}_i$ on some part of the dataset, and then estimating $(Y_i-X{\widehat{\beta }}_i)$ using the remainder of the dataset.

This framework is easily extended by considering

• Grouped penalization, where the penalization explicitly includes a prior clustering of the features, i.e. voxel-related signals, into given groups. This is particularly important to include external anatomical priors on the relevant solution.

• Combined penalizations, i.e. a mixture of simple and group-wise penalizations, that allow some variability to fit the data in different populations of subjects, while keeping some common constraints.

• Logistic regression, where a logistic non-linearity is applied to the linear model so that it yields a probability of classification in a binary classification problem.

• Robustness to between-subject variability is an important question, as it makes little sense that a learned model depends dramatically on the particular observations used for learning. This is an important issue, as this kind of robustness is somewhat opposite to sparsity requirements.

• Multi-task learning: if several target variables are thought to be related, it might be useful to constrain the estimated parameter vector $\beta$ to have a shared support across all these variables.

  For instance, when one of the variables ${𝐘}_i$ is not well fitted by the model, the estimation of other variables ${𝐘}_j,j\ne i$ may provide constraints on the support of ${\beta }_i$ and thus, improve the prediction of ${𝐘}_i$. Yet this does not impose constraints on the non-zero parameters of the parameters ${\beta }_i$.

  $𝐘=𝐗\beta +ϵ,$

  (3)

  then

  $\widehat{\beta }={\text{argmin}}_{\beta =\left({\beta }_i\right),i=1..n_f}\sum _{i=1}^{n_f}{\parallel {𝐘}_{𝐢}-𝐗{\beta }_{𝐢}\parallel }^2+\lambda \sum _{j=1}^{n_{voxels}}\sqrt{{\sum }_{i=1}^{n_f}{\beta }_{𝐢,𝐣}^{\mathbf{2}}}$

  (4)