lqa-package: Fitting GLMs based on penalized likelihood inference.
Description
The lqa
package is designed to fit Generalized Linear Models (GLMs) based on penalized likelihood inference.
That is we assume our objective to be
$$\min_{\mathbf{b}} - \ell (\mathbf{b}) + P_\lambda (\boldsymbol{\beta}),$$
where $\ell(\mathbf{b})$ is the log-likelihood of the underlying GLM with unknown coefficient vector
$\mathbf{b} = (\beta_0, \boldsymbol{\beta}^\top)^\top$ and the penalty term has structure
$$P_{\lambda} (\boldsymbol{\beta}) = \sum_{j=1}^J p_{\lambda,j} (|\mathbf{a}_j^\top \boldsymbol{\beta}|)$$
with known vectors of constants $\mathbf{a}_j$.
The subscript
$\boldsymbol{\lambda}$ illustrates the dependency on a vector of tuning parameters. This structure allows for many different penalty terms,
including polytopes (such as lasso, fused lasso, LICB) and quadratic penalties (ridge, penalreg etc.).
The main important fitting procedure is the LQA algorithm. Alternatively, you can apply GBlockBoost (including RidgeBoost as
special case when you use the arguments penalty = ridge
and componentwise = TRUE
) or ForwardBoost.
However, the P-IRLS algorithm is also implemented (indirectly) as this is a special case of the LQA algorithm.
See Ulbricht (2010) or the accompanying `User's Guide' for further details.Details
ll{
Package: lqa
Type: Package
Version: 1.0-2
Date: 2010-04-15
License: GPL-2
LazyLoad: yes
}References
Ulbricht, Jan (2010) Variable Selection in Generalized Linear Models. Ph.D. Thesis. Ludwig Maximilians University Munich.