| Authors: | Jerome H. Friedman, Trevor Hastie, Rob Tibshirani |
| Title: | [download] (2161)Regularization Paths for Generalized Linear Models via Coordinate Descent |
| Reference: | Vol. 33, Issue 1, Feb 2010 Submitted 2009-04-22, Accepted 2009-12-15 |
| Type: | Article |
| Abstract: | We develop fast algorithms for estimation of generalized linear models with convex penalties. The models include linear regression, two-class logistic regression, and multi- nomial regression problems while the penalties include ℓ1 (the lasso), ℓ2 (ridge regression) and mixtures of the two (the elastic net). The algorithms use cyclical coordinate descent, computed along a regularization path. The methods can handle large problems and can also deal efficiently with sparse features. In comparative timings we find that the new algorithms are considerably faster than competing methods. |
| Paper: | [download] (2161)Regularization Paths for Generalized Linear Models via Coordinate Descent (application/pdf, 544.3 KB) |
| Supplements: | [download] (66)glmnet_1.1-4.tar.gz: R source package (application/x-gzip, 63.6 KB) |
| [download] (92)v33i01.R: R example code to replicate the figures from the paper (application/octet-stream, 1.9 KB) |
|
| [download] (54)v33i01-timings.zip: ZIP archive with source code for replicating the timings simulations (application/zip, 14 KB) |
|
| [download] (58)InternetAd.RData: Data set in R binary format (application/octet-stream, 48.5 KB) |
|
| [download] (71)Leukemia.RData: Data set in R binary format (application/octet-stream, 1.9 MB) |
|
| [download] (68)NewsGroup.RData: Data set in R binary format (application/octet-stream, 9.4 MB) |
|
| [download] (59)Ramaswamy.RData: Data set in R binary format (application/octet-stream, 21.9 MB) |
|
| Resources: | BibTeX | OAI |
