Published by the Foundation for Open Access Statistics Editors-in-chief: Bettina Grün, Torsten Hothorn, Rebecca Killick, Edzer Pebesma, Achim Zeileis    ISSN 1548-7660; CODEN JSSOBK
Authors: Markus Schmidberger, Martin Morgan, Dirk Eddelbuettel, Hao Yu, Luke Tierney, Ulrich Mansmann
Title: State of the Art in Parallel Computing with R
Abstract: R is a mature open-source programming language for statistical computing and graphics. Many areas of statistical research are experiencing rapid growth in the size of data sets. Methodological advances drive increased use of simulations. A common approach is to use parallel computing.

This paper presents an overview of techniques for parallel computing with R on computer clusters, on multi-core systems, and in grid computing. It reviews sixteen different packages, comparing them on their state of development, the parallel technology used, as well as on usability, acceptance, and performance.

Two packages (snow, Rmpi) stand out as particularly suited to general use on computer clusters. Packages for grid computing are still in development, with only one package currently available to the end user. For multi-core systems five different packages exist, but a number of issues pose challenges to early adopters. The paper concludes with ideas for further developments in high performance computing with R. Example code is available in the appendix.

Page views:: 32718. Submitted: 2008-12-29. Published: 2009-08-04.
Paper: State of the Art in Parallel Computing with R     Download PDF (Downloads: 32761)
v31i01-appendix.pdf: Appendix with code examples Download (Downloads: 6714; 373KB) v31i01-appendixA.R: R code from Appendix A Download (Downloads: 2084; 2KB) v31i01-appendixB1.R: R code from Appendix B.1 Download (Downloads: 1987; 1KB) v31i01-appendixB2.R: R code from Appendix B.2 Download (Downloads: 1871; 1KB) v31i01-appendixB3.R: R code from Appendix B.3 Download (Downloads: 1887; 2KB)

DOI: 10.18637/jss.v031.i01

This work is licensed under the licenses
Paper: Creative Commons Attribution 3.0 Unported License
Code: GNU General Public License (at least one of version 2 or version 3) or a GPL-compatible license.