In R usually data is loaded in RAM.
Are there any packages which load the data in disk rather than RAM
In R usually data is loaded in RAM. Are there any packages which load
Share
Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.
Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Please briefly explain why you feel this question should be reported.
Please briefly explain why you feel this answer should be reported.
Please briefly explain why you feel this user should be reported.
In R usually data is loaded in RAM.
Are there any packages which load the data in disk rather than RAM
Check out the
bigmemorypackage, along with related packages likebigtabulate,bigalgebra,biganalytics, and more. There’s alsoff, though I don’t find it as user-friendly as thebigmemorysuite. Thebigmemorysuite was reportedly partially motivated by the difficulty of usingff. I like it because it required very few changes to my code to be able to access abigmatrixobject: it can be manipulated in almost exactly the same ways as a standard matrix, so my code is very reusable.There’s also support for HDF5 via NetCDF4, in packages like
RNetCDFandncdf. This is a popular, multi-platform, multi-language method for efficient storage and access of large data sets.If you want basic memory mapping functionality, look at the
mmappackage.