Software Map
Project Tree
Now limiting view to projects in the following categories:
Programming Language :: R [Remove This Filter]
Topic :: High Performance Computing :: Large Memory [Remove This Filter]
Topic > Database
|
Browse By: |
3 projects in result set.
0. track: store obects on disk - Automatically stores objects in files on disk so that
files are rewritten when objects are changed, and so
that objects are accessible but do not occupy memory until
they are accessed. Also tracks times when objects are created
and modified. | |
|
Activity Percentile: 0.00 Registered: 2010-06-22 04:40 |
1. Plot manageable subsets of data - Plotting a large data set is difficult if it does not fit into memory as a data frame, so we introduce more efficient data structures and alternative plot functions that work with large data. | |
|
Activity Percentile: 0.00 Registered: 2009-09-29 11:02 |
2. RMVL - Mappable vector library provides convenient way to access large datasets on solid state drives. This bypasses limitation of physical memory size as well as limited bandwidth of database interfaces. Memory mapped data can be shared between multiple R processes. Access speed depends on storage medium, so solid state drive is recommended, preferably with PCI Express (or M.2 nvme) interface. The data is memory mapped into R and then accessed using usual R list and array subscription operators. The layout of underlying MVL files is optimized for large datasets. The vectors are stored to guarantee alignment for vector intrinsics after memory map. The package is built on top of libMVL, which can be used as standalone C library. libMVL has simple C API making it easy to interchange of datasets with outside programs. | |
|
Activity Percentile: 0.00 Registered: 2021-08-19 02:16 |