Software Map
Project Tree
Now limiting view to projects in the following categories:
Operating System :: OS Independent [Remove This Filter]
Programming Language :: C/C++ [Remove This Filter]
Topic :: High Performance Computing :: Large Memory [Remove This Filter]
Operating System > OS Independent |
Browse By: |
2 projects in result set.
0. Large objects for R - Package 'ff' supports fast on-disk objects: standard and packed atomics, ffdf data.frames, csv import/export, chunking and indexing. Integrated package 'bit' supports fast in-memory booleans: 'bit' (1-bit boolean), 'bitwhich' (asymetric booleans). | |
|
Activity Percentile: 0.00 Registered: 2009-07-19 10:21 |
1. RMVL - Mappable vector library provides convenient way to access large datasets on solid state drives. This bypasses limitation of physical memory size as well as limited bandwidth of database interfaces. Memory mapped data can be shared between multiple R processes. Access speed depends on storage medium, so solid state drive is recommended, preferably with PCI Express (or M.2 nvme) interface. The data is memory mapped into R and then accessed using usual R list and array subscription operators. The layout of underlying MVL files is optimized for large datasets. The vectors are stored to guarantee alignment for vector intrinsics after memory map. The package is built on top of libMVL, which can be used as standalone C library. libMVL has simple C API making it easy to interchange of datasets with outside programs. | |
|
Activity Percentile: 0.00 Registered: 2021-08-19 02:16 |