Software Map

Project Tree

Project Tree

Now limiting view to projects in the following categories:
Operating System :: OS Independent [Remove This Filter]

Topic > High Performance Computing > Large Memory

Browse By:

5 projects in result set.

0. RMVL - Mappable vector library provides convenient way to access large datasets on solid state drives. This bypasses limitation of physical memory size as well as limited bandwidth of database interfaces. Memory mapped data can be shared between multiple R processes. Access speed depends on storage medium, so solid state drive is recommended, preferably with PCI Express (or M.2 nvme) interface. The data is memory mapped into R and then accessed using usual R list and array subscription operators. The layout of underlying MVL files is optimized for large datasets. The vectors are stored to guarantee alignment for vector intrinsics after memory map. The package is built on top of libMVL, which can be used as standalone C library. libMVL has simple C API making it easy to interchange of datasets with outside programs.

Development Status : 3 - Alpha [Filter]
Intended Audience : End Users/Desktop [Filter]
License : OSI Approved : GNU Lesser General Public License (LGPL) [Filter]
Operating System : OS Independent (Now Filtering)
Programming Language : C/C\+\+ [Filter]
Programming Language : R [Filter]
Topic : Database [Filter]
Topic : High Performance Computing : Large Memory [Filter]
Topic : High Performance Computing : Parallel Computing [Filter]

Activity Percentile: 0.00

Registered: 2021-08-19 02:16

1. Plot manageable subsets of data - Plotting a large data set is difficult if it does not fit into memory as a data frame, so we introduce more efficient data structures and alternative plot functions that work with large data.

Development Status : 3 - Alpha [Filter]
Environment : Console (Text Based) [Filter]
Intended Audience : Developers [Filter]
Intended Audience : End Users/Desktop [Filter]
License : OSI Approved : GNU General Public License (GPL) [Filter]
Natural Language : English [Filter]
Operating System : OS Independent (Now Filtering)
Programming Language : PL/SQL [Filter]
Programming Language : R [Filter]
Topic : Database [Filter]
Topic : Graphics : Plotting [Filter]
Topic : High Performance Computing : Large Memory [Filter]

Activity Percentile: 0.00

Registered: 2009-09-29 11:02

2. colbycol - This is a package intended for reading huge text data files into R by processing columns one by one individually.

Development Status : 4 - Beta [Filter]
Environment : Console (Text Based) [Filter]
Intended Audience : End Users/Desktop [Filter]
License : OSI Approved : GNU General Public License (GPL) [Filter]
Natural Language : English [Filter]
Operating System : OS Independent (Now Filtering)
Programming Language : Java [Filter]
Programming Language : R [Filter]
Topic : High Performance Computing : Large Memory [Filter]

Activity Percentile: 0.00

Registered: 2009-05-18 10:18

3. Large objects for R - Package 'ff' supports fast on-disk objects: standard and packed atomics, ffdf data.frames, csv import/export, chunking and indexing. Integrated package 'bit' supports fast in-memory booleans: 'bit' (1-bit boolean), 'bitwhich' (asymetric booleans).

Development Status : 5 - Production/Stable [Filter]
Environment : Console (Text Based) [Filter]
Intended Audience : Developers [Filter]
License : OSI Approved : GNU General Public License (GPL) [Filter]
Natural Language : English [Filter]
Operating System : OS Independent (Now Filtering)
Programming Language : C/C\+\+ [Filter]
Programming Language : R [Filter]
Topic : High Performance Computing : Large Memory [Filter]

Activity Percentile: 0.00

Registered: 2009-07-19 10:21

4. track: store obects on disk - Automatically stores objects in files on disk so that files are rewritten when objects are changed, and so that objects are accessible but do not occupy memory until they are accessed. Also tracks times when objects are created and modified.

Development Status : 5 - Production/Stable [Filter]
Intended Audience : Developers [Filter]
Intended Audience : End Users/Desktop [Filter]
License : OSI Approved : GNU General Public License (GPL) [Filter]
Natural Language : English [Filter]
Operating System : OS Independent (Now Filtering)
Programming Language : R [Filter]
Topic : Database [Filter]
Topic : High Performance Computing : Large Memory [Filter]

Activity Percentile: 0.00

Registered: 2010-06-22 04:40