Package nz.org.riskscape.engine.io

Class DiskStorage

java.lang.Object

nz.org.riskscape.engine.io.DiskStorage

All Implemented Interfaces:

nz.org.riskscape.engine.io.TupleStorage

public class DiskStorage
extends Object
implements nz.org.riskscape.engine.io.TupleStorage

TupleStorage backed by a directory on the filesystem.

Field Summary

Fields

Modifier and Type	Field	Description
static final String	TUPLES_FILE_FORMAT
static final Pattern	TUPLES_FILE_PATTERN

Constructor Summary

Constructors

Constructor	Description
DiskStorage()	Create disk storage that writes out the to the JVM's temp dir.
DiskStorage(com.codahale.metrics.Counter counter)
DiskStorage(Path dataDir)	Create disk storage that writes files in to the given directory
DiskStorage(Path dataDir, boolean useCompression)
DiskStorage(Path dataDir, boolean useCompression, com.codahale.metrics.Counter counter)	Create disk storage based on a given directory

Method Summary

Modifier and Type	Method	Description
nz.org.riskscape.engine.io.TupleWriter	createTemporaryWriter()
Path	getDataDir()
DiskStorageReader	getReader(DiskStorageWriter writer)
nz.org.riskscape.engine.io.TupleReader	getReader(nz.org.riskscape.engine.io.TupleWriter writer)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

TUPLES_FILE_FORMAT

public static final String TUPLES_FILE_FORMAT

See Also:

• Constant Field Values

TUPLES_FILE_PATTERN

public static final Pattern TUPLES_FILE_PATTERN

Constructor Details

DiskStorage

public DiskStorage(Path dataDir)

Create disk storage that writes files in to the given directory

Parameters:

dataDir - directory to store tuples in

DiskStorage

public DiskStorage()

Create disk storage that writes out the to the JVM's temp dir.

DiskStorage

public DiskStorage(Path dataDir,
 boolean useCompression,
 com.codahale.metrics.Counter counter)

Create disk storage based on a given directory

Parameters:

dataDir - directory to store tuples in

useCompression - if true, all readers and writers from this storage will use gzip compression. This can use less disk at the cost of CPU when reading in and out.

DiskStorage

public DiskStorage(com.codahale.metrics.Counter counter)

DiskStorage

public DiskStorage(Path dataDir,
 boolean useCompression)

Method Details

createTemporaryWriter

public nz.org.riskscape.engine.io.TupleWriter createTemporaryWriter()
                                                             throws IOException

Specified by:

createTemporaryWriter in interface nz.org.riskscape.engine.io.TupleStorage

Throws:

IOException

getReader

public DiskStorageReader getReader(DiskStorageWriter writer)
                            throws IOException

Throws:

IOException

getReader

public nz.org.riskscape.engine.io.TupleReader getReader(nz.org.riskscape.engine.io.TupleWriter writer)
                                                 throws IOException

Specified by:

getReader in interface nz.org.riskscape.engine.io.TupleStorage

Throws:

IOException

getDataDir

public Path getDataDir()