Package io.datarouter.bytes.blockfile.row

Class BlockfileRowCollator

java.lang.Object

io.datarouter.bytes.blockfile.row.BlockfileRowCollator

public class BlockfileRowCollator
extends Object

Collate BlockfileRows using only the binary data, not requiring the objects to be decoded. Facilitates sorting much more data than fits in memory.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	BlockfileRowCollator.BlockfileRowCollatorPruneDeletesScanner	Assumes non-null entries.
static class	BlockfileRowCollator.BlockfileRowCollatorPruneVersionsScanner	Assumes non-null entries.
static enum	BlockfileRowCollator.BlockfileRowCollatorStrategy

Constructor Summary

Constructors

Constructor	Description
BlockfileRowCollator()

Method Summary

Modifier and Type	Method	Description
static io.datarouter.scanner.Scanner<BlockfileRow>	keepAll(List<io.datarouter.scanner.Scanner<BlockfileRow>> readers)	Fastest option Merge entries keeping all versions and ops, including duplicates.
static io.datarouter.scanner.Scanner<BlockfileRow>	pruneAll(List<io.datarouter.scanner.Scanner<BlockfileRow>> readers)	Merge entries keeping the latest version.
static io.datarouter.scanner.Scanner<BlockfileRow>	pruneVersions(List<io.datarouter.scanner.Scanner<BlockfileRow>> readers)	Merge entries keeping the latest version.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

BlockfileRowCollator

public BlockfileRowCollator()

Method Details

keepAll

public static io.datarouter.scanner.Scanner<BlockfileRow> keepAll(List<io.datarouter.scanner.Scanner<BlockfileRow>> readers)

Fastest option Merge entries keeping all versions and ops, including duplicates. Assumes input is sorted by key+version+op.

pruneVersions

public static io.datarouter.scanner.Scanner<BlockfileRow> pruneVersions(List<io.datarouter.scanner.Scanner<BlockfileRow>> readers)

Merge entries keeping the latest version. Keeps deletes. Assumes input is sorted by key+version+op. If multiple entries have same latest version then selection is undefined.

pruneAll

public static io.datarouter.scanner.Scanner<BlockfileRow> pruneAll(List<io.datarouter.scanner.Scanner<BlockfileRow>> readers)

Merge entries keeping the latest version. If lastest version is a DELETE then it's omitted. Assumes input is sorted by key+version. If multiple entries have same latest version then selection is undefined.