Package io.datarouter.bytes.kvfile.read

Class KvFileCollator

java.lang.Object

io.datarouter.bytes.kvfile.read.KvFileCollator

public class KvFileCollator
extends Object

Collate KvFileEntries using only the binary data, not requiring the objects to be decoded. Facilitates sorting much more data than fits in memory.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	KvFileCollator.KvFileCollatorPruneDeletesScanner	Assumes non-null entries.
static class	KvFileCollator.KvFileCollatorPruneVersionsScanner	Assumes non-null entries.
static enum	KvFileCollator.KvFileCollatorStrategy

Constructor Summary

Constructors

Constructor	Description
KvFileCollator()

Method Summary

Modifier and Type	Method	Description
static io.datarouter.scanner.Scanner<KvFileEntry>	keepAll(List<io.datarouter.scanner.Scanner<KvFileEntry>> readers)	Fastest option Merge entries keeping all versions and ops, including duplicates.
static io.datarouter.scanner.Scanner<KvFileEntry>	pruneAll(List<io.datarouter.scanner.Scanner<KvFileEntry>> readers)	Merge entries keeping the latest version.
static io.datarouter.scanner.Scanner<KvFileEntry>	pruneVersions(List<io.datarouter.scanner.Scanner<KvFileEntry>> readers)	Merge entries keeping the latest version.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

KvFileCollator

public KvFileCollator()

Method Details

keepAll

public static io.datarouter.scanner.Scanner<KvFileEntry> keepAll(List<io.datarouter.scanner.Scanner<KvFileEntry>> readers)

Fastest option Merge entries keeping all versions and ops, including duplicates. Assumes input is sorted by key+version+op.

pruneVersions

public static io.datarouter.scanner.Scanner<KvFileEntry> pruneVersions(List<io.datarouter.scanner.Scanner<KvFileEntry>> readers)

Merge entries keeping the latest version. Keeps deletes. Assumes input is sorted by key+version+op. If multiple entries have same latest version then selection is undefined.

pruneAll

public static io.datarouter.scanner.Scanner<KvFileEntry> pruneAll(List<io.datarouter.scanner.Scanner<KvFileEntry>> readers)

Merge entries keeping the latest version. If lastest version is a DELETE then it's omitted. Assumes input is sorted by key+version. If multiple entries have same latest version then selection is undefined.