io.druid.query.groupby.epinephelinae

Class SpillingGrouper<KeyType extends Comparable<KeyType>>

java.lang.Object

io.druid.query.groupby.epinephelinae.SpillingGrouper<KeyType>

All Implemented Interfaces:

Grouper<KeyType>, Closeable, AutoCloseable

public class SpillingGrouper<KeyType extends Comparable<KeyType>>
extends Object
implements Grouper<KeyType>

Grouper based around a single underlying BufferGrouper. Not thread-safe. When the underlying grouper is full, its contents are sorted and written to temporary files using "spillMapper".

Nested Class Summary

Nested classes/interfaces inherited from interface io.druid.query.groupby.epinephelinae.Grouper

Grouper.Entry<T>, Grouper.KeyComparator, Grouper.KeySerde<T>, Grouper.KeySerdeFactory<T>

Constructor Summary

Constructors

Constructor and Description
SpillingGrouper(ByteBuffer buffer, Grouper.KeySerdeFactory<KeyType> keySerdeFactory, ColumnSelectorFactory columnSelectorFactory, AggregatorFactory[] aggregatorFactories, int bufferGrouperMaxSize, float bufferGrouperMaxLoadFactor, int bufferGrouperInitialBuckets, LimitedTemporaryStorage temporaryStorage, com.fasterxml.jackson.databind.ObjectMapper spillMapper, boolean spillingAllowed)

Method Summary

Modifier and Type	Method and Description
boolean	aggregate(KeyType key) Aggregate the current row with the provided key.
boolean	aggregate(KeyType key, int keyHash) Aggregate the current row with the provided key.
void	close() Close the grouper and release associated resources.
Iterator<Grouper.Entry<KeyType>>	iterator(boolean sorted) Iterate through entries.
void	reset() Reset the grouper to its initial state.
void	setSpillingAllowed(boolean spillingAllowed)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SpillingGrouper

public SpillingGrouper(ByteBuffer buffer,
                       Grouper.KeySerdeFactory<KeyType> keySerdeFactory,
                       ColumnSelectorFactory columnSelectorFactory,
                       AggregatorFactory[] aggregatorFactories,
                       int bufferGrouperMaxSize,
                       float bufferGrouperMaxLoadFactor,
                       int bufferGrouperInitialBuckets,
                       LimitedTemporaryStorage temporaryStorage,
                       com.fasterxml.jackson.databind.ObjectMapper spillMapper,
                       boolean spillingAllowed)

Method Detail

aggregate

public boolean aggregate(KeyType key,
                         int keyHash)

Description copied from interface: Grouper

Aggregate the current row with the provided key. Some implementations are thread-safe and some are not.

Specified by:

aggregate in interface Grouper<KeyType extends Comparable<KeyType>>

Parameters:

key - key object

keyHash - result of Groupers.hash(Object) on the key

Returns:

true if the row was aggregated, false if not due to hitting resource limits

aggregate

public boolean aggregate(KeyType key)

Description copied from interface: Grouper

Aggregate the current row with the provided key. Some implementations are thread-safe and some are not.

Specified by:

aggregate in interface Grouper<KeyType extends Comparable<KeyType>>

Parameters:

key - key

Returns:

true if the row was aggregated, false if not due to hitting resource limits

reset

public void reset()

Description copied from interface: Grouper

Reset the grouper to its initial state.

Specified by:

reset in interface Grouper<KeyType extends Comparable<KeyType>>

close

public void close()

Description copied from interface: Grouper

Close the grouper and release associated resources.

Specified by:

close in interface Grouper<KeyType extends Comparable<KeyType>>

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

setSpillingAllowed

public void setSpillingAllowed(boolean spillingAllowed)

iterator

public Iterator<Grouper.Entry<KeyType>> iterator(boolean sorted)

Description copied from interface: Grouper

Iterate through entries. If a comparator is provided, do a sorted iteration. Once this method is called, writes are no longer safe. After you are done with the iterator returned by this method, you should either call Grouper.close() (if you are done with the Grouper), Grouper.reset() (if you want to reuse it), or Grouper.iterator(boolean) again if you want another iterator. If "sorted" is true then the iterator will return sorted results. It will use KeyType's natural ordering on deserialized objects, and will use the Grouper.KeySerde.comparator() on serialized objects. Woe be unto you if these comparators are not equivalent.

Specified by:

iterator in interface Grouper<KeyType extends Comparable<KeyType>>

Parameters:

sorted - return sorted results

Returns:

entry iterator