Package org.apache.arrow.flatbuf
Class RecordBatch
java.lang.Object
com.google.flatbuffers.Table
org.apache.arrow.flatbuf.RecordBatch
public final class RecordBatch
extends com.google.flatbuffers.Table
A data header describing the shared memory layout of a "record" or "row"
batch. Some systems call this a "row batch" internally and others a "record
batch".
-
Nested Class Summary
Nested Classes -
Field Summary
Fields inherited from class com.google.flatbuffers.Table
bb, bb_pos -
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescription__assign(int _i, ByteBuffer _bb) void__init(int _i, ByteBuffer _bb) static voidaddBuffers(com.google.flatbuffers.FlatBufferBuilder builder, int buffersOffset) static voidaddCompression(com.google.flatbuffers.FlatBufferBuilder builder, int compressionOffset) static voidaddLength(com.google.flatbuffers.FlatBufferBuilder builder, long length) static voidaddNodes(com.google.flatbuffers.FlatBufferBuilder builder, int nodesOffset) static voidaddVariadicBufferCounts(com.google.flatbuffers.FlatBufferBuilder builder, int variadicBufferCountsOffset) buffers(int j) Buffers correspond to the pre-ordered flattened buffer tree The number of buffers appended to this list depends on the schema.intOptional compression of the message bodystatic intcreateRecordBatch(com.google.flatbuffers.FlatBufferBuilder builder, long length, int nodesOffset, int buffersOffset, int compressionOffset, int variadicBufferCountsOffset) static intcreateVariadicBufferCountsVector(com.google.flatbuffers.FlatBufferBuilder builder, long[] data) static intendRecordBatch(com.google.flatbuffers.FlatBufferBuilder builder) static RecordBatchstatic RecordBatchgetRootAsRecordBatch(ByteBuffer _bb, RecordBatch obj) longlength()number of records / rows.nodes(int j) Nodes correspond to the pre-ordered flattened logical schemaintstatic voidstartBuffersVector(com.google.flatbuffers.FlatBufferBuilder builder, int numElems) static voidstartNodesVector(com.google.flatbuffers.FlatBufferBuilder builder, int numElems) static voidstartRecordBatch(com.google.flatbuffers.FlatBufferBuilder builder) static voidstartVariadicBufferCountsVector(com.google.flatbuffers.FlatBufferBuilder builder, int numElems) static voidlongvariadicBufferCounts(int j) Some types such as Utf8View are represented using a variable number of buffers.intcom.google.flatbuffers.LongVectorcom.google.flatbuffers.LongVectorvariadicBufferCountsVector(com.google.flatbuffers.LongVector obj) Methods inherited from class com.google.flatbuffers.Table
__has_identifier, __indirect, __indirect, __offset, __offset, __reset, __reset, __string, __string, __union, __union, __vector, __vector_as_bytebuffer, __vector_in_bytebuffer, __vector_len, compareStrings, compareStrings, getByteBuffer, keysCompare, sortTables
-
Constructor Details
-
RecordBatch
public RecordBatch()
-
-
Method Details
-
ValidateVersion
public static void ValidateVersion() -
getRootAsRecordBatch
-
getRootAsRecordBatch
-
__init
-
__assign
-
length
public long length()number of records / rows. The arrays in the batch should all have this length -
nodes
Nodes correspond to the pre-ordered flattened logical schema -
nodes
-
nodesLength
public int nodesLength() -
nodesVector
-
nodesVector
-
buffers
Buffers correspond to the pre-ordered flattened buffer tree The number of buffers appended to this list depends on the schema. For example, most primitive arrays will have 2 buffers, 1 for the validity bitmap and 1 for the values. For struct arrays, there will only be a single buffer for the validity (nulls) bitmap -
buffers
-
buffersLength
public int buffersLength() -
buffersVector
-
buffersVector
-
compression
Optional compression of the message body -
compression
-
variadicBufferCounts
public long variadicBufferCounts(int j) Some types such as Utf8View are represented using a variable number of buffers. For each such Field in the pre-ordered flattened logical schema, there will be an entry in variadicBufferCounts to indicate the number of number of variadic buffers which belong to that Field in the current RecordBatch. For example, the schema col1: Structinvalid input: '<'alpha: Int32, beta: BinaryView, gamma: Float64> col2: Utf8View contains two Fields with variadic buffers so variadicBufferCounts will have two entries, the first counting the variadic buffers of `col1.beta` and the second counting `col2`'s. This field may be omitted if and only if the schema contains no Fields with a variable number of buffers, such as BinaryView and Utf8View. -
variadicBufferCountsLength
public int variadicBufferCountsLength() -
variadicBufferCountsVector
public com.google.flatbuffers.LongVector variadicBufferCountsVector() -
variadicBufferCountsVector
public com.google.flatbuffers.LongVector variadicBufferCountsVector(com.google.flatbuffers.LongVector obj) -
variadicBufferCountsAsByteBuffer
-
variadicBufferCountsInByteBuffer
-
createRecordBatch
public static int createRecordBatch(com.google.flatbuffers.FlatBufferBuilder builder, long length, int nodesOffset, int buffersOffset, int compressionOffset, int variadicBufferCountsOffset) -
startRecordBatch
public static void startRecordBatch(com.google.flatbuffers.FlatBufferBuilder builder) -
addLength
public static void addLength(com.google.flatbuffers.FlatBufferBuilder builder, long length) -
addNodes
public static void addNodes(com.google.flatbuffers.FlatBufferBuilder builder, int nodesOffset) -
startNodesVector
public static void startNodesVector(com.google.flatbuffers.FlatBufferBuilder builder, int numElems) -
addBuffers
public static void addBuffers(com.google.flatbuffers.FlatBufferBuilder builder, int buffersOffset) -
startBuffersVector
public static void startBuffersVector(com.google.flatbuffers.FlatBufferBuilder builder, int numElems) -
addCompression
public static void addCompression(com.google.flatbuffers.FlatBufferBuilder builder, int compressionOffset) -
addVariadicBufferCounts
public static void addVariadicBufferCounts(com.google.flatbuffers.FlatBufferBuilder builder, int variadicBufferCountsOffset) -
createVariadicBufferCountsVector
public static int createVariadicBufferCountsVector(com.google.flatbuffers.FlatBufferBuilder builder, long[] data) -
startVariadicBufferCountsVector
public static void startVariadicBufferCountsVector(com.google.flatbuffers.FlatBufferBuilder builder, int numElems) -
endRecordBatch
public static int endRecordBatch(com.google.flatbuffers.FlatBufferBuilder builder)
-