Logically the same as Binary, but the internal representation uses a view
struct that contains the string length and either the string's entire data
inline (for small strings) or an inlined prefix, an index of another buffer,
and an offset pointing to a slice in that buffer (for non-small strings).
Optional compression for the memory buffers constituting IPC message
bodies.
----------------------------------------------------------------------
A Buffer represents a single contiguous memory segment
Date is either a 32-bit or 64-bit signed integer type representing an
elapsed time since UNIX epoch (1970-01-01), stored in either of two units:
* Milliseconds (64 bits) indicating UNIX time elapsed since the epoch (no
leap seconds), where the values are evenly divisible by 86400000
* Days (32 bits) since the UNIX epoch
Exact decimal value represented as an integer value in two's
complement.
For sending dictionary encoding information.
----------------------------------------------------------------------
A field represents a named column in a record / row batch or child of a
nested type.
----------------------------------------------------------------------
Data structures for describing a table row batch (a collection of
equal-length Arrow arrays)
Metadata about a field at some level of a nested type tree (but not
its children).
----------------------------------------------------------------------
Arrow File metadata
----------------------------------------------------------------------
user defined key value pairs to add custom metadata to arrow
key namespacing is the responsibility of the user
Same as Binary, but with 64-bit offsets, allowing to represent
extremely large data values.
Same as List, but with 64-bit offsets, allowing to represent
extremely large data values.
Same as ListView, but with 64-bit offsets and sizes, allowing to represent
extremely large data values.
Same as Utf8, but with 64-bit offsets, allowing to represent
extremely large data values.
Represents the same logical types that List can, but contains offsets and
sizes allowing for writes in any order and sharing of child values among
list values.
A Map is a logical nested type that is represented as
Listinvalid input: '<'entries: Structinvalid input: '<'key: K, value: V>>
In this layout, the keys and values are each respectively contiguous.
These are stored in the flatbuffer in the Type union below
A data header describing the shared memory layout of a "record" or "row"
batch.
Contains two child arrays, run_ends and values.
----------------------------------------------------------------------
A Schema describes the columns in a row batch
Compressed Sparse format, that is matrix-specific.
----------------------------------------------------------------------
EXPERIMENTAL: Data structures for sparse tensors
Coordinate (COO) format of sparse tensor index.
Compressed Sparse Fiber (CSF) sparse tensor index.
A Struct_ in the flatbuffer metadata is the same as an Arrow Struct
(according to the physical memory layout).
----------------------------------------------------------------------
Data structures for dense tensors
Shape data for a single axis in a tensor
Time is either a 32-bit or 64-bit signed integer type representing an
elapsed time since midnight, stored in either of four units: seconds,
milliseconds, microseconds or nanoseconds.
Timestamp is a 64-bit signed integer representing an elapsed time since a
fixed epoch, stored in either of four units: seconds, milliseconds,
microseconds or nanoseconds, and is optionally annotated with a timezone.
A union is a complex type with children in Field
By default ids in the type vector refer to the offsets in the children
optionally typeIds provides an indirection between the child offset and the type id
for each child `typeIds[offset]` is the id used in the type vector
Unicode with UTF-8 encoding
Logically the same as Utf8, but the internal representation uses a view
struct that contains the string length and either the string's entire data
inline (for small strings) or an inlined prefix, an index of another buffer,
and an offset pointing to a slice in that buffer (for non-small strings).