Skip to content

chunking module

Extensions for chunking of base operations.

array_gl_slicer ArraySlicer

2-dim array slicer along the column axis based on group lengths.

flex_1d_array_gl_slicer FlexArraySlicer

Flexible 1-dim array slicer along the column axis based on group lengths.

flex_array_gl_slicer FlexArraySlicer

Flexible 2-dim array slicer along the column axis based on group lengths.

group_idxs_mapper GroupIdxsMapper

Default instance of GroupIdxsMapper.

group_lens_mapper GroupLensMapper

Default instance of GroupLensMapper.

shape_gl_slicer ShapeSlicer

Flexible 2-dim shape slicer along the column axis based on group lengths.

get_group_lens_slice function

get_group_lens_slice(
    group_lens,
    chunk_meta
)

Get slice of each chunk in group lengths.

ChunkedFlexArray class

ChunkedFlexArray(
    *args,
    **kwargs
)

Class representing a chunkable flexible array.

Superclasses

Inherited members

ChunkedGroupLens class

ChunkedGroupLens(
    *args,
    **kwargs
)

Class representing chunkable group lengths.

Superclasses

Inherited members

ChunkedGroupMap class

ChunkedGroupMap(
    *args,
    **kwargs
)

Class representing a chunkable group map.

Superclasses

Inherited members

FlexArraySelector class

FlexArraySelector(
    *args,
    **kwargs
)

Class for selecting one element from a NumPy array's axis flexibly based on the chunk index.

The result is intended to be used together with flex_select_1d_nb and flex_select_nb.

Superclasses

Inherited members

FlexArraySizer class

FlexArraySizer(
    *args,
    **kwargs
)

Class for getting the size from the length of an axis in a flexible array.

Superclasses

Inherited members

FlexArraySlicer class

FlexArraySlicer(
    *args,
    **kwargs
)

Class for selecting one element from a NumPy array's axis flexibly based on the chunk index.

The result is intended to be used together with flex_select_1d_nb and flex_select_nb.

Superclasses

Inherited members

GroupIdxsMapper class

GroupIdxsMapper(
    *args,
    **kwargs
)

Class for mapping chunk metadata to per-group column indices.

Argument must be a group map tuple.

Superclasses

Inherited members

GroupLensMapper class

GroupLensMapper(
    *args,
    **kwargs
)

Class for mapping chunk metadata to per-group column lengths.

Argument can be either a group map tuple or a group lengths array.

Superclasses

Inherited members

GroupLensSizer class

GroupLensSizer(
    *args,
    **kwargs
)

Class for getting the size from group lengths.

Argument can be either a group map tuple or a group lengths array.

Superclasses

Inherited members

get_obj_size class method

GroupLensSizer.get_obj_size(
    obj,
    single_type=None
)

Get size of an object.

GroupLensSlicer class

GroupLensSlicer(
    *args,
    **kwargs
)

Class for slicing multiple elements from group lengths based on the chunk range.

Superclasses

Inherited members

GroupMapSlicer class

GroupMapSlicer(
    *args,
    **kwargs
)

Class for slicing multiple elements from a group map based on the chunk range.

Superclasses

Inherited members