datumaro.plugins.data_formats.datumaro_binary#

class datumaro.plugins.data_formats.datumaro_binary.DatumaroBinaryBase(path: str, *, num_workers: int = 0, subset: str | None = None, ctx: ImportContext | None = None)[source]#

Bases: DatumaroBase

Parameters:

path – Directory path to import DatumaroBinary format dataset
num_workers – The number of multi-processing workers for import. If num_workers = 0, do not use multiprocessing.

property is_stream: bool#

Boolean indicating whether the dataset is a stream

If the dataset is a stream, the dataset item is generated on demand from its iterator.

infos()[source]#: Returns meta-info of dataset.

categories()[source]#: Returns metainfo about dataset labels.

media_type()[source]#

Returns media type of the dataset items.

All the items are supposed to have the same media type. Supposed to be constant and known immediately after the object construction (i.e. doesn’t require dataset iteration).

ann_types()[source]#: Returns available task type from dataset annotation types.

class datumaro.plugins.data_formats.datumaro_binary.DatumaroBinaryExporter(extractor: IDataset, save_dir: str, *, save_media: bool | None = None, image_ext: str | None = None, default_image_ext: str | None = None, save_dataset_meta: bool = False, ctx: ExportContext | None = None, num_workers: int = 0, max_blob_size: int = 1048576, **kwargs)[source]#

Bases: DatumaroExporter

Parameters:

num_workers – The number of multi-processing workers for export. If num_workers = 0, do not use multiprocessing.
max_blob_size – The maximum size of DatasetItem serialization blob. Changing from the default is not recommended.

DEFAULT_IMAGE_EXT = '.jpg'#

PATH_CLS#: alias of DatumaroBinaryPath

classmethod build_cmdline_parser(**kwargs)[source]#

create_writer(subset: str, images_dir: str, pcd_dir: str, video_dir: str) → _SubsetWriter[source]#

class datumaro.plugins.data_formats.datumaro_binary.DatumaroBinaryImporter[source]#

Bases: DatumaroImporter

PATH_CLS#: alias of DatumaroBinaryPath

classmethod build_cmdline_parser(**kwargs)[source]#

classmethod detect(context: FormatDetectionContext) → FormatDetectionConfidence | None[source]#

Modules

`datumaro.plugins.data_formats.datumaro_binary.base`
`datumaro.plugins.data_formats.datumaro_binary.exporter`
`datumaro.plugins.data_formats.datumaro_binary.format`
`datumaro.plugins.data_formats.datumaro_binary.importer`
`datumaro.plugins.data_formats.datumaro_binary.mapper`