Module opendal_source

Re-exports

pub use batch_posix_fs_source::BatchPosixFsEnumerator;

pub use batch_posix_fs_source::BatchPosixFsReader;

pub use batch_posix_fs_source::BatchPosixFsSplit;

pub use opendal_enumerator::OpendalEnumerator;

Modules

azblob_source

batch_posix_fs_source

gcs_source

opendal_enumerator

opendal_reader

posix_fs_source

s3_source

Structs

AzblobProperties

BatchPosixFsProperties

FsSourceCommon

GcsProperties

OpendalAzblob

OpendalGcs

OpendalPosixFs

OpendalS3

OpendalS3Properties

PosixFsProperties

S3PropertiesCommon

These are supported by both s3 and s3_v2 (opendal) sources.

Constants

AZBLOB_CONNECTOR

BATCH_POSIX_FS_CONNECTOR

DEFAULT_REFRESH_INTERVAL_SEC

GCS_CONNECTOR

OPENDAL_S3_CONNECTOR

The new s3_v2 will use opendal. Note: user uses connector='s3', which is converted to connector='s3_v2' in frontend (in validate_compatibility). If user inputs connector='s3_v2', it will be rejected.

POSIX_FS_CONNECTOR

Traits

OpendalSource