API reference
python:irx:irx.record_batch.ParquetOptions
class ParquetOptions
ParquetOptions(batch_size: int = 65536, row_group_size: int = 1048576, data_page_size: int = 1048576, compression: str = 'snappy', compression_level: int | None = None, columns: tuple[str, ...] = (), partition_columns: tuple[str, ...] = (), row_groups: tuple[int, ...] = (), predicates: tuple[ParquetPredicate, ...] = (), use_threads: bool = False, pre_buffer: bool = False, dataset: bool = False, hive: bool = False, unify: bool = False, normalize: bool = False, atomic: bool = False, durable: bool = False, reconstruct: bool = False, append: bool = False, encryption_key: bytes | None = None)
Source: packages/irx/src/irx/parquet_options.py:60
Declared as: python:irx:irx.parquet_options.ParquetOptions
Options copied into a native Parquet session at open time.
Empty columns/row_groups select all. Dataset evolution unions same-typed fields only. Atomic replacement and rewrite append are POSIX-local operations with advisory writer exclusion and optional fsync durability. Reconstruct preserves supported logical types over explicit physical storage for single files. Raw AES keys are excluded from repr; callers own key distribution and lifetime.
Attributes
-
batch_size — Size of batch.; Type: int
-
row_group_size — Size of row group.; Type: int
-
data_page_size — Size of data page.; Type: int
-
compression — Compression.; Type: str
-
compression_level — Compression level.; Type: int | None
-
columns — Column declarations or values.; Type: tuple[str, ...]
-
partition_columns — Partition columns.; Type: tuple[str, ...]
-
row_groups — Row groups.; Type: tuple[int, ...]
-
predicates — Predicates.; Type: tuple[ParquetPredicate, ...]
-
use_threads — Whether to use use threads.; Type: bool
-
pre_buffer — Whether to use pre buffer.; Type: bool
-
dataset — Whether to use dataset.; Type: bool
-
hive — Whether to use hive.; Type: bool
-
unify — Whether to use unify.; Type: bool
-
normalize — Whether to use normalize.; Type: bool
-
atomic — Whether to use atomic.; Type: bool
-
durable — Whether to use durable.; Type: bool
-
reconstruct — Whether to use reconstruct.; Type: bool
-
append — Whether to use append.; Type: bool
-
encryption_key — Encryption key.; Type: bytes | None
Methods
-
__init__ —
-
__post_init__ — Validate collection items and secrets before any native side effect.
-
native — Create and release a temporary checked native options owner.