Parquet-WASM: Rust-based WebAssembly bindings to read and write Parquet data

I'd like to point out that fastparquet has been built for wasm (pydide/pyscript) for some time and works fine, producing pandas dataframes. Unfortunately, the thread/socket/async nature of fsspec means you have to get the files yourself into the "local filesystem" (meaning: the wasm sandbox). (I am the fastparquet author)

Seeing as the popular alternative here would be DuckDB-WASM, which (last time I checked) is on the order of 50MB, this is comparatively super lightweight.

in my [albeit outdated] experience ArrowJS is quite a bit slower than using native JS types. i feel like crossing the WASM&lt;&gt;JS boundary is very expensive, especially for anything other than numbers&#x2F;typed arrays.<p>what are people&#x27;s experiences with this?

@dang we have a mass spam incursion in this comment thread.

Can this read and write Parquet files to S3-compatible storage?

;8y aiu;khjbvnvxzg;o9