Skip to content

Storage recipes

The storage category covers ETL pipelines into storage, the four backends (CSV, JSON, Parquet, DuckDB), reload, and analytics on stored data.

ID Title Runtime API key
RECIPE-031 ETL pipeline 2 – 4 s no
RECIPE-032 Export to CSV < 1 s no
RECIPE-033 Export to Parquet < 1 s no
RECIPE-034 Export to DuckDB < 1 s no
RECIPE-035 Reload from storage < 1 s no
RECIPE-036 Analytics on stored data < 1 s no

Path

  1. RECIPE-031 — ETL pipeline. Fetch → export.
  2. RECIPE-032 — Export to CSV.
  3. RECIPE-033 — Export to Parquet.
  4. RECIPE-034 — Export to DuckDB.
  5. RECIPE-035 — Reload from storage.
  6. RECIPE-036 — Analytics on stored data.

Run them all

for recipe in recipes/storage/*.py; do
    UN_COMTRADE_MOCK=1 python "$recipe"
done

Next steps