Show HN: nbpipe – A lightweight workflow runner for Jupyter notebooks
nbpipe is a tool designed to run sequences of Jupyter notebooks as workflows from the command line or JupyterLab. Users can create a workflow by defining a YAML file that specifies the order of notebook execution and expected outputs. The tool simplifies the process of managing and executing multiple notebooks in a structured manner.
- ▪nbpipe allows users to run Jupyter notebooks as workflows from the command line or JupyterLab.
- ▪To use nbpipe, a user must create a .nbpipe/ directory and add a workflow YAML file.
- ▪The YAML file defines the sequence of notebooks to run and their expected outputs.
Opening excerpt (first ~120 words) tap to expand
nbpipe Run sequences of Jupyter notebooks as a workflow from the command line or the JupyterLab sidebar. Installation pip install nbpipe Usage Create a .nbpipe/ directory at the root of your project and add a workflow YAML file inside it. # .nbpipe/my_workflow.yaml # Notebook paths are relative to the project root name: my_workflow steps: - notebook: prepare_data.ipynb output: data/processed.csv - notebook: train_model.ipynb Run it from the CLI: nbpipe run .nbpipe/my_workflow.yaml or from JupyterLab: Step fields Field Required Description notebook yes Notebook to run, relative to the project root output no File the notebook must produce — workflow fails if absent
Excerpt limited to ~120 words for fair-use compliance. The full article is at GitHub.