Resources

Docs, guides and developer tools

Everything you need to build, operate and scale modern data pipelines with Pipevia.

Quickstart

1. Install CLI

$ curl -fsSL https://get.pipevia.dev | bash
$ pipevia login

2. Init project

$ pipevia init my-pipeline
$ cd my-pipeline
$ pipevia add connector shopify

3. Deploy

$ pipevia deploy --env prod
$ pipevia run orders_pipeline

Sample pipeline definition

# pipeline.yaml
sources:
  - name: shopify_orders
    type: shopify
    incremental: true
  - name: postgres_app
    type: postgres
    cdc: true

transforms:
  - name: clean_orders
    sql: |
      select
        id, customer_id, total_amount, created_at
      from shopify_orders
      where status = 'paid'
    assert:
      - total_amount >= 0

targets:
  - warehouse: snowflake
    schema: analytics
    table: orders
    load: merge
 

Developer tools

REST API

Automate runs, manage environments and query lineage.

# Trigger a run
POST /v1/runs
{ "pipeline": "orders_pipeline", "env": "prod" }

Webhooks

Receive events for run start/finish, failures and SLA breaches.

{
  "event": "run.completed",
  "pipeline": "orders_pipeline",
  "status": "success",
  "duration_ms": 182300
}

Terraform & CLI

Provision workspaces, secrets and schedules via IaC.

resource "pipevia_workspace" "prod" {
  name = "prod"
}

Connectors catalog

See the full catalog

Browse all connectors and partner integrations.
View all connectors