Docs, guides and developer tools
Everything you need to build, operate and scale modern data pipelines with Pipevia.
Quickstart
1. Install CLI
$ curl -fsSL https://get.pipevia.dev | bash
$ pipevia login2. Init project
$ pipevia init my-pipeline
$ cd my-pipeline
$ pipevia add connector shopify3. Deploy
$ pipevia deploy --env prod
$ pipevia run orders_pipelineSample pipeline definition
# pipeline.yaml
sources:
- name: shopify_orders
type: shopify
incremental: true
- name: postgres_app
type: postgres
cdc: true
transforms:
- name: clean_orders
sql: |
select
id, customer_id, total_amount, created_at
from shopify_orders
where status = 'paid'
assert:
- total_amount >= 0
targets:
- warehouse: snowflake
schema: analytics
table: orders
load: merge
Developer tools
REST API
Automate runs, manage environments and query lineage.
# Trigger a run
POST /v1/runs
{ "pipeline": "orders_pipeline", "env": "prod" }Webhooks
Receive events for run start/finish, failures and SLA breaches.
{
"event": "run.completed",
"pipeline": "orders_pipeline",
"status": "success",
"duration_ms": 182300
}Terraform & CLI
Provision workspaces, secrets and schedules via IaC.
resource "pipevia_workspace" "prod" {
name = "prod"
}Connectors catalog
See the full catalog
Browse all connectors and partner integrations.