Quickstart
This walkthrough takes you from an empty workspace to a running pipeline. You will connect Nexa to a source system, pull in a data source, map it through the Curated and Consumption layers, and run the pipeline Nexa generates. Each step links to the deeper reference page for that screen. Budget 20–30 minutes for a first run against a small source.
Before you begin
Section titled “Before you begin”You need:
- Access to the Nexa web UI and a workspace to work in.
- Credentials for one source system — a PostgreSQL database, a Kafka-compatible message queue, or file storage (S3 / Unity Catalog volume).
- Your data platform (Snowflake or Databricks) already connected during install, so generated pipelines have somewhere to run.
Step 1 — Create a connection
Section titled “Step 1 — Create a connection”A connection stores the reachable endpoint and credentials for one source system. Connections are managed under Settings → Connection Settings.
- Open Settings and select the Connection Settings tab.
- Add a connection for your source type:
- RDS — host, port, database, and credentials for a relational database.
- Message Queue — bootstrap servers and SASL/SCRAM authentication for Kafka.
- File System — the path to your file storage.
- Use Test connection to confirm Nexa can reach the endpoint before saving.
Nexa stores the secret securely rather than in plain config. See Connections overview, and the type-specific pages for PostgreSQL, Kafka, and S3 / volumes.
Step 2 — Create a connector
Section titled “Step 2 — Create a connector”A connector binds a connection to the specific tables or files you want to ingest, and to a sync schedule. Connectors are managed on the Connectors screen.
- Open Connectors and create a new connector.
- Choose the connection from Step 1.
- Select the tables (or files) to ingest.
- Pick a sync mode —
livefor continuous sync orbatchfor a scheduled pull — and set a cron schedule for batch.
See Creating a connector and Execution modes for the full field reference.
Step 3 — Add the data source
Section titled “Step 3 — Add the data source”With ingestion configured, the incoming data appears as a data source in Data Flow. This is where you confirm what Nexa detected and start modeling it.
- Open Data Flow. Ingested sources show under the New Dataflows tab; already-modeled ones under Existing Dataflows.
- Open the new source to review the tables and fields Nexa detected.
- If you are working from a file instead of a live connector, you can also upload a CSV or JSON directly from the add-source flow.
See Adding a data source and the Data integration overview.
Step 4 — Map to the Curated layer
Section titled “Step 4 — Map to the Curated layer”The Curated layer (silver) is where raw source fields become clean, conformed business entities. Nexa proposes field mappings and PII tags with AI assistance; you review and adjust them.
- From the source, open the entity mapping editor to map Raw fields to Curated attributes.
- Review the AI-suggested mappings and tags, correcting any that are wrong.
- Save the mapping. Nexa records it as the definition it will compile into pipeline code.
See Curated layer. If two sources describe the same entity, you may also set precedence in Conflict resolution.
Step 5 — Shape the Consumption layer
Section titled “Step 5 — Shape the Consumption layer”The Consumption layer (gold) combines curated entities into wide, analysis-ready shapes — for example a 360-degree customer view. You model this visually on the Canvas.
- Open Canvas and add or edit the consumption entity that joins your curated entities.
- Map curated attributes into the consumption entity and save.
See Consumption layer and Canvas.
Step 6 — Run the pipeline
Section titled “Step 6 — Run the pipeline”Each mapping you saved compiles into a pipeline. Run it to materialize the layers in your data platform.
- Open Jobs & Pipeline.
- Find the pipeline generated for your source and run it.
- Watch the run and check its history to confirm it completes.
See Pipelines overview and Jobs.
What you built
Section titled “What you built”You now have a source flowing through Raw → Curated → Consumption, materialized by a pipeline in your own data platform. From here you can add governance and build on top of the data.