Appearance
Using Your Workspace
What DataNature is
DataNature is a lakehouse data and AI platform. It gives your organisation a workspace containing everything needed to:
- ingest data,
- transform it,
- govern it,
- serve it to SQL, BI and AI users.
All data lives as Apache Iceberg tables on S3-compatible object storage. Several engines read the same tables:
| Engine | Used for |
|---|---|
| Trino ("Lakehouse") | Interactive SQL, CSV export, external JDBC, dbt |
| Spark 4 (Connect) | Notebooks, heavy dbt transforms |
| DN Warehouse (StarRocks) | Fast serving, semantic-layer materialized views |
Core concepts
| Concept | What it is |
|---|---|
| Workspace | Your organisation's isolated environment. It has a display name and a slug (e.g. acme-ab12cd). The slug shows up in host names, catalog names and SQL user names. |
| Lakehouse | The Iceberg catalog, called lakehouse in SQL. Address tables as lakehouse.<schema>.<table>. |
| Schema (namespace) | A folder of tables. Ingestion writes to bronze_<source>, and dbt builds silver and gold schemas. |
| Pipeline | A Connect definition that copies tables from a source database into bronze. |
| Job | A schedule that runs pipelines, dbt models and cube refreshes in order. |
| dbt project | Your transformation code (SQL models). It lives in the workspace's Version Control (git). |
| Cube | A semantic-layer definition of measures and dimensions over a gold table. It can be materialized in the DN Warehouse. |
| Policy | A governance rule (access, column masking or row filter) enforced by the query engines. |
| Lakebase | The workspace's internal PostgreSQL. It stores platform configuration. Treat it as read-only and internal. Don't build on it. |
Medallion layers
| Layer | Schema naming | Built by | Contents |
|---|---|---|---|
| Bronze | bronze_<source> (from the pipeline's destination name) | Connect | Raw copy of source tables. All columns nullable, lower-case names. |
| Silver | e.g. default_silver, or your dbt schema name | dbt | Cleaned, typed, de-duplicated, joined |
| Gold | e.g. default_gold / gold | dbt | Business-level facts and aggregates. Cubes and dashboards should read from here. |
Signing in
- Every surface uses single sign-on: the portal and all tools (BI, notebooks, orchestration, query UI, catalog). Sign in once with your platform username and password.
- Password rules on hardened installs:
- at least 12 characters, with upper-case, lower-case, a digit and a symbol;
- it must not contain your username.
- Lockout: 5 wrong passwords locks the account temporarily, with the wait growing up to about 15 minutes.
- ⚠️ A BI tool or SQL client that keeps retrying an old saved password will lock you out. Update saved passwords in your tools straight after changing yours.
- Sessions expire after about 30 minutes idle, and at most about 10 hours. Save your work in notebooks and editors.
- Pending account actions (a forced password change, verifying your profile) block external tools such as DBeaver or JDBC from signing in. Sign in to the portal once in a browser and complete them.
- After a platform upgrade, if a page behaves oddly, do a hard refresh (Ctrl+Shift+R / ⌘+Shift+R). The browser may be caching the old UI.
Roles and permissions
Access is set per page. Each page has one of four levels:
| Level | Meaning |
|---|---|
| No access | The page is hidden |
| View | Read-only |
| Use | Work with it: run, create your own items |
| Manage | Administer it: settings, other people's items, enable or disable |
- The workspace owner has full access to everything.
- Admins define custom roles in Settings → Roles and assign people in Settings → Organization.
- Data access is separate from page access. Tables, rows and columns are governed by policies (Access & Policies). You might be able to open the Workbench and still not see a table.
Things that surprise people:
- Semantic Models needs Use or higher. With View only, you get a 403 on cubes. This is intentional.
- Cube materialized views (
mv_*tables) can't be queried directly in SQL. Use the semantic layer. - If you can see pages but every save fails with something like
Required: write, current: read, you've been given a viewer role. Ask an admin.
There is no in-product access request form yet. To get access, ask a workspace admin: anyone with Manage on Data & AI Security for data, or on Settings → Roles for pages.
Navigating the portal
| Sidebar | Page | Purpose |
|---|---|---|
| Overview | Command Center | Health of compute, storage, tools and workloads |
| Recents | Things you recently touched | |
| Applications | Tool launcher | Open, enable or scale tools, and view connection details |
| Semantic Models | Cubes, warehouse browser, query playground | |
| Marketplace | Shared assets | |
| Data Engineering | Connect | Ingestion: sources, destinations, pipelines, reconciliation |
| Jobs | Scheduling ingestion + dbt + cube refresh | |
| Workbench | DBT Editor, Workflow (DAG repo), Query Editor (SQL) | |
| Voir | Chat, Twins, Skills, Connectors | AI analytics agents (licensed) |
| DocuContext | Document knowledge base (licensed) | |
| Atlas | Monitoring, Runs, Alerts, Logs & Audit | Run health, dbt run history, alerts, audit trail |
| Atlas → Data & AI Security | Governance: access, masking, row filters, cube security, PII guardrails | |
| Account menu | Settings | Organization, roles, API keys, license, email |
Items marked Soon in the sidebar (Streaming, Activation, ODS & Data Sharing, Secrets, Version Control) are not available yet.
Tools (Applications)
Each tool card on Applications has Open and Connection details. Admins also get Enable, Disable and Scale down.
| Tool | Address | What you use it for |
|---|---|---|
| Query engine (Trino) | query.<domain> | SQL over the lakehouse. Also the JDBC endpoint for DBeaver or BI tools. |
| BI (Superset) | bi.<domain> | Dashboards and charts |
| Orchestration (Airflow) | orchestration.<domain> | Viewing DAG runs and task logs. You normally drive runs from Jobs. |
| Notebooks (JupyterHub) | notebook.<domain> | Python / PySpark notebooks |
| Transform (Spark) | transform.<domain> | Spark UI. Spark itself is used from notebooks and dbt. |
| Dataflow (ingestion runtime) | dataflow.<domain> | The engine behind Connect. You rarely need to open it. |
| Catalog (DataHub) | governance.<domain> | Search, lineage and documentation. Not on every install. |
| DN Warehouse | via Workbench | Fast serving SQL (StarRocks) |
| MLflow, Milvus, Redis | in-cluster only | From notebooks only. See BI, Voir AI & ML Tools. |
Your first hour: a suggested path
- Connect → Sources → New connection. Add your source database and click Test connection.
- Connect → Destinations. Create a destination, e.g.
crm, which writes tobronze_crm. - Connect → Pipelines → + New pipeline. Pick two small tables as Full load, then Deploy. See Ingestion (Connect).
- Jobs → + Create job → Ingest only. Set Trigger now, or add a schedule.
- Workbench → Query Editor → Lakehouse. Run
SELECT * FROM lakehouse.bronze_crm.<table> LIMIT 50. - Workbench → DBT Editor. Write a silver model and run it. See Transformation (dbt).
- Jobs. Turn it into an Ingest + Transform job so the whole chain runs on a schedule.
The end-to-end path
Source DB ──► Connect pipeline ──► bronze_<source>.* (Iceberg, lakehouse)
(Oracle/MSSQL/ │
MySQL/Postgres) ▼
dbt models ──► silver / gold (Iceberg or DN Warehouse)
│
▼
Semantic cubes (+ optional MVs)
│
┌──────────────┬───────────┼──────────────┬──────────────┐
▼ ▼ ▼ ▼ ▼
SQL Workbench Notebooks Voir AI Superset BI External JDBC
▲
Jobs schedule the whole chain. Governance (Ranger) applies to every query path that runs as you.Conventions used in these docs
- UI labels are in bold, as they appear on screen: Data Engineering → Jobs.
<workspace>is your workspace slug, e.g.acme-ab12cd.<safe>is the same with dashes as underscores:acme_ab12cd.<domain>is your platform's domain name. Tool addresses look likequery.<domain>, orquery-<platform>.<domain>on some installs.- ⚠️ marks a rule that has caused data loss or an outage when ignored.
- "Contact your admin" means a workspace admin or platform operator has to act; you can't fix it from your seat.
Your install may differ. Self-hosted and air-gapped installs are upgraded on their own schedule. If a feature here doesn't match your screen, your install may be on an older release. Ask your admin which one.
