Staff Data Engineer - Core Data Pipelines
Lead the design and standards for core data pipelines, time-series alignment, and observability at a proptech company, ensuring scalable, trusted data foundations for Digital Twin and AI teams.
- Compensation
- Not disclosed
- Location
- Not listed
- Work setup
- Not specified
- Seniority
- Staff
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Staff-level experience in data engineering or data platform engineering
- Strong experience building and operating core data pipelines (batch and/or streaming)
- Deep understanding of data modeling, data quality, contracts, lineage, observability, and schema evolution
- Strong proficiency in SQL and Python
- Experience with IoT, telemetry, time-series, operational, or high-volume event data
- Experience with Digital Twins, ontologies, semantic models, metadata modeling, or domain-driven data structures
- Hands-on experience with Kafka, Flink, Spark, Airflow, dbt, BigQuery, ClickHouse, PostgreSQL, or comparable tools
- Strong systems thinking for end-to-end data flows from ingestion to downstream consumption
- Proven ability to set technical standards and influence architecture across teams
Full description
Our team at KODE Labs is looking for a Staff Data Engineer to lead the technical foundations behind our core data pipelines, data alignment, quality, lineage, and observability standards.
This is a highly cross-functional technical leadership role. You’ll build shared data foundations while defining the patterns and standards used by teams across Integrations, Digital Twin, Data Platform, Fault Detection & Diagnostics (FDD), Energy, Analytics, APIs, and AI Agents.
You won’t own every product-specific pipeline or validation rule. Instead, you’ll establish the foundations that allow teams across KODE to build on trusted, scalable, observable, and consistently modeled data.
What You Will Do
- Design, build, and evolve core data pipelines and datasets that serve as shared foundations across KODE OS.
- Define reusable patterns for aligning IoT, BMS, operational, asset, meter, work order, schedule, weather, occupancy, and time-series data with our Digital Twin.
- Establish standards for the full data lifecycle — from raw ingestion through alignment, cleaning, modeling, serving, and consumption.
- Build shared frameworks for data validation, normalization, lineage, observability, and readiness.
- Define common approaches to data quality, including quality flags, confidence scores, validation signals, and product-readiness checks.
- Establish time-series standards covering timestamps, time zones, expected frequencies, gaps, late-arriving data, duplicates, and standard aggregation grains.
- Define and evolve data contracts, schema standards, and versioning practices across data producers and consumers.
- Build observability foundations that surface issues with freshness, coverage, schema changes, data quality, pipeline failures, and data drift before they impact downstream products.
- Establish clear lineage from raw → ingested → aligned → cleaned → modeled → served → consumed data.
- Develop reusable mapping and alignment patterns that make onboarding new integrations and data sources more consistent and scalable.
- Partner closely with Integrations and Digital Twin engineers to ensure required identifiers, metadata, entity relationships, point classifications, and semantic alignment are reliable.
- Work with FDD, Energy, Analytics, API, and AI teams to ensure downstream products consume data with clear quality, freshness, lineage, semantic context, and readiness indicators.
- Review new data models, schemas, pipelines, mappings, and cross-team data flows to ensure they follow shared engineering standards.