Data Platform Engineer – Data Operations

About the role

As a Data Platform Engineer in the Data Operations team, you will build and maintain the software backbone that makes STARK's AI data pipeline usable at scale. You will turn raw multi‑sensor recordings into searchable, version‑controlled datasets that power perception and autonomy systems for high‑performance unmanned platforms.

Key responsibilities

• Design, develop, and maintain Python‑based ETL pipelines that ingest flight data, rosbags, video and external deliveries into GCP storage.
• Create programmatic tools for sub‑sampling video, extracting frames, packaging datasets and enabling self‑serve data access.
• Engineer metadata databases and data catalogs, ensuring accurate tracking of datasets, recordings, sensors, labels and lineage using solid SQL schema design.
• Own end‑to‑end technical workflows for data curation and labeling, coordinating with field collection teams, external annotation vendors and ML engineers.

Required profile

• Strong experience building data pipelines and tooling for large‑scale sensor data.
• Ability to work cross‑functionally and act as a hub between data collection, annotation and machine‑learning teams.
• Attention to data quality, versioning and traceability throughout the data lifecycle.

Required skills

• Python programming
• Google Cloud Platform (GCP) services
• SQL and relational database design
• ETL pipeline development
• Data cataloging and metadata management