Software Engineer, II - Autonomy Data
Build and maintain data pipelines that ingest high-bandwidth sensor logs from autonomous trucks, curate datasets for ML training, and provide visualization tooling for autonomy engineers.
- Compensation
- $139K–$166.8K / yr
- Location
- Remote - US, Blacksburg, VA
- Work setup
- Remote
- Seniority
- Not specified
- Employment
- Full time
- Experience
- 2+ years
- Category
- Software engineering
- Posted
Skills
Nice to have
- Experience with autonomous vehicles, robotics, or other sensor-driven autonomous systems.
- Deep experience with Foxglove or Rerun beyond basic playback, e.g. building custom extensions or integrating them into a structured log review or annotation QA workflow.
- Familiarity with the MCAP CLI and/or python library and experience converting MCAP data to columnar data formats for further querying and processing.
- Experience with data curation for ML training, e.g. diversity sampling, pseudo-labeling, and dataset versioning.
Full description
About The Company:
At Torc, we have always believed that autonomous vehicle technology will transform how we travel, move freight, and do business. A leader in autonomous driving since 2007, Torc has spent over a decade commercializing our solutions with experienced partners. Now a part of the Daimler family, we are focused solely on developing software for automated trucks to transform how the world moves freight. Join us and catapult your career with the company that helped pioneer autonomous technology, and the first AV software company with the vision to partner directly with a truck manufacturer.
Meet The Team:
Torc is hiring an Autonomy Data Engineer Level 2 to help design, build and operate the data infrastructure that powers our autonomy program. You will build the pipelines, storage systems, and tooling that turn raw vehicle sensor logs into the curated, structured datasets that our perception, planning and simulation engineers depend on.
This is a high-ownership role on a lean team. Moving large scale sensor data reliably from vehicles operating in demanding environments and making it quickly available for model training is a difficult and high-impact problem to solve.
What You'll Do:
- Data Lake and Ingestion Pipeline
- Contribute to the design and organization of the program’s data lake, including schema definitions, partitioning strategy and metadata indexing.
- Build and maintain end-to-end pipelines that ingest high-bandwidth sensor logs from vehicles into cloud storage with high reliability and tolerant of ad-hoc and intermittent connectivity mechanisms.
- Implement data validation and integrity checks that can detect corrupted information, missing sensors, and inconsistent calibration prior to the data being processed by downstream systems.
- Implement retention, tiering and lifecycle policies for data to balance storage costs with development value.
- Dataset Curation and Labeling Infrastructure
- Build tooling to query raw logs to produce curated training and evaluation datasets.
- Build automation to run cost-effective pseudo-labeling workflows at the scale of data ingest.
- Implement data quality and model performance metrics that are used to direct labeling effort toward the highest-value examples.
- Autonomy Data Visualization
- Deploy and maintain data visualization tooling to support log review, annotation QA, and autonomy debugging workflows.
- Build integrations between the visualization tooling and the data lake so engineers can navigate from a dataset entry or model failure directly to the origin log data