Software Engineer II (Data Pipelines & Event Processing)
Builds backend services and scalable data pipelines at Torch.AI that ingest, transform, enrich, and fuse large volumes of multi-source data to support defense/government mission decision-making. Core stack includes Python, APIs, distributed systems, AWS, Docker, and ETL/ELT patterns in secure, controlled environments.
- Compensation
- Not disclosed
- Location
- HQ - LEAWOOD, KS 66211
- Work setup
- Not specified
- Seniority
- Middle
- Employment
- Not specified
- Experience
- 3+ years
- Category
- Software engineering
- Posted
Skills
Must have
- B.S. or M.S. in Computer Science, Engineering, or related field
- 3-6 years of professional software engineering experience
- Strong proficiency in Python (preferred) or similar backend programming languages
- Experience building production systems for data ingestion, integration, or processing
- Experience working with APIs, automated data access techniques, and distributed systems
- Strong understanding of data pipeline patterns, including ETL/ELT workflows
- Experience with structured and semi-structured data formats (JSON, CSV, Parquet)
- Familiarity with SQL and NoSQL databases and query optimization
- Experience designing systems that operate reliably under variable data availability and latency conditions
- Familiarity with cloud environments (AWS preferred) and containerization (Docker)
- Experience with CI/CD pipelines and modern software development practices
- Understanding of secure software development practices and controlled data access patterns
- Strong problem-solving skills; ability to operate in fast-paced, mission-driven environments
Nice to have
- Experience with workflow orchestration tools (Airflow, NiFi) or similar systems
- Experience with streaming or event-driven architectures (Kafka or equivalent)
- Familiarity with large-scale data ingestion, indexing, or search systems
- Experience working with geospatial, temporal, or multi-source datasets
- Exposure to data enrichment, entity resolution, or relationship mapping techniques
- Experience implementing controlled or privacy-aware data acquisition techniques
- Familiarity with infrastructure patterns supporting identity protection, request management, or traffic routing in distributed systems
- Experience supporting defense, intelligence, or other regulated environments
- Familiarity with distributed systems and microservices architectures
- Exposure to observability tooling (logging, monitoring, metrics)
Full description
The world’s most consequential systems need the world’s best builders.
A new era is taking shape. AI is no longer confined to models or interfaces. It is becoming the foundation of how decisions are made across governments, industries, and real-world environments. What matters now is not just access to capability, but how it is applied, controlled, and sustained over time.
Torch.AI builds a government-owned reasoning infrastructure which creates a Reasoning Layer to enable machine reasoning at scale, in environments where it is hardest to achieve and least tolerant of failure. This is not incremental software. It is long-term infrastructure designed to endure, integrate, and evolve alongside the systems it supports.
Not another dashboard. Not another workflow app. Not another black-box model glued to a PowerPoint.
The Reasoning Layer is a modular architecture where data is connected, governed, transformed, represented, fused, reasoned over, and delivered into mission applications and operational workflows. It does not replace systems of record. It enables them to function better together.
The Reasoning Layer is comprised of: ORCUS (ingestion, orchestration, governance), NEXUS (semantic representation, vectorization), HALO (graph-based fusion and reasoning) and various product and capability components deployed for specific customer use cases.
We are seeking candidates who approach problems creatively, are comfortable operating without full clarity, and take responsibility for outcomes, not just implementation.
If you’re driven to strengthen U.S. defense readiness and protect national interests, Torch.AI offers meaningful impact at national scale.
Responsibilities
This role focuses on building production-grade software systems that ingest, process, and enrich large volumes of real-world data to support mission-critical decision making. You will develop scalable data pipelines and backend services that transform diverse, multi-source information into structured, actionable insights.
The work emphasizes reliability, adaptability, and operational security. Systems are designed to run continuously, handle evolving data sources, and operate within controlled environments that require careful handling of access patterns, attribution, and compliance constraints.
What You’ll Do
- Design, build, and maintain backend services and pipelines that acquire and process data from diverse data sources.
- Develop automated data access workflows using APIs, web interfaces, and distributed systems while adhering to controlled access and usage constraints.
- Implement data transformation, enrichment, and normalization processes to support downstream analytics and mission applications.