Senior Data Engineer
- Compensation
- Not disclosed
- Location
- Herndon, VA
- Work setup
- Hybrid
- Seniority
- Senior
- Employment
- Contract
- Experience
- 8+ years
- Category
- Data engineering
- Posted
Skills
Must have
- B.S. in Computer Science (or equivalent experience) and at least 8 years of professional experience working as part of an Agile team using DevOps practices and modern programming languages and framewo
- Experience with modern programming languages and frameworks including Python (FastAPI, Django, Flask), JavaScript (Node.js, Express, Vue, Svelte, React), and Java (Spring Boot)
- Experience developing data focused solutions to include experience designing and implementing OpenAPI compliant data schemas and REST APIs, implementing data persistence and query logic using Object R
- Experience developing AWS cloud solutions with a specific focus on data services such as S3, RDS, and EMR
- Experience building scalable, production-grade data solutions that can be used by thousands of data consumers concurrently
- US Citizenship and an active Secret security clearance
Nice to have
- M.S in Computer Science or related
- Experience with AI/ML
- Experience with Kubernetes (Rancher RKE2, AWS EKS) and microservice architectures
- Experience with data engineering and big data technologies such as Apache Airflow, Trino, and AWS EMR
- Experience with NIST Risk Management Framework and security accreditation process and tasks
- Experience with HL7, FHIR, and Mirth Connect
- Experience with dbt and Apache Spark
- Familiarity with Great Expectations, data contracts, and data validation
Full description
Dark Wolf is looking for a Senior Data Engineer to join our team in Herndon, VA supporting the Defense Health community. This position will have hybrid/remote flexibility. The Data Engineer will be responsible for designing, building, and optimizing robust data pipelines and data infrastructure to ensure the reliability, accessibility, and quality of operational medicine data for analytics and mission-critical applications. The ideal candidate will leverage extensive experience with data engineering principles, DevSecOps best practices, and Test Driven Development (TDD) principles to rapidly develop and deliver first-class, customer-centric software solutions. They will utilize leading languages and frameworks, including Python (FastAPI), AWS, SQL (Trino SQL), and Rancher Kubernetes, to develop high-performance data engineering solutions, automate testing, and ensure delivered software meets and exceeds customer needs, all while working collaboratively within a dedicated team.
Key Responsibilities:
- Using DevSecOps best practices to rapidly develop and deliver first class solutions for a DoW customer.
- Developing software using leading languages and frameworks including Python (FastAPI), AWS, SQL (Trino SQL), and Rancher Kubernetes.
- Building high-throughput data pipelines that aggregate, standardize, and process large volumes of heterogeneous data with Apache Spark, DBT, and Trino.
- Establishing RESTful API endpoints that rapidly return large volumes of analytical health data.
- Taking ownership of project domains and quickly becoming proficient in novel subjects.
- Leveraging Test Driven Development and User Centered design best practices automate testing and ensure delivered software meets and exceeds customer needs.
- Applying software design best practices to identify and analyze potential solutions, generate design diagrams to convey and capture system design, and participate in technical exchange meetings to discuss with the team and customer stakeholders.
- Embracing a shared responsibility for system security.
- Continuously engaging with project teams to deliver quality products.
- Participating in daily standups, sprint planning/review meetings, discover and framing workshops, and customer demo sessions.
Required Qualifications:
- B.S. in Computer Science (or equivalent experience) and at least 8 years of professional experience working as part of an Agile team using DevOps practices and modern programming languages and frameworks to develop and engineer data-related services and applications to cloud platforms
- Experience with modern programming languages and frameworks including Python (FastAPI, Django, Flask), JavaScript (Node.js, Express, Vue, Svelte, React), and Java (Spring Boot)