Senior Data Engineer
- Compensation
- Not disclosed
- Location
- Arlington VA
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Contract
- Experience
- 8+ years
- Category
- Data engineering
- Posted
Skills
Must have
- BS Degree.
- 8+ years of professional experience needed for MOST of our opportunities.
- Python experience with data manipulation, scripting, and more.
- Databricks experience.
- Proficient in designing and implementing Extract Transform Load (ETL) data processes.
- Experience with at least ONE relational database, such as PostgreSQL, MySQL or SQLite.
- Experience with Agile SCRUM methodologies.
Nice to have
- Familiar with database design, server management, connection protocols, database normalization, and principles of information theory.
- Experience with data cleaning or data organization.
- Familiar with NiFi, SQL, NoSQL and Graph Databases and Data Lakes.
- Familiar with Dashboarding tools similar to Qlik.
- Familiar with Cybersecurity with design and implementation of unique data transfer protocols.
Full description
Job Type: Full- Time
Workplace Type: Hybrid
Clearance: Active Secret clearance
Must be a U.S. CitizenJob Summary
Castalia is seeking exceptional Senior Level Data Engineers to join our expanding team. In this role, you will be responsible for ensuring data availability—including the seamless movement, modification, and storage of critical data. Working closely with Software Engineers and Data Scientists, you will ensure the scalability and successful deployment of data pipelines that support high-priority users.
The Mission
Our team develops and deploys cutting-edge AI and Machine Learning applications that directly support national security missions. We empower 19 key Principal Staff members (Senior Executive Service and General Officers) within the Office of the Undersecretary of Defense (OUSD) and the Intelligence Community. Your work will provide these leaders with the critical, data-driven insights necessary for strategic decision-making.
Candidate Profile
The ideal candidate is a motivated technologist who thrives with limited direction and is passionate about continuous learning. We are looking for engineers who can pivot quickly to new languages and technologies to solve complex problems.
Roles and ResponsibilitiesA qualified candidate will perform the following duties and responsibilities, but are not limited to:
- Design, develop, and maintain scalable data pipelines and ETL processes to ingest, transform, integrate, and deliver mission-critical data from multiple sources.
- Ensure data availability, quality, reliability, and performance by monitoring data workflows, troubleshooting issues, and optimizing data processing and storage solutions.
- Develop and maintain data solutions using Python, Databricks, SQL, relational databases, and other modern data engineering technologies.
- Collaborate with Software Engineers, Data Scientists, and mission stakeholders to support the development and deployment of AI/ML applications and data-driven analytics.
- Design and implement secure data integration and transfer solutions while supporting database architecture, data organization, scalability, and cybersecurity requirements within classified environments.
Required Qualifications
- BS Degree.
- 8+ years of professional experience needed for MOST of our opportunities.
- Python experience with data manipulation, scripting, and more.