Senior Data Engineer 4 4P/259
- Compensation
- Not disclosed
- Location
- ATLANTA, GA
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Contract
- Experience
- 1+ years
- Category
- Data engineering
- Posted
Skills
Nice to have
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field.
- Microsoft Azure Data Engineer Associate or equivalent certifications preferred.
- Experience in data governance processes and supporting enterprise analytics platforms.
- Knowledge of containerization (e.g., Docker) and CI/CD pipelines in DevOps environments.
Full description
Senior Data Engineer
Location: Atlanta, GAClient- Southern Company
Contract- 1 Year
Experience Level: 10+ Years
Position Summary:
We are seeking an experienced Senior Data Engineer with a strong background in designing and developing robust, scalable, and high-performance data infrastructure. The ideal candidate will have 10+ years of experience in manipulating data, working with both relational and NoSQL systems, and building modern data pipelines across data lakes and warehouses. This role demands a deep technical skillset in SQL, data modeling, and data pipeline orchestration tools like Apache Spark, Hive, and Airflow.
Key Responsibilities:
-
Design, develop, and maintain scalable ETL/ELT pipelines to process and integrate data from disparate sources.
-
Work with structured and unstructured data to build clean, efficient, and machine-readable datasets.
-
Normalize databases and ensure that data structures align with application and business requirements.
-
Collaborate with business analysts, data scientists, and software engineers to deliver data solutions aligned with company objectives.
-
Design and implement data models that support reporting, analytics, and machine learning use cases.
-
Migrate and optimize workloads in cloud-based environments (e.g., Azure, AWS, GCP).
-
Monitor and optimize data pipeline performance, data quality, and reliability.
-
Implement data governance best practices and ensure compliance with security and privacy regulations.
Technical Skills & Expertise:
-
Expert-level proficiency in SQL, including writing complex queries and optimizing performance.
-
Deep understanding of data modeling techniques for both OLTP and OLAP systems.
-
Hands-on experience with big data frameworks:
-
Apache Spark, Hive, Airflow, Databricks
-
Experience with modern cloud data platforms:
-
Azure Data Lake, , , or