Data Engineer

Responsibilities:

• Build and Manage Data Pipelines: Develop secure and scalable data ingestion and transformation pipelines using AWS services (Glue, Lambda, Athena, Timestream, S3) and edge technologies (MQTT, AWS IoT Greengrass).
• Infrastructure as Code (IaC): Define, develop, and deploy cloud infrastructure using Terraform.
• SQL and Data Transformation: Write, optimize, and maintain complex SQL queries for data transformation and validation across AWS data services.
• Observability and Security: Implement and maintain observability tools (CloudWatch, Grafana) and ensure robust data security using best practices for IAM, encryption, and access control.
• Cross-Functional Collaboration: Partner with software, DevOps, and product teams to deliver comprehensive data solutions.

Requirements:

• Education and Experience: Bachelor's degree in Computer Science, Engineering, or a related technical field, coupled with 2+ years of hands-on software or data engineering experience in a multidisciplinary team.
• Development Lifecycle: Proven experience in prototyping, testing, and code review across full development cycles.

Technical Skills:

• Strong proficiency in SQL.
• Skilled in scripting languages like Python or JavaScript.
• Experience with Linux environments, Docker, and Git.
• Solid understanding of cloud infrastructure and Terraform.

Key Attributes:

• Self-motivated, responsible, adept at managing multiple priorities independently, with excellent communication, collaboration, and analytical skills.
• A proactive, quick learner with a strong sense of initiative and ownership.

Preferred Qualifications:

• Experience with low-latency edge-to-cloud data pipelines.
• Familiarity with React/Node.js for internal tools or dashboards.
• Hands-on experience with a broader range of AWS services and IaC tools (e. g., Terragrunt, Atlantis).
• Exposure to additional monitoring tools (e. g., Prometheus) or end-to-end testing frameworks.