Data Engineer, Spark / AWS data infrastructure (Remote, Full-time) — Micro1 via AI Gig Scout
Micro1 is hiring a full-time, fully remote Data Engineer ($100k–$150k/yr USD) to build and scale the data infrastructure powering AI-driven products and research — designing distributed data pipelines and AWS data architectures. Core stack: Python, SQL, Apache Spark, and SQL/NoSQL databases.
- Compensation
- $100K–$150K / yr
- Location
- Worldwide
- Work setup
- Remote
- Seniority
- Not specified
- Employment
- Full time
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Strong Python
- Strong SQL
- Distributed processing frameworks such as Apache Spark
- Hands-on AWS data services and cloud-native data architectures
- Experience with both SQL and NoSQL databases
- Managing and processing large-scale datasets in distributed environments
- Strong understanding of data partitioning, performance optimization and scalable architectures
Nice to have
- Exposure to AI/ML workflows
- Data visualization tools (Matplotlib, Seaborn, Plotly)
- LLM-related data workflows
Full description
micro1 is hiring a Data Engineer, full-time and remote, to build and scale the data infrastructure that powers AI-driven products and research initiatives. The listed base salary range is $100,000–$150,000 USD a year. You will develop distributed data pipelines, manage large-scale datasets across cloud environments and design reliable data systems for data processing, experimentation and model development at scale.
Key responsibilities: design, build and maintain scalable pipelines that ingest, process and transform large datasets from multiple sources; develop and optimize distributed processing workflows with Spark and cloud-native technologies; build and maintain SQL and NoSQL storage for scalability, performance and reliability; design data architectures on AWS for high-volume ingestion, processing and distribution; write efficient Python and SQL; ensure data quality, integrity, monitoring and operational reliability; collaborate with AI researchers, data scientists and engineering teams; and implement automation, orchestration and monitoring workflows.
Requirements: strong Python, SQL and distributed processing frameworks such as Apache Spark; hands-on AWS data services and cloud-native data architectures; experience with both SQL and NoSQL databases; managing and processing large-scale datasets in distributed environments; and a strong understanding of data partitioning, performance optimization and scalable architectures. Nice to have: exposure to AI/ML workflows, data visualization tools (Matplotlib, Seaborn, Plotly) and LLM-related data workflows.
Details and apply link: https://aigigscout.com/jobs/micro1/data-engineer-4e941f66?utm_source=kubernetesjobs&utm_medium=jobboard&utm_campaign=aigigscout_growth
Disclosure: posted by AI Gig Scout, an independent listing site (not Micro1). The apply link may be a referral link.