Senior Software Engineer, Platform - Data + AI (Back-End)
Senior back-end engineer on C3 AI's Platform Data org, building petabyte-scale data pipelines, datastore and file-system abstractions, connectors, and distributed compute/ML infrastructure (Spark, Ray, Kafka) for the C3 enterprise AI platform. Requires 5+ years experience, strong Java/C++/C# (or Python) skills, and public cloud experience.
- Compensation
- $145K–$187K / yr
- Location
- Redwood City, CA
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Not specified
- Experience
- 5+ years
- Category
- Backend
- Posted
Skills
Must have
- Bachelor of Science in Computer Science, Computer Engineering, or related fields
- Minimum 5 years of work experience in a fast-paced software company
- Strong understanding of Computer Science fundamentals
- High proficiency in coding with Java, C++, C#, or another compiled language (Python also acceptable)
- Strong competency in object-oriented programming, data structures, algorithms, and software design patterns
- Experience with version control systems such as Git
- Experience with large-scale distributed systems
- Experience with any public cloud platform (AWS, Azure, GCP)
- Some familiarity with distributed computing technologies (e.g., Hadoop, Spark, Kafka)
- Familiarity with modern data science/analysis and engineering ecosystem (e.g., Pandas, Koalas)
- Good verbal and written technical communication ability
- Thrive in a fast-paced, dynamic environment and value end-to-end ownership of components
- Intellectually curious and open to challenges
Nice to have
- Advanced degree in engineering, sciences, or related field
- Experience with Agile development methodology
- Experience developing and working with REST and/or GraphQL APIs
- Experience building scalable and reliable data pipelines
- Experience with integration of data from multiple sources
- Experience working with analytics and/or data processing engines
- Experience developing distributed computation over large-scale data
- Experience working with distributed computing frameworks (e.g., Hadoop, Spark, Kafka)
- Experience with data science/analysis libraries (e.g., Pandas, Koalas)
- Experience with task schedulers in distributed computing (e.g., Spark, Ray, Dask)
- Familiarity with machine learning workload orchestration in a distributed computing environment
- Familiarity with workflow execution and/or optimization using DAGs, ideally for machine learning use-cases
- Conceptual understanding of orchestration and resource provisioning systems (Kubernetes)
Full description
C3 AI (NYSE: AI), is the Enterprise AI application software company. C3 AI delivers a family of fully integrated products including the C3 Agentic AI Platform, an end-to-end platform for developing, deploying, and operating enterprise AI applications, C3 AI applications, a portfolio of industry-specific SaaS enterprise AI applications that enable the digital transformation of organizations globally, and C3 Generative AI, a suite of domain-specific generative AI offerings for the enterprise. Learn more at: C3 AI
C3 AI is looking for Senior Software Engineers to join the rapidly growing Data org within the Platform Engineering department. Successful candidates will get the opportunity to work on high-value technologies at the intersection of large-scale distributed systems, data infrastructure, and machine learning. You will design, develop, and maintain various features in a highly scalable and extensible AI/ML platform for large-scale applications, involving data science, distributed systems, and multi-cloud strategy.
You will be given opportunities to take ownership of components, collaborate to drive technical direction, and work on interesting, impactful projects. Join us in building the next-generation AI/ML platform at petabyte level scale that powers some of the world’s largest companies in Energy, Financial Services, Utilities, Health Care, Aerospace, Defense, etc. Accelerate your career in the leading enterprise AI company that is in a hyper-growth trajectory.
Responsibilities:
- Design and develop infrastructure and services to enable data pipelines for petabyte level scale and more.
- Design and develop abstractions over datastores such as Cassandra, PostgreSQL, Snowflake, etc.
- Design and develop file system abstractions over AWS S3, Azure Blobs, HDFS, etc.
- Design and develop connectors to various external data stores.
- Design and develop distributed system components for stream processing, queueing, batch processing, analytics engines, etc.
- Develop and maintain industry-leading, high-performance APIs for AL/ML applications.
- Develop and maintain features for distributed computations over large-scale data for ML workflows.
- Design and develop ML-specific data-systems such as feature stores and behavioral frameworks such as recommendation engines.
- Design and develop integrations with distributed computing technologies such as Apache Spark, Ray, etc. for data exploration and ML workload orchestration.
- Design and develop integrations with data analysis libraries such as Pandas, Koalas, etc.
- Develop and production AI/ML models for failure prediction, data schema inferencing, etc.