Software Engineer,Risk & Data Technology - Python or Java or C#

JUXT is partnering with a leading global commodities trading firm to build its new core data platform for real-time and end-of-day market data.

During this mission we’ll replace an existing system with a new highly scalable cloud-native data platform, without breaking client applications that rely on this data today. We’ll build new data ingestion pipelines to consume from a wide variety of market data providers. We will also build new query capabilities that are compatible with existing APIs, so that client applications keep working unchanged.

This is a greenfield build with a pragmatic team that likes to prove solutions quickly and iterate. You’ll work alongside highly experienced engineers to plan the migration, build and deploy new systems, analyse existing traffic and prioritise, then expand feeds and query APIs to cover new use-cases.

Responsibilities

• Building the feed ingestion subsystem: event-driven connectors pulling data directly from external market data providers.
• Building query APIs using modern scalable data technologies like ClickHouse and S3 Tables/Iceberg with Athena. Experience with other massively scalable data tech is beneficial (QuestDB, Snowflake, DuckDB).
• Building an intercepting proxy to intelligently direct traffic towards new query services. Achieving faithful API compatibility so that clients can continue to operate correctly.
• Gathering and analysing metrics and request payloads to discover and survey existing data clients. Validating the design end-to-end against real client requests, and rolling out new systems in carefully staged steps.
• End-to-end observability across every component: logs, metrics and traces into ClickStack and Grafana, augmented by AWS observability services.
• Working carefully to guide the client, learning through discovery sessions, and thinking carefully about platform architecture (streaming vs request-response use cases, staged and low-risk roll-outs, tracking data licenses, high-frequency feed downsampling).

Requirements

• A strong senior backend engineer, comfortable across the languages in play on a data platform (e.g. Java, C#, Python) and experienced in building production data-intensive services.
• Real experience with data pipelines and event-driven ingestion: connectors, schedulers, idempotency, backfill, and the operational care that feeds demand.
• Solid networking fundamentals: DNS, TLS and certificates, OSI model, TCP packet analysis, HTTP proxying: enough to reason confidently about a transparent interception layer and debug it when reality intrudes.
• Experience with scalable cloud data platforms, ideally AWS: object storage, table formats, query engines.
• Strong testing discipline. Validation, reconciliation, and careful roll-out.
• High autonomy and clear communication: a small senior team, embedded with the client, making pragmatic decisions and explaining them well. They will need to take ownership of significant tasks, design solutions and deliver.