Senior Information Security Infrastructure Engineer - Security Architecture - InfoSec
Senior Information Security Infrastructure Engineer on Elastic's internal Security Architecture team, owning the end-to-end security telemetry pipeline: getting data from cloud/SaaS/endpoint sources into Elasticsearch, keeping ECK clusters healthy, and managing infra with Terraform, Kubernetes, Helm and Python, using AI automation to reduce toil.
- Compensation
- Not disclosed
- Location
- United Kingdom
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Not specified
- Experience
- Not specified
- Category
- Devops
- Posted
Skills
Must have
- Ability to operate Elastic and Elasticsearch in production: ingest pipelines, index templates, mappings, queries, healthy and upgraded clusters
- Proven track record of using AI to accelerate development, debug complex systems, and accelerate operations while owning final outcomes
- Kubernetes: deploying and operating workloads (scheduled jobs, Helm charts, operators); troubleshooting pods/jobs
- Terraform: managing cloud and Elasticsearch resources as code
- API integration: consuming REST APIs for data ingestion (auth, pagination, rate limiting, concurrency, error handling)
- Python scripting: read, write, and modify ingestion/automation scripts (scripting-level, not full software-engineering depth)
- Eligibility to work in DoD Impact Level 4 or above cloud service environments
Nice to have
- Experience with ECK or Elasticsearch on Kubernetes
- Hands-on experience with cloud providers, preferably GCP, working with audit and logging data
- Knowledge of GitHub, PR-based workflows, GitHub Actions and Continuous Integration (CI)
- Knowledge of SOC operations and incident response (IR) workflows, including use of security telemetry during investigations
- Ability to develop and use dashboard/visualization tools
Full description
Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale — unleashing the potential of businesses and people. The Elastic Search AI Platform, used by more than 50% of the Fortune 500, brings together the precision of search and the intelligence of AI to enable everyone to accelerate the results that matter. By taking advantage of all structured and unstructured data — securing and protecting private information more effectively — Elastic’s complete, cloud-based solutions for search, security, and observability help organizations deliver on the promise of AI.
What is The Role :
Join the InfoSec - Security Architecture team as a Senior Information Security Infrastructure Engineer, where you'll have the chance to play a key role in protecting our organization's data and systems. This position offers the opportunity to work on meaningful projects that directly impact our security posture and collaborate with a skilled team passionate about information security.
In more details: We ingest the security telemetry that the whole security org runs on. In this role you'll get that telemetry into Elasticsearch consistently and keep the underlying Elastic clusters healthy. You own the pipeline end to end: from a new security data source landing, through ingest pipelines, into the indices detection, IR, and consulting teams query, plus the clusters that store it all.
What You Will Be Doing :
-
Security telemetry ingestion - build and maintain ingestion of security-relevant data into Elasticsearch (cloud provider audit logs, identity/SaaS activity, endpoint and asset data). This means integrating with third-party and cloud provider APIs to pull telemetry: auth, pagination, rate limits, and handling schema changes. Both Elastic integrations and one-off custom integrations.
-
Keep the Elastic Cloud on Kubernetes clusters healthy. Monitor and upgrade them regularly. This involves updating versions and builds. Manage capacity and shards. Handle index lifecycle management (ILM). Enable cross-cluster search (CCS).
-
Use Terraform to manage cloud infrastructure and Elasticsearch resources. This includes managing pipelines, index templates, and alerts. Utilize Kubernetes and Helm to deploy scheduled ingest jobs.
-
Use AI automation and tooling to reduce toil. This includes self-healing jobs and health checks. It also involves alerting, internal CLIs, and AI or agent-assisted workflows for investigation and operations.
-
Data quality & reliability - Own the "is the security data actually flowing correctly?" question. Monitor backfills. Ensure that schemas and fields are consistent. Keep an eye on costs.