Software Developer (Content Integration & Data Pipelines)
Designs, builds, and scales production content pipelines that collect, process, and index online news and web content for a PR media-intelligence platform: TypeScript scraping/parsing and integrations, Java REST services, Kafka event-driven processing, and Solr search indexing. Remote-first; salary $75k–$110k.
Compensation
CA$75K–CA$110K / yr
Location
Ottawa, Canada
Work setup
Remote
Seniority
Not specified
Employment
Not specified
Experience
3+ years
Category
Software engineering
Posted
Skills
ai
analytics
api
automation
data-modeling
data-pipelines
data-quality
design-thinking
event-driven-architecture
git
html
java
kafka
maven
observability
rest
solr
sql
typescript
Must have
Degree in Computer Science or related field (or equivalent experience)
3+ years of software development experience
Solid experience building backend services (Java or similar)
Hands-on experience with web scraping and crawling in production environments (robots.txt, rate limiting, terms of use)
Practical experience with event-driven architecture and message streaming (e.g., Kafka)
Practical experience with HTML parsing, content extraction, and normalization
Experience with SQL and data modeling
Experience with Git and modern development workflows
Experience with Maven
Nice to have
Knowledge of Solr (indexing, schema design, query tuning)
Experience building content ingestion pipelines for news or media data
Understanding of system design and scalability tradeoffs
Ability to work independently and take ownership of projects
Strong problem-solving and system design thinking
Effective communication across technical and non-technical stakeholders
Passion for data, automation, and emerging technologies, including AI
Full description
Software Developer (Content Integration & Data Pipelines)
Company Overview
Agility PR Solutions provides today’s communicators with powerful and intuitiveAI poweredmedia outreach, monitoring, and measurement solutions. For almost twenty years, Agility has helped clients from across industries and continents discover relevant journalists and influencers, make meaningful connections with the media, amplify their stories,monitormedia coverage and social conversations, and report on the impact of their public relations activities. Agility is one of the fastest growing companies in the PR tech space andit’srecognized by users on G2 for ease of use, quick implementation, and outstanding customer service.
We are a remote-first company, with colleagues based across vibrant cities in Canada, US, the UK,Philippinesand India. We are intentional in helping our teams realize their full potential, and continue to invest in their learning and development, career progression, offering competitive pay and benefits, enabling leadership and work environment.
About the Role
As a Software Developer (Content Integration & Data Pipelines) , you will design, build, and scale the production-grade pipelines that collect, process, and deliver online news and web content across our platform. You will play a key role in shaping how content flows from thousands of sources into our search and analytics systems — powering the monitoring, insights, and AI-driven features PR professionals rely on every day.
This role goes beyond implementation. You will contribute to system design, architecture decisions, and data strategy, helping define how content is acquired, normalized, enriched, and indexed at scale using event-driven design.
You’ll work across both:
Content acquisition and integration (TypeScript, web scraping and crawling, source integrations)
Backend and pipeline systems (Java, event-driven architecture with Kafka, search indexing with Solr)
Agility PR Solutions is building next-generation media intelligence capabilities powered by AI. Your work will directly influence how customers extract insights, automate workflows, and make decisions from large-scale media data
What you’ll do
Build and maintain scalable web scrapers and crawlers that follow web scraping standards and best practices (robots.txt, rate limiting, polite crawling)
Develop content integration and parsing logic using TypeScript
Design and build event-driven services using Kafka to process, enrich, and route content in near real time
Integrate with third-party content providers, feeds (RSS/Atom), and external APIs
Design and implement to support content processing and delivery
Software Developer (Content Integration & Data Pipelines) at Agility-PR-Solution (Remote) — aijobsearch
RESTful services (Java)
Define and enforce best practices for:
Scraping compliance and source management
Pipeline reliability, error handling, and data quality
Observability and monitoring of content pipelines
Optimize performance, cost, and reliability of pipeline workloads
Contribute to architectural decisions and technical direction
Mentor junior developers and contribute to team knowledge sharing
What You'll Bring
Degree in Computer Science or related field (or equivalent experience)
3+ years of software development experience
Solid experience building backend services ( Java or similar )
Hands‑on experience with web scraping and crawling in production environments , including adherence to web scraping standards (robots.txt, rate limiting, terms of use)
You should have practical experience with:
Event-driven architecture and message streaming (e.g., Kafka )
HTML parsing, content extraction, and normalization techniques
Experience with:
SQL and data modeling
Git, and modern development workflows
Kafka
Maven
Knowledge of Solr (indexing, schema design, query tuning) is an asset
Strongly preferred:
Experience building content ingestion pipelines for news or media data
Understanding of system design and scalability tradeoffs
Ability to work independently and take ownership of projects
Strong problem-solving and system design thinking
Effective communication across technical and non-technical stakeholders
Passion for data, automation, and emerging technologies, including AI
Why You'll Love It Here
Fully remote work environment
Collaborative culture – and key tools enabling it
Competitive compensation package
RRSP matching
Life Insurance
Employee Assistance Program (EAP)
Career Development & Progression opportunities
Paid Vacation, Personal Days and Sick days
Week off between Christmas and New Years'
No Internal Meetings Fridays
Compensation for this role is expected to fall within the range of $75,000 - 110,000 annually.
The final offer will reflect each candidate’s experience, skills, and internal equity.
This is for a vacant position.
AI Usage
We use technology to make hiring smarter, faster, and more personal, never less human. Artificial intelligence (AI) tools help us manage applications efficiently and highlight qualifications that align with each role, allowing our recruiters to focus more on meaningful conversations with candidates. AI does not make hiring decisions at Agility. Every decision is made by people, our hiring managers and recruitment professionals, who are trained to apply sound judgment and equitable practices at every stage. We believe technology exists to amplify human insight, not replace it. That belief shapes how we build relationships, tell stories, and grow our teams.
At Agility, we strive every day to build a more inclusive work environment and introduce tools that enable it. We strongly encourage applications from all people regardless of race, religion, gender, age, disability status or sexual orientation.
Even if you find yourself not checking all the boxes of our listed requirements but you are excited about this opportunity, we'd love to hear from you anyway. Our Talent Acquisition team will review your application for this role, and other potential role matches open now or in the future.
If, at any stage of the application process, you require accommodation owing to disability or a medical need, please let us know at careers@agilitypr.com for us to make appropriate arrangements.
At Agility, we strive every day to build a more inclusive work environment and introduce tools that enable it. We strongly encourage applications from all people regardless of race, religion, gender, age, disability status or sexual orientation.
Even if you find yourself not checking all the boxes of our listed requirements but you are excited about this opportunity, we'd love to hear from you anyway. Our Talent Acquisition team will review your application for this role, and other potential role matches open now or in the future.
If, at any stage of the application process, you require accommodation owing to disability or a medical need, please let us know at careers@agilitypr.com for us to make appropriate arrangements.
Thank you for your time in reviewing this opportunity, and we hope to hear from you should you find this the right fit!