Purpose of the job
The DataOps Engineer will play a critical role in ensuring the reliability, security and operational excellence of Collinson's modern data platform. As a key member of the Data & Analytics team, you will be responsible for automating platform operations, maintaining cloud infrastructure, supporting CI/CD pipelines and ensuring the platform remains secure, scalable and highly available.
In this hands-on role, you will work closely with Data Engineers, Security, Infrastructure and Product teams to support enterprise-wide data initiatives through automation, observability and platform standardisation.
Key Responsibilities
· Manage and maintain Snowflake, Kafka, AWS, MongoDB and supporting data platform infrastructure.
· Build and maintain CI/CD pipelines and deployment automation.
· Develop and maintain Infrastructure as Code using Terraform.
· Manage AWS networking including VPCs, VPC Peering, PrivateLink and secure private networking.
· Work with the Central Network team to implement and support enterprise networking solutions.
· Support Confluent Kafka platform operations and event-driven data integration patterns.
· Perform platform patching, upgrades, and lifecycle management.
· Ensure timely remediation of security vulnerabilities and compliance with security standards.
· Implement monitoring, alerting and observability using Datadog and platform monitoring tools.
· Support production incidents, root cause analysis, and operational improvements.
· Maintain platform documentation, operational runbooks, and engineering standards.
· Optimize platform performance, reliability, and cloud costs.
· Support platform governance, access management, and disaster recovery activities.
· Evaluate emerging technologies and recommend improvements to platform engineering practices.
· Own operational excellence of the data platform.
· Define and improve platform reliability standards.
· Drive automation and reduce manual operational effort.
· Improve developer experience for data engineering teams.
· Develop and maintain operational metrics, SLAs and SLOs to improve platform reliability and availability.
Knowledge, skills and experience required
Mandatory Technical Skills
DataOps & Platform Engineering
AWS fundamentals
Snowflake Administration
MongoDB
Confluent Kafka Platform
Python
SQL
Git
CI/CD pipelines
Infrastructure as Code (Terraform)
Data Observability and Monitoring (Datadog)
Incident Management
Production Support
Security Patching
Vulnerability Management
Performance optimisation
Cost optimisation
AWS Networking
VPC
VPC Peering
AWS PrivateLink
Route 53
Security Groups
IAM
Private networking
Central Network integration
Preferred Skills
AWS Transit Gateway
AWS Direct Connect / VPN concepts
Datadog dashboards and alerting
Airflow
Platform Engineering / SRE practices
Nice to Have
Generative AI fundamentals
LLM integration patterns
AI Agent frameworks
Machine Learning platform awareness
Real-time analytics architectures
Person Specification
• Self-motivator with a desire to learn new skills and embrace new technologies in a constantly changing technology landscape
• Strong problem-solving and analytical skills.
• Passion for automation, reliability and secure platform operations.
• Self-motivated with a continuous learning mindset.
• Strong stakeholder management and communication skills.
• Ability to communicate technical concepts to non-technical audiences.
• Collaborative team player who thrives in agile environments.
• Quality-focused with strong attention to detail.
• Ability to balance business priorities with technical excellence.
• Proactive in identifying opportunities for improvement and innovation.
• Comfortable working across global teams and multiple business domains.
