Senior Data Engineer — Ingestion & Platform
Traffic Label is building a Customer Data Platform (CDP) that ingests data from 10+ casino partners, builds a unified player profile, and activates marketing campaigns through multiple ESPs (DotDigital, Adestra, FastTrack). The platform is live with 5 sources in production and 30-40 dbt models in the silver layer. You will join a Data Platform team of 5-10 engineers and report to the Data Engineering Lead. You will own the ingestion layer, source integrations, and platform tooling, with the goal of making it so that connecting a new data source takes days, not months. You will design and build reusable pipeline templates and own integrations with external systems, focusing on building the system that generates pipelines and owning the integrations that feed and consume data.
- Design and build ingestion pipelines for REST API, database sources, etc., using Python
- Own ETL and Reverse ETL end-to-end, including implementation, deployment, operations, and incident handling.
- Understand how external systems work (casino platforms, ESPs, affiliate tools) to build reliable integrations with them.
- Design DAG patterns: dependency management, partial retry, backfill procedures.
- Implement and maintain authentication flows, token refresh handling, and secrets management.
- Monitor, troubleshoot, and resolve integration issues in production environments.
- Write and maintain automated tests to ensure the reliability and stability of integration services.
- Collaborate closely with Engineering, Product, and Data teams to support platform scalability and operational efficiency.
- Contribute to infrastructure improvements and Infrastructure-as-Code initiatives.
- Write Architecture Decision Records (ADRs) for significant design choices.
- 6+ years in data engineering.
- Advanced Python: API clients, file processing, schema validation, integration logic.
- Deep Airflow experience: DAG design, dynamic generation, sensors, retry patterns, backfill, pools, connections management.
- dbt (mid+): bronze/silver models, source freshness, tests, materialisation strategy.
- Snowflake (mid): external stages, COPY INTO, storage integration, basic optimisation.
- API integration experience: authentication (OAuth, API keys), pagination, rate limiting, retry with backoff, error classification.
- Proven experience building reusable pipeline frameworks/templates that others use daily.
- Reverse ETL or outbound integration experience: pushed data from the warehouse to external systems.
- Writes clear documentation: architecture decisions, pipeline templates, and onboarding guides for the team.
- CI/CD pipeline design (GitHub Actions).
- Terraform basics (nice to have).
- Metadata-driven / config-driven pipeline experience (nice to have).
- Experience with ESP platforms (DotDigital, SendGrid, Braze, or similar) (nice to have).
- Gambling, marketing, or multi-tenant data platform experience (nice to have).
- Comfortable using AI coding assistants (nice to have).
- Competitive salary.
- Fully remote work across Europe.
- Flexible collaboration hours and strong work-life balance.
- The opportunity to work on scalable, business-critical systems and integrations.
- A collaborative culture focused on ownership, innovation, and continuous improvement.
Affiliate business working with all viable channels of online marketing since 2006. Onlinebingo.co.uk | 1CS.com