Senior DataOps Engineer

Trustly's DataOps team is responsible for delivering the data generated by the application to interested areas, as well as data from APIs and other tools. All this thought in a safe, structured, scalable and generic way, because we work with multiple environments (in different regions) and we need to maintain consistency. We work with both the batch layer (using Airflow) and the streaming layer (Kafka). We help areas in process automation to deliver data more quickly and reliably. We are also concerned with the quality of the data (Data Quality), creating an observability layer for the data to act in a preventive and immediate way to the inconsistencies and failures of our processes. We also work on the delivery of products and services to facilitate the use and consultation of our data, such as maintaining tools such as Redshift and QuickSight. Last but not least, we interacted with the Data Science area to provide the necessary support and infrastructure for the production of models. To achieve our goals, we follow good code and development practices, apply end-to-end encryption in all our processes, use infrastructure as code, etc. Our work makes it possible for teams to have full capacity to work with the company's data. The Data Analytics area develops several internal processes to facilitate the delivery of more structured data to the business areas, developing views and reports that leverage the data in decision making. In addition, we were able to provide more productivity to the areas with the automation of processes, guaranteeing the dependencies and leaving the areas more focused on their activities. We make data available in a secure manner for use by the Risk & Data Science areas, to facilitate the training and production of models that have a direct impact on the conversion of our transactions and the fight against fraud. Our work is summarized in delivering data that will be decisive for the areas in their processes and also in making it a valuable asset as a parameter of our growth and decision-making. We still have many challenges ahead, such as having a robust monitoring and visibility system on top of the lake, using dedicated tools to do this control. Develop and maintain various services in Kubernetes. Create layers of abstractions to facilitate the creation of new data for the company, used by the areas. Make our processes more robust and automated with CI/CD. Improve the visibility of the data we have available for consultation by the areas, increasing their productivity. And keep improving our processes, applying optimizations and giving reliability to our changes with unit tests. As a Senior DataOps Engineer, you are a technical leader of Trustly’s data maturity. You don't just maintain pipelines; you design the scalable frameworks and design patterns that make data consumption effortless. Your role is to bridge the gap between complex infrastructure (EKS, EMR, Glue) and business value, collaborating closely with other teams to ensure our platform is as resilient as it is innovative.

• Design, implement, and maintain the scalable data platform infrastructure (AWS, Kubernetes, EMR, Redshift, Glue, etc.).
• Manage and evolve internal tools and frameworks for data ingestion and processing (e.g., Airbyte, Debezium, Airflow).
• Build and maintain secure, automated CI/CD pipelines for platform components and infrastructure-as-code.
• Collaborate with DevOps and Security teams to ensure compliance, reliability, and scalability of the data platform.
• Support version control, release workflows, and automation for notebooks, jobs, and tools used by data producers and consumers.
• Ensure high availability and performance of core data infrastructure through observability and alerting integrations.
• Build and apply design patterns for data architecture
• Build requirements with internal clients in structured tasks

• Bachelor’s or Master’s degree in IT/Math/CS/Engineering or other technical discipline
• Successful history of building big data pipelines, and orchestrating data workloads
• Experience with AWS cloud services (EKS, EC2, EMR, RDS) and big data tools (Spark, Redshift)
• Experience with relational databases (preferably Postgres), strong SQL coding, data modeling, data warehouses
• Experience with IaC, Terraform, etc
• Experience with Kubernetes, Docker
• Experience with CI/CD tools
• Experience with automation and workflow management tools (e.g. Airflow, Sagemaker)
• Python programming skills
• Full Professional Proficient in English for daily collaboration across a distributed global team

Skills:

Ownership and Accountability: Demonstrates responsibility for assigned tasks and projects. Takes initiative and follows through to ensure successful delivery without needing constant supervision.

Collaboration and Teamwork: Works effectively with cross-functional teams (Data Engineering, DevOps, Product, Security). Shares knowledge, supports peers, and contributes to a positive and collaborative team environment.

Analytical Thinking and Problem Solving: Approaches challenges with a structured and critical mindset. Identifies root causes and proposes practical, scalable solutions.

Clear and Assertive Communication: Communicates technical concepts clearly to both technical and non-technical stakeholders. Effectively documents processes and aligns with teams and business needs.

Continuous Improvement Mindset: Always looking for ways to improve processes, performance, and reliability. Proactively suggests optimizations and embraces a learning culture.

Prioritization and Time Management: Manages multiple tasks and projects effectively, understanding what’s urgent and important in a fast-paced environment.

Proactivity and Initiative: Takes action without waiting to be asked. Anticipates potential risks or blockers and addresses them ahead of time.

Flexibility and Adaptability: Comfortable with shifting priorities, new technologies, and changing environments. Maintains a positive and productive attitude under change.

Mentorship and Technical Influence: Supports and guides less experienced engineers. Leads by example and contributes to elevating the team's technical standards and culture.

• Bradesco health and dental plan, for you and your dependents, with no co-payment cost;
• Life insurance with differentiated coverage;
• Meal voucher and supermarket voucher;
• Home Office Allowance;
• Wellhub - Platform that gives access to spaces for physical activities and online classes;
• Trustly Club - Discount at educational institutions and partner stores;
• English Program - Online group classes with a private teacher;
• Extended maternity and paternity leave;
• Birthday Off;
• Flexible hours/Home Office - our culture is remote-first! You can work in every city in Brazil;
• Welcome Kit - We work with Apple equipment (Macbook Pro, iPhone) and we send many more treats! Spoiler alert: Equipment can be purchased by you according to internal criteria!;
• Referral Program - If you refer a candidate and we hire the person, you will receive a reward for that!