Data Engineer

Andersen is hiring a Data Engineer in Poland for a project processing large-scale data and delivering analytics solutions that support data-driven decision-making.

The company  is a global technology provider specializing in data analytics and AI-powered solutions that help organizations better understand customers, optimize marketing, and make data-driven decisions.

The project focuses on processing and analyzing large-scale audience and media consumption data to support advertising, content measurement, and consumer analytics, while maintaining high-volume data pipelines and ensuring reliable delivery of analytics solutions.

Responsibilities:

• Analyzing and resolving pipeline failures, triaging data integrity issues, and applying targeted code corrections.
• Addressing operational tickets during designated hours; responding to production incidents as assigned.
• Delivering validated pull requests with automated testing consistent with company standards and providing a concise technical summary for each ticket.
• Transitioning legacy processes to Kubernetes-native operators and maintaining Airflow compatibility.
• Refactoring code in line with the customer’s engineering standards.
• Supporting cross-functional integration requirements in collaboration with internal teams.

Must-haves:

• Bachelor's degree in Computer Science, Software Engineering, or a related technical field, or equivalent.
• Experience as a Data Engineer for 5+ years.
• Hands-on production experience on AWS or Databricks.
• Strong proficiency in Python and PySpark at production quality.
• Experience designing and developing API-first services.
• Experience with Apache Airflow in production.
• Hands-on experience with Kubernetes infrastructure management.
• Strong understanding of distributed data processing and workflow orchestration.
• Level of English – from Upper-Intermediate and above.

Nice to have:

• Background in ACR or television measurement systems.
• Experience with identity-resolution frameworks.