Data Engineer

Andersen is hiring a Data Engineer in Poland for a project focused on processing large-scale data and delivering analytics solutions that support data-driven decision-making.

Our customer is a global technology provider delivering data analytics and AI-powered solutions that help organizations understand customer behavior, optimize marketing performance, and make informed business decisions.

The project processes large-scale audience and media consumption data for advertising, content measurement, and consumer analytics, while maintaining high-volume data pipelines and reliable analytics solutions.

Responsibilities:

• Analyze and resolve pipeline failures, triage data integrity issues, and apply targeted code fixes.
• Handle operational tickets and respond to production incidents during designated hours.
• Deliver validated pull requests with automated tests according to engineering standards, including concise technical summaries.
• Migrate legacy processes to Kubernetes-native operators while maintaining Airflow compatibility.
• Refactor code in line with customer engineering standards.
• Support cross-functional integration requirements in collaboration with internal teams.

Must-haves:

• Bachelor's degree in Computer Science, Software Engineering, or a related technical field, or equivalent.
• Experience as a Data Engineer for 5+ years.
• Hands-on production experience on AWS or Databricks.
• Strong proficiency in Python and PySpark at production quality.
• Experience designing and developing API-first services.
• Experience with Apache Airflow in production.
• Hands-on experience with Kubernetes infrastructure management.
• Strong understanding of distributed data processing and workflow orchestration.
• Level of English – from Upper-Intermediate and above.

Nice to have:

• Background in ACR or television measurement systems.
• Experience with identity-resolution frameworks.