01 Zakres zadań
Responsibilities:
- Developing ETL/ELT pipelines for data ingestion and transformation based on SA specifications.
- Implementing data mart prototypes in Greenplum for production: refactoring SQL, implementing incremental loading, and ensuring idempotency.
- Optimizing queries and data marts in Greenplum: selecting distribution keys, implementing partitioning, analyzing query plans (EXPLAIN ANALYZE), mitigating data skew and broadcast/redistribute motion, and configuring resource queues/groups.
- Configuring pipeline orchestration, monitoring, and alerting.
- Performing data quality checks and ensuring SLAs for data mart freshness.
