Our client is a diversified financial services firm replacing the legacy infrastructure used across capital markets and modernizing the brokerage ecosystem with their cloud-native clearing and custody system.

We're seeking Kafka Expert to support and optimize their data streaming infrastructure.

This role includes working closely with the engineering team to improve the performance, scalability, and maintainability of their Kafka environment while integrating it with related technologies.

• Manage and optimize Kafka brokers, connector clusters and associated management tools/UI.
• Develop, test, and maintain Kafka transformers for real-time data processing.
• Ensure high availability, reliability, and monitoring of Kafka infrastructure.
• Collaborate with cross-functional teams to integrate Kafka with tools like Snowflake for data warehousing and analytics.
• Work on containerized deployments leveraging Kubernetes.
• Contribute to automation workflows using Argo or Airflow.
• Evaluate and integrate other streaming technologies as needed to enhance system capabilities.

• Proven expertise with Apache Kafka (brokers, connectors, UI tools, transformers).
• Hands-on experience with Kafka Clusters and best practices for scaling and managing them.
• Proficiency with related technologies: Snowflake, Kubernetes, Argo or Airflow.
• Understanding of bronze, silver and gold layers in Medallion Architecture
• Familiarity with cloud environments (AWS, GCP, or Azure)
• Experience designing of a multi cloud (among multiple AWS accounts) systems.
• Strong analytical and problem-solving skills.
• Experience working remotely with geographically distributed teams.

• Experience with other streaming technologies (e.g., Apache Flink, Pulsar, or Spark Streaming).
• Familiarity with cloud environments (AWS, GCP, or Azure).
• Understanding of DevOps practices, CI/CD pipelines, and monitoring tools.