GSPANN is hiring a Data Engineering Lead to build and optimize scalable cloud data platforms and pipelines, focusing on trusted, high-quality data and analytics solutions while guiding cross-functional teams.
Description
Roles and Responsibilities
- Design and develop scalable Extract, Transform, Load (ETL) and Extract, Load, Transform (ELT) pipelines and cloud data platforms.
- Lead data warehouse and lakehouse implementations using Amazon Redshift or Databricks.
- Build and optimize data transformations using dbt, Spark, Python, and SQL.
- Implement data quality, governance, monitoring, and observability frameworks.
- Collaborate with cross-functional teams and provide technical leadership.
Skills and Experience
- Apply strong expertise in Amazon Redshift, dbt, Python, Apache Airflow, and Apache Spark to build scalable data platforms and analytics solutions.
- Bring experience with the AWS cloud ecosystem and services.
- Demonstrate knowledge of data mesh and modern data architecture principles.
- Work with real-time data processing and streaming architectures.
- Utilize Infrastructure as Code (IaC) tools such as Terraform and AWS CloudFormation.
- Bring experience working in Agile and Scrum environments.
- Demonstrate strong stakeholder management and leadership skills.