Microsoft Fabric Data Engineer – Generative AI

Azure Data Factory (ADF)PySparkStructured Query Language (SQL)Microsoft FabricDatabricksGenerative Artificial Intelligence (GenAI)

Description

GSPANN is hiring a Microsoft Fabric Data Engineer with Generative AI skills to build data models and streaming pipelines on Microsoft Azure, focusing on reliable data ingestion and clear analytics for analysts and customers.

Roles and Responsibilities

  • Build and launch new data models that deliver intuitive analytics for analysts and customers.
  • Develop high-performance, flexible streaming pipelines that evolve rapidly to handle new technologies, techniques, and modeling approaches.
  • Manage data ingestion pipelines end to end and build deep data expertise across sources.
  • Design complex Extract, Transform, Load (ETL) processes and frameworks using ADF.
  • Implement large-scale, near real-time streaming data processing pipelines.

Skills and Experience

  • Bring 5+ years of experience leading the design and development of data and analytics projects in a global company.
  • Demonstrate experience working on projects with cross-functional teams, building sustainable processes, and coordinating release schedules.
  • Apply Microsoft SQL Server experience to data modeling.
  • Work with Microsoft Azure, including strong knowledge of Azure Data Lake Storage (ADLS), Azure Blob Storage, ADF, SQL Server, and data warehouses.
  • Utilize cloud-based Enterprise Data Warehouse (EDW) platforms such as Snowflake, Azure Synapse Analytics, Amazon Redshift, and Google BigQuery.
  • Demonstrate strong knowledge of Spring frameworks.
  • Work with the Apache Kafka messaging platform and Big Data streaming platforms such as Apache Spark, Apache Flink, Kafka Streams, and Azure Event Hubs.
  • Utilize Azure cloud services such as Azure Virtual Machines (VMs), Azure Cognitive Search, Azure HDInsight (HDI), and Azure Functions.
  • Apply familiarity with containers, microservices, and Application Programming Interfaces (APIs).
  • Bring experience working across Unix, Windows, and Linux operating systems.

Apply Now

PDF or DOCX up to 5MB