Lead Azure Data Engineer Job at Info Resume Edge, New York, NY

N2p0YUdRZEJuSUhpVWRxNlhtcmtpcm81R2c9PQ==
  • Info Resume Edge
  • New York, NY

Job Description

Key Responsibilities

  • Participate in the modernization and migration of current Azure data and analytics systems to the Databricks Lakehouse Platform .

  • Support Databricks platform enablement, configuration, and deployment activities.

  • Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory, Azure Functions, and Databricks.

  • Build scalable data integration solutions across Azure Data Lake, Azure SQL Database, Azure Storage (Blob/File) , and Databricks.

  • Assist in optimizing ingestion and transformation processes for performance, reliability, and cost efficiency.

  • Migrate legacy data pipelines, workflows, and processing logic into Databricks notebooks or Delta pipelines.

  • Work with cross-functional teams to understand business requirements and translate them into technical solutions.

  • Ensure all solutions comply with Marsh MMA standards for security, governance, and data quality .

  • Perform data validation, unit testing, troubleshooting, and system performance tuning.

  • Document architecture, workflows, design decisions, and operational procedures.

Required Technical Skills

  • Strong hands-on experience with:

    • Azure Data Factory (ADF)

    • SQL / T-SQL

    • Azure Functions

    • Azure SQL Database

    • Azure Data Lake (ADLS Gen2)

    • Azure Storage (Blob / File)

    • Databricks (Notebooks, Delta Lake, Spark)

Qualifications

  • Bachelors degree in Computer Science, Data Engineering, Information Technology, or related field.

  • Proven experience working with cloud-based data engineering solutions, preferably in Azure ecosystems.

  • Experience supporting cloud migration or modernization initiatives is a plus.

  • Strong understanding of ETL/ELT concepts, data modeling, and distributed data processing.

Soft Skills

  • Strong analytical and problem-solving mindset.

  • Excellent communication and documentation abilities.

  • Ability to collaborate with cross-functional teams across technical and business domains.

  • Detail-oriented with a focus on quality and compliance.

Job Tags

Similar Jobs

Raytheon

Unreal Engine/C++ Development Engineer Job at Raytheon

 ...Development experience using the Unreal Engine Experience in modeling, animation, rending, and visualization Programming experience in C++...  ...we Prefer: ~ Active Secret security clearance. ~3D modeling and animation using Autodesk 3ds Max ~ Experience with... 

i9 Sports - Sounth Kent, Sussex, Wicomico, Somerset, Worcest...

Flag Football Official Job at i9 Sports - Sounth Kent, Sussex, Wicomico, Somerset, Worcest...

 ...pick. i9 Sports offers youth sports leagues, camps, and clinics for kids ages 3-17 in today's most popular sports such as flag football, soccer, basketball, volleyball, and baseball. With our focus on fun, safety, convenience, and good sportsmanship, i9 Sports is reinventing... 

Brays Island Plantation

Spray Technician Job at Brays Island Plantation

 ...Description Spray Technician TITLE: Spray TechnicianDEPT: Landscape MaintenanceREPORTS TO: Landscape SupervisorEXEMPT STATUS: Non...  ...Serves as landscape spray technician for the plantation landscape maintenance department. Responsibilities include chemical applications and... 

Kaiser Permanente

Home Health Visiting RN - Redmond/Issaquah Job at Kaiser Permanente

 ...Description: Job Summary: Provides comprehensive skilled nursing care and services to patients in the home setting. Works on an interdisciplinary team to provide care in the home health, palliative care and hospice programs. Accountable for the assessment,... 

Seven Healthcare

Travel Nurse RN - Case Management Job at Seven Healthcare

 ...- CCRN certification preferred Why Work with Seven Healthcare? Recognized as a Best Travel Nurse Company 2024 by BluePipes and holding 5-star ratings on Google and Vivian, Seven Healthcare provides competitive pay, exclusive assignments, and dedicated support....