Job Title: Azure Data Engineer
Location: Weehawken, NJ ( 5 days WFO)
Job Type : Fulltime
8+ years exp
JOB Description :
· Expert level skills writing and optimizing complex SQL
· Experience with complex data modelling, ETL design, and using large databases in a business environment
· Experience with building data pipelines and applications to stream and process datasets at low latencies
· Fluent with Big Data technologies like Spark, Kafka and Hive
· Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is required
· Designing and building of data pipelines using API ingestion and Streaming ingestion methods
· Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is essential
· Experience in developing NO SQL solutions using Azure Cosmos DB is essential
· Thorough understanding of Azure and AWS Cloud Infrastructure offerings
· Working knowledge of Python is desirable
· Designing and implementing scalable and secure data processing pipelines using Azure Data Factory, Azure Databricks, and other Azure services
· Managing and optimizing data storage using Azure Data Lake Storage, Azure SQL Data Warehouse, and Azure Cosmos DB
· Monitoring and troubleshooting data-related issues within the Azure environment to maintain high availability and performance
· Implementing data security measures, including encryption, access controls, and auditing, to protect sensitive information
· Automating data pipelines and workflows to streamline data ingestion, processing, and distribution tasks
· Utilizing Azure's analytics services, such as Azure Synapse Analytics, to provide insights and support data-driven decision-making.
· Documenting data procedures, systems, and architectures to maintain clarity and ensure compliance with regulatory standards
· Providing guidance and support for data governance, including metadata management, data lineage, and data cataloging
Best Regards,
Dipendra Gupta
Technical Recruiter
Dipendra.gupta@programmers.ai
...Transport Services is looking for enthusiastic, team players to deliver packages of all weights and sizes. Delivery Assistants work to assist the Delivery Associate ensure packages/boxes are delivered safely, timely and with care. Job Description NEW...
JOB SUMMARY: Performs routine to complex magnetic resonance procedures and related techniques, producing images at the request of and for interpretation by a licensed independent practitioner. Ensures services are performed in a safe environment in accordance with...
As an Apartment Maintenance Technician, you will play a crucial role in ensuring the smooth operation and upkeep of our apartment building. Your responsibilities will include: General Maintenance:- Perform routine repairs and maintenance tasks for both individual apartments...
...Pittston, PA for a large Flooring manufacturing company. The Forklift Operator will need to be able to operate both the sit-down and... ...will have flexibility to work both day and night shift. Training will occur on day shift and switch to nights. Lots of overtime...
...to patients in the CV ICU and acute Inpatient CV Units. Act as a first assist in CV Surgery cases in the Operating Room. Vein harvesting experience preferred. Follow established nursing standards, procedures, and practices to give patient care directions to nursing...