Senior Azure Data Engineer

Senior Azure Data Engineer

27 Oct
|
Antal TECH jobs
|
Junagadh

27 Oct

Antal TECH jobs

Junagadh

Job description

- Data Ingestion covers structured, unstructured, and semi-structured data
- Creating File shares/Blob container in ADLS to store the Ingested Data
- Data Modelling for the Staging Layer
- Data Cleansing/formatting in staging layer in ADLS using Azure Synapse
- Transform raw data into standardized formats using data transformation processes in Azure Synapse
- Data Transformation process to merge, harmonize and transform the data and load it in transformation layer using Azure Synapse pipelines
- Copying the transformed data from ADLS to Synapse DB Schema
- Creating the final high-level aggregations/summary tables needed for consumption






- Create Synapse pipelines to expose the summarized data for API calls using SOAP/REST APIu2019s
- Implement Azure Purview for data cataloguing and governance
- Implement Azure Monitor for logging and monitoring activities
- Implement Microsoft Entra ID for secure authentication and access control

Requirements

- Creating Azure Synapse pipelines to Ingest data from Flat Files (Blob Storage) and Other Data Sources
- Data Ingestion covers structured, unstructured, and semi-structured data
- Creating File shares/Blob container in ADLS to store the Ingested Data
- Data Modelling for the Staging Layer
- Data Cleansing/formatting in staging layer in ADLS using Azure Synapse
- Transform raw data into standardized formats using data transformation processes in Azure Synapse
- Data Transformation process to merge, harmonize and transform the data and load it in transformation layer using Azure Synapse pipelines
- Copying the transformed data from ADLS to Synapse DB Schema
- Creating the final high-level aggregations/summary tables needed for consumption






- Create Synapse pipelines to expose the summarized data for API calls using SOAP/REST APIu2019s
- Implement Azure Purview for data cataloguing and governance
- Implement Azure Monitor for logging and monitoring activities
- Implement Microsoft Entra ID for secure authentication and access control

▶️ Senior Azure Data Engineer
🖊️ Antal TECH jobs
📍 Junagadh

Subscribe to this job alert:
Enter Your E-mail address to receive the latest job offers for: senior azure data engineer
Subscribe to this job alert:
Enter Your E-mail address to receive the latest job offers for: senior azure data engineer