22 Oct
Antal TECH jobs
Dombivli
Job description
- Data Ingestion covers structured, unstructured, and semi-structured data
- Creating File shares/Blob container in ADLS to store the Ingested Data
- Data Modelling for the Staging Layer
- Data Cleansing/formatting in staging layer in ADLS using Azure Synapse
- Transform raw data into standardized formats using data transformation processes in Azure Synapse
- Data Transformation process to merge, harmonize and transform the data and load it in transformation layer using Azure Synapse pipelines
- Copying the transformed data from ADLS to Synapse DB Schema
- Creating the final high-level aggregations/summary tables needed for consumption
- Create Synapse pipelines to expose the summarized data for API calls using SOAP/REST APIu2019s
- Implement Azure Purview for data cataloguing and governance
- Implement Azure Monitor for logging and monitoring activities
- Implement Microsoft Entra ID for secure authentication and access control
Requirements
- Creating Azure Synapse pipelines to Ingest data from Flat Files (Blob Storage) and Other Data Sources
- Data Ingestion covers structured, unstructured, and semi-structured data
- Creating File shares/Blob container in ADLS to store the Ingested Data
- Data Modelling for the Staging Layer
- Data Cleansing/formatting in staging layer in ADLS using Azure Synapse
- Transform raw data into standardized formats using data transformation processes in Azure Synapse
- Data Transformation process to merge, harmonize and transform the data and load it in transformation layer using Azure Synapse pipelines
- Copying the transformed data from ADLS to Synapse DB Schema
- Creating the final high-level aggregations/summary tables needed for consumption
- Create Synapse pipelines to expose the summarized data for API calls using SOAP/REST APIu2019s
- Implement Azure Purview for data cataloguing and governance
- Implement Azure Monitor for logging and monitoring activities
- Implement Microsoft Entra ID for secure authentication and access control
▶️ Senior Azure Data Engineer
🖊️ Antal TECH jobs
📍 Dombivli