17 Oct
Infogain
Gurugram
Job Description
# : Azure Data Engineer (Senior)
**Location:** Gurugram, India
**Posted on:** October 15, 2024
---
## Share on
- [LinkedIn](#)
- [Twitter](#)
- [Facebook](#)
---
## ROLES & RESPONSIBILITIES
- Overall 6 to 8 years of experience in cloud data engineering, with a minimum of 3 to 5 years experience in Azure Databricks and PySpark.
- Proficient in SQL; must have worked on complex joins, subqueries, functions, and procedures, with the ability to perform SQL tuning and query optimization independently. Ideally, 5 to 6 years of solid experience in SQL.
- Design, develop, and maintain ETL pipelines using Databricks, PySpark, and ADF to extract, transform, and load data from various sources.
- Experience in implementing large and complex hosted solutions using Azure (ADF, Azure Data Lake Storage, and Databricks).
- Must have good experience working on Delta tables, deduplication, and merging with terabyte-sized datasets.
- Optimize and fine-tune existing ETL workflows for performance and scalability. 2 to 3 years of experience in ADF is desirable (medium expertise required).
- Must have experience working with large datasets.
- Experience in working with batch and streaming data processing (Good to have).
- Ability to develop reliable, secure, and compliant data processing systems.
- Collaborate closely with cross-functional teams to support data analytics, reporting, and business intelligence initiatives.
- Self-driven with the ability to work independently without support.
## EXPERIENCE
- 6-8 Years
## SKILLS
- **Primary Skill:** Data Engineering
- **Sub Skill(s):** Data Engineering
- **Additional Skill(s):** Python, Databricks, Azure Data Factory, PySpark
---
## ABOUT THE COMPANY
Infogain is a human-centered digital platform and software engineering company based out of Silicon Valley. We engineer business outcomes for Fortune 500 companies and digital natives in the technology, healthcare, insurance, travel, telecom, and retail & CPG industries using technologies such as cloud, microservices, automation, IoT, and artificial intelligence. We accelerate experience-led transformation in the delivery of digital platforms. Infogain is also a Microsoft (NASDAQ: MSFT) Gold Partner and Azure Expert Managed Services Provider (MSP).
Infogain, an Apax Funds portfolio company, has offices in California, Washington, Texas, the UK, the UAE, and Singapore, with delivery centers in Seattle, Houston, Austin, Krakw, Noida, Gurgaon, Mumbai, Pune, and Bengaluru.