15 Oct
Www.Huquo.com
Gurugram
Position : Data Engineer / Managed ServiceWork Location : Pune/ Hyderabad / Gurgaon / HybridExperience : 8+ YearsMust have Skills :
- Must have proven experience in leading and/or managing a team of data engineers previously.
- Strong experience utilising the Microsoft Azure stack for data engineering that is Azure data factory, Data lakes.
- Proven experience using data bricks i.e. Lake house, Delta live tables, Pyspark etc.
- Experience designing, developing, and maintaining data warehouses and data lakes.
- Excellent experience with SQL and T-SQL programming.
- Experience on distributed computing frameworks such as Spark.
- Demonstrate strong expertise in data pipelines, ETL/ELT processes, and cloud-based data platforms (Azure).
- Expertise in cloud data warehousing and core data modelling concepts.
- Proficiency in version control systems (Azure DevOps/Git) and experience with CI/CD.
- Experience with scripting languages such as Python.
Good to Have :Certifications : Data Engineering certifications from Microsoft or Data bricks technologies (Desirable). Role & Responsibilities :
- Leadership of a managed service team and overseeing multiple data lake environments
- Design, develop, maintain, test, and optimise a scalable and reliable data platform for collecting, processing, and transforming large volumes of company data from various sources.
- Work with cross-functional teams to understand data platform requirements and deliver solutions that meet business needs.
- Secure data access in the Data Lake following company policies and manage permissions for existing services (Azure Services, Unity Catalog, workspace) including creation of new catalog and schemas.
- Maintain Release & Change Management with test validation,
rollback plans, and successful deployment verification.
- Enhance data storage and retrieval systems for high performance and data integrity.
- Implement and maintain a data quality and observability framework to ensure data accuracy, completeness, and consistency.
- Implement a robust change management process for ensuring smooth transitions into production
- Actively manage cloud-based data services to balance performance and cost.
- Mentor and guide data engineers, fostering a culture of continuous learning and development.
- Knowledge and adoption of data engineering best practices and standards.
- Coordinate resolution to any changes with other immediate and wider team membersEducation :Bachelor's degree in Computer Science, Software Engineering,
MIS or equivalent combination of education and experienceEvery individual comes with a different set of skills and qualities so even if you don't tick all the boxes for the role today, we urge you to apply as there might be a suitable/unique role for you tomorrow!
(ref:hirist.tech)
▶️ Lead Data Engineer - Azure Databricks/DataLake
🖊️ Www.Huquo.com
📍 Gurugram