21 Oct
Coeo
Secunderabad
Senior Data Engineer
Coeo are trusted data management and analytics experts, delivering technology strategy and support for business. The team have deep technical and commercial experience working with Microsoft Data Services to help our clients optimise their costs and maximise the benefits from their investments in these technologies. Coeo has been established for over 15 years and has offices in Reading, UK and Hyderabad, India. We are exclusively focused on Microsoft technologies. Our mission is to help our clients predict their future through the better use of data, technology, people, and processes. To do this our business has always focused on:
Data Managed Services
Data Platform Consultancy
Analytics Consultancy
Artificial Intelligence Consultancy
Adoption and Change Management
But above all, Coeo's most important asset is its people and at Coeo we are really focused on investing time, attention, and resources into building a culture that truly values its people.
We are growing our teams in India to support our ongoing customer requirements in Managed Services, Consulting and Development.
Coeo are recruiting for a strong Senior Data Engineer and we'll give you the opportunity to grow and develop your capabilities as well as supporting you through Microsoft certifications. You'll have experience in:
Developing low to high complexity, secure, governed, high quality and efficient data pipelines from a variety of on and off premise, internal and external data source.
Ensuring that data is cleansed, mapped, transformed and optimised for storage to meet requirements for business and technical use cases.
Building data observability and data quality by design into all Data pipelines,
promoting self-testing pipelines that proactively identify processing issues or discrepancies.
Take all requirements into account when creating a proposal
Understanding and evaluating the organisational impact of new technologies and digital services
Troubleshooting and resolving issues
You may be building solutions that transform data into data lake storage areas, physical database models and reporting structures across data lakes, data warehouse, business intelligence systems and analytics applications. You may also be required to carry out unit testing of own code and peer testing of others to ensure appropriate quality.
Experience
Experience of working with large, event based, datasets in an enterprise environment.
Minimum 4 years within an Azure or SQL Data Engineering environment
Engineering and database skills in SQL Server and/or Azure (Data Factory, Synapse) and the associated ETL technologies.
Experience developing, driving & maintaining Data Integration Roadmaps and best practices.
Overall responsibility of all technical business requirements gathering deliverables and implementation.
Ability to deliver high to low-level designs for Data Solutions and have a good understanding of the full data lifecycle.
Hands-on experience in designing and developing scripts for custom ETL processes and automation in Azure Data Factory, Azure Databricks, Azure Synapse, Python, Pyspark etc.
Hands-on experience designing and developing stored procedures/functions and leveraging ETL packages/workflows
Expertise in Cloud related Big Data integration and infrastructure tech stack using Azure Databricks & Apache Spark framework
Well-versed with scripting languages such as Python
Experience of Continuous Integration / Continuous Delivery (CI/CD).
Experience of working in an agile environment and self-managing teams.
Understanding and practical knowledge of testing techniques and tools
Desired techologies
Big Data
Azure
Spark
Python
Azure Databricks
Azure Synapse
Azure Data Factory
SQL Server
Benefits
Company bonus scheme driven by yours and our success
We care about your wellbeing so have invested resources and training help to ensure you can be at your best with us
Very friendly, inclusive culture, family-feel and strong camaraderie
Company growth and new projects means on going career progression options
Up to date technology, so collaboration has never been easier
Cutting edge technology projects exciting goals ahead!
Click Apply or visit our Careers page at www.coeo.com. For a full Job Description and further information on the benefits of working with us, please email [HIDDEN TEXT]
Diversity and Inclusion
Coeo are an equal opportunity employer which celebrates Diversity and has a commitment to Inclusion. All applicants will be considered for employment with us without attention to age, race, colour, religion, sex, sexual orientation, gender identity, national origin, and disability status.