Senior Data Engineer

Senior Data Engineer

13 Oct
|
NeST Digital
|
Kolhapur

13 Oct

NeST Digital

Kolhapur

- Design, develop, and maintain scalable and efficient data pipelines to extract, transform, and load (ETL) data from various sources into data lakes and data warehouses.
- Design and develop microservices to
- Collaborate with data scientists, analysts, and cross functional teams to design data models, database schemas and data storage solutions.
- Implement data integration and data quality processes to ensure the accuracy and reliability of data for analytics and reporting.
- Optimize data storage, processing, and querying performance for large-scale datasets.
- Enable advanced analytics and machine learning capabilities on the data platform.
- Continuously monitor and improve data quality and data governance practices.






- Stay up to date with the latest data engineering trends, technologies, and best practices.

Requirements:

- Bachelor’s degree in computer science, Engineering, or a related field.
- 8+ of proven experience in data engineering, data warehousing, and ETL processes.
- Proficiency in data engineering tools and technologies such as SQL, Python, Spark, Hadoop, DBT, Airflow, Apache Kafka and Presto.
- Solid experience with table formats such as Delta Lake or Apache Iceberg
- Design and development experience with batch and real time streaming infrastructure and workloads.
- Solid experience with implementing data lineage, data quality and data observability for Big data workflows.
- Solid experience designing and developing microservices and distributed architecture.
- Hands-on experience with GCP ecosystem and data lakehouse architectures.
- Strong experience with implementing Databricks.
- Strong experience with container technologies such as Docker, Kubernetes.






- Strong understanding of data modeling, data architecture, and data governance principles.
- Excellent experience with DataOps principles and test automation.
- Familiarity with data processing and querying using distributed systems and NoSQL databases.
- Ability to optimize and tune data processing and storage for performance and cost-efficiency.
- Excellent problem-solving skills and the ability to work on complex data engineering challenges.
- Strong communication and collaboration skills to work effectively with cross-functional teams.
- Previous experience mentoring and guiding junior data engineers is a plus.






- Relevant certifications in data engineering or cloud technologies are desirable.

Nice to have:

- Experience working in a Data Mesh architecture.
- Supply Chain domain experience.

▶️ Senior Data Engineer
🖊️ NeST Digital
📍 Kolhapur

Subscribe to this job alert:
Enter Your E-mail address to receive the latest job offers for: senior data engineer

Senior Data Engineer

Senior Data Engineer

Hi All, Hope you are doing well ! Job Title: Senior Data Engineer Experience: 4 - 8 years Location: Chennai Job Type: Full-time (5 days office) Job Description: We are seeking a skilled Senior Data Engineer with over 4+ years of experie [...]
Kolhapur
14 Oct
    Kolhapur
    14 Oct

Senior/ Data Engineer - Kafka/ Apache Beam

Senior/ Data Engineer - Kafka/ Apache Beam

About Mitra Innovation ( Mitra AI is a global technology company that specializes in AI-driven solutions, cloud engineering, enterprise integration and workflow automation. Headquartered in the UK, Mitra has been serving global clients for the last [...]
Kolhapur
20 Oct
    Kolhapur
    20 Oct

Senior/ Data Engineer - Kafka/ Apache Beam

Senior/ Data Engineer - Kafka/ Apache Beam

About Mitra Innovation ( Mitra AI is a global technology company that specializes in AI-driven solutions, cloud engineering, enterprise integration and workflow automation. Headquartered in the UK, Mitra has been serving global clients for the last [...]
Kolhapur
22 Oct
    Kolhapur
    22 Oct

Senior Data Engineer – Azure & Python

Senior Data Engineer – Azure & Python

Job description Job Title: Senior Data Engineer – Azure & Python Shift Timing: US Shift (6 PM IST - 3:30 AM IST; flexible) Join our company as a Senior Data Engineer and drive innovation in the pharmaceutical industry! Key Responsibilities: [...]
Kolhapur
24 Oct
    Kolhapur
    24 Oct
Subscribe to this job alert:
Enter Your E-mail address to receive the latest job offers for: senior data engineer