22 Oct
Mindteck
Palakkad
Senior Data Engineer (Scala)
Details below:
Location: India (WFH)
Mode: Permanent
Must: Immediate - 30 days
3x headcounts in 10+ yrs band (should be flexible for IST and Europe Time Zone)
Salary: INR 24-28 LPA
Interview rounds: 2 or 3
Job Description:
Primarily experts of Spark 3.X, SCALA, Delta lake implementation, streaming solution implementation for IOT in Spark streaming. Kafka expertise.
Any experience with MFG BI, DWH and Datalake implementation would be a bonus.
KEY RESPONSIBILITIES:
Understand the factories , manufacturing process , data availability and avenues for improvement
Brainstorm , together with engineering,
manufacturing and quality problems that can be solved using the acquired data in the data lake platform.
Define what data is required to create a solution and work with connectivity engineers , users to collect the data
Create and maintain optimal data pipeline architecture.
Assemble large, complex data sets that meet functional / non-functional business requirements.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery for greater scalability
Work on data preparation, data deep dive , help engineering, process and quality to understand the process/ machine behavior more closely using available data
Deploy and monitor the solution
Work with data and analytics experts to strive for greater functionality in our data systems.
Work together with Data Architects and data modeling teams.
SKILLS /COMPETENCIES
Good knowledge of the business vertical with prior experience in solving different use cases in the manufacturing or similar industry
Ability to bring cross industry learning to benefit the use cases aimed at improving manufacturing process
Problem Scoping/definition Skills:
Experience in problem scoping, solving, quantification
Strong analytic skills related to working with unstructured datasets.
Build processes supporting data transformation, data structures, metadata, dependency and workload management.
Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores
Ability to foresee and identify all right data required to solve the problem
Data Wrangling Skills:
Strong skill in data mining, data wrangling techniques for creating the required analytical dataset
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets
Adaptive mindset to improvise on the data challenges and employ techniques to drive desired outcomes
Programming Skills:
Experience with big data tools: Spark,Delta,CDC,NiFi, Kafka, etc
Experience with relational SQL ,NoSQL databases and query languages, including oracle , Hive, sparkQL.
Experience with object-oriented languages: Scala, Java, C++ etc.
Visualization Skills
Know how of any visualization tools such as PowerBI, Tableau
Good storytelling skills to present the data in simple and meaningful manner
Data Engineering Skills
Strong skill in data analysis techniques to generate finding and insights by means of exploratory data analysis
Good understanding of how to transform and connect the data of various types and form
Great numerical and analytical skills
Identify opportunities for data acquisition
Explore ways to enhance data quality and reliability
Build algorithms and prototypes
Reformulating existing frameworks to optimize their functioning.
Good understanding of optimization techniques to make the system performant for requirements.
About Mindteck
Join Us! We are a growth-oriented company that needs the valuable contributions from you to join our team.
While others say it, we do it: We Care. We have helped thousands of talented individuals carve out their role and have a healthy work-life balance.
Just like life, you will experience a good mix of challenges and opportunities. But we will be rooting for you along the way.
Apply Today!
Presently,
Mindteck employs over 1,000 individuals throughout offices in:
- India
- UK & Europe
- US & Canada
- Singapore & Malaysia
- Middle East
It also has four development centers (US, Singapore and India (Kolkata, Bangalore)).
The company is listed on the Bombay Stock Exchange (BSE 517344) and is among a select group of global companies appraised at Maturity Level 5, Version 1.3 of the CMMI Institute’s Capability Maturity Model Integration (CMMI)
Mindteck is an Equal Employment Opportunity (EEO). All qualified applicants will receive consideration for employment without regard to race, religion, color, national origin, sex,
sexual orientation, gender identity, age, status as a protected veteran, status as a qualified individual with a disability, or any other trait protected by law
▶️ Senior Data Engineer (Scala) - WFH
🖊️ Mindteck
📍 Palakkad