27 Oct
Recmatrix Consulting
Junagadh
Job Title: Tech Lead - BigData, Digital Business
Location: Remote within India
Employment Type: Contract
Experience Level: 8+ years
Position Overview:
We are seeking a Tech Lead - BigData, Digital Businesst to join our Digital Business team. This role involves building and managing data warehouses to support various business functions such as Sales, Marketing, and Content teams, along with driving best practices in Data engineering, Data Modeling, ETL, SQL and AWS Cloud services.
Key Responsibilities:
• Supporting Multiple ongoing and future big data projects in this fast paced environment
• Solving big data problems by structuring and analyse the behaviour of data using a various data technology and tools
• Handle large scale database, analysing the patterns of data to make strong and accurate business decisions.
• Benchmark systems, analyse system bottlenecks and propose solutions to eliminate them, be able to clearly articulate pros and cons of various
technologies and platforms.
• Build & manage the data pipelines for billions of event in OTT domain is plus.
• Code review and Mentor team members.
Required Skills and Experience:
- Bachelor’s degree in Computer Science, Information Technology, or a related field.
- Overall 8+ years of IT experience with 5+ years in Data related technologies, and expertise of 3+ years in data-related AWS Cloud services
• Have 3+ year of experience in ClickHouse or any other OLAP system
• Mandatory to have knowledge of Big Data Architecture Patterns and experience in the delivery of end-to-end Big Data solutions.
• Expert in programming languages like Java/ Scala and good to have Python
• Worked on at least one distributed data processing framework: Spark (Core, Streaming, SQL), Storm or Flink, etc.
• Worked in Hadoop eco-system with AWS cloud distribution and worked at least on one or more big data ingestion tools (Sqoop, Flume, NiFI, etc),
distributed messaging and ingestion frameworks (Kafka, Pulsar, Pub/Sub, etc) and good to know traditional tools like Informatica, Talend etc
- • Good Exposure in development with CI / CD pipelines. Knowledge of containerization, orchestration and kubernetes engine would be an added advantage.
▶️ Lead Data Engineer
🖊️ Recmatrix Consulting
📍 Junagadh