22 Oct
Mitra AI
Malappuram
About Mitra Innovation (
Mitra AI is a global technology company that specializes in AI-driven solutions, cloud engineering, enterprise integration and workflow automation. Headquartered in the UK, Mitra has been serving global clients for the last 12 years in the US, UK, EU and APAC, across industries such as BFSI, telecommunications, healthcare, and retail, helping businesses modernize and optimize their operations.
Working mode
This is a FULL-TIME PERMANENT , REMOTE role for all Indian candidates.
Role
We are looking for talented Senior Data Engineers/ Data Engineers to join our team and play a key role in building and maintaining data streaming pipelines.
The successful candidate will have experience with event-driven architectures and be proficient in Kafka, Apache Beam, or Flink. This position will focus on ensuring scalable data processing, optimizing pipeline performance, and ensuring data security and observability.
Job Specific Duties & Responsibilities
- Design, build, and maintain data streaming pipelines for both batch and real-time processing using Kafka and Flink or Apache Beam
- Develop and manage Kafka AVRO schemas to ensure robust data serialization
- Create Kafka streamers for publishing and subscribing, ensuring data flow across systems
- Integrate API clients with OAuth 2 for REST and GraphQL services
- Implement containerized solutions using Docker for streamlined deployments
- Collaborate with cross-functional teams, participating in Agile ceremonies such as sprint planning and user story grooming
- Develop and perform testing at all levels, including unit, functional, integration, and non-functional testing
- Design data models and integrate them into SQL databases
Required Skills,
Experience & Qualifications
- Data Engineer - 3+ years of hands-on experience with Kafka, Redis, Apache Beam, Flink for event-driven design and implementation
- Senior Data Engineer - 5+ years of hands-on experience with Kafka, Redis, Apache Beam, Flink for event-driven design and implementation
- Strong Kafka AVRO schema design skills
- Experience in Kafka streamers (publishers/subscribers) development using Apache Beam or Flink
- Proficiency in API development (REST/GraphQL) with OAuth 2
- Experience with Docker containerization
- Strong testing mindset with experience in TDD/BDD
- Proficiency in SQL databases such as PostgreSQL and data modelling
- Knowledge of Kubernetes (K8s) and Amazon EKS
- Experience working with AWS services for cloud-based solutions
- Understanding of data security measures, including encryption and ACL on Kafka topics
- Knowledge of Kafka optimization techniques (compression)
- Experience in observability, including metrics, tracing, and logging
Nice to have
- Experience with Kubernetes pipeline tools such as ArgoCD, GitOps, and Helm Charts
- Familiarity with Artifactory for managing artefacts
- Exposure to DevSecOps tools like Snyk for vulnerability scanning
- Experience with GitHub Actions for continuous integration and delivery
- Observability tools knowledge (AWS Cloud Watch, ELK, Grafana, Prometheus)
- Experience with Kafka load testing to ensure system reliability
▶️ Senior/ Data Engineer - Kafka/ Apache Beam
🖊️ Mitra AI
📍 Malappuram