25 Oct
Coforge
Greater Noida
Job Description
Responsibilities • Design, develop, and maintain data ingestion and processing pipelines for various data sources and formats. • Implement data quality checks, validation rules, and error handling mechanisms to ensure data accuracy and reliability. • Collaborate with data scientists, machine learning engineers, and product managers to understand data requirements and deliver solutions. • Optimize data pipelines for performance, scalability, and security. • Document data models, schemas, and data flows. Requirements • Bachelor's degree in computer science, engineering, or a related field. • At least 5 years of experience in data engineering or a similar role. • Proficient in Python, Spark, SQL,
and cloud-based data platforms (e.g. Azure). • Experience with data ingestion and processing frameworks (e.g. Spark, Databricks, etc.). • Knowledge of generative AI techniques and tools (e.g. GPT-4, OpenAI Codex, etc.) is a plus. • Strong communication, problem-solving, and analytical skills.
Posted On
Responsibilities • Design, develop, and maintain data ingestion and processing pipelines for various data sources and formats. • Implement data quality checks, validation rules, and error handling mechanisms to ensure data accuracy and reliability. • Collaborate with data scientists, machine learning engineers, and product managers to understand data requirements and deliver solutions. • Optimize data pipelines for performance, scalability, and security. • Document data models, schemas, and data flows. Requirements • Bachelor's degree in computer science, engineering, or a related field. • At least 5 years of experience in data engineering or a similar role. • Proficient in Python,
Spark, SQL, and cloud-based data platforms (e.g. Azure). • Experience with data ingestion and processing frameworks (e.g. Spark, Databricks, etc.). • Knowledge of generative AI techniques and tools (e.g. GPT-4, OpenAI Codex, etc.) is a plus. • Strong communication, problem-solving, and analytical skills.
Skills Required
PYTHON
Posted On PYTHON Location
Greater Noida
Posted On Greater Noida Desirable Skills
SPARK, SQL SERVER, SCALA
Posted On SPARK, SQL SERVER, SCALA
▶️ SENIOR DATA ENGINEER/ TECHNICAL ANALYST
🖊️ Coforge
📍 Greater Noida