23 Oct
Coforge
Greater Noida
Job Description
Position: Senior Data Engineer (7-10 Years)
Location: Gr. Noida
Duration: Full Time
MUST HAVE SKILLS:
1: Python
2: Spark
3: SQL
4: Azure Cloud (Databricks)
5: AI (GPT-4, OpenAI Codex)
RESPONSIBILITIES:
- Design, develop, and maintain data ingestion and processing pipelines for various data sources and formats.
- Implement data quality checks, validation rules, and error handling mechanisms to ensure data accuracy and reliability.
- Collaborate with data scientists, machine learning engineers, and product managers to understand data requirements and deliver solutions.
- Optimize data pipelines for performance, scalability, and security.
- Document data models, schemas, and data flows.
REQUIREMENTS:
- Bachelor's degree in computer science, engineering, or a related field.
- At least 5 years of experience in data engineering or a similar role.
- Proficient in Python, Spark, SQL, and cloud-based data platforms (e.g. Azure).
- Experience with data ingestion and processing frameworks (e.g. Spark, Databricks, etc.).
- Knowledge of generative AI techniques and tools (e.g. GPT-4, OpenAI Codex, etc.) is a plus.
- Strong communication, problem-solving, and analytical skills.
Posted On
Position: Senior Data Engineer (7-10 Years)
Location: Gr. Noida
Duration: Full Time
MUST HAVE SKILLS:
1: Python
2: Spark
3: SQL
4: Azure Cloud (Databricks)
5: AI (GPT-4, OpenAI Codex)
RESPONSIBILITIES:
- Design, develop, and maintain data ingestion and processing pipelines for various data sources and formats.
- Implement data quality checks, validation rules, and error handling mechanisms to ensure data accuracy and reliability.
- Collaborate with data scientists,
machine learning engineers, and product managers to understand data requirements and deliver solutions.
- Optimize data pipelines for performance, scalability, and security.
- Document data models, schemas, and data flows.
REQUIREMENTS:
- Bachelor's degree in computer science, engineering, or a related field.
- At least 5 years of experience in data engineering or a similar role.
- Proficient in Python, Spark, SQL, and cloud-based data platforms (e.g. Azure).
- Experience with data ingestion and processing frameworks (e.g. Spark, Databricks, etc.).
- Knowledge of generative AI techniques and tools (e.g. GPT-4, OpenAI Codex, etc.) is a plus.
- Strong communication, problem-solving, and analytical skills.
Skills Required
PYTHON
Posted On PYTHON Location
Greater Noida
Posted On Greater Noida
▶️ Senior Data Engineer (7-10 Years)
🖊️ Coforge
📍 Greater Noida