25 Oct
Coforge
Greater Noida
Job Description
Position : Senior Data Engineer (7-10 Years)
Location : Gr. Noida
Duration : Full Time
MUST HAVE SKILLS : 1 : Python
1 : Python
2 : Spark
3 : SQL
4 : Azure Cloud (Databricks)
5 : AI (GPT-4, OpenAI Codex)
RESPONSIBILITIES :
- Design, develop, and maintain data ingestion and processing pipelines for various data sources and formats.
- Implement data quality checks, validation rules, and error handling mechanisms to ensure data accuracy and reliability.
- Collaborate with data scientists, machine learning engineers, and product managers to understand data requirements and deliver solutions.
- Optimize data pipelines for performance, scalability, and security.
- Document data models, schemas, and data flows.
REQUIREMENTS :
- Bachelor's degree in computer science, engineering, or a related field.
- At least 5 years of experience in data engineering or a similar role.
- Proficient in Python, Spark, SQL, and cloud-based data platforms (e.g. Azure).
- Experience with data ingestion and processing frameworks (e.g. Spark, Databricks, etc.).
- Knowledge of generative AI techniques and tools (e.g. GPT-4, OpenAI Codex, etc.) is a plus.
- Strong communication, problem-solving, and analytical skills.
Posted On
Position : Senior Data Engineer (7-10 Years)
Location : Gr. Noida
Duration : Full Time
MUST HAVE SKILLS : 1 : Python
1 : Python
2 : Spark
3 : SQL
4 : Azure Cloud (Databricks)
5 : AI (GPT-4, OpenAI Codex)
RESPONSIBILITIES :
- Design, develop, and maintain data ingestion and processing pipelines for various data sources and formats.
- Implement data quality checks, validation rules, and error handling mechanisms to ensure data accuracy and reliability.
- Collaborate with data scientists,
machine learning engineers, and product managers to understand data requirements and deliver solutions.
- Optimize data pipelines for performance, scalability, and security.
- Document data models, schemas, and data flows.
REQUIREMENTS :
- Bachelor's degree in computer science, engineering, or a related field.
- At least 5 years of experience in data engineering or a similar role.
- Proficient in Python, Spark, SQL, and cloud-based data platforms (e.g. Azure).
- Experience with data ingestion and processing frameworks (e.g. Spark, Databricks, etc.).
- Knowledge of generative AI techniques and tools (e.g. GPT-4, OpenAI Codex, etc.) is a plus.
- Strong communication, problem-solving, and analytical skills.
Skills Required
PYTHON
Posted On PYTHON Location
Greater Noida
Posted On Greater Noida
30+ days ago