25 Oct
Edstem Technologies
Dombivli
Role Overview Description
- The Senior Data Engineer will work collaboratively with Data Science and Analytics teams to build scalable, robust, and efficient data pipelines to enable data-driven decision making.
- Responsible for designing data architectures, building/maintaining data pipelines, and integrating and transforming data from various sources to maximize accessibility and usability.
Roles & Responsibilities
- Design reliable and scalable data architectures and pipelines for streaming and batch data
- Develop complex ETL processes to extract, transform and load data from various sources to destinations
- Work on data quality monitoring and optimization processes
- Collaborate with data scientists and analyst to understand their data and analytics needs
Requirements
- 5+ years of experience as a Data Engineer
- Expert level knowledge of SQL, Python and PySpark
- Experience in Airflow is preferred
- Strong software engineering fundamentals including systems design, algorithmic thinking and complexity analysis
▶️ Senior PySpark Data Engineer
🖊️ Edstem Technologies
📍 Dombivli