13 Oct
Manuh Technologies
Ghaziabad
Position - AWS Data Engineer
Location - Pune/Hyderabad (Hybrid)
Experience - 3-6 Years
Responsibilities:
- Design, develop and maintain large-scale data pipelines using AWS services such as Glue, Lambda and S3.
- Architect and implement data solutions in AWS Redshift for optimized data storage and retrieval.
- Build, automate and monitor data workflows using AWS Step Functions and CloudFormation.
- Ensure the effective setup and management of AWS Lake Formation and Glue Data Catalog for data lake environments.
- Develop and optimize ETL processes using Python and PySpark to process and transform large datasets.
- Collaborate with data scientists,
analysts and stakeholders to understand data requirements and translate them into scalable solutions.
- Implement best practices for data governance, security and quality across AWS infrastructure.
- Troubleshoot, optimize and enhance existing data pipelines and architecture for performance and scalability.
Required Skills:
- 3+ years of experience in data engineering with a focus on AWS.
- Expertise in AWS Glue, Lambda, S3, Redshift and Step Functions.
- Hands-on experience with AWS CloudFormation and AWS Lake Formation is a highly beneficial.
- Advanced programming skills in Python and PySpark for building and optimizing ETL pipelines.
- Experience with performance tuning, data modeling and query optimization in AWS environments.
- Strong understanding of data security, governance and compliance in cloud environments.
Good to have skills:
- Experience with CI/CD pipeline setup for data workflows.
- Knowledge of AWS cost optimization practices.
- Familiarity with other AWS services such as Athena, DynamoDB or RDS.
▶️ AWS Data Engineer
🖊️ Manuh Technologies
📍 Ghaziabad