13 Oct
IntraEdge
Bikaner
Looking for an AWS Redshift Developer with 3-5 years of experience to design, implement, and optimize data warehousing solutions, leveraging Redshift for robust analytics and reporting. Responsibilities : Design, develop, test, and maintain data pipelines in AWS Redshift. Provide expertise in Redshift database optimization, performance tuning, and query optimization. Design and implement workflows using Airflow or Event Engine. Work closely with version control team (Git). Develop and maintain data models for Redshift databases, including schema design, table structures, and optimization techniques. Collaborate with data architects and stakeholders to understand requirements and translate them into efficient data structures.
Design and implement Extract, Transform, Load (ETL) processes to extract data from various sources, transform it as per business requirements, and load it into Redshift. Develop efficient and scalable ETL workflows, considering data quality, performance, and data governance. Optimize query performance by creating appropriate data distribution keys, sort keys, and compression techniques. Identify and resolve performance bottlenecks, fine-tuning queries, and optimizing data processing to enhance Redshift's performance. Integrate Redshift with other AWS services, such as AWS Glue, AWS Lambda, Amazon S3, and more, to build end-to-end data pipelines. Ensure seamless data flow between different systems and platforms, maintaining data integrity and consistency. Implement monitoring and alerting systems to proactively identify issues and ensure the stability and availability of the Redshift cluster. Perform troubleshooting, diagnose and resolve data-related issues,
and work closely with support teams to resolve any performance or operational problems. Plan and execute strategies for scaling Redshift clusters to handle increasing data volumes and user demands. Monitor resource utilization, track data growth, and make recommendations for capacity planning and infrastructure scaling. Required Skills AWS data lake solutions Data Modeling and Design ETL Development Performance Optimization Monitoring and Troubleshooting Redshift and other AWS services (DMS, Glue, Lambda, S3, Athena, Airflow) Python/Scala Programming Languages. Pyspark and Glue ETL CloudFormation AWS infrastructure (YAML, IAM) AWS tooling (CloudWatch logs, log insights, CloudTrail, IAM) DevOps tools SQL API (API Gateway, Route structuring, API authentication) Shell scripting