Software Development Engineer - Cloud

Software Development Engineer - Cloud

23 Oct
|
Sigmoid
|
Anantapur

23 Oct

Sigmoid

Anantapur

About the Role:

We are looking for a skilled SDE with 3-6 years of experience in big data technologies, particularly Java, Apache Spark, SQL and data lakehouse architectures. The ideal candidate will have a strong background in building scalable data pipelines and experience with modern data storage formats, including Apache Iceberg. You will work closely with cross-functional teams to design and implement efficient data solutions in a cloud-based environment.

Key Responsibilities:

- Data Pipeline Development:
- Design, build, and optimize scalable data pipelines using Apache Spark.
- Implement and manage large-scale data processing solutions across data lakehouses.
- Data Lakehouse Management:






- Work with modern data lakehouse platforms (e.g.Apache Iceberg) to handle large datasets.
- Optimize data storage, partitioning, and versioning to ensure efficient access and querying.
- SQL & Data Management:
- Write complex SQL queries to extract, manipulate, and transform data.
- Develop performance-optimized queries for analytical and reporting purposes.
- Data Integration:
- Integrate various structured and unstructured data sources into the lakehouse environment.
- Work with stakeholders to define data needs and ensure data is available for downstream consumption.
- Data Governance and Quality:
- Implement data quality checks and ensure the reliability and accuracy of data.
- Contribute to metadata management and data cataloging efforts.
- Performance Tuning:
- Monitor and optimize the performance of Spark jobs, SQL queries, and overall data infrastructure.
- Work with cloud infrastructure teams to optimize costs and scale as needed.

Qualifications:

- Bachelor’s or Master’s degree in Computer Science,





Information Technology, or a related field.
- 3-6 years of experience in data engineering, with a focus on Java, Spark and SQL Programming languages.
- Hands-on experience with Apache Iceberg, Snowflake, or similar technologies.
- Strong understanding of data lakehouse architectures and data warehousing principles.
- Proficiency in AWS data services.
- Experience with version control systems like Git and CI/CD pipelines.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.







Nice to Have:

- Experience with containerization (Docker, Kubernetes) and orchestration tools like Airflow.
- Certifications in AWS cloud technologies

▶️ Software Development Engineer - Cloud
🖊️ Sigmoid
📍 Anantapur

Subscribe to this job alert:
Enter Your E-mail address to receive the latest job offers for: software development engineer - cloud

Software Development Engineer-Frontend

Software Development Engineer-Frontend

Job description - Good experience into ReactJS or one modern MVC style JS Framework - Deep understanding of the DOM and how the browser works - Experience in building large scale pluggable UIs - Good understanding of the constantly evolving world of [...]
Anantapur
22 Oct
    Anantapur
    22 Oct

Software Development Engineer II (SDE II)

Software Development Engineer II (SDE II)

About Us SuperAGI is pioneering the future of Artificial General Intelligence with groundbreaking research and innovative AI products. Our mission is to transform the future of applications through intelligent, autonomous solutions that drive unpar [...]
Anantapur
28 Oct
    Anantapur
    28 Oct

Software Development Engineer II (Backend)

Software Development Engineer II (Backend)

About Us: Observe.AI is the fastest way to boost contact center performance with live conversation intelligence. Built on the most accurate AI engine in the industry, Observe.AI uncovers insights from 100% of customer interactions and maximizes f [...]
Anantapur
20 Oct
    Anantapur
    20 Oct

Lead Software Development Engineer

Lead Software Development Engineer

The Role: A lead software development engineer at Razorpay is well-grounded - innovative, quality focussed, product thinker, and business conscious - not mere coders, of course, with deeper technical context and experience to build quality software [...]
Anantapur
23 Oct
    Anantapur
    23 Oct
Subscribe to this job alert:
Enter Your E-mail address to receive the latest job offers for: software development engineer - cloud