Senior Data Engineer, AWS ETL & Redshift

India
8 days ago

Description

We are seeking a Senior Data Engineer with deep expertise in building and managing data pipelines on AWS. The ideal candidate will be responsible for designing, developing, and optimizing data workflows using AWS Glue and other related technologies. You'll also play a critical role in data modeling and managing our Redshift data warehouse to support analytics and business intelligence initiatives.

Location: India

Requirements

  • 7+ years of experience in a Data Engineering role.
  • Extensive experience with AWS data services, particularly AWS Glue (Glue Studio, Glue Data Catalog, Glue Jobs).
  • Demonstrated expertise in building complex ETL/ELT processes.
  • Proven experience with Amazon Redshift and a solid understanding of data warehouse concepts.
  • In-depth knowledge of data modeling techniques, including Star schema and canonical models.
  • Proficiency in SQL and scripting languages like Python or Scala.
  • Experience with other AWS services like S3, Lambda, and IAM.
  • At least 2-3 relevant demonstrable project experiences involving large-scale data pipelines and data warehousing are required.
  • Prior experience working in a SaaS environment is highly desirable.

Responsibilities

  • Architect and build scalable and resilient ETL pipelines using AWS Glue, including Glue crawlers, jobs, and workflows.
  • Perform data modeling for a data warehouse using Star schema and canonical models.
  • Manage and optimize data within Amazon Redshift to ensure high performance and cost efficiency.
  • Collaborate with data analysts and business teams to understand their data requirements and translate them into technical solutions.
  • Monitor data pipelines, troubleshoot issues, and ensure data quality and integrity.

Additional Information

About EffiQ

EffiQ's mission is to empower and elevate businesses with innovative solutions to enhance their digital journeys by modernizing, integrating, and automating. We specialize in delivering cutting-edge solutions that drive efficiency, improve productivity and unlock new levels of operational excellence. EffiQ Technology Solutions is a team of experienced professionals and technology experts who can support and manage enterprise software systems such as Manhattan WMS, SAP and Microsoft D365 ERP.  EffiQ's vision is to revolutionize supply chain.

We also assist organizations to quickly fill skill gaps, manage increased workloads, and maintain productivity without the long-term commitment of permanent hires. 

https://www.effiqt.com/
Apply Now