Responsibilities

Role Description:

The Senior Data Engineer will be responsible for architecting and implementing scalable data solutions using AWS cloud services, Python-based data processing, and Snowflake as the core data warehouse. The role involves building robust data pipelines, ensuring data quality, and enabling analytics and reporting capabilities across the organization.

Key Responsibilities:

• Design and develop scalable ETL/ELT pipelines using Python and AWS services (e.g., Glue, Lambda, S3, Step Functions).
• Build and maintain data models and data marts in Snowflake to support analytics and reporting.
• Collaborate with business stakeholders to understand data requirements and deliver solutions.
• Optimize data workflows for performance, reliability, and cost-efficiency.
• Ensure data quality, integrity, and security across all data platforms.
• Lead and mentor junior data engineers and contribute to best practices and standards.
• Participate in architectural discussions and influence data platform strategy.
• Monitor and troubleshoot data pipeline issues and ensure timely resolution.
• Document data flows, architecture, and technical decisions.

Qualifications

Must Have

Education: B.E/B.Tech/MCA (CS, IT, E&C or E&TC only) .

Skill Set:

• Proficiency in Python for data processing and automation.
• Strong hands-on experience with AWS services: S3, Glue, Lambda, Athena, LakeFormation, IAM, CloudWatch.
• Deep understanding of Snowflake architecture, SQL, and performance optimization techniques.
• Experience with orchestration tools like AWS Step Functions.
• Proficiency in warehousing concepts, and performance tuning.
• Experience with CI/CD pipelines, version control (Git), and infrastructure as code (CloudFormation).
• Strong problem-solving, communication, and collaboration skills. Finish

Other:

• Excellent analytical and debugging skills.
• Strong leadership and mentoring capabilities.
• Ability to work independently and in a team-oriented, collaborative environment.
• Passion for data and continuous learning.

Competencies

• Drive Innovation and Continuous Improvement
• Build Scalable and Sustainable Solutions
• Foster Collaboration and Knowledge Sharing
• Deliver Results with Accountability
• Adapt to Change and Lead Through Ambiguity