What’s the role 

We are looking for a highly skilled Sr. Data Engineer to join our team and help design, build and maintain the infrastructure required for optimal extraction , transformation and loading of data from various sources (which include streaming and batch data). The candidate is expected to work closely with multiple business stakeholders and teams to support data initiatives and ensure business value generation.  

Accountabilities: 

• Closely working with product / project team and stakeholders to understand the requirement 

• Solution consultation and development in accordance with the enterprise technology principles, methods, standards, and practices.  

• Estimation, solution & detailed technical design, implementation of high performance data pipelines which is secure and scalable  

• To define data models and schemas to support data analytics  

• Integrate different kind of data sources(database, API, streams) into unified data platform 

• Implement solutions for near-real-time data access.  

• Maintain and improve data quality, consistency and data governance throughout the ETL/ELT process  

• application technical deliverables including code, associated tests, and documentation  

• To automate the data workflows and reduce manual intervention.  

• To collaborate with multiple teams to integrate data solutions into other applications 

• To build the reusable solutions which can be reused across multiple projects 

• To identify areas, for improving efficiency in data operations  

• To innovate solutions for complex data and to ensure scalability and performance  

What you bring  

• Must have legal authorization to work in the US on a full-time basis for anyone other than current employer 

• Degree in Software Engineer or demonstrated capability, applied experience, and role-relevant skills 

• 10 + Years of relevant data engineering experience which include solutioning, design, planning and implementing end-to-end data solutions. Have in-depth hands-on experience in multiple complex implementations which include different tools and technologies  

• Good understanding of Energy Trading Business Domain and experience in transformation, orchestration of data in Energy Trading area 

• Proficient in Azure Cloud Technologies: Hands-on experience with a wide range of Azure services including Azure Data Factory (ADF), Azure Databricks (ADB), Azure Active Directory, Azure Storage, Azure Data Lake Services (ADLS), Azure Key Vault, Azure SQL Database, Azure Logic Apps and Azure DevOps 

• Data Engineering Expertise: Implemented several end-to-end data solutions using Azure Databricks Delta Lake for optimized storage, processing, and analytics over Azure Data Lake Storage (ADLS) 

• Azure Data Integration & Orchestration: Extensive experience in using Azure Data Factory (ADF) to orchestrate complex ETL/ELT pipelines, integrating with various data sources and destinations across Azure ecosystem 

• Advanced Knowledge in Data Processing & Analytics: Strong skills in Apache Spark and PySpark, leveraging Databricks for large-scale data processing and transformation 

• Azure Functions & Event-Driven Architectures: Experience developing serverless solutions using Azure Functions for data integration, real-time message consumption, and event-driven architectures  

• Python Programming: Expertise in developing data engineering pipelines, automation scripts, and data transformations using Python.  

• Data Storage Solutions: Hands-on experience with Azure SQL Database, SQL Warehouse, and Blob Storage/ADLS for structured, semi-structured data storage 

• DevOps, GitHub & CI/CD Pipelines: Skilled in Azure DevOps/GitHub for implementing continuous integration and continuous deployment (CI/CD) pipelines and managing source control and project workflows 

Note: This role is a virtual position based in the US 

What we offer 

The base salary range for this position is $124,000 - $186,000 per year.  Individual pay will be based on various factors, such as relevant work experience, education, certifications, skill level, seniority, and internal equity. 

For regular full-time or regular part-time employees of the Company (participating companies as listed in the Summary Plan Description), insurance coverage options include medical, dental, vision coverage, life Insurance, Business Travel Accident Insurance, and Occupational Accidental Death Benefit programs. Employees also participate in a company pension plan and a 401(k) plan. Paid leave includes up to 6 weeks of paid vacation time, up to 11 paid holidays, and parental leave offering 16 weeks of paid leave for birthing parents, and 8 weeks of paid leave for non-birthing parents. 

Additionally, employees are eligible for short-term disability leave for up to 26 weeks at 100% or 50% of base pay as well as Long-Term Disability insurance. Shell also offers other compensation such financial reimbursement for adoption, wellness, education, and personal learning expenses, and some roles are eligible for discretionary long-term incentives.  For interns, eligible benefits include medical, dental, and vision coverage, life insurance, Business Travel Accident Insurance, and Occupational Accidental Death Benefit programs; participation in a 401(k) plan; and paid leave for up to 11 paid holidays.  Additional information on Shell’s US benefit programs can be found at https://www.shell.us/careers/about-careers-at-shell/rewards-and-benefits.html. 

You bring your skills and experience to Shell and in return you work with talented, committed people on one of the most important challenges facing our planet. You’ll have the opportunity to develop the skills you need to grow in an environment where we value honesty, integrity, and respect for one another. You’ll be able to balance your priorities as you become the best version of yourself. 

• Progress as a person as we work on the energy transition together 

• Continuously grow the transferable skills you need to get ahead 

• Work at the forefront of technology, trends, and practices 

• Collaborate with experienced colleagues with unique expertise 

• Achieve your balance in a values-led culture that encourages you to be the best version of yourself 

• Benefit from flexible working hours, and the possibility of remote/mobile working 

• Perform at your best with a competitive starting salary and annual performance related salary increase – our pay and benefits packages are considered to be among the best in the world. 

• Take advantage of paid parental leave, including for non-birthing parents 

• Join an organization working to become one of the most diverse and inclusive in the world. We strongly encourage applicants of all genders, ages, ethnicities, cultures, abilities, sexual orientation, and life experiences to apply 

• Grow as you progress through diverse career opportunities in national and international teams 

• Gain access to a wide range of training and development programs 

We'd like you to know that Shell has a bold goal: to become one of the world’s most diverse and inclusive companies. You can get to know more about how we're working towards that goal, click here.  

Shell in The United States 

Shell has been in the US for more than 100 years, leading the sector in energy, petrochemicals and refined products.  Today, we provide millions of Americans with the energy needed to heat and cool their homes and power the economy.   

We operate in all 50 states, from our Deepwater platforms in the Gulf of America to the Pennsylvania Chemicals complex and our miles of pipelines throughout the US. 

We reach our customers through our 13,000 branded retail stations, and we are number 1 in gasoline sales. We also own the #1 brand of motor oil in the U.S. – Pennzoil® – made from natural gas. 

We are excited to play a key role in the move to net carbon emissions while providing the oil and gas needed by society for many decades to come.