Senior Data Engineer

  • Quantiphi
  • USA - Remote
  • 4mo ago
  • Full-Time
  • Remote

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.


If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

About Quantiphi:

Quantiphi is an award-winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed.

Quantiphi has seen 2.5x growth YoY since its inception in 2013, we don’t just innovate - we lead. Headquartered in Boston, with 4,000+ Quantiphi professionals across the globe. As an Elite/Premier Partner for Google Cloud, AWS, NVIDIA, Snowflake, and others, we’ve been recognized with:

  • 17x Google Cloud Partner of the Year awards in the last 8 years.

  • 3x AWS AI/ML award wins.

  • 3x NVIDIA Partner of the Year titles.

  • 2x Snowflake Partner of the Year awards.

  • We have also garnered top analyst recognitions from Gartner, ISG, and Everest Group.

  • We offer first-in-class industry solutions across Healthcare, Financial Services, Consumer Goods, Manufacturing, and more, powered by cutting-edge Generative AI and Agentic AI accelerators.

  • We have been certified as a Great Place to Work for the third year in a row- 2021, 2022, 2023.

Be part of a trailblazing team that’s shaping the future of AI, ML, and cloud innovation. Your next big opportunity starts here!

For more details, visit: Website or LinkedIn Page.

Experience Level: 8+ years of experience  

Work Location: Atlanta, GA (Preferred)/ Anywhere in USA or Canada

About the Role:

As a Senior Data Engineer, you will play a key role in designing, building, and maintaining scalable data pipelines that power analytics, insights, and business decision-making. You will work across both batch and streaming architectures, leveraging PySpark, SQL, and modern data engineering frameworks to deliver reliable, high-performance data solutions.

What Success Look Like:

  • Design, develop, and maintain scalable batch and streaming data pipelines using PySpark, SQL, and modern data engineering frameworks.

  • Perform deep-dive analysis into complex source systems to define extraction patterns, transformation logic, and integration workflows.

  • Implement data models optimized for analytics, performance, and operational excellence.

  • Build and manage data systems across AWS or GCP cloud environments, ensuring reliability, scalability, and cost efficiency.

  • Lead and participate in design reviews, provide mentorship to junior engineers, and take ownership of code quality and engineering best practices.

  • Collaborate with cross-functional teams including architects, analysts, product, and platform engineers to deliver high-quality data solutions.

  • Troubleshoot performance bottlenecks, optimize data processing workflows, and improve pipeline robustness.

Essential Skills/Qualifications:

  • 8+ years of experience in data engineering or a related field.

  • Strong expertise in PySpark, SQL, and data modeling for high-volume datasets.

  • Hands-on experience building and optimizing data pipelines in AWS or GCP environments.

  • Track record of working with complex source systems and developing accurate extraction and transformation logic.

  • Proven experience in mentoring engineers, performing code reviews, and leading technical design discussions.

  • Solid understanding of distributed computing, data partitioning, and performance tuning.

Nice to haves: 

  • Expert-level knowledge of Azure and Databricks architecture, including Lakehouse patterns and the Medallion Framework.

  • Familiarity with Delta Lake, orchestration tools, or Unity Catalog.

  • Experience with CI/CD for data pipelines and automated testing frameworks.

What We Offer:

  • Join a high-growth, AI-first digital engineering and transformation company

  • Work with Fortune 500 clients and cutting-edge market disruptors

  • Collaborate with a talented, dynamic, and driven team

  • Gain exposure to the latest technologies in AI, ML, cloud, and data engineering

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!