Job Description:

We are looking for an Associate Director, Data Engineer to join our Research & Competitive team. You may be based anywhere in continental United States or near one of our office locations including New York City, NY, Chicago, IL, and Detroit, MI. You will be enabling the collection, organization, and accessibility of Competitive Intelligence data to help the team deliver key insights, and trends, in shorter periods of time through automation.

This role will require someone with the ability to set up the pipelines and structure data in an easy-to-use format. Translating requirements from multiple stakeholders and reports into actionable data performance.

Key Accountabilities

• You will lead comprehensive data engineering initiatives to architect robust solutions aligned with client objectives.

• You'll apply OCR to static images (JPG, PNG, GIF) and video frames (MP4) via software, e.g. Azure AI Video Indexer, as well as Python libraries to extract, index, and tag metadata for integration into warehouses.

• You'll architect advanced ETL workflows in SQL Server Integration Services (SSIS) and/or Azure Data Factory, including incremental loads, slowly changing dimensions, and CDC (Change Data Capture).

• You will normalize disparate data sources by enforcing conformed dimensions, applying surrogate key management, and establishing star/snowflake schemas for downstream analytics.

• You'll integrate structured and unstructured datasets ensuring proper indexing, partitioning, and query optimization for workloads.

• You'll implement data quality monitoring using stored procedures, validation rules, and alerting pipelines to ensure referential integrity and schema compliance.

• Govern data assets, e.g. implementing Microsoft Purview, defining lineage, metadata cataloguing, retention schedules, and Role-Based Access Control aligned to compliance standards as applicable.

• You'll document data architectures with ER diagrams, schema definitions, and transformation logic to enable reproducibility and long-term governance.

• You'll conduct advanced web scraping to augment proprietary datasets with external intelligence.

• Familiarity with media reporting tools like Nielsen's Ad Intel, Sensor Tower's Pathmatics, Vivvix / MediaRadar, a plus.

Person Specification

• 8+ years of experience in data engineering, BI, or related domains

• Advanced academic qualification in Computer Science (B.S., M.Sc., or Ph.D.) or equivalent experience

• Extensive hands-on expertise with SSIS and Azure Data Factory, architecting ETL workflows with incremental loads, SCDs, and CDC pipelines

• Strong ability to design and enforce schema architectures, including star/snowflake models, surrogate keys, and conformed dimensions

• Demonstrated success in optimizing Synapse/SQL Server workloads through indexing, partitioning, and performance tuning

• Applied fluency in OCR technologies across static image and video media using Azure AI Video Indexer and/or open-source Python libraries

• Understanding of governance frameworks, including Microsoft Purview deployment for lineage, RBAC, metadata cataloguing, and retention compliance

• Experience with enforcing enterprise-grade data quality via SQL procedures, validation scripts, and automated pipeline alerts

• Capable of applying advanced web scraping techniques to expand datasets with market and competitive intelligence. For example, familiarity with web scraping & crawling using Python libraries like Beautiful Soup or Scrapy.

• Expert use of RESTful APIs to pull structured data from industry partners, news feeds, and public data sources.

This will be a remote position reporting to the SVP of Strategy & Insight.

Additional information

The annual salary range for this position is $94,000 - $152,375. Placement within the salary range is based on a variety of factors, including relevant experience, knowledge, skills, and other factors permitted by law. Additionally, this position is eligible for discretionary incentive compensation.

Benefits available with this position include:

• Medical, vision, and dental insurance,

• Life insurance,

• Short-term and long-term disability insurance,

• 401k,

• Flexible paid time off,

• At least 15 paid holidays per year,

• Paid sick and safe leave, and

• Paid parental leave.

Dentsu also complies with applicable state and local laws regarding employee leave benefits, including, but not limited to providing time off pursuant to the Colorado Healthy Families and Workplaces Act, in accordance with its plans and policies. For further details regarding Dentsu benefits, please visit www.dentsubenefitsplus.com.

#LI-JH2 #remote #LI-remote

Location:

New York

Brand:

Carat

Time Type:

Full time

Contract Type:

Permanent