Overview

Summary

At Karsun we defy assumptions and enable transformation as IT modernization experts. Our people and client-first focus, innovation and performance driven culture empowers and encourages our employees with the autonomy to innovate, and be accountable to take ownership and seek advancement opportunities for personal growth.

Then we have a Data Engineer performance challenge for you. You will be responsible for developing data pipelines, automation of the data lifecycle, developing prototypes and proofs of concepts, and advancing a data program with modern approaches and technologies.

Responsibilities

What You'll Do:

• Develop strategies for one-time, incremental and continuous data ingestion processes from a variety of sources, including EDMS systems, databases, web and file repositories.
• Develop data pipelines as required using StreamSets/Pentaho Data Integration, AWS services or other products including COTS and open source to deliver to requirements
• Provide development of scripting for the data platform including python and shell scripting
• Provide exceptionally strong skills on version management and using repositories such as git for ETL, SQL and other scripting versioning and deployment management
• Conduct maintenance of ETL code, data quality, reliability and performance including but not limited to process monitoring, data validation and data refresh
• Provide support to data analysts, project managers and product owners with planned and ad hoc data requests, access and extracts of data content from a variety of database systems including PostgreSQL, Oracle, Sybase and Domino.
• Continuously improve automation, processes and service reliability, availability and performance across the cloud data and application platform.

Qualifications and Education

Required Qualifications:

• Requires a Bachelors Degree in Engineering, Math, or Science and a minimum of 15 years of relevant experience
• 4+ years of experience in data pipelines design and development with tools and services such as Pentaho PDO, Python, AWS Glue, Informatica or equivalent ETL tools
• Ability to create and orchestrate complex and efficient data pipelines across relational, NoSQL and otherdata sources including data APIs
• 2 yrs of experience in Python
• Experienced with python libraries for web scraping such as beautiful soup and scrapy
• Excellent troubleshooting and performance optimization skills for ETL platform administration, integration and performance monitoring
• Code maintenance, version control and documentation
• Ability to successfully obtain and maintain a U.S. Suitability/Public Trust Background Clearance

Compensation

The proposed salary range for this role is $****** to $******* USD. The salary range provided is a good faith estimate representative of all experience levels. Karsun considers several factors when extending an offer, including but not limited to, the role, function and associated responsibilities, a candidate’s work experience, location, education/training, and key skills.