Data Integration Engineer
Overview
We are seeking a skilled and experienced Data Integration Engineer with a strong background in SQL development, proficient knowledge of Azure Data Factory, and the ability to set up Azure Synapse and Azure Data Factory objects and processes. The ideal candidate will have expertise in data factory optimization, data transformation, and information governance processes. Experience in documenting systems and solutions is essential for success in this role. This role will work with the Manager of Data & Integrations and will work on the development and execution of an Enterprise Data Strategy. The role will involve a lot of hands-on development.
Responsibilities
- Develop and optimize SQL queries, stored procedures, and scripts to extract, transform, and load (ETL) data from various sources into target systems.
- Design, configure, and deploy Azure Data Factory pipelines, activities, and data flows to orchestrate and automate data movement and transformation processes.
- Set up and maintain Azure Synapse objects, including data warehouses, data lakes, and data integration services, to support efficient data storage and processing.
- Collaborate with data architects and analysts to understand data requirements and translate them into technical specifications and data models.
- Implement data transformation logic, data cleansing techniques, and data enrichment processes to ensure data quality and consistency.
- Optimize data factory pipelines and workflows to enhance performance, scalability, and efficiency of data processing and integration operations.
- Develop and maintain technical documentation, including system designs, data flow diagrams, and process documentation.
- Ensure compliance with information governance policies and best practices, including data privacy, data security, and regulatory requirements.
- Conduct data profiling and analysis to identify data quality issues, anomalies, and opportunities for data improvement.
- Stay updated with emerging trends and technologies in SQL development, Azure Data Factory, and cloud-based data solutions.
Qualifications
- 3 or more years experience in SQL development, including experience in writing complex queries, stored procedures, and scripts
- Solid understanding of data integration principles, data transformation techniques, and ETL methodologies.
- Good working knowledge of Azure Data Factory, including the setup and configuration of pipelines, activities, and data flows.
- Experience in setting up and managing Azure Synapse objects, such as data warehouses and data lakes.
- Familiarity with data factory optimization techniques to improve performance and efficiency of data processing workflows.
- Knowledge of information governance processes, including data privacy, data security, and regulatory compliance.
- Experience in documenting technical solutions, system designs, and data flows.
- Proficiency in data profiling and analysis tools for identifying data quality issues and anomalies.
- Excellent problem-solving and analytical skills, with the ability to troubleshoot and resolve data-related issues.
- Bachelors in Computer Science, Information Technology, or a related field preferred.
- Relevant certifications are a plus.
*This position could be offered at different levels for candidates who qualify with a combination of advanced levels of education and/or years of experience. The salary range will adjust along with the level of the role to match the person’s relevant experience and/or education level.
Inotiv is a growing contemporary drug discovery and development company where we “Play to Win” in an industry rich with opportunity. Together, we face challenges and together we win in the delivery of world-class drug discovery and development solutions that impact the health and well-being of people all over the world. There’s an opportunity for everyone at all phases of a career, each individual’s unique skill set has an impact on the work we conduct. If you have the talent and desire to impact the quality of people’s lives, we have the career opportunities to make it happen. Join us in embracing research and science to impact the health and well-being of people all over the world.
Inotiv has been named a 2023 Top Workplace!
Salary will be commensurate with experience and responsibilities. Benefits include health and dental coverage, short- and long-term disability, paid time off, paid parental leave, 401K participation with company match, and more!
Inotiv is an Equal Opportunity Employer. It is our policy to provide a fair and equal employment opportunity to all persons, regardless of age, race, color, religion, gender, gender identity, sexual orientation, disability, national origin, veteran status, or any other basis prohibited by law. This policy governs all aspects of employment, including selection, job assignment, compensation, discipline, termination and access to benefits and training.
#LI-JM1
#LI-Remote