BI Data Engineer

The BI Data Integration Engineer will ensure data integrity and process consistency while maintaining efficient data integration solutions for business intelligence (BI) systems. This role will be responsible for the analysis, design, documentation, unit testing, and support of data integration and database objects development. As a member of our team, you will be tasked with creating and maintaining optimal on premise and cloud-based data pipeline architectures capable of ingesting structured and unstructured data using both batch and streaming methods in a secure, scalable, and efficient manner. The right person for this role will be comfortable with regular and collaborative interaction with business users.

Day to Day:

The position is accountable for the following:
– Gather and analyze business and technical requirements for data integration solutions.
– Design, develop, and implement efficient and scalable data integration solutions using a variety of tools and technologies, including SSIS and Azure Data Factory.
– Ensure a high degree of data quality from end to end across integrations.
– Maintain and support existing ETL processes.
– Create and maintain documentation on integration processes, execution procedures, data profiling results, data dictionaries, business glossaries, and data analysis findings.
– Work with 3rd party data providers and APIs to pull data into Microsoft SQL Server.
– Write, test, and troubleshoot complex SQL queries, stored procedures, and ETL processes.
– Manage assigned projects to ensure they are delivered successfully and in a timely manner.
– Participate in method development, process improvement, and standardization.
– Continuously develop professional skills to use the most effective approaches/methods/technologies.

Required Skills & Experience
– 3-5 years SSIS experience – Working with APIs unstructured data. Data Integration technologies and principles with strong knowledge of SSIS package development, deployment, and troubleshooting
– Strong SQL development skills.
– 3+ years Microsoft T-SQL and Microsoft databases technologies (strong knowledge of stored procedures, ETL’s, complex queries & joins, and user-defined functions)

* Microsoft centric – 90% of time spent in T-SQL – advanced queries, stored procedures, create work statements
– Experience with Master Data Management (MDM) solutions – building CI/CD pipelines
– Working knowledge of cloud-based data pipeline development.

* Experience or certification with Azure, specifically SQL DB, SQL DW, or Azure fundamentals
– Hands on experience using databases like SQL Server, Oracle, IBMi and DB2.
– Experience with REST and other web API data transmission technologies.
– Experience building and optimizing data pipelines for acquisition and management of data including data security, metadata capture, data cataloging, classification and data profiling and data quality.
– Bridge gap between technical and non-technical teams
– High interpersonal, communication, analytical, presentation skills, with a high business maturity.
– Strong organizational skills and the ability to meet deadlines/work independently.

Job Category
Data and Analytics
Job Type
unspecified
Salary
USD 82,000.00 - 123,000.00 per year
Country
United States
City
Clearwater
Career Level
unspecified
Company
Insight Global
JOB SOURCE
https://jobs.insightglobal.com/jobs/find_a_job/florida/clearwater/bi-data-engineer/job-314029/