As the Senior Data Integration Engineer at TRANZACT, you will play a critical role in driving a digital transformation initiative to seamlessly migrate our RDBMS-based Enterprise Data Warehouse and custom Enterprise integration platform to an innovative Next-Gen Data + AI ecosystem, anchored in the Databricks Platform and DataMesh Architecture. We are seeking a hands-on Data Integration Engineer who has deep technical expertise in Apache Airflow, Azure Data Factory and Databricks and understands how build and scale a performant data platform and enjoys enabling other team members to do the same.

Responsibilities:

• Lead the design and implementation of the data & analytics architecture ensuring compliance, quality and a sustainable growth of the platform.

• Build scalable data pipelines to integrate and model datasets from different sources that meet functional and non-functional requirements.

• Provide the technology, the tools and data to support data scientists and analysts.

• Manage the technical backlog on the Data & Analytics Platform.

• Ensure the data quality by implementing and monitoring a data quality framework together with the data source teams.

• Work with data infrastructure to triage infrastructure issues and drive to resolution.

• Collaborate with cross-functional stakeholders to understand their business needs.

• Formulate and complete end-to-end analysis that includes data gathering, analysis, ongoing scaled deliverables.

• Foster a data driven culture throughout the team and to participate in data science projects that will have impact throughout the organization.

Qualifications:

• BS degree Computer Science or related field

• 5+ years relevant experience as Data Engineer, building Data Platforms, Datalakes and Business Intelligence solutions. Experience on Databricks preferred.

• Proficient implementing data pipelines (using i.e. Pyspark, Spark SQL), orchestration tools/services (i.e. Apache Airflow, data factory) and testing frameworks.

• Experience in one of the main cloud services (AWS or Azure) with Big Data services (Databricks, Kinesis, etc.). Experience in leveraging AWS API Gateway, AWS Lambda and AWS AppSync strongly preferred.

• Experience in databases (columnar, nosql and relational databases: Dynamodb, Aurora, Postgres), data modeling and data management tools (Databricks).

• Experience with reporting systems and visualization tools like PowerBI

• Experience working in Agile methodologies

Bonus Qualifications:

• Experience with DevOps, DataOps and MLOps.

• Experience in Data Science and Machine Learninge

• Knowledge on Data Mesh Architectures

• Knowledge of the Insurance Industry.

**At TRANZACT we promote inclusion and job insertion without distinction based on disability, gender, orientation, gender identity and expression, place of origin or any other reason protected by national legislation. The company respects diversity and does not tolerate acts of discrimination in its processes.

As a company, we believe in equal opportunities and inclusion. Consequently, this job opening is applicable to people with disabilities (in accordance with what is stated in Law No. 29973).