Data Integration / Analytics Engineer (PROJ-4591)
Job Description
The role supports the delivery of fit-for-purpose data analytics capabilities using contemporary tools and automated data engineering techniques across enterprise platforms.
The Data Integration / Analytics Engineer ensures development activities align with established engineering standards and that deployment risks are effectively managed. The role focuses on managing, transforming and operationalising data to meet defined analytics needs. Key duties include developing and maintaining data transformations that map domain-specific datasets to the enterprise ontology using Palantir platforms such as Gotham and Foundry. (RFI 42-2526)
Role Description
Key Responsibilities
- Manages the iteration, review and maintenance of data requirements and data models
- Sets standards for data modelling and design tools and techniques, advises on their application and ensures compliance
- Provides expert guidance in the selection, provision and use of database and data warehouse architectures, software and facilities
- Manages the investigation of enterprise data requirements based upon a detailed understanding of analytic use cases
- Coordinates the application of analysis, design and modelling techniques to establish, modify or maintain data structures and their associated components
- Provides expert advice and guidance to enable the organisation to get maximum value from its data assets
- Creates and maintains data pipelines to connect data within and between data stores, applications and organisations
- Works collaboratively with teams of technology specialists, security professionals and systems administrators, within the organisation and with external partners
Core capabilities
- A deep understanding of systems integration and architecture including integration patterns, middleware and platforms
- Proficiency in a number of programming and scripting languages including SQL, Python and Java
- Analytical and problem-solving skills including the ability to apply logical reasoning to overcome integration challenges
- Effective data management and workflow design abilities including the understanding of data structures, databases and ETL processes
- Strong communication and collaboration skill including a proven ability to work effectively as a member of cross-functional teams.
Mandatory Qualifications
- 5+ years of relevant data integration / analytics engineering experience
Desirable Qualifications
- IT-related degree (e.g. Bachelor of Computer Science or Bachelor of IT)
Required Knowledge/Experience and tools Required
- Proven experience in using enterprise data pipeline platforms such as MS-SSiS, Informatica, Apache Kafka and NiFi to manage corporate data assets
- Proven experience using enterprise data platforms such as Oracle, MS SQL Server, Apache Spark and ElasticSearch to support analytic use cases
- Experience In one or more of the below technologies/languages: Python, Swing or React
- Experience troubleshooting IT systems and using logging tools such as Elastic Stack (ELK).
Highly Desirable
- Experience with continuous integration and delivery pipeline toolsets including GitLab, Artifactory, Jenkins, Docker, Ansible or similar applications
- Experience using and maintaining Jira tickets and boards
- Experience providing advice and support to analytic end-users
- Experience with Palantir products such as Gotham or Foundry