Senior Data Flow Engineer (PROJ-4549)
Job Description
Remote is seeking a Data Flow Manager/ Data Flow Engineer to join the team in Home Affairs. The Data Flow Manager/ Data Flow Engineer will be responsible for building and managing secure transfers of data between different networks along with providing monitoring and alerting services. This includes the development and sustainment of data flows using a variety of technologies. They will also manage capability and processes, using appropriate tools and techniques that conform to agreed process standards and industryspecific regulations. Working in a diverse team environment, this will involve sharing outcomes and experience with others to support development and growth.
This role sits within the Data Flows team who provide architecture, management and support of data flows. The team acts as a digital post office through automated routing of data to and/or from systems including the collection of data feeds from external sources to be ingested and distributed to systems. (RFI 38-2526)
Role Description
Key Responsibilities:
- Engineer, implement, test, debug, and monitor data flows to ensure the continuous distribution of data from sources to destinations in a secure, efficient and timely manner
- Troubleshoot and minimise any data flow downtimes
- Architecture, management and support of secure gateways and data flows
- Automated routing of data to and/or from systems including the collection of data feeds from external sources to be ingested and distributed to systems
- Developing relevant technical documentation
- Working with business stakeholders, project managers, system architects, software developers and date engineers.
Desirable Qualifications:
- Tertiary qualifications in a technology field.
Required Knowledge/Experience and tools
- 3+ years of relevant data flow or System Administrator experience
- Programming experience (e.g. Python and SQL)
- Experienced in a range of monitoring and alerting platforms
- Adept at troubleshooting and resolving system issues to minimise downtime
- Knowledgeable about automated deployments
- Knowledgeable in designing and building integrations to facilitate interactions between systems, via APl'sand Object Stores
- Ability to integrate with domain services such as Active Directory, Certificate Servers and security products
- Technical expertise in configuration of system components and equipment for systems testing
- Ability to design, perform and report results of tests for integration builds
- Experienced at identifying and documenting data flow and system integration components for recording in configuration management systems
- Demonstrated ability to develop technical documentation and track work in collaboration tools such as Confluence and JIRA
Highly Desirable:
- Linux-based system administration skills.
- Skills in building and operating a continuous integration (Cl) capability when required for employing version control of source code and related artefacts.
- History of contributing to the selection of the configuration methods, tools and techniques.
- Knowledge of Cyber Security