Data Engineer

Requirements 

Data management
• Assesses the integrity of data from multiple sources.
• Provides advice on the transformation of data from one format/medium to another.
• Assist in enabling the availability, integrity and searchability of information through the application of formal data and metadata
structures and protection measures.

Data modelling and design
• Applies standard data modelling and design techniques based upon a detailed understanding of requirements.
• Establishes, modifies and maintains data structures and associated components.
• Communicates the details of data structures and associated components to others using the data structures and associated
components.

Data engineering
• Applies data engineering standards and tools to create and maintain data pipelines and extract, transform and load data.
• Carries out routine data quality checks and remediation.

Essential
The service contractor will be required to have technical depth in modern data engineering and platform integration. The principal
skill areas required are:
1. Data engineering, including Python, Spark, Kafka, ETL/ELT pipelines, and automation
2. Data modelling, ontology engineering, and semantic interoperability
3. Metadata management and data governance
4. Data quality frameworks and validation mechanisms
5. Data platform integration and build/configuration practices
6. Knowledge of federated data environments and, where possible, defence or mission-oriented data-sharing contexts.

The service contractor will be required to have a Bachelor of Science (BSc) degree at a nationally recognised/certified university
in a technical subject with substantial Information Technology (IT) content and 3 years post-related experience. As an exception, the
lack of a university degree may be compensated by the demonstration of a candidate's particular abilities or experience
that are of interest to the NCI Agency; namely, at least 5 years of extensive and progressive experience in the duties related to the
functions of this post.

Desirable
- Prior experience of working in an international environment comprising both military and civilian elements.
- Knowledge of NATO organization, internal structure and resultant relationships.