Senior Data Engineer

Duties

• Devises and implements master data management processes for specific subsets of data.
• Assesses the integrity of data from multiple sources.
• Provides advice on the transformation of data from one format/medium to another.
• Maintains and implements information handling procedures.
• Enables the availability, integrity and searchability of information through the application of formal data and metadata structures and protection measures.
• Applies standard data modelling and design techniques based upon a detailed understanding of requirements.
• Establishes, modifies and maintains data structures and associated components.
• Communicates the details of data structures and associated components to others using the data structures and associated components.
• Applies data engineering standards and tools to create and maintain data pipelines and extract, transform and load data.
• Carries out routine data quality checks and remediation.

Requirement

• The service contractor will be required to have strong technical depth in modern data engineering and platform integration.
• The principal skill areas required are: 1. Data engineering, including Python, Spark, Kafka, ETL/ELT pipelines, and automation
• The principal skill areas required are: 2. Data modelling, ontology engineering, and semantic interoperability
• The principal skill areas required are: 3. Metadata management and data governance
• The principal skill areas required are: 4. Data quality frameworks and validation mechanisms
• The principal skill areas required are: 5. Data platform integration and build/configuration practices
• The principal skill areas required are: 6. Knowledge of federated data environments and, where possible, defence or mission-oriented data-sharing contexts.
• The service contractor will be required to have a Bachelor of Science (BSc) degree at a nationally recognised/certified university in a technical subject with substantial Information Technology (IT) content and 3 years post-related experience.
• As an exception, the lack of a university degree may be compensated by the demonstration of a candidate's particular abilities or experience that are of interest to the NCI Agency; namely, at least 5 years of extensive and progressive experience in the duties related to the functions of this post.

Preferences

• Prior experience of working in an international environment comprising both military and civilian elements.
• Knowledge of NATO organization, internal structure and resultant relationships.