Today
Top Secret/SCI
Unspecified
Unspecified
IT - Software
Maclean, VA (On-Site/Office)
Responsibilities and Duties
- Support data engineering, exploitation, and management processes.
- Provide engineering support for data triage and assessment as directed by the Sponsor.
- Provide direct support to data ingestion in support of requirements.
- Document CONOPS, data workflows, and processes pertaining to data engineering projects as required by the Sponsor.
- Identify new technologies and assess their technical and performance characteristics.
- Identify and provide agile approaches to the automation of manual and inefficient processes.
- Provide insight into industry trends and make recommendations on future direction for the program.
- Demonstrated experience with large scale Elasticsearch 7.x cluster implementation, index design, and data ingest.
- Demonstrated experience performing the various aspects of identity resolution at large scale, to include ingest of data, mapping of data, and integration of identity resolution capabilities into data engineer and systems workflows.
- Demonstrated experience with distributed data pipeline/ ETL technologies, including designing data flows and adapting the distributed ETL technology to accommodate new data types.
- Demonstrated experience working with technologies in Hadoop ecosystems and integration of Hadoop capabilities into overall ETL flow of data.
- Demonstrated, Sponsor-specific experience working with Apache Tika to extract metadata and text from various document types.
- Demonstrated, Sponsor-specific experience as a Data Layer Architect focused on fusion of hybrid data sources into a common model to meet Sponsor needs.
- Master's Degree or equivalent work experience in Computer Science.
Certifications:
AWS solution developer or AWS solution architect.
group id: 10290999
