Jan 17
Secret
Mid Level Career (5+ yrs experience)
$110,000
No Traveling
IT - Data Science
Washington, DC (On-Site/Office)
Are you ready to make a direct impact on the readiness of our military? As an RDIM Data Engineer, you will be at the forefront of developing and optimizing the Readiness Decision Impact Model (RDIM), a crucial tool for analyzing readiness data across the Department of Defense.
You will work with cutting-edge technologies to design, develop, and test software. You will leverage distributed computing platforms and tools, like Databricks and Spark to create and maintain robust data pipelines, perform analyses, and generate visualizations using languages like Python, SQL, PySpark, R, and/or Scala. Your work will be used to empower senior leaders with the insights they need to make strategic decisions that shape national defense priorities.
DUTIES AND RESPONSIBILITIES:
• Develop and enhance the Python-based Readiness Decision Impact Model (RDIM), integrating models across the DoD using the CDAO's Advana platform.
• Manage the technical acquisition of data from across the DoD into a centralized location and perform generalization and parameterization of the data via ELT processes using PySpark/SQL/Python while maintaining exhaustive records of data pedigree.
• Support the development of the Readiness Analytics Visualization Environment (RAVEN), enabling senior leaders to interact with and gain insights from RDIM.
• Ensure compliance with ISO/IEEE 29148-2018 standards by driving system lifecycle processes, including test readiness reviews (TRR) and software deployment.
• Perform advanced data analysis and data mining to enhance the existing RDIM, and also perform ad-hoc analyses at the behest of senior leaders to inform decisions independent of the model.
• Collaborate with the DoD’s Data Science, Data Engineering, and Web Development teams to ensure a streamlined and efficient development environment.
• Maintain sufficient documentation of code, ELTs, workflows, and database architecture
• Provide assistance maintaining GitLab CI/CD servers and processes in AWS GovCloud.
• Work independently and as part of a team, delivering high-quality software solutions on time and within budget.
• Performs other related duties as assigned by management.
SUPERVISORY RESPONSIBILITIES:
• This job has no supervisory responsibilities.
QUALIFICATIONS:
• Bachelor’s degree (B.S.) in information technology, computer science, software engineering, or related field.
• A minimum of 3 years of related experience, or an equivalent combination of education and experience in data engineering and software development.
• Programming Skills: Proficiency with Python, SQL, R, or Scala. Familiarity with Spark/PySpark is a bonus.
• Technical Expertise: General experience with ETL/ELT tools and implementation, cloud platforms. Experience with Database systems, architecture, and optimization. Experience with Databricks, Hive, Spark, Cloud (AWS) would be a bonus.
• Software Methodologies: Understanding of Agile/Scrum development processes.
• Source Control: Proficiency in Git for source control management.
• Detail-Oriented: Acute attention to detail and strong problem-solving skills.
• Work Arrangement: Mainly onsite with some hybrid capability.
• Clearance: Active Secret clearance required, Top Secret preferred.
You will work with cutting-edge technologies to design, develop, and test software. You will leverage distributed computing platforms and tools, like Databricks and Spark to create and maintain robust data pipelines, perform analyses, and generate visualizations using languages like Python, SQL, PySpark, R, and/or Scala. Your work will be used to empower senior leaders with the insights they need to make strategic decisions that shape national defense priorities.
DUTIES AND RESPONSIBILITIES:
• Develop and enhance the Python-based Readiness Decision Impact Model (RDIM), integrating models across the DoD using the CDAO's Advana platform.
• Manage the technical acquisition of data from across the DoD into a centralized location and perform generalization and parameterization of the data via ELT processes using PySpark/SQL/Python while maintaining exhaustive records of data pedigree.
• Support the development of the Readiness Analytics Visualization Environment (RAVEN), enabling senior leaders to interact with and gain insights from RDIM.
• Ensure compliance with ISO/IEEE 29148-2018 standards by driving system lifecycle processes, including test readiness reviews (TRR) and software deployment.
• Perform advanced data analysis and data mining to enhance the existing RDIM, and also perform ad-hoc analyses at the behest of senior leaders to inform decisions independent of the model.
• Collaborate with the DoD’s Data Science, Data Engineering, and Web Development teams to ensure a streamlined and efficient development environment.
• Maintain sufficient documentation of code, ELTs, workflows, and database architecture
• Provide assistance maintaining GitLab CI/CD servers and processes in AWS GovCloud.
• Work independently and as part of a team, delivering high-quality software solutions on time and within budget.
• Performs other related duties as assigned by management.
SUPERVISORY RESPONSIBILITIES:
• This job has no supervisory responsibilities.
QUALIFICATIONS:
• Bachelor’s degree (B.S.) in information technology, computer science, software engineering, or related field.
• A minimum of 3 years of related experience, or an equivalent combination of education and experience in data engineering and software development.
• Programming Skills: Proficiency with Python, SQL, R, or Scala. Familiarity with Spark/PySpark is a bonus.
• Technical Expertise: General experience with ETL/ELT tools and implementation, cloud platforms. Experience with Database systems, architecture, and optimization. Experience with Databricks, Hive, Spark, Cloud (AWS) would be a bonus.
• Software Methodologies: Understanding of Agile/Scrum development processes.
• Source Control: Proficiency in Git for source control management.
• Detail-Oriented: Acute attention to detail and strong problem-solving skills.
• Work Arrangement: Mainly onsite with some hybrid capability.
• Clearance: Active Secret clearance required, Top Secret preferred.
group id: 91086992
