Today
Secret
IT - Data Science
Scott Air Force Base, IL (On-Site/Office)
We are seeking a passionate and experienced Solutions Architect with a strong data science foundation to design, build, and maintain our data processing and machine learning solutions on the AWS Databricks platform. You will be instrumental in establishing a robust and scalable architecture, implementing best practices, and ensuring our solutions are secure, optimized, and integrate seamlessly with data science workflows.
Responsibilities:
Architecture & Implementation:
Design and implement a robust and scalable data processing and machine learning pipeline on AWS Databricks using Python and relevant AWS services.
Leverage knowledge of Medallion data structures and best practices for data management within the Databricks environment.
Integrate data science models and algorithms developed by the team, ensuring smooth transition from development to production.
Development Environment & Best Practices:
Set up and maintain a secure and efficient development environment on Databricks, including CI/CD pipelines, Git, and code quality tools.
Implement and champion industry best practices for coding standards, documentation, and testing within the Databricks ecosystem.
Machine Learning & Data Science Integration:
Collaborate closely with data scientists to understand modeling requirements and optimize the Databricks environment for their workflows.
Design and implement solutions leveraging MLflow, Spark MLlib, and other relevant frameworks to deploy and manage machine learning models.
Performance, Security, & Collaboration:
Continuously monitor and optimize the performance and cost-efficiency of Databricks clusters and jobs.
Implement robust security measures to protect sensitive data within Databricks and ensure compliance with relevant regulations.
Work closely with data scientists, engineers, and stakeholders to ensure seamless integration of data pipelines and machine learning solutions.
Qualifications:
Experience & Technical Skills:
Proven experience as a Solutions Architect or similar role with a strong understanding of cloud computing, big data principles, and data science workflows.
Extensive experience with AWS Databricks, including cluster management, notebook development, job scheduling, and integration with other AWS services (e.g., S3, Glue).
Proficiency in Python and experience with relevant data science libraries (e.g., Pandas, NumPy, Scikit-learn) and Databricks-specific tools (e.g., Delta Tables, MLflow).
Solid understanding of Machine Learning concepts and experience deploying models in production environments.
Data & Security:
Hands-on experience with Medallion data structures and best practices for data management.
Experience with data transformation and analysis techniques, including working with large datasets and potentially EDI data structures.
Strong understanding of security best practices in cloud environments, particularly within the Databricks platform.
Collaboration & Communication:
Excellent communication and collaboration skills, with the ability to bridge the gap between technical and non-technical stakeholders.
Experience working in a team environment and collaborating effectively with data scientists, engineers, and business users.
Bonus Points:
Experience with logistics or supply chain data.
Familiarity with EDI data structures and standards.
Experience with infrastructure automation tools (e.g., Terraform) and their integration with Databricks.
Contributions to open-source projects or participation in relevant communities.
Clearance: Ability to obtain a Secret clearance required. Active Secret clearance preferred.
Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following:
Medical, dental & vision
Critical Illness, Accident, and Hospital
401(k) Retirement Plan – Pre-tax and Roth post-tax contributions available
Life Insurance (Voluntary Life & AD&D for the employee and dependents)
Short and long-term disability
Health Spending Account (HSA)
Transportation benefits
Employee Assistance Program
Time Off/Leave (PTO, Vacation or Sick Leave)
This position requires an active DoD Clearance (Secret, Top Secret, Top Secret/SCI) or the ability to be obtain an (Interim Secret, Interim Top Secret)
Because an active or interim DoD clearance is required, U.S. Citizenship is required.
Responsibilities:
Architecture & Implementation:
Design and implement a robust and scalable data processing and machine learning pipeline on AWS Databricks using Python and relevant AWS services.
Leverage knowledge of Medallion data structures and best practices for data management within the Databricks environment.
Integrate data science models and algorithms developed by the team, ensuring smooth transition from development to production.
Development Environment & Best Practices:
Set up and maintain a secure and efficient development environment on Databricks, including CI/CD pipelines, Git, and code quality tools.
Implement and champion industry best practices for coding standards, documentation, and testing within the Databricks ecosystem.
Machine Learning & Data Science Integration:
Collaborate closely with data scientists to understand modeling requirements and optimize the Databricks environment for their workflows.
Design and implement solutions leveraging MLflow, Spark MLlib, and other relevant frameworks to deploy and manage machine learning models.
Performance, Security, & Collaboration:
Continuously monitor and optimize the performance and cost-efficiency of Databricks clusters and jobs.
Implement robust security measures to protect sensitive data within Databricks and ensure compliance with relevant regulations.
Work closely with data scientists, engineers, and stakeholders to ensure seamless integration of data pipelines and machine learning solutions.
Qualifications:
Experience & Technical Skills:
Proven experience as a Solutions Architect or similar role with a strong understanding of cloud computing, big data principles, and data science workflows.
Extensive experience with AWS Databricks, including cluster management, notebook development, job scheduling, and integration with other AWS services (e.g., S3, Glue).
Proficiency in Python and experience with relevant data science libraries (e.g., Pandas, NumPy, Scikit-learn) and Databricks-specific tools (e.g., Delta Tables, MLflow).
Solid understanding of Machine Learning concepts and experience deploying models in production environments.
Data & Security:
Hands-on experience with Medallion data structures and best practices for data management.
Experience with data transformation and analysis techniques, including working with large datasets and potentially EDI data structures.
Strong understanding of security best practices in cloud environments, particularly within the Databricks platform.
Collaboration & Communication:
Excellent communication and collaboration skills, with the ability to bridge the gap between technical and non-technical stakeholders.
Experience working in a team environment and collaborating effectively with data scientists, engineers, and business users.
Bonus Points:
Experience with logistics or supply chain data.
Familiarity with EDI data structures and standards.
Experience with infrastructure automation tools (e.g., Terraform) and their integration with Databricks.
Contributions to open-source projects or participation in relevant communities.
Clearance: Ability to obtain a Secret clearance required. Active Secret clearance preferred.
Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following:
Medical, dental & vision
Critical Illness, Accident, and Hospital
401(k) Retirement Plan – Pre-tax and Roth post-tax contributions available
Life Insurance (Voluntary Life & AD&D for the employee and dependents)
Short and long-term disability
Health Spending Account (HSA)
Transportation benefits
Employee Assistance Program
Time Off/Leave (PTO, Vacation or Sick Leave)
This position requires an active DoD Clearance (Secret, Top Secret, Top Secret/SCI) or the ability to be obtain an (Interim Secret, Interim Top Secret)
Because an active or interim DoD clearance is required, U.S. Citizenship is required.
group id: 10105424
Accelerating IT transformation in the public sector
