Data Engineer

Credence Management Solutions

Today
Secret
Unspecified
Unspecified
IT - Database
McLean, VA (On-Site/Office)

Responsibilities include, but are not limited to the duties listed below

  • Assist in designing, developing, and maintaining data pipelines, ensuring smooth data flow from diverse sources into our data warehouse and data lakes to support end-to-end solutions including AI/ML.
  • Collaborate with architects, data scientists and senior and junior software engineers to implement efficient and scalable data processing solutions.
  • Exploration and assessment of technical solutions through analysis, prototypes, and pilots.
  • Perform data cleansing, transformation, and aggregation to ensure data integrity and accuracy.
  • Help optimize and tune data pipelines for performance and reliability.
  • Assist in monitoring and troubleshooting data-related issues to ensure smooth operations.
  • Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions.
  • Research and stay up-to-date with emerging data engineering technologies and best practices to contribute innovative ideas and improvements.
  • Required to document data engineering processes, procedures, and standards per projects needs and as a best practice for future references.


Education, Requirements and Qualifications

  • Must be a US Citizen with Active or ability to obtain DoD secret clearance, top-secret clearance as required.
  • Required CompTIA Security + certification and AWS Cloud Practitioner certification.
  • Bachelor's degree in computer science, information systems, statistics, or a related critical thinking field. Equivalent practical experience will also be considered.
  • Strong understanding of data engineering concepts and principles (ingestion, standardization, transformation)
  • Demonstrated Proficiency in programming languages such as Python, Java, or Scala
  • Experience with EKS, ECS, Kafka, Data Firehose, Kinesis, Airflow, AWS Glue, Kendra, Step Functions, Elasticsearch or OpenSearch integration, S3, Lambda, Amazon Redshift, Dynamo DB, RDS, AWS Lake Formation, AWS Sagemaker, Bedrock, Event Bridge, Athena, CloudTrail, CloudWatch, Databricks
  • Proficiency with No SQL, relational databases Such as SQL Server, Oracle, Open Source DBs like PostgreSQL, Vector DB, Graph DB, Dynamo DB, Graph QL, Data Retention, Performance Tuning etc.
  • Experience with Data Modeling, Data Orchestration, ELT/ETL tools and familiarity with concepts such as Medallion Architecture, Data Mesh, data lakehouse etc.,
  • Experience with DevSecOps, Monitoring, Error Logging, Tracing/Analysis, Alerts Management
  • Knowledge of infrastructure as Code (IaC), DevOps scripting languages (Gitlab CI/CD), Terraform, AWS CDK, AWS CloudFormation, AWS Code Deploy.
  • Proficiency with Analytics tools like Tableau, Power BI
  • Experienced with Data Security, Data Encryption, Data Masking, Data Privacy Rules
  • Experience with Federal Data Compliance Regulations
  • Proficiency in distributed computing and big data technologies such as EMR, Apache Hadoop, Spark
  • Knowledge of other cloud-based data storage and processing platforms like Azure, or Google Cloud is a plus.
  • Excellent problem-solving and analytical skills.
  • Excellent communication skills and combined with strong team player abilities.
  • Attention to detail and commitment to delivering high-quality work.
  • Ability to work in a fast-paced environment and handle multiple tasks simultaneously.

Nice to have.
  • AWS Certified Data Engineer
  • Databricks Certified Data Engineer


Working Conditions and Physical Requirements

AWOnsite in - Vienna Va

#LI-Onsite
group id: 10526121
Find Credence Management Solutions on Social Media
Network Employers (6)
C
Senior Technical Recruiter
N
Recruiter
W
Recruiter
R
Recruiter
D
Recruiter
About Us
Mission. Powered by Technology. Credence is one of the largest and fastest growing privately-held government technology and services companies and is repeatedly acclaimed as a Washington Post Top Workplace. As evidenced by our awards and certifications, we have the capability and maturity, as well as the agility and responsiveness, to tackle our customers’ most challenging mission needs. Our teams solve agency-wide IT challenges, including DevSecOps and AI solutions; protect our nation’s critical systems from cyber attacks; engineer innovative warfighting systems; train fighter pilots; and support global health and humanitarian assistance programs that save lives and alleviate suffering. Our technology solutions drive innovation, efficiencies, and savings to benefit the mission in tangible ways. For each project, our goal is to exceed customer expectations, and for each employee, to foster excellence and promote wellbeing—ideals best exemplified by our corporate philosophy:

Credence Management Solutions Jobs


Job Category
IT - Database
Clearance Level
Secret