Description
As a data engineer, your expertise in organizing and analyzing both structured and unstructured data will unlock valuable insights for various impactful projects. This position requires a skilled AWS Data Engineer specializing in streaming data pipelines, helping clients to derive intelligence from their big data while contributing to national security missions, fraud detection efforts, and cancer research initiatives.
You will be integral in designing, developing, and maintaining scalable data pipelines that process large datasets from diverse sources, collaborating effectively with a multidisciplinary team of analysts, developers, and data engineers in an agile environment.
Responsibilities
- Design and develop highly scalable and fault-tolerant streaming data pipelines.
- Collect, transform, and store streaming data from various sources, including databases, sensors, and web applications.
- Build batch data pipelines to complement real-time streaming pipelines.
- Continuously monitor and optimize streaming applications for performance, stability, and security.
- Implement processes for high availability, disaster recovery, and failure recovery.
- Collaborate with cross-functional teams to determine streaming data requirements.
Required Skills & Qualifications
- 2+ years of experience with programming languages such as C++, Java, or Python.
- 2+ years of experience with messaging protocols like RTMP, MQTT, and AMQP.
- Proven experience in building and managing streaming data pipelines and applications.
- Familiarity with batch data pipeline design in conjunction with real-time streaming.
- Competence in performance optimization and security in data streaming.
- Strong collaboration skills in working with engineers, data scientists, and business teams.
- Active TS/SCI clearance.
- High school diploma or GED.
Preferred Qualifications
- 2+ years of experience in Enterprise or Cloud IT.
- Experience with AWS services such as Amazon Aurora, PostgreSQL, RedShift, Lambda, S3, Kinesis, and SQS.
- Familiarity with Infrastructure as Code (IaC) tools like AWS CDK and CloudFormation.
- Experience with CI/CD workflows in AWS environments.
- Understanding of industry standards including ICD 503, NIST 800-53, and FEDRAMP.
- Strong leadership skills and exceptional communication abilities.
- TS/SCI clearance with polygraph.
- AWS Certifications, such as AWS Certified Solutions Architect or AWS Certified Data Analytics.
Clearance Requirement
Applicants must hold an active TS/SCI security clearance to qualify for this position.
Compensation & Benefits
We value your contributions and offer a comprehensive benefits package including health, life, disability, financial, and retirement options. Additional benefits include paid leave and professional development opportunities, along with work-life programs. Compensation is determined by various factors, including location, experience, and education, with an estimated salary range of \(60,400 to \)137,000 per year.
Work Model
Our flexible work model promotes a balance between in-person collaboration and remote work. Depending on the role’s requirements, you may work onsite, remotely, or in a hybrid setting.
Equal Employment Opportunity Commitment
We are dedicated to fostering an inclusive environment where individuals are empowered to drive change, regardless of race, ethnicity, religion, gender identity, disability, veteran status, or any other protected status under applicable law.
Employment Type: Full-Time