Job Overview
We are seeking a highly skilled Senior Data Engineer to join our dedicated team in supporting the National Media Exploitation Center (NMEC). This remote opportunity presents a unique chance to engage in impactful projects while fostering your professional development in a dynamic work environment.
Key Responsibilities
- Design, implement, maintain, and monitor sophisticated data pipelines that bolster R&D prototypes and production workflows.
- Oversee the management of various database systems, including MariaDB/MySQL, PostgreSQL, Elasticsearch, Qdrant, and Milvus.
- Uphold data integrity by adhering to established data engineering best practices.
- Document processes comprehensively, producing data dictionaries and system diagrams.
- Collaborate effectively with infrastructure and network engineers, data scientists, and system engineers to solve complex technical challenges and devise innovative solutions.
Required Skills
- Profound expertise in SQL, NoSQL, and vector databases such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, and Milvus.
- Experience with ETL/ELT pipelines and technologies, including Spark, Airflow, and Dagster.
- Strong abilities in database design, maintenance, performance tuning, and optimization.
- Proficient in data profiling and quality assessment techniques.
- Development experience in Python.
- Excellent verbal and written communication skills, with the ability to operate both independently and as part of a team.
Qualifications
- A Bachelor's Degree with over 12 years of pertinent experience, or a Master's Degree with at least 10 years of relevant experience.
- An active TS security clearance, with the capacity to obtain and sustain a TS/SCI clearance with Polygraph.
Career Growth Opportunities
This position allows for significant professional advancement through participation in innovative projects that support both research and production activities, thereby enhancing your technical acumen and marketability in the field.
Company Culture And Values
We pride ourselves on fostering a collaborative and supportive work environment that encourages innovation and teamwork, making it an ideal place for professionals to thrive.
Compensation And Benefits
- Salary range: \(101,400.00 - \)183,300.00, commensurate with experience, education, and job responsibilities.
- Flexible scheduling options to promote a healthy work-life balance.
Ready to elevate your career? Join our esteemed team and contribute to transformative work in a nurturing and forward-thinking atmosphere.
Employment Type: Full-Time