Senior Data Engineer

We are seeking a Senior Data Engineer to join our data science group at Grey Matters Defense Solutions. The ideal candidate will work closely with data scientists and machine learning engineers to build and maintain scalable, efficient data pipelines, manage metadata storage, and deploy machine learning models. You'll integrate multiple data sources, handle data format conversions, manage tagging tools, and ensure the smooth operation of machine learning workflows, which includes setting up scalable, automated pipelines for data ingestion, preprocessing, and annotation, as well as implementing robust systems for model versioning, deployment, and monitoring.

Primary Responsibilities:

• Data Pipeline Development: Build and maintain data pipelines for the ingestion, conversion, and processing of raw data into formats suitable for machine learning models.
• Metadata and Tagging Management: Implement tagging and annotation tools to enhance data used for model training, ensuring efficient metadata storage and retrieval.
• Database Management: Design and maintain databases for structured/unstructured data, including tags and metadata.
• Preprocessing & Automation: Automate the preprocessing of data (e.g., cleaning, normalization, augmentation) for neural network models.
• MLops Integration: Collaborate with machine learning engineers to implement end-to-end machine learning workflows, integrating data pipelines with model training, deployment, and monitoring processes.
• Model Deployment and Monitoring: Set up and manage infrastructure for deploying machine learning models, including maintaining inference servers and continuous integration pipelines.
• Model Versioning: Implement model version control and management systems to track experiments and ensure smooth transitions between model iterations.

Qualifications:

• Eight (8) years of experience in a Data Engineer role.
• Active TS (Top Secret) clearance.
• Experience with machine learning workflows, including data pipelines and model deployment.
• Familiarity with handling unstructured and structured data for machine learning models.
• Strong understanding of MLops practices, including model versioning, monitoring, and CI/CD for machine learning models.
• Experience in scaling infrastructure to manage large datasets and multiple models in production.

Skills:

• MLops Tools: Experience with tools and platforms like Kubeflow, MLflow, or Seldon, including model tracking, deployment, and monitoring systems.
• Data Engineering Tools: Proficiency in Airflow, Bash, Docker, Docker Compose, GDAL, Git, Linux, make, MongoDB.
• NVIDIA Ecosystem: Expertise in NVIDIA installations (CUDA, cuDNN, Drivers, NVIDIA CONTAINER TOOLKIT).
• Python: Proficiency in Python (Dask, Faker, Jupyter, NumPy, pandas, pydantic, pymongo, pytest).
• Data Conversion and Processing: Experience with data conversion libraries such as Rasterio and RAY.
• Web & API Development: Familiarity with Traefik and hosting tools.
• Database Management: Strong experience with managing metadata and tagging in databases like MongoDB, with scalable storage solutions.

Salary Range: $150,000 - $195,000 + 25% SEP

Grey Matters Defense Solutions offers a comprehensive benefits package including:

• Medical, dental, vision, life insurance, short-term, and long-term disability.
• SEP IRA 25% of base salary.
• PTO: Six weeks.
• IBA: 12.5%.
• Employee assistance program, employee discount, flexible spending account, and health savings account.
• Referral program.

Grey Matters Defense Solutions’ most valuable assets are our employees, consisting of data scientists, custom software developers, and analysts/subject matter experts, with senior-level personnel formerly from DIA, NRO, NSA, and the US Armed Forces. Our team possesses deep analytical knowledge and an understanding of managing and delivering products within government systems. Grey Matters Defense Solutions provides transformational leadership and builds award-winning teams and products.

Join our team of exceptional developers, architects, and data scientists! Visit us at www.greymattersdefense.com or follow us on LinkedIn. If you have any questions, please contact: jenny.rosenberg@greymattersdefense.com

“Know Your Rights: Workplace Discrimination is Illegal”