AI Machine Learning Engineer

About the job

This role is a collaborative partnership with Data Scientists and Data Engineers from the various Commercial Lines Data Science teams. It focuses on ensuring the health and reliability of Production deployed machine learning and AI models by monitoring data drift, data quality, and model performance. This is accomplished by managing incidents through ServiceNow as well as providing consultative feedback to model owners on observed performance issues. The ideal candidate for this role would have: • Strong experience in Data Science and MLOps tech stack. • Extensive experience in building predictive ML and NLP solutions. • Expertise in designing and building Model Monitoring/Observability Frameworks and supporting solutions for interpretation and visualization. • Strong foundations in the Cloud Platform stack for building and hosting solutions. • Solid knowledge of CI/CD tech stack. • Experience in building scalable monitoring solutions for both traditional ML and advanced AI systems. Key Responsibilities Model Monitoring & Observability • Collaborate with Data Scientists to onboard models into monitoring systems (e.g., MHM database) and maintain configuration files for drift and performance checks. • Support retraining workflows when drift or degradation is detected. • Implement monitoring frameworks to track data drift, training-serving skew, and model performance metrics in production environments. • Utilize observability tools like Arize to set up monitors for accuracy, precision, recall, and other KPIs. • Configure automated alerts for anomalies in input/output distributions and performance degradation. Data Quality Assurance • Perform QC checks on incoming data to validate integrity and completeness before model scoring. • Develop pipelines for continuous validation of data sources and ensure compliance with quality standards. Performance Evaluation • Monitor KPIs such as accuracy, precision, recall, and fairness across demographic slices. • Conduct root-cause analysis for performance degradation and recommend retraining strategies. Infrastructure & Automation • Build and maintain CI/CD pipelines for deploying monitoring solutions and model updates. • Leverage cloud technologies for scalable monitoring and orchestration. Documentation & Reporting • Maintain detailed logs of monitoring activities, thresholds, and alerts. • Provide periodic reports on model health, including drift metrics and performance trends.

Requirements

• Data Science
• MLOps
• Machine Learning
• NLP
• Python
• Cloud Platform
• CI/CD

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a closely related field
• 5+ years of professional experience with a Bachelor’s degree or 3+ years with a Master's degree

Preferred Technologies

• Data Science
• MLOps
• Machine Learning
• NLP
• Python
• Cloud Platform
• CI/CD

Benefits

• Collaborative work environment with global teams.
• Competitive salary and comprehensive benefits.
• Continuous learning and professional development opportunities.

About the company

The Hartford is a leading insurance provider that offers a broad range of property and casualty insurance solutions. They are known for their focus on customer service and commitment to innovation in the insurance industry.