Position: Data Quality Analyst
Location - San Jose, CA
Duration- Full Time
Job Description-
Data AI/ML
• Calibrate with human labeling teams around project guidelines to identify market specific pain points and ensure quality improvements.
• Assist in the revision of project guidelines according to investigated areas of weakness or lack of clarity.
• Perform audits on samples of data labeled by vendor teams. Use the results of these audits to calculate performance metrics, execute deep dive analysis, and provide insights to project management teams regarding rater performance and areas of improvement
• Use analyses from audits to provide feedback on current project guidelines, assisting in the process of rewriting them for clarity to improve rater performance or to capture previously ignored sentiment.
• Calibrate with vendor team leads and trainers to clarify confusions with labeling methodology and understand rater pain points for guideline improvements and supplemental guidance
• Complete ad-hoc requests including the labeling and analysis of data outside of the routine measurement of project health
• Validate data presented in visualization dashboards to ensure accurate and up to date reflections of project quality
• Deliver reports detailing the quality of data through audit results, using data-backed insights to provide action plans for additional support.
• Familiarity with Microsoft Excel/Google Sheets spreadsheets, including formulas and pivot tables