Title: Content Producer
Location: Cupertino, CA (Hybrid)
Duration: 6 Months to begin with
Pay: $31.00/hr. on W2 with Benefits
Description:
- Ability to work cross-functionally with Design, Product, Editorial, Safety and Engineering teams to deliver quality on time. Collaborate with cross functional teams to precisely define the evaluation requirements necessary for Machine Learning/ Large Language Models implementation across different projects.
- Native-level fluency and Strong written communication skills in US English language is essential to this role.
- Linguistic/cultural skills: expert knowledge of grammar, spelling, and cultural appropriateness to accurately represent user experience early in the software development cycles.
- Ensure data quality is maintained at high standards and continually enhance processes based on both quantitative and qualitative feedback
Responsibility and Skills Required:
- Responsibilities may include, but are not limited to: evaluating content, researching and verifying accuracy of relevant metadata pertaining to different media types.
- Quality assurance reviewing, verifying, editing, scoring, transcribing, copywriting, and reporting on data and/or assets across a broad scope of media and content types.
- Problem solves, provide clear suggestion/feedback to leads, and effectively communicate recommendations to both editorial and engineering teams.
- Leverage established workflows and tooling for various content tasks.
- Collaborate and follow guidance from the Project Lead, Style Guides, and Terminology Databases on all matters related to the Client style and project requirements.
- Experience in Large Language Models and knowledge about LLM evaluation techniques, such as human evaluation and automated benchmarks is desirable.
- Conduct research with humans to validate and create automated benchmarks for LLM evaluations. Collect data from human participants (e.g., surveys, experiments) with knowledge about data quality, data validity, etc.
- Advanced degree in linguistics, computer science, machine learning, cognitive science, psychology, economics, or similar (preferred).
- 3+ Years of experience is needed.