- Identifying and prioritizing language model issues, and working with researchers to find a path to resolution.
- Creating novel data collection tasks for taskers to evaluate language models and to collect training data for fine-tuning.
- Creating language model prototypes to prove out new feature directions and scope projects.
- Engineering prompts to teach language models how to behave across a wide range of scenarios.
- Working closely with researchers and engineers to define and manage engineering and research projects.
- Deploying and tracking AB model experiments in production.
- Embody our Culture and Values.
- Bachelorโs Degree AND 5+ years experience in product/service/project/program management or software development or equivalent experience.
- 5+ years of experience leading multi-disciplinary projects, defining requirements, developing project plans and working with multi-disciplinary teams to execute them.
Preferred Qualifications:
- Bachelor's Degree AND 10+ years experience in product/service/project/program management or software development or equivalent experience.
- 5+ years of experience shipping consumer-facing products. Youโve brought products to market, collected user feedback, defined success metrics and iteratively improved products.
- Technical depth in software development, data science and machine learning. While you are not expected to write code on the critical path, youโre able to build zero-to-one prototypes, reason over large amounts of data, and speak the language of the engineers and researchers you work with.
- Experience using and applying Large Language Models. LLMs will be your clay โ you should know how to prompt engineer them, how to evaluate them, and understand they are tuned.
TBD