Research Scientist, Gemini

At Google DeepMind, we value diversity of experience, knowledge, backgrounds and perspectives and harness these qualities to create extraordinary impact. We are committed to equal employment opportunity regardless of sex, race, religion or belief, ethnic or national origin, disability, age, citizenship, marital, domestic or civil partnership status, sexual orientation, gender identity, pregnancy, or related condition (including breastfeeding) or any other basis as protected by applicable law. If you have a disability or additional need that requires accommodation, please do not hesitate to let us know.
Snapshot
Gemini Human Data is looking for a Research Scientist with a passion for data to join a team of researchers and engineers working on advancing the capabilities of Google’s natively multi-modal GenAI. With training data quality widely seen as key to reaching SOTA performance, we focus on developing methods for sourcing SFT and RLHF data in close collaboration with an interdisciplinary team of human-computer interaction researchers, QAs and Natural Language Processing experts. The successful candidate will help us advance our (post-)training data expertise in lockstep with the newest ML research, navigating a world of rapidly evolving models that increasingly exhibit superhuman behavior.
About Us
Artificial Intelligence could be one of humanity’s most useful inventions. At Google DeepMind, we’re a team of scientists, engineers, machine learning experts and more, working together to advance the state of the art in artificial intelligence. We use our technologies for widespread public benefit and scientific discovery, and collaborate with others on critical challenges, ensuring safety and ethics are the highest priority.
The Role
Key responsibilities
Work with an interdisciplinary team of training data experts on collecting data from human raters while defining and monitoring quality standards.
Use the collected data to improve model quality via supervised fine-tuning and reinforcement learning.
Evaluate model improvements by establishing appropriate metrics, running experiments and evaluations, and eyeballing test data.
Understand interactions and dependencies between different aspects of model quality: truthfulness/factuality, style, modality/format, safety.
Make calls with regard to non-trivial metrics tradeoffs.
Work with external collaborators and maintain relationships with relevant research labs and key individuals as appropriate.
Work in collaboration with our Ethics and Governance teams to ensure our advances in intelligence are developed ethically and provide broad benefits to humanity.
About You
In order to set you up for success as a Research Scientist at Google DeepMind, we look for the following skills and experience:
PhD in an ML-related topic.
Experience with training Large Language Models or Generative AI, ideally deployed at scale in the industry.
Proficiency in Python, C++ or equivalent programming languages.
Experience with and interest in data-driven quality work.
In addition, the following would be an advantage:
Hands-on experience with LLM/GenAI-based products, understanding user behavior, logs analysis.
Background in Natural Language Processing.
Applications close: Monday 3rd June 5pm BST.
#J-18808-Ljbffr