Generative AI Evaluation Clinical Scientist
- linkCopy link
- emailEmail a friend
Minimum qualifications:
- Medical degree (e.g., MD, MBBS, or equivalent degree) or a PhD in Health Informatics, Psychology, Biomedical Engineering, Epidemiology or relevant field with formal research training.
- 3 years of experience applying qualitative and quantitative research methods relevant to health AI model validation.
- Experience implementing analysis with tools relevant to AI evaluation.
Preferred qualifications:
- Research publication record in health AI evaluation or machine learning.
- Experience designing and evaluating psychometrically sound survey rating instruments.
- Experience with AI/ML applied to clinical or health problems, including assessment of their benefits, harms, and potential biases.
- Experience with clinical evaluation of generative AI models, with a focus on assessing scientific accuracy, safety and health impact.
- Experience with clinical research, digital health, real-world evaluations and working with large and complex healthcare datasets.
- Experience in an environment that has developed, launched, and evaluated health technology products.
About the job
Our mission is to foster excellence in digital health research and health impact assessment across Google. Our centralized Health Impact Center of Excellence provides scientific leadership and operational support to accelerate health research productivity, increase methodological accuracy and assess the health impact of Google health initiatives around the world.
Google Health is a company-wide effort to help billions of people be healthier. We work toward this vision by meeting people in their everyday moments and empowering them to stay healthy and partnering with care teams to provide more accurate, accessible, and equitable care. Our teams are applying our expertise and technology to improve health outcomes globally – with high-quality information and tools to help people manage their health and wellbeing, solutions to transform care delivery, research to catalyze the use of artificial intelligence for the screening and diagnosis of disease, and data and insights to the public health community.
The US base salary range for this full-time position is $146,000-$216,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.
Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about benefits at Google.
Responsibilities
- Develop, validate, and deploy standardized rating instruments to assess the quality, accuracy, robustness, and efficacy of AI models, ensuring alignment with Google’s AI Principles, regulatory guidelines, and industry best practices.
- Design and execute evaluations of AI models in health-related areas, with a focus on assessing information quality, clinical impact, safety, and potential biases.
- Employ expertise in qualitative and quantitative research methods, including clinical study design and execution, to design state-of-the-art methods for AI model assessment.
- Collaborate closely with cross-functional teams, including engineers, clinicians, researchers, and product managers, to ensure that AI models are evaluated transparently throughout the development life-cycle.
- Leverage programming skills (e.g., Python/Colab/Jupyter notebooks, R) to conduct analyses, develop evaluation tools, and support scaling of automated evaluation workflows.
Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google's Applicant and Candidate Privacy Policy.
Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google's EEO Policy, Know your rights: workplace discrimination is illegal, Belonging at Google, and How we hire.
If you have a need that requires accommodation, please let us know by completing our Accommodations for Applicants form.
Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.
To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes.