Description:
Senior Research Data Scientist
Location
Strong preference for candidates located in Seattle. Secondary location preference: New York, San Diego, or the Bay Area.
Exceptionally strong candidates outside these areas will be considered.
Job Summary
We are seeking a highly skilled and motivated Data Scientist to join our Responsible AI team. In this role, you will be responsible for designing, coordinating, supporting, and executing evaluations of large language model (LLM) features to ensure their safety, fairness, and alignment.
You will work closely with multidisciplinary teams, including Research Scientists, Product Managers, Engineers, and other Data Scientists, to drive human-centric evaluations that inform product decisions and improve model performance.
This position requires a combination of strong technical skills, experience in industry settings, and a deep understanding of human-centered data science. Familiarity with responsible AI principles and practices is a strong plus.
Key Responsibilities
• Design, implement, support, and evaluate experiments for LLM feature safety, including both human and automated evaluations.
• Develop scalable pipelines and tools to process and analyze heterogenous datasets.
• Collaborate with cross-functional teams to operationalize research findings
• Write high-quality, maintainable code, and contribute to shared codebases
• Create and maintain documentation for research processes and evaluation frameworks.
• Communicate findings effectively through presentations and reports, translating technical results into actionable insights for diverse audiences.
Key Qualifications
• Strong programming skills in Python, with experience in writing production-level code and implementing best practices (e.g., unit testing, version control).
• Experience with data engineering, including working with large datasets or heterogenous datasets with mixed provenance.
• Solid understanding of machine learning concepts, particularly related to LLMs, NLP, and model evaluation.
• Experience designing and executing experiments, including human-centered evaluations and automated benchmarking.
• Experience in observational or experimental research with human subjects.
• Familiarity with SQL for data manipulation and analysis.
• Strong analytical and problem-solving skills, with experience applying statistical methods to real-world problems.
• Excellent verbal and written communication skills, with experience in explaining technical concepts to non-technical stakeholders.
Strongly Preferred
• Hands-on, technical experience solving data science or ML problems with LLMs, preferably in an applied industry context
• Experience with responsible AI, including fairness, transparency, and safety in AI systems.
• Background in human-centered data science, HCI, or social science fields relevant to understanding human-AI interactions or measuring human-centered phenomena.
Education
Master’s or PhD in Computer Science, Machine Learning, Data Science, Statistics, Cognitive Science, Psychology, Human-Computer Interaction, or a related field.
- **Only those lawfully authorized to work in the designated country associated with the position will be considered.**
- **Please note that all Position start dates and duration are estimates and may be reduced or lengthened based upon a client’s business needs and requirements.**
I believe the best thing that Rose HR has going for it is the incredible responsiveness. Everyone is very quick to reply to any concerns, and contacts the contracted employees very quickly and efficiently.
Kevin, Consultant
Thanks for the opportunity. If in the future I ever need a job, I would like to work for Rose International.
David, Consultant
Rose is an assembly of people grounded in honesty, truth and dignity for all of its employees and contractors.
Samba, Consultant
I am very happy with the Rose International, and the professionalism of the employees.
Robin, Consultant
It was great working for Rose International. Everyone was extremely helpful.
Rosann, Consultant
EMPLOYEE COMMENTS