Data Scientist, AI Development
- Columbus, OH, United States
- Omaha, NE, United States
- Cincinnati, OH, United States
- Denver, CO, United States
- New York, NY, United States
- Minneapolis, MN, United States
- Philadelphia, PA, United States
- Clifton Park, NY, United States
- Milwaukee, WI, United States
Applications open in a new tab.
Job details
- Posting language
- English
- Posted
Original job description
About the team
Ultimus is investing in AI to transform how fund administration work gets done, from generative AI assistants, intelligent document processing and machine learning to a growing set of agentic AI workflows. Our AI Development teams are small, cross-functional groups of AI engineers, data scientists, data engineers and AI analysts who partner closely with our operations experts to redesign key workflows and build the AI solutions that support them, with AI agents an increasingly important part of that work. They are backed by a dedicated AI Infrastructure team and a shared enterprise AI platform.
About the role
As Data Scientist in an AI Development pod you design the AI approach for each workflow and prove that it works. You shape the models, prompts and agent logic, and you own how we measure accuracy, quality and savings.
What you'll do
- Work with operations experts to break a workflow into steps and decide where AI models, AI agents, rules or people should handle each one.
- Design the right AI approach for each task, whether predictive models, LLM prompts and retrieval, or agent reasoning, and select the right models.
- Build evaluation sets and metrics (accuracy, exception rates, review time) and run offline and online evaluations before and during pilots.
- Analyze pilot results, find failure patterns and improve the solutions until they meet the targets to go live.
- Measure the time and cost saved by each workflow and report results to the program team.
- Package what works into reusable patterns for the next workflow.
Ultimus Leverpoint is an equal opportunity employer and does not discriminate on the basis of the applicant’s or employee’s race, color, religion, national origin, ancestry, gender, sexual orientation, age, disability, veteran or military status, genetic information, citizenship or any other status entitled to protection under federal, state or local anti-discrimination laws. No questions on our employment application are intended to secure information that is to be used for impermissible purposes.
More about this job
Skills
- Machine learning
- Workflow