LLM Data Scientist
Experience Required: 2+ years
About the Role: We are seeking an experienced LLM Data Scientist to join our team working on Outcome Assistant (OA), our generative AI-powered chatbot service. You will be responsible for developing and optimizing AI models, implementing agentic workflows, and building robust RAG systems to enhance our product capabilities.
Required Skills & Experience:
- 2+ years of professional experience in data science or machine learning
- 2+ years of hands-on experience with Generative AI and Large Language Models
- Strong proficiency in Python programming
- Experience working with LLMs (OpenAI, Anthropic, open-source models, etc.)
- Practical knowledge of agentic AI frameworks (CrewAI, Phidata, LangGraph, or similar)
- Expertise in RAG (Retrieval-Augmented Generation) architectures
- Experience with vector databases (Pinecone, Weaviate, ChromaDB, FAISS, or similar)
- Proficiency in Flask or similar Python web frameworks
- Working knowledge of AWS cloud services
- Strong SQL database skills
- Understanding of prompt engineering and optimization techniques
Nice to Have:
- Familiarity with embedding models and semantic search
- Experience with streaming responses and real-time systems
What You'll Do:
- Design and implement LLM-based features for our chatbot platform
- Build and optimize RAG pipelines for document retrieval and question answering
- Develop agentic workflows for complex, multi-step tasks
- Integrate various AI models and services into our product
- Collaborate with product and engineering teams to deliver AI-powered features
- Monitor and improve model performance and accuracy
