Senior AI Prompt Engineer

About the Role

The Senior AI Prompt Engineer builds, tests, and scales LLM prompts in a small, fast-moving team. Using diverse toolkits, the ideal candidate employs GenAI to better understand our users, our marketplace experts, and improve our chatbot experience, driving revenue and strategic outcomes at every step. This individual knows how to process and model data at scale, and is comfortable making decisions based on that information. Furthermore, the candidate is a technical and strategic leader in the team. Blending operational LLM support with company-wide outreach, the Senior AI Prompt Engineer enables teams across the organization to get more out of their prompts and products. They should be self-directed and have keen judgment about moving projects to completion. 

What You’ll Do

• Advanced LLM prompt engineering & applications

• Use LLMs and generative AI to process large data swaths, drive product lifecycles, and shape chatbot logic 

• Evaluate the efficiency of LLM prompts to create flexible, impactful, cost-effective solutions 

• Improve products and customer experience with A/B testing, owning the applied LLM component 

• Optimize existing user experiences with LLMs and build new ones that engage, convert, and support customers  

• Evangelize LLM operations to both a team of subject matter experts as well as relative outsiders 

• Work closely with Product Managers to identify new testing opportunities and application of foundation LLMs and frameworks

What we're looking for

• Master’s Degree or PhD in Computer Science, Computational Linguistics, or specialization in ML
• Intermediate to Advanced Python skills and work experience
• Strong knowledge of LLMs and applied LLM frameworks/methods (e.g. RAG, fine-tuning, etc.)
• Exceptional logical, analytical, and organizational skills
• Understanding of NLP/Information retrieval techniques, libraries, or toolkits 
• Intermediate or higher proficiency in Microsoft Excel 
• Excellent business judgement and analytical problem-solving skills 
• Ability to take direction and work autonomously once briefed 
• Expertise in foundation models across AI vendors, including open-source models; knows tradeoffs between models and model versions
• Management or lead experience highly preferred
• Proficiency PowerBI and/or Google Analytics 
• Familiarity with Agile or experience working in scrum sprints
• Familiarity with Azure Boards, Asana, and/or related project management suites

Why You’ll Love Working With Us

• Access to 12,000 licensed professionals and over 25 million real professional-client conversations to train AI
• Our AI is rated 22% more helpful than ChatGPT for professional services (A/B tested with 5,000+ users)
• Over 10 years of AI innovation, evolving from NLP and ChatScript to cutting-edge Generative AI/LLMs
• A proven leader in LLM commercial implementation, driving $50M+ in revenue and deploying new foundational models within days of release
• Operate in a true agile environment, enabling rapid iteration, experimentation, and continuous delivery of innovative solutions

About Us
We are a San Francisco based company founded in 2003. Our mission is simple: we help people. We have democratized professional services by connecting customers with verified and vetted Experts who provide reliable answers at any hour and on any budget. JustAnswer members enjoy round-the-clock access to 12,000+ doctors, lawyers, tech support, mechanics,