Senior LLM Engineer / Data Scientist, Noa.ai team (100% remote-friendly within Poland)

<h3>Company Description</h3><p><strong>Welcome to the good side of tech 👋</strong></p><p>You might have heard about us, but with a different name: Doctoralia. It all started 12 years ago when we asked ourselves: is anyone in healthcare thinking about patients? We jumped in and we empowered patients by giving them access to leave and read reviews about their visit. We then provided doctors with the technology to manage bookings easily and save time, so they could devote themselves to what they always wanted: treating patients. And today is the day in which we ask you: wanna join us in the next step of making the healthcare experience more human?</p><p><strong> </strong></p><p><strong>Docplanner at scale</strong></p><p>We are leaders in 13 countries so far, and more than 90 million patients trust us every month. almost 300.000 specialists believe in us and our product, and so do leading venture capital funds such as Point Nine Capital, Goldman Sachs Asset Management, and One Peak Partners. And yet, employing over  3.000people all over the globe, we managed to keep the startup mindset we started with over 12 years ago.</p><p><strong>How does Docplanner Tech fit here?</strong></p><p>At <a href="https://docplanner.tech/">Docplanner Tech</a> we are a diverse group of almost 400 people working in Engineering, Data, and Product teams. We are responsible for building the product for all locations. Many of us have been here for over 5 years, yet we still welcome each new person with great joy and excitement.</p><p>We could tell you about us, but we will let our <a href="https://www.glassdoor.es/Overview/Working-at-DocPlanner-EI_IE1071394.11,21.htm?countryRedirect=true">reviews on Glassdoor</a> speak for themselves. In case you’d like to see how it feels to be 100% yourself at work, <a href="https://bit.ly/3xwnSAk">here’s a video of us</a>. </p><p><strong> </strong></p><p><strong>And why should you join us?</strong></p><p>Because it feels good to tell your family and your friends how you made the world a little bit better. You go to bed knowing that what you do matters, and that your talents align with your beliefs.</p><p>We want to make the healthcare experience more human, and that starts with you being you. We believe that taking the diversity of human experience into account makes a better healthcare experience for all . We’re not just different: we embrace diversity. We will encourage you to come to work your whole self, and that includes not coming to the office at all if you prefer not to, as we're 100% remote-friendly.</p><h3>Job Description</h3><p>We are looking for a <strong>Senior LLM Engineer</strong> to join the development of the <a href="http://noa.ai">Noa.ai</a> product. Our mission is to revolutionize access to quality healthcare by alleviating the administrative burden on doctors, clinics, and medical personnel, enabling them to focus on patient care.</p><p>Currently, the team is dedicated to Noa Notes, an innovative solution that automates medical documentation creation freeing doctors from time-consuming administrative tasks.Technically,  it blends Automatic Speech Recognition models with the power the LLMs power. Apart from the online inference system, we’ve built a comprehensive quality assurance and validation stack.</p><p>Our mission includes improving transcription quality by training ASR for medical terminology and low-quality audio, enhancing note quality by refining prompts to capture essential details while maintaining structure, and enabling personalized, structured medical notes.</p><p>But that’s not all - we are actively planning and exploring additional groundbreaking AI initiatives aimed at transforming healthcare through technology. As part of this team, you’ll play a key role in shaping the future of AI-driven healthcare solutions.</p><p><strong>Responsibilities:</strong></p><p><strong>Prompt engineering</strong></p><ul><li><p>Optimize prompts to improve recall and veracity, especially for medical terminology and concepts.</p></li><li><p>Continuously refine input-output workflows to enhance LLM accuracy in complex medical scenarios.</p></li><li><p>Identify common failure points in LLM outputs, particularly in medical contexts, and implement strategies to mitigate inaccuracies.</p></li><li><p>Enable system-level personalization for healthcare providers by tailoring AI outputs to align with individual doctors' preferences and needs.</p></li><li><p>Design methods for customized output formatting, ensuring compatibility with various medical systems (e.g., EHRs, diagnostic tools).</p></li></ul><p><strong>QA &amp; validation</strong></p><ul><li><p>Integrate quality assurance mechanisms to reduce misinformation in generated content.</p></li><li><p>Build and maintain validation datasets to validate the improvements and run regression tests. </p></li><li><p>Review reported cases to monitor potential errors and implement improvements to mitigate them. </p></li></ul><p><strong>Collaboration</