Ai Engineer Jobs in New York, USA

Senior AI Engineer at Doctronic. Apply via Ashby.

<p data-prosemirror-content-type="node" data-prosemirror-node-name="paragraph" data-prosemirror-node-block="true">We’re looking for a Staff Software Engineer with deep experience in GenAI/ML to join Datadog’s Application Performance Monitoring (APM) team. APM is a product which provides deep visibility into applications, enabling users to identify performance bottlenecks, troubleshoot issues, and optimize services. With distributed tracing, profiling, out-of-the-box dashboards, and seamless correlation with other telemetry data, Datadog APM provides some of the deepest and most structured visibility into the health and performance of applications. This context sets us up for an opportunity to be the world leaders in agentic investigations and incident troubleshooting.</p> <p data-prosemirror-content-type="node" data-prosemirror-node-name="paragraph" data-prosemirror-node-block="true">You’ll act as a technical leader within the APM group, focused on agentic workflows. You’ll lead efforts to design, train, evaluate, and deploy GenAI/ML models at scale. We’re looking for a product-minded ML engineer with strong technical expertise, excellent communication skills, and a track record of driving impactful initiatives end to end.</p> <p data-prosemirror-content-type="node" data-prosemirror-node-name="paragraph" data-prosemirror-node-block="true"><em data-prosemirror-content-type="mark" data-prosemirror-mark-name="em">At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.</em></p> <p data-prosemirror-content-type="node" data-prosemirror-node-name="paragraph" data-prosemirror-node-block="true"> </p> <p data-prosemirror-content-type="node" data-prosemirror-node-name="paragraph" data-prosemirror-node-block="true"><strong data-prosemirror-content-type="mark" data-prosemirror-mark-name="strong">What You’ll Do:</strong></p> <ul> <li data-prosemirror-content-type="node" data-prosemirror-node-name="paragraph" data-prosemirror-node-block="true">Act as a technical leader within the APM organization, driving GenAI/machine learning projects from concept to production.</li> <li data-prosemirror-content-type="node" data-prosemirror-node-name="paragraph" data-prosemirror-node-block="true">Build and benchmark GenAI/ML models using state-of-the-art techniques.</li> <li data-prosemirror-content-type="node" data-prosemirror-node-name="paragraph" data-prosemirror-node-block="true">Co

<p data-prosemirror-content-type="node" data-prosemirror-node-name="paragraph" data-prosemirror-node-block="true" data-pm-slice="0 0 []">We’re looking for a Senior Staff Software Engineer with deep experience in GenAI/ML to join Datadog’s Application Performance Monitoring (APM) team. APM is a product which provides deep visibility into applications, enabling users to identify performance bottlenecks, troubleshoot issues, and optimize services. With distributed tracing, profiling, out-of-the-box dashboards, and seamless correlation with other telemetry data, Datadog APM provides some of the deepest and most structured visibility into the health and performance of applications. This context sets us up for an opportunity to be the world leaders in agentic investigations and incident troubleshooting. </p> <p data-prosemirror-content-type="node" data-prosemirror-node-name="paragraph" data-prosemirror-node-block="true">You’ll act as a technical leader within the APM group, focused on agentic workflows. You’ll lead efforts to design, train, evaluate, and deploy GenAI/ML models at scale. We’re looking for a product-minded ML engineer with strong technical expertise, excellent communication skills, and a track record of driving impactful initiatives end to end.</p> <p data-prosemirror-content-type="node" data-prosemirror-node-name="paragraph" data-prosemirror-node-block="true"><em data-prosemirror-content-type="mark" data-prosemirror-mark-name="em">At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.</em></p> <p data-prosemirror-content-type="node" data-prosemirror-node-name="paragraph" data-prosemirror-node-block="true"> </p> <p data-prosemirror-content-type="node" data-prosemirror-node-name="paragraph" data-prosemirror-node-block="true"><strong data-prosemirror-content-type="mark" data-prosemirror-mark-name="strong">What You’ll Do:</strong></p> <ul> <li data-prosemirror-content-type="node" data-prosemirror-node-name="paragraph" data-prosemirror-node-block="true">Serve as the technical owner for GenAI initiatives within APM, leading design, development, and deployment of ML/AI-powered features across multiple teams.</li> <li data-prosemirror-content-type="node" data-prosemirror-node-name="paragraph" data-prosemirror-node-block="true">Guide long-term strategy and technical direction for GenAI workflows across APM and related products.</li> <li data-prosemirror-content-type=&q

<p>As a Staff Software Engineer on Datadog’s Cloud FinOps team, you will help shape how the company understands, analyzes, and optimizes its cloud infrastructure spend. This role sits at the intersection of engineering, finance, and executive leadership, building the systems and insights that drive company-wide decisions about infrastructure usage, AI usage and efficiency. You will design scalable solutions that improve cost attribution, forecasting, and visibility across Datadog’s multi-cloud environment. This is a high-impact opportunity to influence strategic decisions, solve complex infrastructure efficiency challenges, and help define the future of FinOps capabilities at Datadog.</p> <p><em>At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.</em></p> <p> </p> <p><strong>What You’ll Do:</strong></p> <ul> <li>Design and evolve internal platforms and tools that provide visibility into Datadog’s cloud infrastructure costs across AWS, GCP, and Azure.</li> <li>Partner with Finance, Engineering, and Executive Leadership to analyze cloud spend trends and inform strategic decisions.</li> <li>Develop scalable models and systems for cloud cost attribution across complex shared infrastructure.</li> <li>Build forward-looking FinOps capabilities that help teams proactively manage and optimize infrastructure usage.</li> <li>Work cross-functionally with engineering leaders to understand system architecture and translate infrastructure usage patterns into actionable cost insights.</li> <li>Influence company-wide initiatives around cost efficiency, forecasting, and infrastructure planning.</li> <li>Raises team performance by leading by example, building systems and patterns that improve productivity and autonomy by guiding with pragmatic technical judgment while being a hands-on contributor.</li> </ul> <p> </p> <p><strong>Who You Are:</strong></p> <ul> <li>Experience designing or operating distributed systems at scale.</li> <li>Proven ability to lead large cross-organizational technical initiatives and influence senior stakeholders.</li> <li>Strong communication skills and ability to explain complex technical concepts to engineering, finance, and executive audiences.</li> <li>Experience working with cloud infrastructure platforms such as AWS, GCP, or Azure.</li> <li>Ability to operate autonomously in ambiguous problem spaces and develop scalable solutions.</li> <li>Interest in infrastructure efficiency, cost attribution, and FinOps-style problem domains.</li> </ul> &

<p>We're looking for a Staff Software Engineer with deep experience in AI/ML to join the Notebooks team. Datadog Notebooks provide a flexible tool for ad-hoc data analysis, collaborative investigations, and technical documentation. Its fluidity makes it an ideal surface for agents and humans to interact. The Notebook team is building AI-driven workflows for natural-language data analysis, assisted graph generation, automated investigations, and more. You will act as a technical leader in this domain, focused on building industry-leader AI-powered features. We’re looking for a product-minded ML engineer with strong technical expertise, excellent communication skills, and a track record of driving impactful initiatives end to end.</p> <p><em>At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.</em></p> <p> </p> <p><strong>What You’ll Do:</strong></p> <ul> <li>Spearhead AI initiatives within Notebooks, serving as the technical owner for the design, development, and deployment of ML/AI-driven features.</li> <li>Shape the long-term technical direction and strategy for AI workflows within Notebooks and related products.</li> <li>Champion the full development cycle: from rapid prototyping and defining success metrics/evaluations to running experiments, iterating, and achieving production-ready scale and reliability.</li> <li>Drive product direction with a strong user focus, always advocating for the best end-user experience.</li> <li>Coordinate with other leaders and product teams interested in leveraging Notebooks in their AI-powered workflows.</li> <li>Develop robust agent systems, including tools, retrieval and planning strategies, guardrails, prompt management/evaluations, fallbacks, and human-in-the-loop processes.</li> <li>Stay up to date with industry trends, guiding the adoption of new technologies and evolving best-practices.</li> </ul> <p> </p> <p><strong>Who You Are:</strong></p> <ul> <li>You have a BS/MS/PhD in a scientific field or equivalent experience</li> <li>10+ years of relevant engineering experience, as well as experience acting as a technical lead</li> <li>Proven track record of leading large-scale AI/ML initiatives in a product-driven environment</li> <li>You have significant experience in model deployment, development, training, fine-tuning, and evaluation</li> </ul> <ul> <li>You are passionate about mentoring others and cultivating a high-performing engineering culture.</li> <li>You’re excited about leveraging AI tools to enhance how

<h2><strong>The opportunity</strong></h2> <p>Datadog’s APM Experiences team owns the core product experience for <a href="https://docs.datadoghq.com/tracing/">Application Performance Monitoring</a> — including distributed tracing, service representation, and more. We’re building a new wave of AI-powered capabilities that help customers <em>detect, resolve, and prevent</em> performance issues faster. In this role, you will lead end‑to‑end development of LLM- and Agent‑based features that can:</p> <ul> <li>Debug and investigate application performance issues down to the root cause, as both a developer assistant and a fully autonomous agent</li> <li>Proactively recommend performance and reliability-based optimizations to prevent the next incident</li> <li>Automatically create intelligent monitors and SLOs for the most important business flows and critical paths</li> </ul> <p>This is a highly product‑minded engineering role: you’ll work from problem discovery and UX all the way to reliable, scalable production systems.</p> <h2><strong>What you’ll do</strong></h2> <ul> <li><strong>Shape AI experiences for APM.</strong> Design and ship LLM/agentic workflows that analyze traces, metrics, logs, and other telemetry to generate diagnoses, explanations, and guided fixes.</li> <li><strong>Own the full loop.</strong> Prototype quickly, define success metrics and evals, run experiments, iterate, and ultimately productionize for scale and reliability.</li> <li><strong>Build robust agent systems.</strong> Develop tools, retrieval and planning strategies, and guardrails; manage prompts/evals; design fallbacks and human‑in‑the‑loop paths.</li> <li><strong>Integrate with Datadog’s platform.</strong> Leverage surfaces like Trace Explorer, Service Catalog, monitors, and workflows to deliver end‑to‑end value in the APM UI.</li> <li><strong>Partner deeply.</strong> Collaborate with PM, Design, and partner teams to build cohesive experiences.</li> <li><strong>Raise the bar on engineering.</strong> Write performant, maintainable backend code, own services in production, and improve reliability for high‑throughput, low‑latency data systems.</li> </ul> <h2><strong>Who you are</strong></h2> <p><strong>Product‑minded engineer who ships AI to production</strong></p> <ul> <li>4+ years building backend or real-time ML systems; you value simplicity, correctness, and performance</li> <li>Proven experience delivering LLM/agent features to production (prompting, tooling, evals, safety/guardrails)</li> <li>Comfortable owning user journeys, iterating from prototype → alpha → GA, and measuring impa