Databricks Specialist

<div class="content-intro"><p><strong>Company Overview:</strong></p> <p>Over the past 15 years, eTel has delivered essential solutions for the federal government by securing and managing data, providing scalable identity access, modernizing legacy systems, and building high-performance platforms. By integrating new technologies and ensuring reliable operations we help agencies stay prepared for future challenges As a premier technology solutions and services company to the US federal government, eTel possesses longstanding relationships across the federal civilian marketplace. Other customers include the broader Treasury Department, Commerce Department, and State Department.</p> <p>&nbsp;</p> <p>eTel offers integrated CMMI Level 3 processes, tools, and techniques with innovative, cost-efficient, and secure solutions to address complex challenges. eTel also holds ISO 9001:2015, ISO/IEC 27001:2013, and ISO/IEC 20000-1:2018 certifications, and offers dedicated subject matter experts (SMEs) and thought leaders that possess a deep understanding of customers’ environments and challenges.</p></div><p><strong>Security Clearance:</strong> IRS MBI clearance (MUST already be in place)</p> <p>&nbsp;</p> <p><strong>Position Summary</strong>:</p> <p>The IRS is modernizing its data platform to support analytics, reporting, and predictive modelling. We are seeking a skilled Databricks Specialist / Data Engineer to design, implement, and optimize big data pipelines and analytics solutions. The ideal candidate will have hands-on experience with Databricks, Apache Spark, and cloud-based data platforms, and a strong understanding of data governance, security, and compliance standards relevant to federal environments.</p> <p>&nbsp;</p> <p><strong>Key Responsibilities</strong>:</p> <ul> <li>Design, develop, and maintain scalable ETL/ELT pipelines using Databricks and Apache Spark.</li> <li>Work with large datasets from multiple sources, including structured and unstructured data, to support analytics and reporting.</li> <li>Collaborate with IRS teams to implement data lakehouse solutions and optimize data storage and retrieval.</li> <li>Develop and maintain Delta Lake tables and pipelines to ensure data reliability and ACID compliance.</li> <li>Implement data transformations, cleansing, and enrichment processes for downstream analytics and reporting.</li> <li>Work with Python, SQL, and other scripting languages to build and automate workflows.</li> <li>Ensure compliance with IRS security standards, NIST 800-53, and IRS 1075 for handling sensitive taxpayer data.</li> <li>Collaborate with data scientists, analysts, and other stakeholders to deliver actionable insights.</li&g