<p><strong>Position: Databricks Data Engineer</strong></p><p><strong>Location:</strong> Remote (U.S. based) — Preference for candidates in or willing to relocate to <strong>Washington, DC</strong> or <strong>Indianapolis, IN</strong> for periodic on-site support</p><p><strong>Citizenship Requirement:</strong> U.S. Citizen</p><p><br></p><p><strong>Role Summary:</strong></p><p>Seeking a Databricks Data Engineer to develop and support data pipelines and analytics environments within an Azure cloud-based data lake. This role translates business requirements into scalable data engineering solutions and supports ongoing ETL operations with a focus on data quality and management.</p><p><br></p><p><strong>Key Responsibilities:</strong></p><ul><li>Design, build, and optimize scalable data solutions using <strong>Databricks</strong> and <strong>Medallion Architecture</strong>.</li><li>Develop ingestion routines for multi-terabyte datasets across multiple projects and Databricks workspaces.</li><li>Integrate structured and unstructured data sources to enable high-quality business insights.</li><li>Apply data analysis techniques to extract insights from large datasets.</li><li>Implement data management strategies to ensure data integrity, availability, and accessibility.</li><li>Identify and execute cost optimization strategies in data storage, processing, and analytics.</li><li>Monitor and respond to user requests, addressing performance issues, cluster stability, Spark optimization, and configuration management.</li><li>Collaborate with cross-functional teams to support AI-driven analytics and data science workflows.</li><li>Integrate with Azure services including:</li><li>Azure Functions</li><li>Storage Services</li><li>Data Factory</li><li>Log Analytics</li><li>User Management</li><li>Provision and manage infrastructure using <strong>Infrastructure-as-Code (IaC)</strong>.</li><li>Apply best practices for <strong>data security</strong>, <strong>governance</strong>, and <strong>compliance</strong>, supporting federal regulations and public trust standards.</li><li>Work closely with technical and non-technical teams to gather requirements and translate business needs into data solutions.</li></ul><p><strong>Preferred Experience:</strong></p><ul><li>Hands-on experience with the above Azure services.</li><li>Strong foundation in <strong>advanced AI technologies</strong>.</li><li>Experience with <strong>Databricks</strong>, <strong>Spark</strong>, and <strong>Python</strong>.</li><li>Familiarity with <strong>.NET</strong> is a plus.</li></ul>

<p><strong>Job Requirements:</strong></p><p>To be considered for this position, candidates must possess:</p><p><strong>Education & Experience:</strong></p><ul><li>Bachelor’s degree in Computer Science or related field with <strong>3+ years</strong> of experience, or</li><li>Master’s degree with <strong>2+ years</strong> of experience.</li></ul><p><strong>Technical Expertise:</strong></p><ul><li><strong>3+ years</strong> of experience designing and developing ingestion flows for structured, streaming, and unstructured data using cloud platform services, with a focus on data quality.</li><li><strong>Databricks Data Engineer certification</strong> and <strong>2+ years</strong> of experience maintaining the Databricks platform and developing in <strong>Apache Spark</strong>.</li><li>Proficiency in <strong>Python</strong>, <strong>Spark</strong>, and <strong>R</strong>; experience with <strong>.NET</strong> is a plus.</li><li>Strong knowledge of <strong>data governance</strong> practices, including:</li><li>Metadata management</li><li>Enterprise data catalog</li><li>Design standards</li><li>Data quality governance</li><li>Data security</li></ul><p><strong>Client Interaction & Communication:</strong></p><ul><li>Ability to work directly with clients and provide front-line support.</li><li>Skilled in documenting and presenting solutions using architecture and interface diagrams.</li></ul><p><strong>Development Methodologies:</strong></p><ul><li>Experience with <strong>Agile</strong> methodologies.</li><li>Familiarity with <strong>CI/CD automation</strong> and <strong>cloud-based development</strong> (Azure, AWS).</li></ul><p><strong>Preferred Qualifications (Not Required):</strong></p><ul><li>Certifications in <strong>Azure Cloud</strong>.</li><li>Knowledge of <strong>FinOps principles</strong> and <strong>cost management</strong>.</li></ul><p><strong>Eligibility:</strong></p><ul><li>This role will require US Citizenship and the ability to obtain a public trust clearance. No C2C allowed.</li></ul>

<h3 class="rh-display-3--rich-text">Technology Doesn't Change the World, People Do.^®</h3> <p>Robert Half is the world’s first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.</p> <p>Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. <a href="https://www.roberthalf.com/us/en/mobile-app" target="_blank">Download the Robert Half app</a> and get 1-tap apply, notifications of AI-matched jobs, and much more.</p> <p>All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit <a href="https://roberthalf.gobenefits.net/" target="_blank">roberthalf.gobenefits.net</a> for more information.</p> <p>© 2025 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking “Apply Now,” you’re agreeing to <a href="https://www.roberthalf.com/us/en/terms">Robert Half’s Terms of Use</a>.</p>