Company Overview:
Req ID: 398192
NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.
NTT DATA's Client is currently seeking a Senior Databricks Engineer to join their team in Atlanta, Georgia (US-GA), United States (US).
Job Description:
Job Title: Senior Databricks Engineer / Technical Product Manager (80% Engineering | 20% Product Management)
Job Summary
We are seeking a highly skilled Senior Databricks Engineer with deep expertise in Python, Databricks, Unity Catalog, Data Governance, and Data Quality to lead the design and implementation of scalable data governance and data platform solutions. This role is primarily hands-on technical (80%), requiring strong engineering capabilities, while also partnering with business and technology stakeholders on product management activities (20%), including roadmap planning, requirements gathering, and stakeholder alignment.
The ideal candidate combines strong software engineering and data platform expertise with the ability to translate governance and business requirements into scalable technical solutions.
Key Responsibilities
Technical Engineering (80%)
Databricks & Data Platform Engineering
Design, develop, and support enterprise-scale solutions on the Databricks Lakehouse Platform.
Build and optimize data pipelines using Databricks, PySpark, SQL, and Python.
Develop reusable, configuration-driven frameworks for data quality validation, metadata management, and governance automation.
Implement scalable ingestion, transformation, and validation processes across structured and semi-structured data.
Troubleshoot performance bottlenecks and optimize Databricks workloads.
Unity Catalog & Data Governance
Implement and manage Unity Catalog governance capabilities, including:
Catalogs, Schemas, and Tables
Access controls and permissions
Data lineage
Data classification and tagging
Business and technical metadata management
Partner with governance teams to establish data ownership, stewardship, and governance controls.
Enable governance integration between enterprise governance tools and Databricks.
Define and implement metadata standards, data quality controls, and governance policies.
Python Development
Design and develop enterprise-grade Python applications and utilities.
Build APIs, automation tools, and governance accelerators.
Develop reusable Python modules, testing frameworks, and deployment pipelines.
Perform code reviews and establish engineering best practices.
Data Quality & Metadata Management
Design and implement automated data quality validation frameworks.
Define quality rules, thresholds, monitoring, and exception handling processes.
Develop metadata harvesting, synchronization, and lineage solutions.
Support data observability and monitoring initiatives.
Architecture & Technical Leadership
Contribute to platform architecture and design reviews.
Define engineering standards, governance frameworks, and development best practices.
Mentor junior engineers and provide technical leadership.
Collaborate with cloud, security, architecture, and governance teams.
Product Management Activities (20%)
Stakeholder Engagement
Partner with business, governance, and technology stakeholders to understand requirements and priorities.
Translate business needs into technical specifications and delivery plans.
Facilitate discussions between engineering and business teams.
Product Delivery
Define and manage backlog, epics, features, and user stories.
Support roadmap planning and prioritization activities.
Drive solution adoption through demonstrations and stakeholder engagement.
Track delivery progress, risks, dependencies, and outcomes.
Strategy & Governance
Help define the strategic direction for governance and data platform capabilities.
Evaluate new technologies, governance tools, and platform enhancements.
Develop business cases and recommendations for platform investments.
Must have Technical Skills
8+ years of experience in Data Engineering, Analytics Engineering, or Data Platform Engineering.
5+ years of hands-on Databricks experience.
Expert-level Python programming skills.
Strong experience with:
Databricks Lakehouse Platform
PySpark
SQL
Delta Lake
Unity Catalog
Deep understanding of:
Data Governance
Data Quality
Metadata Management
Data Lineage
Master and Reference Data Concepts
Experience building APIs and automation frameworks.
Strong understanding of CI/CD, Git, and DevOps practices.
Experience with Azure cloud platform.
Ideal Candidate
Thinks like an engineer and builds like an architect.
Has deep Databricks and Unity Catalog expertise.
Understands governance beyond compliance and can operationalize it through technology.
Can independently drive technical solutions from concept to production.
Effectively balances hands-on engineering with stakeholder and product management responsibilities.
Allocation: 80% Technical Engineering | 20% Product Management
About NTT DATA:
NTT DATA is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure and connectivity. We are one of the leading providers of digital and AI infrastructure in the world. NTT DATA is a part of NTT Group, which invests over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. Visit us at us.nttdata.com
NTT DATA provides a reasonable range of compensation for U.S.-based positions. The starting pay range for this role is [$60-$70 hourly]. Actual compensation will depend on a number of factors, including the candidate’s relevant experience, technical skills, and other qualifications.
This position is eligible for company benefits including participation in medical, dental, and vision insurance, flexible spending or health savings account, and AD&D insurance, employee assistance, participation in a 401k program, and additional voluntary or legally-required benefits
NTT DATA endeavors to make https://us.nttdata.com accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at https://us.nttdata.com/en/contact-us. This contact information is for accommodation requests only and cannot be used to inquire about the status of applications. NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. For our EEO Policy Statement, please click here. If you'd like more information on your EEO rights under the law, please click here. For Pay Transparency information, please click here.