Required Skills & Experience
- 10-15+ years of total experience in Data Engineering related roles 5+ years of Databricks architecture experience and
- proven experience implementing Databricks in AWS environment
- deep expertise with Unity Catalog architecture and administration.
- Strong experience with RBAC, ABAC, IAM, and enterprise security models.
- Strong understanding of Databricks account and workspace administration.
- Experience with Databricks Classic/Serverless Compute architecture and security.
- Experience with Databricks Apps and associated platform architecture.
- Experience with Databricks security, audit logging, and monitoring.
- Strong knowledge of service principals and machine-to-machine authentication.
- Experience with AWS IAM, S3, networking, and cloud-security patterns.
- Strong experience with Terraform, AWS CloudFormation, Databricks CLI/SDK/APIs, or comparable IaC and automation tooling.
- Experience implementing Git-based and CI/CD-driven platform administration.
- Experience conducting Databricks health checks, security assessments, or architecture reviews.
- Experience identifying issues and hands-on implementing remediation, not simply producing recommendations.
- Understanding of Mosaic AI, Model Serving, Foundation Model APIs, and enterprise AI/ML workload architecture.
- Network and Data Protection Architecture Review (PrivateLink, egress controls, encryption, exfiltration prevention) with implemented fixes
Nice to Have Skills & Experience
- Databricks certifications
Job Description
A global law firm with nearly 1,400 lawyers and more than 3,000 employees across 19 offices in the United States, Europe, and Asia is looking to build out a data lake to encompass both internal and external data. The role is a contract with potential to hire down the line if a need arises. The firm is widely recognized for its expertise in corporate law, litigation, intellectual property, life sciences, technology, and venture capital, advising on transformative deals, IPOs, and complex regulatory matters. The firm has earned numerous workplace accolades, including being named to Fortune’s Best Companies to Work For and receiving honors such as Best Workplaces for Women, Best Workplaces for Flexibility, Best Workplaces for Giving Back, and Best Workplaces for Parents.
The Client is transforming how they use data to empower our attorneys, clients, and business teams. As they build their Northstar Lakehouse (medallion architecture) and shift toward AI‑assisted analytics.
We are looking for a senior, independent, hands-on architect who can work with limited technical direction. The candidate must be capable of entering an existing Databricks environment, independently assessing the current architecture and security posture, identifying risks and technical debt, defining pragmatic target-state solutions, and implementing the agreed improvements alongside the internal team. The candidate should be equally comfortable discussing architecture and security with technical leadership and hands-on developing Terraform, automation scripts, policies, access models, and platform configurations. Candidates who primarily provide architecture recommendations without hands-on Databricks implementation experience will not be a fit for this role.
Expected Deliverables
The engagement should produce tangible outcomes, including:
- Databricks Platform Health Check & Architecture Assessment
- Security and Platform Hardening Assessment
- Unity Catalog Assessment and Target-State Design
- RBAC/ABAC and Identity/Access Model
- Serverless Compute Architecture and Governance Recommendations
- Lakeflow / Lakeflow Connect Architecture Review
- Databricks Apps and AI Platform Readiness Assessment
- Prioritized Risk and Remediation Roadmap
- Script/IaC-Based Databricks Administration Framework
- Git and CI/CD-Based Platform Change Management Approach
- Platform Administration, Security, and Governance Standards
- Operational Runbooks and Knowledge Transfer
- Cost Governance and Usage Monitoring Framework (system-table dashboards, tagging standards, compute policies, budget alerts)
- Audit Logging, Monitoring, and Alerting Implementation (log delivery, SIEM integration, detection use cases)
- Disaster Recovery and Resilience Recommendations DBA based CICD deployment
Compensation:
$80/hr to $90hr. Exact compensation may vary based on several factors, including location, skills, experience, and education. Employees in this role will enjoy a comprehensive benefits package starting on day one of employment, including options for medical, dental, and vision insurance. Eligibility to enroll in the 401(k) retirement plan begins after 90 days of employment. Additionally, employees in this role will have access to paid sick leave and other paid time off benefits as required under the applicable law of the worksite location.