Databricks Subject Matter Expert
Position Description
About the Role
We are seeking a highly experienced Databricks Subject Matter Expert to join at the Lead / Principal level. In this role, you will serve as the firm's foremost technical authority on the Databricks Lakehouse Platform, guiding clients through complex data transformation initiatives - from strategic architecture design through hands on implementation and production deployment.
You will partner directly with client stakeholders (CTOs, VPs of Data, and Engineering Leads) to define data strategies, architect scalable solutions on Databricks, and mentor delivery teams. This is a high visibility role that blends deep technical expertise with client advisory, pre sales support, and thought leadership.
This role must be performed at the Dallas, TX location onsite 5 days of each week.
Key ResponsibilitiesAbout the Role
We are seeking a highly experienced Databricks Subject Matter Expert to join at the Lead / Principal level. In this role, you will serve as the firm's foremost technical authority on the Databricks Lakehouse Platform, guiding clients through complex data transformation initiatives - from strategic architecture design through hands on implementation and production deployment.
You will partner directly with client stakeholders (CTOs, VPs of Data, and Engineering Leads) to define data strategies, architect scalable solutions on Databricks, and mentor delivery teams. This is a high visibility role that blends deep technical expertise with client advisory, pre sales support, and thought leadership.
Key Responsibilities
Solution Architecture & Design
. Lead end to end design of Databricks Lakehouse architectures, including Delta Lake, Unity Catalog, and medallion (bronze/silver/gold) data models.
. Define reference architectures, best practices, and reusable accelerators for client engagements.
. Evaluate and recommend deployment patterns across Azure Databricks, AWS Databricks, and GCP, aligning platform choices with client infrastructure and governance needs.
Data Engineering & Pipeline Development
. Architect and oversee large scale ETL/ELT pipelines using Apache Spark, Delta Live Tables, and Databricks Workflows.
. Design real time and batch ingestion frameworks covering structured, semi structured, and unstructured data sources.
. Establish data quality, lineage, and observability standards using Unity Catalog, Delta Lake features, and complementary tooling.
Machine Learning & MLOps
. Guide clients on implementing end to end ML workflows using MLflow, Feature Store, and Model Serving on Databricks.
. Advise on MLOps patterns including model versioning, A/B testing, monitoring, and automated retraining pipelines.
. Collaborate with data science teams to productionize models and integrate ML outputs into business applications.
Client Advisory & Engagement Leadership
. Serve as the trusted advisor to senior client stakeholders on all matters related to data platform strategy and Databricks adoption.
. Lead discovery workshops, architecture reviews, and technical assessments to define solution roadmaps.
. Support pre sales efforts by developing proposals, estimating level of effort, and delivering technical demonstrations.
Thought Leadership & Practice Development
. Contribute to the firm's intellectual property by developing frameworks, white papers, and training curricula around Databricks.
. Mentor and upskill consultants across the data practice; foster a community of Databricks practitioners.
. Represent the firm at industry events, Databricks partner summits, and webinars.
Required Qualifications
. 10+ years of professional experience in data engineering, analytics, or platform architecture.
. 5+ years of deep, hands on experience with Databricks, including production deployments at enterprise scale.
. Expert level proficiency in Apache Spark (PySpark and/or Scala), Delta Lake, and SQL.
. Proven track record designing multi cloud Lakehouse architectures (Azure, AWS, or GCP).
. Strong experience with Unity Catalog for data governance, access control, and lineage tracking.
. Demonstrated ability to lead client facing engagements and communicate complex technical concepts to executive audiences.
. Experience in a consulting or professional services environment, with a history of managing multiple concurrent engagements.
. Bachelor's degree in Computer Science, Engineering, Data Science, or a related field (or equivalent practical experience).
Preferred Qualifications
. Databricks Certified Data Engineer Professional or Machine Learning Professional certification.
. Experience with Delta Live Tables, Databricks Workflows, and Photon engine optimization.
. Familiarity with complementary tools such as dbt, Terraform/Pulumi (IaC), and CI/CD pipelines for data platforms.
. Hands on experience with MLflow, Feature Store, and Model Serving in production environments.
. Prior experience as a Databricks partner or in a Databricks aligned practice within a consulting firm.
. Advanced degree (M.S. or Ph.D.) in a quantitative or technical discipline.
Solution Architecture & Design
. Lead end to end design of Databricks Lakehouse architectures, including Delta Lake, Unity Catalog, and medallion (bronze/silver/gold) data models.
. Define reference architectures, best practices, and reusable accelerators for client engagements.
. Evaluate and recommend deployment patterns across Azure Databricks, AWS Databricks, and GCP, aligning platform choices with client infrastructure and governance needs.
Data Engineering & Pipeline Development
. Architect and oversee large scale ETL/ELT pipelines using Apache Spark, Delta Live Tables, and Databricks Workflows.
. Design real time and batch ingestion frameworks covering structured, semi structured, and unstructured data sources.
. Establish data quality, lineage, and observability standards using Unity Catalog, Delta Lake features, and complementary tooling.
Machine Learning & MLOps
. Guide clients on implementing end to end ML workflows using MLflow, Feature Store, and Model Serving on Databricks.
. Advise on MLOps patterns including model versioning, A/B testing, monitoring, and automated retraining pipelines.
. Collaborate with data science teams to productionize models and integrate ML outputs into business applications.
Client Advisory & Engagement Leadership
. Serve as the trusted advisor to senior client stakeholders on all matters related to data platform strategy and Databricks adoption.
. Lead discovery workshops, architecture reviews, and technical assessments to define solution roadmaps.
. Support pre sales efforts by developing proposals, estimating level of effort, and delivering technical demonstrations.
Thought Leadership & Practice Development
. Contribute to the firm's intellectual property by developing frameworks, white papers, and training curricula around Databricks.
. Mentor and upskill consultants across the data practice; foster a community of Databricks practitioners.
. Represent the firm at industry events, Databricks partner summits, and webinars.
Required Qualifications
. 10+ years of professional experience in data engineering, analytics, or platform architecture.
. 5+ years of deep, hands on experience with Databricks, including production deployments at enterprise scale.
. Expert level proficiency in Apache Spark (PySpark and/or Scala), Delta Lake, and SQL.
. Proven track record designing multi cloud Lakehouse architectures (Azure, AWS, or GCP).
. Strong experience with Unity Catalog for data governance, access control, and lineage tracking.
. Demonstrated ability to lead client facing engagements and communicate complex technical concepts to executive audiences.
. Experience in a consulting or professional services environment, with a history of managing multiple concurrent engagements.
. Bachelor's degree in Computer Science, Engineering, Data Science, or a related field (or equivalent practical experience).
Preferred Qualifications
. Databricks Certified Data Engineer Professional or Machine Learning Professional certification.
. Experience with Delta Live Tables, Databricks Workflows, and Photon engine optimization.
. Familiarity with complementary tools such as dbt, Terraform/Pulumi (IaC), and CI/CD pipelines for data platforms.
. Hands on experience with MLflow, Feature Store, and Model Serving in production environments.
. Prior experience as a Databricks partner or in a Databricks aligned practice within a consulting firm.
. Advanced degree (M.S. or Ph.D.) in a quantitative or technical discipline.
#DICE
Other Information:
CGI is required by law in some jurisdictions to include a reasonable estimate of the compensation range for this role. The determination of this range includes various factors not limited to skill set, level, experience, relevant training, and licensure and certifications. To support the ability to reward for merit based performance, CGI typically does not hire individuals at or near the top of the range for their role. Compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range for this role in the U.S. is $143,500.00 $175,400.00.
CGI's benefits are offered to eligible professionals on their first day of employment to include:
. Competitive compensation
. Comprehensive insurance options
. Matching contributions through the 401(k) plan and the share purchase plan
. Paid time off for vacation, holidays, and sick time
. Paid parental leave
.Learning opportunities and tuition assistance
. Wellness and Well being programs
Your future duties and responsibilities
Required qualifications to be successful in this role
Together, as owners, let’s turn meaningful insights into action.
Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…
You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.
Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.
You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
Come join our team - one of the largest IT and business consulting services firms in the world.
Qualified applicants will receive consideration for employment without regard to their race, ethnicity, ancestry, color, sex, religion, creed, age, national origin, citizenship status, disability, pregnancy, medical condition, military and veteran status, marital status, sexual orientation or perceived sexual orientation, gender, gender identity, and gender expression, familial status or responsibilities, reproductive health decisions, political affiliation, genetic information, height, weight, or any other legally protected status or characteristics to the extent required by applicable federal, state, and/or local laws where we do business.
CGI provides reasonable accommodations to qualified individuals with disabilities. If you need an accommodation to apply for a job in the U.S., please email the CGI U.S. Employment Compliance mailbox at US_Employment_Compliance@cgi.com . You will need to reference the Position ID of the position in which you are interested. Your message will be routed to the appropriate recruiter who will assist you. Please note, this email address is only to be used for those individuals who need an accommodation to apply for a job. Emails for any other reason or those that do not include a Position ID will not be returned.
We make it easy to translate military experience and skills! Click here (https://cgi-veterans.jobs/) to be directed to our site that is dedicated to veterans and transitioning service members.
All CGI offers of employment in the U.S. are contingent upon the ability to successfully complete a background investigation. Background investigation components can vary dependent upon specific assignment and/or level of US government security clearance held. Dependent upon role and/or federal government security clearance requirements, and in accordance with applicable laws, some background investigations may include a credit check. CGI will consider for employment qualified applicants with arrests and conviction records in accordance with all local regulations and ordinances.
CGI will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with CGI’s legal duty to furnish information.