Lead Databricks Application Architect/Full Stack Developer
Position Description
We are seeking a highly experienced Lead Databricks Application Architect / Full Stack Developer to lead the design, development, and implementation of a new enterprise application built on the Databricks Lakehouse Platform.
This role combines deep expertise in Databricks, data engineering, database architecture, application development, and technical leadership.
The successful candidate will serve as the technical lead for a team responsible for delivering a modern, scalable business application that leverages Databricks as its core data and analytics platform while providing intuitive user experiences through modern front end technologies and robust APIs.
The ideal candidate possesses strong hands on experience across the entire application stack, including Databricks, Spark, data modeling, API development, cloud native architecture, and front end frameworks. This individual will establish technical direction, mentor development team members, and work closely with business stakeholders to translate requirements into scalable, production ready solutions.
This position is located in our Dallas, Texas office with work performed at client site in Dallas, Texas. You will be expected to be onsite 5 days/week.
Key Responsibilities
Application Architecture & Technical Leadership
. Lead the end to end architecture, design, and implementation of a Databricks based enterprise application.
. Define technical strategy, architecture standards, coding practices, and development methodologies for the project team.
. Provide technical leadership for a multidisciplinary team of front end, back end, and data engineers.
. Establish reusable application frameworks, design patterns, and development accelerators.
. Conduct architecture reviews, code reviews, and technical quality assessments.
. Collaborate with business stakeholders, product owners, and executive leadership to define solution roadmaps and priorities.
Databricks & Data Platform Development
. Design and implement scalable Databricks Lakehouse solutions utilizing Delta Lake, Unity Catalog, and medallion architecture patterns.
. Lead development of data pipelines using Databricks, Apache Spark, PySpark, SQL, Delta Live Tables, and Databricks Workflows.
. Design and optimize data models, schemas, and storage structures to support application performance and scalability.
. Define and implement data governance, security, lineage, and access control standards.
. Ensure high performance data processing, query optimization, and operational scalability.
Back End Application Development
. Architect and develop RESTful APIs, microservices, and backend application components.
. Design integration patterns connecting Databricks to enterprise applications, third party systems, and cloud services.
. Develop secure, scalable backend services using Python, .NET, Java, or similar technologies.
. Implement authentication, authorization, auditing, and enterprise security controls.
. Design event driven and service oriented architectures where appropriate.
Front End Application Development
. Lead development of modern user facing applications using technologies such as React, Angular, Vue.js, or similar frameworks.
. Design responsive and intuitive user interfaces enabling business users to interact with Databricks powered data and analytics.
. Work closely with UX/UI stakeholders to develop scalable and user friendly application experiences.
. Implement dashboards, workflow management screens, administrative interfaces, and data visualization capabilities.
. Establish front end development standards and component libraries.
Cloud Engineering & DevOps
. Design cloud native architectures leveraging Azure Databricks and related Azure services.
. Establish CI/CD pipelines, automated testing frameworks, and deployment processes.
. Implement Infrastructure as Code using Terraform, Bicep, or similar tools.
. Define monitoring, logging, observability, and production support processes.
. Ensure application reliability, performance, and operational readiness.
Team Leadership & Stakeholder Engagement
. Lead and mentor developers, engineers, and technical contributors.
. Provide technical oversight throughout the software development lifecycle.
. Facilitate technical workshops, solution reviews, and stakeholder presentations.
. Collaborate with project managers and business leaders to manage delivery risks and dependencies.
. Serve as the primary technical point of contact for the application development initiative.
Required Qualifications
. 10+ years of software engineering, application development, data engineering, or solution architecture experience.
. 5+ years of hands on Databricks development experience in enterprise production environments.
. Proven experience leading development teams and delivering large scale enterprise applications.
. Expert level experience with Databricks, Apache Spark, PySpark, SQL, and Delta Lake.
. Strong experience designing and developing modern application architectures.
. Experience developing REST APIs, microservices, and backend services using Python, .NET, Java, or equivalent technologies.
. Experience building front end applications using React, Angular, Vue.js, or similar frameworks.
. Strong understanding of relational and non relational database design, data modeling, and application integration patterns.
. Experience implementing security, authentication, and access controls within enterprise applications.
. Experience with Azure cloud services and Azure Databricks.
. Strong communication skills with the ability to interact effectively with technical and non technical stakeholders.
. Bachelor's degree in Computer Science, Engineering, Information Systems, or related field.
Preferred Qualifications
. Databricks Certified Data Engineer Professional certification.
. Databricks Certified Developer certification.
. Microsoft Azure Solutions Architect Expert certification.
. Experience developing custom applications that leverage Databricks as an operational data platform.
. Experience integrating Databricks with Power BI, Azure AI services, and enterprise applications.
. Experience with MLflow, model serving, and AI/ML enabled applications.
. Experience with Terraform, Azure DevOps, GitHub Actions, or similar DevOps platforms.
. Experience with containerization technologies such as Docker and Kubernetes.
. Experience with event driven architectures leveraging Azure Event Hubs, Service Bus, or Kafka.
. Advanced degree in Computer Science, Engineering, Data Science, or a related field.
Must Have Technical Skills
Databricks & Data Platform
. Databricks
. Delta Lake
. Unity Catalog
. Apache Spark
. PySpark
. SQL
. Delta Live Tables
. Databricks Workflows
Backend Development
. Python (required)
. REST API Development
. Microservices Architecture
. FastAPI, Flask, .NET, Java Spring Boot, or similar frameworks
. Enterprise application integration
Front End Development
. React (preferred) or Angular
. TypeScript
. JavaScript
. HTML/CSS
. Modern UI component frameworks
Cloud & DevOps
. Azure Databricks
. Azure Cloud Services
. CI/CD Pipelines
. Terraform
. GitHub Actions or Azure DevOps
. Docker and Kubernetes
Ideal Candidate Profile
The ideal candidate has successfully led teams building business critical applications on Databricks, rather than solely implementing data platforms. They possess a balanced mix of:
. Databricks architecture expertise
. Full stack application development experience
. Database and data model design skills
. API and integration development expertise
. Front end development leadership
. Cloud architecture knowledge
. Team leadership and mentoring capabilities
They can serve as both the solution architect and technical lead, guiding a team from initial design through production deployment while remaining hands on with development when needed.
#DICE
Other Information:
CGI is required by law in some jurisdictions to include a reasonable estimate of the compensation range for this role. The determination of this range includes various factors not limited to skill set, level, experience, relevant training, and licensure and certifications. To support the ability to reward for merit based performance, CGI typically does not hire individuals at or near the top of the range for their role. Compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range for this role in the U.S. is $100,800.00 $245,500.00.
CGI's benefits are offered to eligible professionals on their first day of employment to include:
. Competitive compensation including profit participation program
. Comprehensive medical, dental, and vision benefits
. Basic life and accidental death & dismemberment insurance
. Matching contributions through 401(k) plan, and CGI share purchase plan
. Flexibility and paid accrued vacation leave, ranging from 10 to 20 days per year, based on job level, years of relevant prior experience, and years of service
. 10 paid holidays per year
. At least 80 consecutive hours of paid sick/safe leave (except where applicable state/local law requires more)
. Paid parental leave, ranging from 20 to 70 consecutive business days based on circumstances of leave and applicable laws
. Bereavement leave, ranging from 1 to 7 days per year based on relationship.
. Paid jury duty leave, up to time summoned
. Learning opportunities and tuition assistance
. Wellness and Well being programs
For more detailed information about our benefits offerings visit Benefits | CGI Careers
Please note that the benefits listed above are subject to change based on the specific terms and conditions of the contract being supported.
Your future duties and responsibilities
Required qualifications to be successful in this role
Together, as owners, let’s turn meaningful insights into action.
Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…
You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.
Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.
You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
Come join our team - one of the largest IT and business consulting services firms in the world.
Qualified applicants will receive consideration for employment without regard to their race, ethnicity, ancestry, color, sex, religion, creed, age, national origin, citizenship status, disability, pregnancy, medical condition, military and veteran status, marital status, sexual orientation or perceived sexual orientation, gender, gender identity, and gender expression, familial status or responsibilities, reproductive health decisions, political affiliation, genetic information, height, weight, or any other legally protected status or characteristics to the extent required by applicable federal, state, and/or local laws where we do business.
CGI provides reasonable accommodations to qualified individuals with disabilities. If you need an accommodation to apply for a job in the U.S., please email the CGI U.S. Employment Compliance mailbox at US_Employment_Compliance@cgi.com . You will need to reference the Position ID of the position in which you are interested. Your message will be routed to the appropriate recruiter who will assist you. Please note, this email address is only to be used for those individuals who need an accommodation to apply for a job. Emails for any other reason or those that do not include a Position ID will not be returned.
We make it easy to translate military experience and skills! Click here (https://cgi-veterans.jobs/) to be directed to our site that is dedicated to veterans and transitioning service members.
All CGI offers of employment in the U.S. are contingent upon the ability to successfully complete a background investigation. Background investigation components can vary dependent upon specific assignment and/or level of US government security clearance held. Dependent upon role and/or federal government security clearance requirements, and in accordance with applicable laws, some background investigations may include a credit check. CGI will consider for employment qualified applicants with arrests and conviction records in accordance with all local regulations and ordinances.
CGI will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with CGI’s legal duty to furnish information.