Archived listing. The details below describe a past opening.
Required Skills & Experience
- Ability to obtain a DHS EOD security clearance
- 7+ years of hands-on experience architecting, designing, data engineering with Databricks and AWS in a government setting
- Previous technical lead experience
- Extensive experience supporting Databricks implementations at DHS agencies (e.g., CBP, USCIS, FEMA, ICE, USCG)
- Experience with Unity Catalog and MLFlow within Databricks
- Experience with agentic AI tools such as Databricks' Genie and Agent Bricks
- Experience integrating Databricks with other analytics platforms
- Strong understanding and experience in areas such as Apache Spark, Lakebase, Lakehouse architectures, Delta Lake, Delta Sharing, Medallion Architecture, Data & AI Governance, and use case acceleration
- Working knowledge of both AWS and Azure ecosystems with demonstrated hands-on experience with cloud native data and ETL capabilities (S3, Lambdas, Glue, etc.)
- Demonstrated experience leveraging data to provide search, enrichment, correlation, AI/ML Model Training, in alignment with government mission and business use cases
- Prior consulting or customer-facing experience in data architecture or modernization initiatives.
- Strong Python skills
- Experience in Agile environments and managing cross-functional technical delivery
- Experience supporting federal customers and federal platforms (e.g., knowledge of GovCloud, FISMA, etc.)
- Familiarity with CI/CD
- At least one Databricks certification (Associate or Professional Data Engineer certifications preferred)
Nice to Have Skills & Experience
- Prior experience supporting DHS
- Experience with the DHS System Engineering Lifecycle (SELC)
- Familiarity with the concepts of a data mesh
- AWS Solutions Architect Associate or Solutions Architect Professional Certification
- Azure Associate certifications (AZ-204, DP-203)
- Familiarity with Databricks Apps
- Experience building reference architectures, playbooks, or platform documentation
- Experience with metadata platforms (e.g., OpenMetaData, Collibra) and integrating Databricks with them
- Prior experience as a Databricks Resident Solutions Architect/Forward Deployed Engineer
Job Description
Insight Global is looking to hire a Lead Databricks Solutions Architect sitting remotely to operate as both a strategic leader and a hands-on technical resource, helping guide how Databricks is implemented and expanded across DHS. This includes supporting the design, implementation, and long-term operation of Databricks throughout the environment. This person will work closely with stakeholders during the initial implementation and transition into owning architectural decisions, best practices, and the continued evolution of the platform. Prior experience supporting Databricks implementations at DHS agencies is critical to being successful in this role.
Responsibilities Include:
- Lead the architecture, implementation, and long-term operation of Databricks on AWS in an enterprise environment
- Build and productionize solutions for federal customers using Databricks
- Provide unification for organization and enterprise data capabilities to break down organizational data and operational silos, including mechanisms to standardize and migrate existing data to a unified data plane/warehouse
- Support the integration of Databricks with existing analytics platforms and metadata solutions
- Serve as a technical advisor to stakeholders and help upskill internal teams through guidance/documentation
- Assist and develop customer use case applications of Databricks
- Provide input on onboarding federal customers new to Databricks
Compensation:
$90.21/hr to $96.15/hr.
Exact compensation may vary based on several factors, including skills, experience, and education.
Employees in this role will enjoy a comprehensive benefits package starting on day one of employment, including options for medical, dental, and vision insurance. Eligibility to enroll in the 401(k) retirement plan begins after 90 days of employment. Additionally, employees in this role will have access to paid sick leave and other paid time off benefits as required under the applicable law of the worksite location.