Senior Splunk ITSI Engineer

Olympus Solutions, Inc. is seeking a Full-Time, highly motivated Senior Splunk ITSI Engineer to own the service intelligence layer of a federal customer’s Splunk environment. In this hands-on engineering role, you will model mission and IT services in Splunk IT Service Intelligence (ITSI), design the KPIs and thresholds behind service health scores, tune event analytics so operators see real problems instead of noise, and keep a search-heavy ITSI deployment performing. You will serve as the customer’s primary ITSI subject matter expert, working onsite with government and contractor operations staff.

This position is 100% onsite at a government facility in the Maryland / Washington, DC metro area. No remote or hybrid option is available.

An active TS/SCI clearance is required at time of application.

Position Details

• Schedule – Standard business hours, with occasional after-hours support for upgrades and incident response.
• Travel – Minimal.
• Employment – Full-time, exempt.
• Salary Range – $165,000 to $195,000 annually. Placement within the range depends on depth of ITSI experience, Splunk certifications, and overall qualifications.
• Clearance and Eligibility – Active TS/SCI required at time of application. Olympus will not sponsor an initial clearance for this position. U.S. citizenship required.

Duties and Responsibilities

Service Modeling and KPI Design

• Design, build, and maintain ITSI service trees, including service decomposition, entity definition and discovery, dependency mapping, and service templates.
• Develop KPIs and shared KPI base searches, and configure static and adaptive (machine learning) thresholds, time policies, and health score weighting.
• Create and maintain glass tables, deep dives, and service analyzer views for NOC, operations, and executive audiences.

Event Analytics and Data Onboarding

• Build and tune event analytics, including correlation searches, notable event aggregation policies, episode review workflows, and ITSM integration (ServiceNow or equivalent) for ticketing.
• Onboard and normalize data sources feeding ITSI, including Common Information Model (CIM) compliance, entity enrichment, and content pack deployment.

Platform Performance and Administration

• Monitor and tune ITSI performance, including search scheduler load, KPI search concurrency, backfill, and summary index health.
• Administer the underlying Splunk Enterprise or Splunk Cloud platform as needed, including search head and indexer configuration, apps and add-ons, role-based access control, and version upgrades.
• Support the security posture of the environment, including STIG application, audit logging, and change management.

Documentation and Leadership

• Document service models, KPI definitions, runbooks, and standard operating procedures, and brief government stakeholders on service health and monitoring maturity.
• Mentor junior Splunk staff and provide technical direction on monitoring strategy.

Required Qualifications

• Active TS/SCI security clearance. Olympus will not sponsor an initial clearance for this position.
• U.S. citizenship.
• 8+ years of IT operations, systems engineering, or monitoring engineering experience, including 5+ years of hands-on Splunk engineering.
• 2+ years building and operating Splunk ITSI in production, including service modeling, KPI design, and event analytics, not just consuming dashboards built by others.
• Strong Search Processing Language (SPL) skills, including base searches, data model acceleration, and search optimization.
• Linux administration and scripting (Python, Bash) in support of Splunk.
• Experience integrating Splunk with an ITSM platform (ServiceNow preferred).
• Bachelor’s degree in Computer Science, Information Systems, or a related field, or four additional years of relevant experience in lieu of a degree.

Preferred Qualifications

• Splunk ITSI Certified Admin.
• Splunk Enterprise Certified Admin or Splunk Enterprise Certified Architect.
• Experience with Splunk Enterprise Security or Splunk Observability Cloud and how each interoperates with ITSI.
• Experience supporting DoD, Intelligence Community, or federal civilian operations centers.
• Working knowledge of ITIL service management and AIOps concepts.
• Experience running Splunk on AWS GovCloud or Azure Government.
• DoD 8140 baseline certification (Security+ or higher).

Company and Benefits

Olympus Solutions offers a competitive benefits package designed to give employees personal, professional, and financial flexibility. Benefits include:

• Medical, Dental, and Vision – Comprehensive health benefits for employees and their families.
• Work-Life Balance – A paid time off plan and a culture that values balance, accountability, and personal well-being.
• Career Development – Career-building opportunities, professional development, and support for training and certifications.
• Financial Security – A 401(k) plan with a discretionary company match and no waiting period before enrollment.
• Referral Bonuses – Eligibility for referral bonuses for qualified new-hire and business development referrals.

About Olympus Solutions, Inc.

Olympus Solutions, Inc. is a Security Systems Engineering (SSE) company specializing in the design, development, implementation, and operation and maintenance (O&M) of identity systems for enterprise customers with millions of users as well as smaller organizations. With offices in Daytona Beach, FL and Norfolk, VA, Olympus is a Service-Disabled Veteran-Owned Small Business (SDVOSB) serving Federal, Defense, Commercial, and SLED clients. Olympus is a proud recipient of the SBA’s Gold HIRE Vets Medallion Award for four consecutive years (2022–2025).

Our core service areas include:

• Consulting and Technical Advisement – Expert guidance on best practices, Federal compliance, and strategic planning for identity and PKI system designs, upgrades, and implementations.
• System Security Engineering (SSE) – Building secure systems that oversee and safeguard critical infrastructure, with automated controls and emergency procedures built in.
• Design and Implementation – End-to-end design and implementation of ICAM, PKI, and PAM systems, with a focus on Zero Trust identity pillar solutions.
• System Upgrades and Legacy Integration – Upgrading complex enterprise systems, including mainframe-era applications, with no unscheduled downtime.
• Operations, Maintenance, and Sustainment – Continuous optimization of customer systems to improve performance, efficiency, and security posture.

Olympus engineers work across leading identity and security platforms including SailPoint, CyberArk, BeyondTrust, Okta, Oracle IAM, EntraID, Ping Federate, Radiant Logic, KeyFactor, AppViewX, and others. We are committed to delivering measurable outcomes for our customers while investing in the growth, development, and success of our team.

Olympus Solutions, Inc. is a Service-Disabled Veteran-Owned Small Business and an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status.