Senior Principal Engineer (Multi-tenant cloud & Microservices)

Are you interested in building large scale performant and reliable multi-tenant services? Do you feel challenged when traditional transport protocols fall short on handling this kind of data?

The Data Edge group at Splunk is looking for a Senior Principal Engineer to join our efforts to define and build the future of Splunk. You will work on our Data Ingestion Platform to provide our customers seamless data onboarding and to enable ever deeper customer insights.

We build high throughput, reliable and secured products and services to collect data from cloud service providers, networking and security products, and enterprise products from leading software engineering companies.

We’re a group of friendly, fun-loving and emotionally adept polyglots. We care a lot about work life balance because we believe that it drives creativity and innovation. We also work hard to lift each other up.

As part of this group, you will provide architectural leadership to engineers on designing and building highly scalable APIs that deal with different application/system layers down to network and Kernel levels.

You will also have the opportunity to collaborate with architectural leads in other areas. We actively participate in open source efforts. This will also allow you to influence the open source community.

  • Design and architect large scale multi-tenant services covering all aspects of collection and processing of system, application, network, and OS level events: API gateway, authentication, authorization, security, management, operability, health monitoring, instrumentation, etc.
  • Self-starter to solve sophisticated problems related to high throughputs, latency, and reliability.
  • Assess the current architecture and work with the product leadership to lay out the architectural roadmap for scale, security, and maintainability.
  • Design and implement the optimal test strategy for our services.
  • Automate the diagnosis of performance and scalability issues.
  • Enhance the tooling and generate code to make your own and other people's job easier.
  • Mentor other architects and senior engineers, and constantly raise the bar on engineering practices across the team and engineering organization.
Required Education and Experience:
  • BS in Computer Science or Engineering.
  • 15+ years’ in software engineering.
  • 10+ years’ experience building distributed systems at scale.
  • 5+ years’ experience in DevOps.
  • Experience building large-scale multi-tenant cloud services.
  • Strong Microservices Experience
  • Strong SaaS background
  • Expert level knowledge of systems-level programming and distributed systems. You have deep knowledge of operating systems, networking and network protocols, data streaming, consensus, failure modes, and parallel programming.
  • Demonstrated ability to design simple and clear APIs for sophisticated functionality You have empathy for developers and customers, and expert skills in architecting APIs that allow other specialists to easily build beautiful code.
  • Ability to help other engineers design systems, scope and decompose projects, manage technical debt and risk, promote good engineering practices, and mentoring them.
  • Ability to work with multiple programming languages. We have code written in several programming languages: Go,(Golang) C++, Java, and Python.
Desired Experience:
  • Streaming/analytics platforms e.g. Kafka, Flink, Pulsar.
  • Linux and Windows Operating Systems.
  • Cloud native deployment infrastructure e.g. Kubernetes
  • Building the tooling for CI/CD and data pipelines.
  • Working on open source projects.
  • Popular cloud services.

We value diversity at our company. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or any other applicable legally protected characteristics in the location in which the candidate is applying.

For job positions in San Francisco, CA, and other locations where required, we will consider for employment qualified applicants with arrest and conviction records.

Splunk's Hiring Practices
Splunk turns machine data into answers. Organizations use market-leading Splunk solutions with machine learning to solve their toughest IT, Internet of Things and security challenges.

Individuals seeking employment at Splunk are considered without regards to race, religion, color, national origin, ancestry, sex, gender, gender identity, gender expression, sexual orientation, marital status, age, physical or mental disability or medical condition (except where physical fitness is a valid occupational qualification), genetic information, veteran status, or any other consideration made unlawful by federal, state or local laws. Click here to review the US Department of Labor’s EEO is The Law notice. Please click here to review Splunk’s Affirmative Action Policy Statement.

Splunk also has policies in place to protect the personal information candidates disclose to us as part of the application process. Please click here to review Splunk’s Career Site Privacy Policy.

Splunk does not discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. Please click here to review Splunk’s Pay Transparency Nondiscrimination Provision. 
For job positions in San Francisco, CA, and other locations where required, we will consider for employment qualified applicants with arrest and conviction records.

Splunk is also committed to providing access to all individuals who are seeking information from our website. Any individual using assistive technology (such as a screen reader, Braille reader, etc.) who experiences difficulty accessing information on any part of Splunk’s website should send comments to Please include the nature of the accessibility problem and your e-mail or contact address. If the accessibility problem involves a particular page, the message should include the URL of that page.

Splunk doesn't accept unsolicited agency resumes and won't pay fees to any third-party agency or firm that doesn't have a signed agreement with Splunk.

To check on your application click here.
Find out what makes Splunk such a great place to work
Our Values

Splunkers are encouraged and empowered to be Innovative, Passionate, Disruptive, Open and Fun.
Learn More

Our Locations

From San Francisco to Shanghai, Splunkers work in 25+ offices across the globe.
Learn More

University Recruiting Program

Intern with people you want to hang out with, even outside the office.
Learn More

Our Blog

Hear from Splunkers on the latest.
Learn More

Diversity & Inclusion

Culture of Inclusion: Splunkers Share Their Stories
Learn More


Follow Splunk on LinkedIn for job announcements, company news, and more.
Learn More