Senior System Test Engineer

Join us as we pursue our disruptive new vision to make machine data accessible, usable and valuable to everyone. We are a company filled with people who are passionate about our product and seek to deliver the best experience for our customers. At Splunk, we’re committed to our work, customers, having fun and most importantly to each other’s success. Learn more about Splunk careers and how you can become a part of our journey!


As a System Test Engineer, you will be working on Splunk product system tests, especially on GDI area. GDI is Getting Data In and it’s the most important foundation layer of Splunk to do the data analysis work. The tests you will conduct include but not limited to Large-Scale end to end user scenarios test, kinds of non-functional *-ability test like stability test (aka. Fault injection/chaos test), upgrade/migration test, reliability test, scalability test and etc. You will also need to develop and maintain related tools and test framework.

You will work in a dynamic team of architects and System Engineers with the responsibility to ensure that we deliver high-quality solutions to meet the business needs of Splunk customers. Working experience in the native cloud software delivery environment is a huge plus.

Responsibilities: I can do that!

  • Define, execute and automate large scale and *-ability system level testing on GDI area of Splunk on-prem and cloud products
  • Read and understand PRD, ERD to make sure we have enough coverage
  • Demonstrate test experience in the following areas on a distributed system:
    • Upgrade and migration
    • Interoperability
    • Stability
    • Reliability
    • Scalability
  • Documents systems-level defects, using Jira tracking system, and reports defects to developers. Inspect and pinpoint the issue, and help to resolve the issue
  • Identifies, analyzes, troubleshoots, and documents problems with program function, output, or content.
  • Develops testing programs that assess effectiveness of a new system or modification of an existing system.
  • Demonstrates knowledge in automation frameworks in a test environment. Additionally, the job involves testing in a lab environment, designing and implementing test setups and automation.


  • Experience in developing test plans/strategies and collaborate with cross teams to define measurement for quality, assess risk and mitigation plan.
  • Strong debugging and technical problem-solving skills, as well as a passion to seek hard, ambiguous problems.
  • Experience in any of or multiple programming languages: Python, JavaScript, Java, C++ or similar
  • Experience in working on distributed systems and micro-service applications
  • Skilled in test automation and CI/CD
  • Good at Linux system knowledge and multiple OS administration skills.
  • Comfortable with Linux, Kubernetes, Promethus, AWS, GCP, GIT, Artifactory in terms of both tools and systems administration
  • Knowledge on Kafka, Flink, Hadoop, MapReduce, Spark is a plus
  • Previous experience in design and implementation of solutions to evaluate and improve performance: availability, reliability, interoperability, scalability of SaaS / Cloud Native / Bigdata Platform and application with microservice architecture
  • Detail-oriented and well organized
  • Excellent communication and team collaboration across sites are a must

Minimum qualifications

  • BS or master’s degree in computer science or related Engineering field or equivalent practical experience.
  • 8 years of experience in engineering with at least 3 years in software development in test
  • Experience with Python/Java/C/C++ and Test Automation.

We value diversity at our company. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or any other applicable legally protected characteristics in the location in which the candidate is applying.

For job positions in San Francisco, CA, and other locations where required, we will consider for employment qualified applicants with arrest and conviction records.

Splunk's Hiring Practices
Splunk turns machine data into answers. Organizations use market-leading Splunk solutions with machine learning to solve their toughest IT, Internet of Things and security challenges.

Individuals seeking employment at Splunk are considered without regards to race, religion, color, national origin, ancestry, sex, gender, gender identity, gender expression, sexual orientation, marital status, age, physical or mental disability or medical condition (except where physical fitness is a valid occupational qualification), genetic information, veteran status, or any other consideration made unlawful by federal, state or local laws. Click here to review the US Department of Labor’s EEO is The Law notice. Please click here to review Splunk’s Affirmative Action Policy Statement.

Splunk also has policies in place to protect the personal information candidates disclose to us as part of the application process. Please click here to review Splunk’s Career Site Privacy Policy.

Splunk does not discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. Please click here to review Splunk’s Pay Transparency Nondiscrimination Provision. 
For job positions in San Francisco, CA, and other locations where required, we will consider for employment qualified applicants with arrest and conviction records.

Splunk is also committed to providing access to all individuals who are seeking information from our website. Any individual using assistive technology (such as a screen reader, Braille reader, etc.) who experiences difficulty accessing information on any part of Splunk’s website should send comments to Please include the nature of the accessibility problem and your e-mail or contact address. If the accessibility problem involves a particular page, the message should include the URL of that page.

Splunk doesn't accept unsolicited agency resumes and won't pay fees to any third-party agency or firm that doesn't have a signed agreement with Splunk.

To check on your application click here.
Find out what makes Splunk such a great place to work
Our Values

Splunkers are encouraged and empowered to be Innovative, Passionate, Disruptive, Open and Fun.
Learn More

Our Locations

From San Francisco to Shanghai, Splunkers work in 25+ offices across the globe.
Learn More

University Recruiting Program

Intern with people you want to hang out with, even outside the office.
Learn More

Our Blog

Hear from Splunkers on the latest.
Learn More

Diversity & Inclusion

Culture of Inclusion: Splunkers Share Their Stories
Learn More


Follow Splunk on LinkedIn for job announcements, company news, and more.
Learn More