PayPay is hiring an Automation QA Engineer. You must have 5+ years of experience in test automation and proficiency in Appium, Selenium, or Rest-Assured. Experience with AI tools and LLM validation is highly valued. Join us in a hybrid role to ensure high-quality product
Be the first to hear about new roles at PayPay
Follow this company and we'll notify you as soon as new roles are posted.
PayPay is a FinTech company that has grown to over 70M (as of July 2025) users since its launch in 2018. Our team is hugely diverse with members from over 50 different countries.
OUR VISION IS UNLIMITED_
We dare to believe that we do not need a clear vision to create a future beyond our imagination. PayPay will always stay true to our roots and realize a vision (future) that no one else can imagine by constantly taking risks and challenging ourselves. With this mindset, you will be presented with new and exciting opportunities on a daily basis and have the opportunity to grow and reach new dimensions that you could never have imagined. We are looking for people who can embrace this challenge, refresh the product at breakneck speed and promote PayPay with professionalism and passion.
※ Please note that you cannot apply or be selected in parallel with PayPay Corporation, PayPay Card Corporation and PayPay Securities Corporation.
Team Missions
Serving as an autonomous QA organization in Product Group.
To improve the overall quality of PayPay products and services
To develop PayPay quality standards and best practices
To gain trust in quality from PayPay Users and Merchants
Job Description
Main Responsibilities
Analyze testing requirements to develop comprehensive test scenarios for various test levels.
Design and create detailed test cases that validate conformance to functional and non-functional requirements.
Prepare and manage essential test data, tools, and environments for test execution.
Execute test cases and scripts, meticulously documenting results.
Log, track, and verify defects, ensuring accurate documentation and timely resolution.
Collect, organize, and analyze test results to provide thorough reports on all QA activities.
Analyze testing outcomes and recommend effective solutions for identified issues.
Maintain and update comprehensive test documentation, ensuring coverage for new features and robust regression testing.
Support knowledge management and foster collaboration by actively participating in testing discussions and contributing to continuous improvement through lessons learned.
Act as a Subject Matter Expert (SME) for designated modules, providing critical domain knowledge and support to the QA team.
Provide guidance and support to junior QA engineers, including onboarding and training.
Leverage AI tools such as NotebookLM, Gemini, Cursor AI, GitHub Copilot, and OpenAI APIs to accelerate test case design, automation, and exploratory testing.
Apply prompt engineering and RAG (Retrieval-Augmented Generation) techniques to validate LLM-driven applications, ensuring accuracy, reliability, and robustness.
Work with OpenAI keys, LLM models, and MCP server integrations, automating API-based interactions and securing AI workflows.
Test and monitor AI/ML systems for issues such as bias, drift, hallucinations, and performance deviations.
Qualifications
Minimum 5+ years of experience in developing, executing, and maintaining automated test cases for mobile applications, web applications, and/or APIs.
Proven professional experience with at least one of the following automation frameworks/tools: Appium (for mobile), Selenium (for web), or Rest-Assured (for APIs).
Proficient in utilizing Cucumber for defining and executing test cases.
Well-versed in Continuous Integration/Continuous Deployment (CI/CD) tools such as Jenkins, Bitrise, or similar platforms.
Basic understanding of microservices architecture and its associated testing challenges.
Strong ability to analyze technical requirements, design comprehensive test strategies, and create detailed, effective test cases.
Exceptional analytical and problem-solving skills, coupled with a meticulous attention to detail.
Excellent communication skills, a team-oriented mindset, and the ability to work effectively both independently and collaboratively.
Hands-on experience with AI productivity tools (NotebookLM, Gemini, Cursor AI, GitHub Copilot).
Knowledge of OpenAI API usage, key management, embeddings, and LLM integration workflows.
Familiarity with MCP server concepts and their integration in test automation pipelines.
Understanding of AI system validation techniques, including testing for bias, hallucinations, drift, and robustness.
Preferred Qualifications
ISTQB or an equivalent QA certification.
Experience working in Agile or other fast-paced development environments.
Familiarity with the financial or payments domain is highly desirable.
Experience in proposing and standardizing QA processes, with a proven ability to collaborate effectively with cross-functional teams.
Experience in designing and executing performance tests using tools such as Gatling, wrk, or JMeter.
Familiarity with Docker and Kubernetes for containerization and orchestration.
Experience with bash or other command-line interface (CLI) scripting.
Coding experience in building web or mobile-based applications.
A strong sense of curiosity and a passion for continuously learning new technologies are definite plusses!
In principle, 9:00am-5:45pm (actual working hours: 7h45m + 1h break)
Holidays
Every Sat/Sun/National holidays (In Japan)/New Year's break/Company-designated Special days
Paid leave
Annual leave (up to 14 days in the first year, granted proportionally according to the month of employment. Can be used from the date of hire)
Personal leave (5 days each year, granted proportionally according to the month of employment)
＊PayPay's own special paid leave system, which can be used to attend to illnesses, injuries, hospital visits, etc., of the employee, family members, pets, etc.
Salary
Annual salary paid in 12 installments (monthly)
Based on skills, experience, and abilities
Reviewed once a year
Late overtime allowance
※Payroll payment can be changed to digital salary payment “PayPay Paycheck” for an amount set by you
Benefits
Social Insurance (health insurance, employee pension, employment insurance and compensation insurance)
