A US based, global financial banking client, embarked on a transformation journey with the objective of moving from siloed applications and processes to a single UI/application covering the regulatory and compliance needs of 90+ countries, supporting multiple LOBs and16 client types.
The client’s Know Your Customer (KYC) application holds details of thousands of customers across 90+ countries including their native rules and laws for 16 client types. A Metadata driven automation framework was developed to test KYC functionalities for all the combinations and ensure high quality testing coverage during functional and regression testing. The framework needed to be flexible so that it could be utilized across development integration, system integration and user acceptance test environments. RPA bots were integrated with Selenium to perform PDF vs UI forms report validation.
Key challenges
- Varied compliance checks for around 1.7 million records of different regions and countries, making it highly challenging to achieve required test coverage. Language translations and localization requirements added to the complexity.
- High complexity of product and test data management to ensure coverage of around 1.7 million records. Added complexity of regulatory changes, involving risk-based sanctioning of countries.
- Manual validation of all combinations and changes to ensure UI and PDF were in sync for all client types, countries, rules. This included the parent and corresponding triggered child questions. This was an enormous effort across all sections and could not be completed within the release timelines.
Ready to experience?
TALK TO EXPERTS
The Solution
Implementing Quality Engineering (QE) levers using Extreme Automation and RPA bots
This testing transformation journey was built on the following QE levers:
- Validation of Metadata/configuration to ensure coverage for all regions and countries
- Usage of scientific free-to-use tools like Advanced Combinatorial Testing System (ACTS) to optimize the coverage of various parameters
- Extreme automation using Selenium, with parallel and repeatable execution to achieve more coverage in shorter timeframe
- Build test data manufacturing tools to cater to all possible combinations of test data requirements
- RPA based solution for validating point-in-time information from PDF documents
Highly scalable extreme automation and PDF validation
- Increased execution productivity to 30+ concurrent threads, in single, hub or multiple node combinations. This enabled execution of 200 end-to-end test cases per day.
- Integrated with existing data mining tools to fetch test data for 1000 test cases
- 500+ application defects logged through automation alone which were not identified by functional validation
- UI vs PDF validation approach: Selenium was first used to store UI contents to database and generate PDF. Then RPA solution was used to extract and generate PDF contents to database. Later, both the data elements were validated.
Benefits
Modular framework capable of supporting 1.7 million combinations of test cases resulting in 15% savings in testing effort
68% increase in test preparation coverage, 94% increase in test execution throughput
Around 87% effort saved in PDF validation, through RPA automation
