TestGrid 0.9.0-m18

We are pleased to announce the release of TestGrid Milestone 18

TestGrid provides enterprise customers with the confidence that the products and fixes they get from WSO2 are tested against all product scenarios against a wide-array of infrastructures and deployments, hence is production-ready.

Here’s what really happens in TestGrid:

• Provision an infrastructure on AWS and other infrastructure providers via Infrastructure as Code (IAC) scripts. We use the IAC scripts provided by WSO2 for this purpose.

• Do WSO2 product deployments on top the provisioned infrastructure. We do that by running Configuration -Management scripts (Puppet/Ansible) provided for WSO2 products.

• Run Jmeter/Selenium/TestNG scenarios against the deployment to certify the created deployment pattern against the given infrastructure combination.

• In the end, Testgrid generates report that shows the outcome of the scenario tests. All is good if it is green; start worrying if it is red! :)

With this release, we provide the following,

• Add product testing on MariaDB, PostgreSQL, SQL Server and Oracle database types with AWS infrastructure
• Introduced new testgrid statuses with icons
• Introduced a new command to finalize the statuses of testplans with errors
• Increased availability of AWS resource space by avoiding snapshots creation on infrastructure deletion
• Simplified test case failure message in final report and TestGrid Dashboard
• Re-structure TestGrid product job directory.
• Bug fixes

List of resolved features and issues can be tracked at :
https://github.com/wso2/testgrid/milestone/19

TestGrid has been tested against following infrastructures:

• Cloud Provider: AWS and K8S-on-Openstack
• Spawn instances with AMI images in any AWS region
• Any database type AWS RDS supports (MySQL, MariaDB, PostgreSQL, SQL Server and Oracle)

Known Issues: https://github.com/wso2/testgrid/issues