Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Activity overview

Panel
titleDescription
Panel
titleTechnical details

This activity attempts to create a fully fledged dynamic test environment for new and existing federated software products to enable quick and easy integration testing.

Panel
titleActivity goals

The aim of the activity is to design such a test environment, identify the necessary technologies and implement a working prototype.

Activity Details

It is currently very hard to test new releases of IdP and SP software against other IdP/SP products. For example, the fix for the latest SATOSA/PySAML security vulnerability turned out to break logins from a number of IdP products, which was not discovered until the patches were tested against real-life IdPs. One solution to this problem would be a dynamic test platform, which could automatically test 'all' combinations of IdPs and SPs.


Panel
titleActivity goals

The aim of the activity is to design such a test environment, identify the necessary technologies and implement a working prototype.

Activity Details

Panel
titleTechnical details

One way to solve this problem is to create an automated test environment. To make this successful a generic platform is needed on which different SP and IdP products can be plugged in. The platform would need to run a CI-like matrix testing (regularly or whenever a new product in added). A number of standard products (SSP, SATOSA, ADFS, etc) would need to be configured for automatic testing, and the platform would need to allow local development teams (for example SSP developers, or local federations which develop their own federation production) to add their own products and versions to the platform.

This activity attempts to design such a test environment. A suitable architecture for an IdP/SP continuous integration platform is to be created. This involves creating use cases and identifying technologies that support them. An iterative approach, in which use cases are successively implemented and products are integrated one after another, is intended to quickly create a functional platform. If the CI approach is successful, ready-to-use software packages can be provided using container technologies such as Docker, to deploy the entire software locally by NRENs or other parties.

...