Update the Magento Functional Testing Framework

Both Magento 2.2 and 2.3 supports MFTF 2.5.3 (Find your version of the MFTF).

Tests and the Framework itself are stored in different repositories.

  • Tests are stored in Module’s directory.
  • MFTF is installed separately (usually as a Composer dependency)

To understand different types of update - please follow the Versioning page.

Patch version update

Takes place when third digit of version number changes.

  1. Make sure that Security settings are set appropriately.
  2. Get latest Framework version with composer update magento/magento2-functional-testing-framework --with-dependencies
  3. Generate updated tests with vendor/bin/mftf generate:tests

Minor version update

Takes place when second digit of version number changes.

  1. Check details about backward incompatible changes in the Changelog and update your new or customized tests.
  2. Perform all the actions provided for Patch Version Update
  3. When updating from versions below 2.5.0, verify WYSIWYG settings
  4. You may need to run the upgrade:tests using vendor/bin/mftf upgrade:tests app

After updating

  1. It is a good idea to regenerate your IDE Schema Definition catalog with vendor/bin/mftf generate:urn-catalog .idea/
  2. Update your tests, including data, metadata and other resoruces. Check if they contain tags that are unsupported in the newer version.
  3. Remove the references to resources (ActionGroups, Sections, Tests) marked as deprecated.
© 2023 Adobe. All rights reserved.