Test Matrixes

February 25, 2022 Engineering

  • When working on complex systems, there are often more than one test parameter that changes. For example when working on a component for your design system, you need to test across all these different parameters:
    • Responsive Breakpoints
    • Dark/Light Mode
    • Accesibility options (screen reader, mouse-only, keyboard-only)
    • Different browser versions
  • A good abstraction to help cope with this increasing complexity is by thinking of combinational matrixes.
    • In code, this can be multi dimensional arrays or nested loops. Jest even has a feature for it.
    • In PR descriptions, it's helpful to draw a table to make sure you test all possible combinations throghoutly.
  • Increasing the dimensions can make a full test run very costly though, so you can’t just blindly add more.
  • A very common pattern where this is userful is for manual pull request descriptions where you want to provide proof that you have exhaustively tested a new feature. A two-dimensional table might be used to show screenshots of e.g. different browsers and different responsive breakpoints.

Other Notes

Engineering/Front-End/Modern Front-End Problems
November 3, 2022
February 27, 2022
February 25, 2022
Engineering/Test Matrixes
February 25, 2022
Engineering/Front-End/React’s Escape Hatch
February 21, 2022

About the author

Philipp Spiess
Philipp Spiess [ˈʃpiːs]

Engineer at Sourcegraph. Prev: Front End Engineer at Meta, curator of This Week in React, React DOM team member, and Lead Engineer at PSPDFKit. Loves fixing Web things.