The text highlights advancements in AI-driven testing tools like Wiremark GUI, Thunders MCP, and frameworks for secure messaging apps, alongside challenges in adopting AI for non-deterministic systems and integrating it into workflows. It underscores growing interest in AI for testing, with 88% of teams prioritizing it, yet only 12.6% implementing it effectively, citing concerns over accuracy and stability.

Test Guild News Show

Test Guild News Show hosted by Joe Colantonio has a round up of Software Testing Tool news and updates. Released as audio and video. Show notes have links to source of each news update.

• https://testguild.com/podcasts/news/
• https://www.youtube.com/playlist?list=PL9AgRtJkydU1WSjOuUkOeRFTDN5dPyL6u

Episode Details

• Show Notes: https://app.testguild.com/podcast/n181-feb22/
• Published: 2026-02-23T22:25:00Z
• Duration: 10:00
• Author: Unknown

Overview

The podcast discusses recent advancements in software testing, with a focus on AI integration. Topics include the expansion of the Test Guild to host in-person events centered around AI in testing, the introduction of a new Wiremark GUI that allows for visual management of test stubs, and the use of the Playwright automation framework for testing secure messaging applications. The conversation also touches on the Thunders’ MCP protocol, which enables test creation using natural language, and the challenges of testing AI systems, including the use of Eliass framework for evaluating non-deterministic AI behaviors. Additionally, research from Leapwork on AI adoption in testing is highlighted.

A key theme throughout the podcast is the growing emphasis on automation in testing processes. The discussion underscores the importance of integrating AI tools effectively to improve testing efficiency and accuracy. At the same time, the complexity of testing AI-driven systems remains a significant challenge, prompting ongoing research and development to address these issues. The podcast highlights various tools and frameworks that are shaping the future of software testing in the context of AI.

What If

• What if you adopt Thunders MCP to automate test authoring using natural language?

  • Move: Integrate Thunders MCP with your preferred AI assistant (e.g., ChatGPT Desktop) to convert design documents or requirements into test cases and execute them via CLI.
  • Why now: The tool reduces context-switching and manual test creation, aligning with Leapworks finding that 88% of teams prioritize AI. Its simple to set up with server URL and OAuth.
  • Expected upside: Cut test authoring time by 40% and improve test coverage by aligning test cases directly with documentation.

• What if you replace manual JSON configuration in Wiremark with its new GUI?

  • Move: Migrate your Wiremark stub setup to the GUI for creating/editing mappings, logging requests, and managing multi-server configurations.
  • Why now: The tool eliminates manual JSON editing, addressing the webinars focus on reducing maintenance overhead in UI test frameworks.
  • Expected upside: Reduce setup/bug-fixing time by 50% and lower errors caused by human input in JSON files.

• What if you prototype Eliass AI testing framework for your AI-powered features?

  • Move: Use DeepEvalve and MLflow to define metrics for your AI app (e.g., hallucination detection) and run side-by-side comparisons across model versions.
  • Why now: The article highlights that 65% of teams are in AI testing exploration, but only 12.6% integrate it. Eliass framework provides concrete tools to address non-deterministic testing gaps.
  • Expected upside: Identify hidden model failures (hallucinations, eval errors) and build robustness into your AI systems before deployment.

Takeaway

• Adopt Wiremark GUI to streamline API stub management
  Use the newly released Wiremark GUI to edit stub mappings, log requests, and manage multi-server configurations visually, eliminating the need for manual JSON file editing and reducing setup overhead.

• Implement Playwright automation for secure messaging apps
  Develop a Playwright testing framework for secure messaging applications (e.g., SalaX) to validate real-time messaging, offline delivery, and encryption behavior, prioritizing edge cases like video/audio calls where testing is minimal.

• Integrate Thunders MCP for natural language test authoring
  Set up Thunders MCP to connect AI assistants (e.g., ChatGPT) to your testing environment, enabling test creation, execution, and analysis via natural language to reduce context-switching and manual test scripting.

• Utilize Enthropics Live App Preview for faster debugging
  Leverage Enthropics Live App Preview feature to inspect application UI states directly within your coding environment, avoiding the need to switch to browsers or emulators during development and testing.

• Deploy Eliass AI testing framework with DeepEvalve and MLflow
  Adopt Eliass framework to evaluate non-deterministic AI systems by tracking model outputs with DeepEvalve and MLflow, starting with small evaluations and defining clear metrics to identify hallucinations and test assertion errors.