Test Automation Tools That Scale: From Zero to 1.6M Users with Sanjay Kumar
Categories: Podcasts , Test Guild
Testers and leaders can benefit from community-driven development and collaboration, as seen in the case of Sanjay Kumar and Selectors Hub, which has created a suite of tools relied upon by over 1.69 million testers.
By focusing on community needs and user feedback, Sanjay has been able to create tools that solve real-world problems and foster a loyal user base, proving that community collaboration can be a more effective approach than relying on venture capital.
Test Guild
Test Guild - hosted by Joe Colantonio has main topic focus on Testing or Automating. Each episode has a different guest. Show notes have comprehensive links and usually a full transcript. Released as audio and video.
- https://testguild.com/
- https://testguild.com/podcasts/automation/
- https://www.youtube.com/playlist?list=PL9AgRtJkydU1jqvx46esyr56BXtm1QEds
- https://www.youtube.com/@JoeColantonio
Episode Details
- Show Notes: https://testtalks.libsyn.com/test-automation-tools-that-scale-from-zero-to-16m-users-with-sanjay-kumar
- Published: 2026-03-03T21:42:00Z
- Duration: 29:51
- Author: Unknown
Overview
The podcast highlights a community-driven approach to developing testing tools, emphasizing collaboration with testers rather than relying on venture capital. It details the evolution of Selectors Hub, a tool initially designed to address gaps in learning XPath and selectors, which has since expanded into a broader ecosystem of utilities shaped by user feedback. Other tools, such as Test Case Studio and Check My Links, are discussed as examples of solutions that enhance productivity and efficiency in testing workflows. The conversation underscores the importance of creating tools that directly address real-world challenges faced by testers, prioritizing practicality and usability over speculative features.
The role of AI in testing is explored as a complementary force that accelerates workflows without replacing the need for skilled testers. The philosophy centers on solving tangible problems through iterative development guided by user input, ensuring tools remain relevant and effective. The discussion also addresses the sustainability of a business model focused on meeting user needs rather than fundraising, with tools developed internally and continuously refined based on community feedback. This approach highlights a commitment to fostering innovation through collaboration, ensuring solutions are both functional and aligned with the evolving demands of the testing community.
What If
-
What if you integrated AI-generated test data into your core tool to reduce manual effort?
- Concrete move: Develop a feature in your core tool that auto-generates realistic test data using pre-trained AI models.
- Why now: The text emphasizes AI’s role in accelerating workflows (e.g., Auto Data Filler, AI Post Creator) while noting testers still need efficient tools. This aligns with community demand for faster, more scalable solutions.
- Expected upside: Reduce user reliance on manual data entry, increase tool adoption among teams, and position your tool as a complementary AI enabler rather than a replacement.
-
What if you launched a community-powered feature request platform for your tools?
- Concrete move: Build a lightweight platform where users can submit, vote on, and comment on feature ideas for your tools (e.g., Test Case Studio, Selector Sub).
- Why now: The text highlights community feedback as the backbone of Selector Subs growth, with users actively suggesting features (e.g., Playwright locators, iframe support). This would formalize that process.
- Expected upside: Prioritize high-impact features, foster deeper user engagement, and reduce the risk of developing features that dont solve real problems.
-
What if you introduced a freemium model for your tools with a pro version focused on enterprise use cases?
- Concrete move: Offer a free tier with core features (e.g., Check My Links, Auto Data Filler) and a paid pro tier with advanced analytics, integrations, and support for enterprise workflows.
- Why now: Selector Subs monetization strategy includes pro versions (e.g., “Slactor Sub Pro”) and sponsorships. This mirrors the texts emphasis on solving user problems while building sustainable revenue.
- Expected upside: Generate recurring revenue streams without compromising free users, attract enterprise clients, and scale development efforts with targeted funding.
Takeaway
- Prioritize community feedback to guide tool development: Actively gather and implement user-reported problems and feature requests (e.g., via meetups, webinars, or forums) to build tools that solve real testing challenges, ensuring relevance and organic growth.
- Avoid venture capital to maintain product control and focus on long-term value: Build your software business using bootstrapped funding or community support (e.g., sponsorships, Pro versions) to avoid diluting your vision with external pressures.
- Offer free, accessible tools with optional premium features: Provide core tools for free to attract users, then monetize via Pro versions (e.g., advanced features for enterprises) or sponsorships, ensuring wide adoption and scalability.
- Leverage AI to enhance productivity, not replace skills: Integrate AI-driven features (e.g., auto-generated test data, smart editors) to streamline workflows, but ensure tools still require and reinforce manual testing expertise (e.g., XPath learning).
- Grow through problem-solving and word-of-mouth: Focus on creating tools that solve specific pain points (e.g., broken link detection, form auto-filling) and rely on user reviews and community advocacy for organic traction, avoiding paid advertising.
For a PDF of longer Software Testing Podcast Episode Summaries with Briefing Notes and more detailed summary notes, visit EvilTester Patreon Podcast Summaries.