In a nutshell:
- We built a web app and had to do lots of repeated manual testing after each push.
- Coding up tests early on just isn’t worth it, especially with the amount of updates they would need as the UI changes so frequently.
- BUT we have to test...
We built an LLM based tool that lets you write, run, and maintain tests for web applications in natural language. E.g., if you want to test the sign in flow, you would simply type "Sign in with email test@example.com and password Passw0rd" and it would execute it for you plus show you a screen recording.
Curious to hear thoughts here - is manual testing as much of a pain for other teams as it is for us?
You can try it for free here :) we would love to hear any and all questions / feedback!
Top comments (3)
Hello! Welcome to DEV.
Seems like an interesting product!
Thanks! Does this sound like something you would use, or is it more of a nice-to-have?
Not sure... my main concern would it be that how can I be sure that every time I run the tests with AI will I have the same consistency, I mean, generally we would use natural language to do it but in other tools such as Playwright you can be very specific about how do you want your tests to be executed, and I understand that you can even record inputs to do some tests... with AI writing tests would be easier for sure... but if the AI doesn't execute as expected then I would have to review the recorded video to see what happened and that's also time I would have to invest with it... I didn't test that tool, honestly, but it looks interesting. I mean, if you can show to the user that is very consistent while running tests, and you can provide in advance some sort of visual map that will tell the user what each test is going to do, it would generate trust and also will let the user know that they won't be wasting time... also I didn't test it because I needed to create an account to use... it seems very new, and it doesn't generate much trust, so I don't feel very comfortable putting my personal email... and passwords I usually never repeat the same one... but probably many users do, so I would understand those people if they don't create a user because they don't want to share their password.
I know that generally... my feedback seems a bit negative, but I'm giving it not to discourage. I'm giving it to tell you what some users could think about the product and what could stop some of them from using it, and maybe how you could address those problems... I would recommend a more appealing landing page... just yesterday I saw something very interesting about it...
This post
I hope my feedback helps to improve the project, at the end of the day this is just one person's opinion. 😉