DEV Community

Discussion on: Puppeteer vs Selenium

Collapse
 
scriptmunkee profile image
Ken Simeon

It's an interesting implementation of a Keyword/Action driven automated testing framework. I've built similar using Java, Selenium, SauceLab and a few add-on libraries for screenshot comparisons. I could see the pull your platform would have on some QA organizations or Directors of Engineering.

Since you've put your product out here I'm assuming you're cool if I ask questions about your platform.

1) I've reviewed your documentation and what I didn't see was how your test framework handles executing the same tests against different environments or URLs. Current software dev shops have multiple environments that they want to run their automated test against (Dev, QA, Stage, ect). How is this handled in your platform using variables?

2) It would be nice to see a demo of how you can have 1 test or suite execute against against multiple browsers without having to duplicate tests for each browser.

3) Do you have any comprehensive examples of your structured results reporting? Your documentation is lacking in this area and as we all know, upper management folks like pretty pictures. ;-)

4) Does your platform offer a way to call external APIs or programs? When I build my automation for a GUI, I like to pre-populate my tests with data before the UI executions and validations without having to drive the UI all the time. Is this possible?

5) When you integrate your platform with Jenkins, Github or others, are the test results pushed back to the calling platform?

6) With your platform retaining all of test actions, video recordings, screenshots and basically the keys to a software teams kingdom with your constant analyzing the sites/apps, what is your security model to protect your customers data?

Thanks for letting me prob into your platform.

Cheers!
Ken

Collapse
 
razgandeanu profile image
Klaus

Hi Ken,

I really appreciate the fact that you tried Endtest.

My opinion is that you could have obtained some of those answers simply by digging more into the platform.

But here are the answers:

  1. You can easily run tests on different environments (Dev, QA, Stage, etc) with Endtest.
    Those environments are obviously going to have different URLs, different usernames, different passwords, etc.
    You can use the "Set Variable" action to create or generate different sets of variables and you can use IF Statements to see which environment you're on and to use the corresponding usernames and passwords.
    You can even define variables directly in the API call for starting a test execution, which makes it even easier.
    There are multiple ways in which you can handle different environments, it depends on what works best for you.

  2. You can run the same test suite on any operating system, browser or mobile device.
    All you have to do is select the desired configuration in the "Run Test Suite" modal or in the API call.
    You don't have to duplicate or modify a test suite in order to run it on different configurations.

  3. You can export the test results directly from the Results page. In that XLSX report, you have all the numbers, all the details, everything that can be extracted from a test execution.
    Since it's in XLSX format, you can easily create your own reports in Microsoft Excel by simply selecting the relevant columns.

  4. Yes, you can use the "Execute JavaScript" step to call any API you want or you can use the "Connect to Database" and "Execute SQL Query" actions to write that data directly in your database.

  5. Absolutely, the integration with services like Jenkins and Github is done through webhooks, you just add the API calls for starting a test execution and fetching the results in the Webhooks sections from those services.
    Additionally, Endtest provides it's own Webhook functionality, this allows you to automatically send the results to a URL after each test execution.

  6. All the traffic on the Endtest platform is encrypted.
    The test data from the execution machines is deleted right after the test is finished.
    The Machine Learning functionality from Endtest does not constantly analyse the sites and the apps, it only analyses them while the tests are being executed.
    There are multiple Security Standards that are being followed, including the famous ISO/IEC 27001.

Collapse
 
scriptmunkee profile image
Ken Simeon

Klaus,

Thanks for the quick response. It was very helpful.