DEV Community

Discussion on: Do you A/B test improvements?

Collapse
 
maxart2501 profile image
Massimo Artizzu

We don't do A/B tests because we're a company of consultants and clients usually think they're a waste of money. "Just give us the best that you can".

Any attempt to bring in the argument is usually perceived as: "Wait, so you don't have a clear idea of what to do? We thought you were professionals." 🤷‍♂️

A/B tests could possibly be considered if the client disagrees on something, but in the end, they pay so we have to comply even if it sounds dumb.
On the lines of:
"If you're still unconvinced, we could make both versions and see what's better for the users."
"Free of charge, I presume?"
"Uh..."

Finally, also because clients usually call us to replace an awfully outdated software, so it's fairly easy to do better.