Douglas Onsite Experimentation Team Embeds EchoLogyx QA to scale high quality experimentation

Douglas' Onsite Experimentation Team engaged Echologyx with clear goals in mind

• Provide dependable QA support that integrates seamlessly with their internal Onsite Experimentation team.
• Maintain and improve testing quality across complex A/B Test launches
• Speed up test delivery without compromising accuracy.
• Increase confidence in test launches through detailed validation.

Douglas runs a high-velocity experimentation program with around 150 A/B tests per year. The Onsite Experimentation team faced specific pressures:

‍

• The team’s dedicated QA capacity for A/B tests was limited, which made it harder to quality-check every test variant thoroughly before launch.
• The growing number of experiments required additional QA support to keep pace with the team’s test roadmap and short launch cycles.
• The team needed a QA partner who could integrate closely with its experimentation workflow (Kameleoon setup, variant QA, cross-device checks) without adding overhead or slowing down test launches.

Embedded QA Partnership:

‍

Echologyx integrated directly with Douglas’ Onsite Experimentation team, acting as an extension of their in-house A/B Test QA capability rather than an external vendor. This allowed for deep collaboration and shared ownership of quality outcomes.

‍

Clear Communication & Alignment:

‍

We prioritised structured communication,participating in daily standups, aligning on priorities, and ensuring progress was transparent across the whole Onsite Experimentation Team. This increased visibility into QA status and reduced uncertainty throughout test cycles.

‍

Responsive, High-Quality QA Execution of Experimentation Programme:

‍

Our QA engineers consistently identified issues across common and edge-case scenarios, validating changes meticulously so the Onsite Experimentation Team could launch tests with confidence. Rapid responsiveness, including support across time zones, kept momentum high even when priorities shifted.

‍

Proactive Ownership & Process Improvements:

‍

Beyond testing, Echologyx took ownership of Experimentation QA workflows, independently managing tasks, contributing to improvements of the team's QA process and helping streamline the A/B test delivery process.

‍

• The Douglas’ Onsite Experimentation team gained a trusted QA partner that felt like a natural part of the team.
• The quality and reliability of A/B Test launches improved through consistent, detailed testing.
• Faster A/B test launch cycles were achieved, thanks to flexible, responsiveness and proactive support.
• Increased visibility into QA progress helped improve coordination and planning.