#ab-testing

[ follow ]
DevOps
fromInfoQ
10 hours ago

QCon London 2026: Behind Booking.com's AI Evolution: The Unpolished Story

Booking.com evolved from a single MySQL database to 6,800 instances by 2020, implementing a data-driven culture through A/B testing and distributed systems like Hadoop to scale their AI and machine learning capabilities.
#statistical-significance
fromNielsen Norman Group
3 days ago
UX design

Statistical Significance Isn't the Same as Practical Significance

Statistical significance indicates a result is unlikely due to chance, but does not guarantee practical importance or meaningful impact on users or business outcomes.
fromHarvard Business Review
3 months ago
Marketing

You're Probably A/B Testing Too Much. Here's What to Do Instead.

A/B testing often delays decisions by producing statistically inconclusive results, causing teams to wait for more data instead of making timely, data-driven choices.
UX design
fromNielsen Norman Group
3 days ago

Statistical Significance Isn't the Same as Practical Significance

Statistical significance indicates a result is unlikely due to chance, but does not guarantee practical importance or meaningful impact on users or business outcomes.
Marketing tech
fromThedrum
5 days ago

Automated Creative launches new interface incorporating ChatGPT

Automated Creative's platform enables brands to test, optimize, and scale creative effectiveness across digital media with integrated ChatGPT capabilities for rapid ideation and production of unlimited unique ads.
Video games
fromThe Verge
1 week ago

Sony appears to be testing dynamic pricing on PlayStation games

Sony is testing dynamic pricing on over 150 games across 68 regions, offering select users discounts ranging from 5% to 17.5% through A/B testing experiments tracked in the PlayStation API.
#marketing-experimentation
Miscellaneous
fromInfoQ
2 weeks ago

Achieve Optimal Efficiency for Your Developer Experience Teams

Monzo formed a Developer Velocity squad that built an Experimentation Platform enabling A/B testing of features across 11 million customers using a small 400-person engineering organization.
#email-marketing
fromBuffer: All-you-need social media toolkit for small businesses
1 month ago

How We Designed and Built the Buffer.com Homepage Hero

Our old homepage hero technically showed all the platforms we support - but it felt overly corporate, like a feature list wearing a trench coat. The previous hero featured an animated headline that rotated through Buffer's supported social media platforms. While it did the job, it didn't feel very "Buffer-y." We wanted to make a stronger first impression - something with more liveliness and delight.
UX design
#bing
#performance-max
fromInfoQ
1 month ago

Enhancing A/B Testing at DoorDash with Multi-Armed Bandits

While experimentation is essential, traditional A/B testing can be excessively slow and expensive, according to DoorDash engineers Caixia Huang and Alex Weinstein. To address these limitations, they adopted a "multi-armed bandits" (MAB) approach to optimize their experiments. When running experiments, organizations aim to minimize the opportunity cost, or regret, caused by serving the less effective variants to a subset of the user base.
fromTechCrunch
1 month ago

Everstone combines Wingify, AB Tasty for $100M+ digital experience optimization platform | TechCrunch

"cleaning up"
Marketing tech
#google-ads
Growth hacking
fromBusiness Insider
2 months ago

'The Diary of a CEO' host Steven Bartlett explains how the '1% rule' has led to big results at his company

Tiny, incremental A/B-tested changes to titles, thumbnails, and small details produced measurable engagement increases and built psychological momentum.
#google-search
Data science
fromInfoQ
2 months ago

Beyond Win Rates: How Spotify Quantifies Learning in Product Experiments

Experiments should be judged by decision-ready learning—valid and actionable outcomes that tell teams to ship, abort, or iterate—rather than by win rates alone.
fromPsychology Today
2 months ago

A Worthless Headline: How Bing's Idea Was Their Biggest Win

Here's what actually happened: A Microsoft employee working on Bing proposed a seemingly minor change to how the search engine displayed ad headlines. The idea required minimal effort-just a few days of engineering time-but it was buried among hundreds of other proposals. Program managers deemed it insignificant and let it languish. The breakthrough came when an engineer, recognizing the low development cost, decided to test the idea anyway.
Growth hacking
Marketing
fromFingerlakes1.com
3 months ago

Understanding Your Audience: The Foundation of Engaging Newsletters | Fingerlakes1.com

Understand and segment your audience, craft personalized subject lines, and test to improve newsletter relevance, engagement, and open rates.
Marketing tech
fromThe Drum
3 months ago

Unlocking the power of generative AI to improve paid social media strategies

Generative AI speeds asset creation but cannot guarantee consistent brand quality or scalable, timely volume without creative automation, templates, and human oversight.
Marketing tech
fromBusiness Insider
3 months ago

This AI startup generates content to help companies retain their customers. Read the pitch deck it used to raise $5 million.

Eikona uses generative AI to create and optimize personalized lifecycle marketing content to improve customer retention; raised a $5M seed led by StageOne Ventures.
#facebook-ads
Marketing tech
fromwww.socialmediatoday.com
3 months ago

Google Adds AI-Powered Image and Video Tools to Demand Gen Campaigns

Google expanded Demand Gen ad tools with AI-driven image and video creation, automated aspect ratios, Asset Uplift A/B experiments, suitability controls, and Pathmatics creative integration.
E-Commerce
fromVogue Business
4 months ago

How to build an e-commerce site that works for emerging brands

Prioritize accessible, fast, functional user journeys before styling; optimize concise product descriptions, consistent imagery, loading time, and A/B testing to improve e-commerce conversion.
Marketing
fromAcast
4 months ago

Experimentation lessons from CRO - a conversation with Ryan Lucht | Business Class Lounge by SearchPilot, hosted by Will Critchlow

Apply CRO experimentation rigor—statistical methods, reliable data pipelines, and production-grade tooling—to scale and mature SEO testing and move teams from reactive to controlled experimentation.
Marketing tech
fromExchangewire
5 months ago

Audible & Readpeak Join Forces With a Plug-In Automated AI Solution Set to Change the Premium Native Marketplace

Readpeak's automated native-ad technology enables rapid bespoke templating, real-time A/B testing and publisher-adaptive creatives to elevate mid-funnel engagement and creative efficiency.
fromSmashing Magazine
5 months ago

The Grayscale Problem - Smashing Magazine

Last year, a study found that cars are steadily getting less colourful. In the US, around 80% of cars are now black, white, gray, or silver, up from 60% in 2004. This trend has been attributed to cost savings and consumer preferences. Whatever the reasons, the result is hard to deny: a big part of daily life isn't as colourful as it used to be.
Digital life
#ai-marketing
Business
fromHarvard Business Review
5 months ago

Cultivating an Experimental Mindset in Your Organization

Business leaders must design rigorous experiments and act on their results to test assumptions, improve products and services, and reduce reliance on intuition.
Marketing tech
fromSocial Media Today
5 months ago

LinkedIn Adds More Ad Automation Options for SMBs

LinkedIn tools—Auto-Targeting, Draft with AI, and Recommendations—enable rapid audience building, scalable ad creative generation, and data-driven optimization with minimal effort.
Artificial intelligence
fromTheWrap
5 months ago

YouTube Has Paid Creators Over $100 Billion Over the Past 4 Years

YouTube is rolling out AI-driven tools globally, including likeness protection, collaboration features, A/B testing, Ask Studio chatbot insights, and auto-dubbing lip sync for creators.
Software development
fromVue.js Jobs
5 months ago

Intermediate Fullstack Engineer (Ruby/Vue.js), Growth at GitLab - VueJobs

GitLab provides an AI-powered DevSecOps platform that unites teams, embeds AI across the SDLC, and drives productivity, adoption, and collaborative software creation.
fromMarTech
6 months ago

B2B marketers at SMBs struggle with conversion rate optimization | MarTech

SMB marketers in the B2B sector say conversion rate optimization (CRO) is their top A/B testing priority in 2025, but a new report found most aren't running A/B tests to improve CRO. The " State of A/B Testing Report " from Unbounce found 56% of SMB marketers in B2B cite CRO as their top testing goal. However, only 32% are running A/B tests on their landing pages.
Marketing
Marketing
fromHubspot
7 months ago

Conde Nast marketing leader shares her framework for destroying your imposter syndrome

Combining digital marketing and life coaching can enhance marketer resilience and effectiveness.
UX design
fromHackernoon
3 years ago

Frequentist Stats Are Failing Your UX Decisions-Here's a Better Way | HackerNoon

Frequentist statistics can be misleading; Bayesian methods offer clearer insights, particularly for business applications.
To effectively use Bayesian statistics, practitioners need to familiarize themselves and potentially create their own tools.
Business intelligence
fromHackernoon
11 months ago

The Next Evolution in Business Process Improvement | HackerNoon

Business processes are standardized activities organizations use to achieve results.
AB testing and Reinforcement Learning provide dynamic strategies to assess and improve business processes.
fromHackernoon
11 months ago

How a BPM Dream Team Ranked the Risks and Tools for AB-BPM | HackerNoon

The grounded theory methodology is suitable for building theory in fields where little is known, making it ideal for investigating AB testing in BPI.
Business intelligence
Marketing tech
fromForbes
9 months ago

A/B Testing Can Help Transform The Effectiveness Of Employee Training

Using A/B testing in L&D can effectively demonstrate training impact and ROI, shifting focus beyond basic completion metrics.
[ Load more ]