Skip to content
Merch Jar
Log in Start free trial

Lesson 6 of 10 · 3 min read

How much data before you decide

How many orders before a bid change, how many clicks before you pause or negate, and which date range to look at.

By Cameron Scot, founder of Merch Jar · Updated

Short answer

  • Bid changes: at least 2 orders. 3 or 4 is better.
  • Pausing or negating: about 20 clicks with no orders for a search term, exact keyword or product target (at a 10% conversion rate). 40 or more for phrase, broad, auto and category targets.
  • Date range: 90 days for pausing and negating, shorter when you have plenty of data. Leave out the last two days.

The question I get most is some version of “how many clicks before I pause this?”

You want enough data to be confident, but not so much that you’ve paid for a pile of clicks that were never going to sell. Waiting for real statistical certainty would take hundreds of clicks per decision, and you’d run out of budget first.

The answer also depends on what you’re about to do. Pausing a keyword or negating a search term is hard to undo, because once it stops getting traffic it stops collecting data. That deserves more evidence. Changing a bid by 10% is small and easy to reverse, so it needs less.

For bid changes, count orders

Bid changes use ACOS, so the data you need is orders. I want at least two orders before I move a bid, and three or four makes the ACOS a lot more reliable.

For pausing and negating, count clicks

Pausing and negating are for things spending money without orders, so you count clicks.

Start from the lowest conversion rate you can live with. Lesson 5 gives you a way to find it, the conversion rate at which your cost per click just hits your target ACOS. That’s CPC ÷ (price × target ACOS). With a $0.60 CPC, a $25 product and a 25% target, it’s $0.60 ÷ $6.25, about 10%.

At a 10% conversion rate, it takes about 10 clicks to get an order on average (100 ÷ 10). Double the clicks and you get 20. So a search term, an exact keyword or a single product target with 20 clicks and no orders has had a fair shot. (For a version based on your actual conversion rate and how sure you want to be, use the calculator below. At 10% and 90% confidence it says 22.)

The chance that a target which really converts at 10% shows no orders anyway: about 35% after 10 clicks, 12% after 20 clicks and under 2% after 40 clicks.CHANCE OF ZERO ORDERS WHEN 1 IN 10 CLICKS BUYS0%25%50%75%100%01020304050clicks with no ordersexact: 20broad: 4035%12%under 2%
A target that really converts at 10% still goes 10 clicks without an order about a third of the time. By 20 clicks that's about 1 in 8.

Broad targets need more. A phrase or broad keyword, an auto campaign target group (lesson 7 covers those) or a category target spreads its clicks across lots of different searches, so 20 clicks might be one click each on 20 searches. I’d want 40 or more before pausing one of those, and often the better move is to negate the searches that aren’t working and keep the target.

Date ranges

When you don’t have enough data, use a longer range. If the last 7 days has two clicks, look at 30. If 30 isn’t enough, look at 60 or 90. For pausing and negating, look at 90 days or longer, so a target in a temporary slump doesn’t get cut. Amazon’s newer reports go back up to 15 months, so 90 days is easy to pull.

When you do have plenty of data, use a shorter range, because recent data is more relevant. If a keyword had 20 orders last week, what it did a month ago doesn’t matter much. That means different ranges for different keywords, which is more work, and it’s also where a lot of the performance comes from.

Leave today and yesterday out of bid decisions. Amazon credits an order to the click for up to 7 days after it (14 for vendors and KDP authors) and reports it on the day of the click, so recent days always look worse than they’ll end up.

Orders reported so far for each of the last seven days. The older days are complete; yesterday and today are still filling in, because orders keep being credited to the click for days afterwards.ORDERS REPORTED SO FAR, BY DAY OF THE CLICKstill filling ina week agoyesterdaytodayreportedstill to come
Orders keep arriving for days after the click, so the newest days always look worse than they'll end up.

Go deeper