Product Comparison and Benchmark Testing
HRG conducts blind head-to-head product comparisons and competitive benchmarks at our Broward County CLT facility. 60/40 protocol, sequential monadic design, and competitor products sourced from South Florida retail. Know exactly how your product performs against the competition before launch.
What is product comparison and benchmark testing?
Product comparison testing measures how a brand's food, beverage, or CPG product performs against competitor products in a blind sensory evaluation. HRG conducts these studies at its Broward County CLT facility using two primary designs: a paired preference comparison, which produces a clear win-loss preference split, and a sequential monadic test, which adds overall liking scores and attribute ratings for each product. Results are assessed against the industry 60/40 benchmark: a product needs at least 60 percent preference to be considered sensorially superior. Studies run across South Florida's multicultural consumer panel in English, Spanish, and Haitian Creole.
The 60/40 Benchmark Standard
The 60/40 rule is the most widely used competitive threshold in food and beverage product testing. In a blind paired comparison, a product that achieves 60 percent or more preference over a named competitor is considered sensorially superior. A result between 50 and 59 percent indicates a competitive parity range where differences may not be statistically significant. A result below 50 percent means the competitor is preferred by the panel.
The 60/40 threshold matters because most product development budgets cannot justify a reformulation or launch investment based on parity. Clients use the benchmark to answer a specific question: does our product beat the market leader on taste before we invest in distribution and marketing? HRG reports preference splits with confidence intervals so clients can see whether a 58/42 result is genuinely within the parity range or whether additional testing is warranted.
Sequential Monadic vs. Paired Comparison
Paired comparison is the fastest and simplest design. Respondents taste two products and state which they prefer. It produces a preference split (for example, 64 percent prefer Product A) and is ideal when the only decision is win-or-lose against a single competitor. It does not explain why one product is preferred or give absolute quality scores.
Sequential monadic evaluation gives respondents one product at a time, fully rated on all attributes before the next product is presented. This produces an overall liking score for each product, ratings on taste, texture, aroma, and aftertaste, purchase intent, and verbatim improvement suggestions. Sequential monadic data is more actionable because it tells the product development team not just that Product B lost, but that it was rated lower specifically on sweetness and aftertaste, which are the attributes to address in the next iteration.
For most product development benchmarks, HRG recommends sequential monadic design because the incremental cost is modest and the diagnostic value is substantially higher.
How Competitor Products Are Handled
HRG purchases competitor products from South Florida retail outlets within 48 hours of the test session to ensure freshness. Products are stored under the same conditions as the client's product. Each product receives a three-digit random code and is served in identical unmarked cups, plates, or containers. Clients are not identified to fieldworkers during the session. The decoding key is held by the client and applied to the dataset after fieldwork is complete.
For products with specific country-of-origin or market variants, HRG can source from specialty retailers in the South Florida market, which stocks a particularly wide range of Latin American, Caribbean, and imported food and beverage products given the region's demographics.
Blind vs. Branded Testing: When to Use Each
Blind testing isolates actual sensory performance from brand perception. It answers the question: setting aside everything you know about the brand, which product tastes better? Branded testing introduces packaging and brand identity, which adds the equity premium or discount that the brand carries in the consumer's mind.
Most competitive benchmarks begin with a blind test, because it gives the purest signal on product quality. If the blind result is strong but purchase intent in a branded condition is low, the brand has an equity problem rather than a product problem. If the blind result is weak, the product needs reformulation regardless of brand strength. Running both blind and branded phases in sequence is the most complete design, typically adding one additional day of fieldwork.
Related Services
Frequently Asked Questions
What is the 60/40 rule in product testing?+
The 60/40 rule is a competitive benchmarking benchmark widely used in food and beverage research. It holds that for a new or reformulated product to be considered competitive, at least 60 percent of respondents in a blind paired comparison should prefer it over the leading competitor, with no more than 40 percent preferring the competitor. A result at or above 60/40 indicates a genuinely superior sensory product. A result below 50/50 means the product has a sensory deficit against the named competitor. The 60/40 threshold originated with Coca-Cola's analysis of its own competitive testing program and is now an informal industry standard in CPG product development.
What is the difference between a paired comparison and a sequential monadic test?+
In a paired comparison test, respondents evaluate two products side by side and indicate which they prefer. It is fast and produces a clear preference split, but does not capture the absolute level of liking for each product. In a sequential monadic test, respondents evaluate each product one at a time in randomized order, rating it fully before seeing the next product. Sequential monadic tests produce richer data: overall liking scores for each product, attribute ratings, and improvement diagnostics. They require more time per respondent but give clients actionable data on why one product performs better, not just which one wins.
Can HRG test our product against specific named competitor products?+
Yes. HRG regularly conducts blind benchmarks against named competitor products sourced from retail. Clients provide the brief specifying which competitors to include; HRG purchases products from retail outlets in South Florida and codes them with three-digit blind numbers alongside the client's product. The client's product is treated identically to competitors in serving order, portion size, temperature, and presentation. Results are reported with coded product identifiers until the final report, where the client's decoding key is applied.
How many competitors can be included in a single benchmark test?+
For taste tests where respondents are consuming products, four is typically the practical limit in a single session before palate fatigue, satiation, or carry-over flavor effects compromise data quality. For beverages and lighter products, five products can be included with extended rest intervals. For products with strong flavors, heavy textures, or high sweetness, two or three products is the recommended maximum. If the client requires benchmarking against more than four competitors, HRG recommends splitting the study into two sessions with different respondent panels and a common anchor product to allow cross-session comparison.
How do you screen out flavor rejecters to get meaningful benchmark data?+
Flavor rejecters are consumers who uniformly rate all products in a category negatively regardless of formulation. Their responses inflate variance and reduce the statistical precision of preference splits. HRG screens out flavor rejecters at recruitment by requiring that participants be current users of the product category, defined as consuming it at least once per week or at a frequency appropriate to the category. For high-frequency products such as carbonated beverages, participants must consume at least two to three times per week. Participants who report strong general dislike of the flavor profile being tested are screened out before the session.
How long does a competitive benchmark study take?+
A two-product blind benchmark in South Florida takes approximately three to four weeks from kick-off to data delivery. This covers screener and discussion guide review, facility scheduling, participant recruitment, two to three days of fieldwork at the Broward County facility, and data processing and reporting. Studies with three to four products take four to five weeks. Rush timelines of two to three weeks are possible for simple two-product designs with smaller samples.
Free Caribbean Market Assessment
Discover which research methodology best fits your Caribbean market entry strategy.