Synthesizing MaxDiffs

Summary Metrics

After the analysis determines the utility coefficients, outputs and deliverables can be prepared to showcase the findings of the study. The utilities are the building blocks of all of the summary metrics.

The core summary metrics that typically accompany MaxDiff analysis are detailed below:

  • Preference Share: The preference share is the measurement of the probability that an item would be chosen over another if a respondent was asked to select the best from all options. It is a product of the utilities calculated using a Multinomial * Logistical Regression model, and is derived by exponentiating the item utility and dividing that by the sum of all of the exponentiated items’ utilities.
  • Average Utility: The average utility score of each item across all respondents. These are ordinal in nature and will show the relative preference between items. The average utilities can give some directional understanding but should not be a standalone metric to summarize the MaxDiff analysis.
  • Counts Analysis: The count analysis is a metric that simply tells us the percentage of time each item was selected most/least when it was shown.
  • Mean100 Score: The mean100 score creates a relative scale to judge the attribute importance on. In the example below, you can see that Starbucks for example is 143% more likely to be preferred over the average brand in this case. Hershey is 66% less preferred than the average brand.

Output Table

The typical output of a MaxDiff Synthesis is a table displaying the choice options (attributes) and the utilities (importance). This importance is typically displayed on a Mean100 scale to make it easier to interpret.

Issue Importance Mean100 Significance (vs Median)
Starbucks 8.7 243.6 TRUE
Peloton 6.86 192.08 TRUE
Tesla 6.26 175.28 TRUE
Apple 6.07 169.96 TRUE
The Walt Disney Company 5.54 155.12 TRUE
Nike 5.39 150.92 TRUE
McDonald’s 3.51 98.28 TRUE
Adidas 3.33 93.24 FALSE
IKEA 3.28 91.84 FALSE
Anheuser-Busch 3.27 91.56 FALSE
Spotify 3.26 91.28 FALSE
Chipotle 3.24 90.72 FALSE
Amazon 3.2 89.6 FALSE
Nintendo 3.08 86.24 FALSE
Netflix 3.04 85.12 FALSE
Johnson & Johnson 2.99 83.72 FALSE
Microsoft 2.99 83.72 FALSE
Coca-Cola 2.93 82.04 FALSE

Output Plot

Next to a table, a graphic makes it much more visible and easy to digest. In our package g6tr.md we have a function to create an automated version of the plot, see example below;