Apply a significance test to a crosstab
Analyze a crosstab report for statistically significant differences between subgroups.
- Open the Analytics app and on the analytics menu, click Crosstabs.
- On the Reports page, click the name of an existing crosstab report.
-
On the left of the page, under Significance
Testing, enable the toggle.
-
Click
Advanced Settings to configure your
significance test settings.
Option Description General Settings Enabling Include Total compares columns to the total for each table. Confidence Level The confidence level is the threshold for determining statistically significant differences in group proportions using the P-value from a t-test. It also controls the rate which false positives are accepted, when the differences in groups are caused by chance or variations in the sample alone.
For example, a confidence level of 95% means we accept false positives 5% of the time when there is no real differences between groups.
Bonferroni Correction Ensures the confidence level remains high when comparing more than two subgroups.
For example, if you are comparing two values in the subgroup "Age Groups", 18-24 vs 25-34, it ensures the confidence level stays at 95%. The Bonferroni Correction may lead to fewer significance differences detected but lower false positives.
- Click Apply.