Publication date: 07/08/2024

Equivalence Test Reports

In the Contingency platform, the options in the Equivalence Tests submenu enable you to perform equivalence, superiority, or noninferiority tests for risk differences or relative risks.

The equivalence test reports contain plots and summary tables. When you select an option in the Equivalence Tests submenu, you must specify test characteristics in the Equivalence Test Specification window.

Equivalence Test Specification Window

Selecting an equivalence test option in the Equivalence Tests submenu launches a window that enables you to define your test.

Alternative Hypothesis

Defines the structure of the equivalence test.

Equivalence (Two-Sided)

Specifies an equivalence test. Use this option when the goal is to show that group differences are not bigger than the equivalence margin.

Superiority (One-Sided)

Specifies a superiority test. Use this option when the goal is to show that a group is superior, or better than, another group.

Noninferiority (One-Sided)

Specifies a noninferiority test. Use this option when the goal is to show that a group is not inferior to another group.

Side of the Alternative Hypothesis

(Available only for one-sided tests.) Specifies the direction of the alternative hypothesis.

Hypotheses Plot

Provides a graphical depiction of the hypothesis test.

Y Category of Interest

Defines the level of the Y variable that is the numerator in the ratio.

X Category of Interest

Defines the level of the X variable that is the denominator in the ratio of the control.

Margin and Alpha

Defines the significance levels for the test.

Difference

(Available only for tests for risk difference.) Specifies the equivalence, superiority, or noninferiority margin. This margin, or delta, is the difference that has practical significance. For equivalence tests, the difference must be greater than zero.

Ratio

(Available only for tests for relative risk.) Specifies the equivalence, superiority, or noninferiority margin as a risk ratio. This margin, or delta, defines a risk ratio that has practical significance. The range of values is defined as (Ratio, 1/Ratio). For equivalence tests, the ratio must be different from 1.

Alpha

Specifies the significance level for the test.

Equivalence Tests Report

The test report begins with a description of the alternative hypothesis begin tested. For each comparison, the Tests report contains the following columns:

Difference

(Available only for tests for risk difference.) The estimated risk difference.

Ratio

(Available only for tests for relative risk.) The estimated risk ratio.

Std Error of Difference

(Available only for tests for risk difference.) The estimated standard error of the risk difference.

Lower Bound Std Error, Upper Bound Std Error

(Only one bound appears for one-sided tests.) The standard errors estimated under the lower or upper hypothetical value.

Lower Bound z Ratio, Upper Bound z Ratio

(Only one bound appears for one-sided tests.) The lower or upper bound z ratios for the one-sided significance tests.

Lower Bound p-Value, Upper Bound p-Value

(Only one p-value appears for one-sided tests.) The significance probabilities (p-values) that correspond to the lower or upper bound z ratios.

Max p-Value

(Appears only for two-sided tests.) Maximum of the lower and upper bound p-values.

Two-Sided Lower 90%, Two-Sided Upper 90%

Limits for a 12α confidence interval for the risk difference or risk ratio.

Assessment

An assessment of the hypothesis test for the specified alpha level.

Equivalence Tests Options

The Equivalence, Superiority, or Noninferiority Tests red triangle menu contains the following options:

Test Report

Shows or hides a report that summarizes the equivalence tests, superiority tests, or noninferiority tests for risk differences or risk ratios. See Equivalence Test Reports.

Forest Plot

Shows or hides a forest plot. The comparison confidence intervals are plotted versus the risk difference or relative risk. The intervals are plotted on a risk difference or relative risk scale. Shading indicates the equivalent, superior, or noninferiority regions.

Tip: Hover over a point to show the groups being compared and the estimated risk difference or relative risk.

Remove

Removes the test report from the Contingency Analysis report window.

Want more information? Have questions? Get answers in the JMP User Community (community.jmp.com).