Screening Bias
This report allows the analyst to identify any large within-site changes in values between two visits to identify regression to the mean in assessing study entry criteria. Analysis are performed using paired t-tests.
An example for subjective criteria is when investigators score a patient at a screening visit and based on this score the patient meets eligibility to get in the study. However, when the patient comes back at the randomization visit, the "more objective" investigator scores the patient noticeably differently. Or, it can pick up noticeable differences between the start and end of a placebo run-in when things are not expected to change.
FDR p-values are calculated and the reference line is determined as described in How does JMP Clinical calculate the False Discovery Rate (FDR)?.
Note: JMP Clinical uses a special protocol for data including non-unique Findings test names. Refer to How does JMP Clinical handle non-unique Findings test names? for more information.
Note: xxTPT should not have any visit-specific information in it, or it is liable to prevent a match using BY variables.
Report Results Description
The Report contains the following elements:
Screening Bias Volcano Plot
Shows a volcano plot used to find records where findings change significantly between one visit and the next.
This section contains the following elements.
| • | One Data Filter. |
Enables you to subset subjects based on country of origin, study site and/or Test. Refer to Data Filter for more information.
| • | One Volcano Plot. Shows a volcano plot used to find records where findings change significantly between one visit and the next. Screening bias compares all numerical variables. These ranges can be quite different from one another, so to summarize all of the variables in one plot, they are centered around 0 and scaled on the X axis using the standardized mean difference, which is:  |
This is the paired t-statistic which has n-1 degrees of freedom. When n is fixed, as it should be for all measurements coming from a site (unless there are missing data), all tests should have n measurements.
Screening Bias generates a number of paired t-test statistics, one for each Findings test for a specific site. These become significant as we depart from 0. Sets of values seem to have smooth curves here because the deviation from zero slows down as the difference gets larger and larger.
Each point represents a single Findings test for a specific site. You can mouse over points of interest to see their labels or select points by dragging a mouse rectangle over them (as shown above). Selected rows are highlighted in other plots and you can also then click on various Down Buttons for further analyses on those specific sites.
In this example, the unusual value at the upper left of the plot is selected.
If you click 
, a subset table containing the selected row with summary statistics is generated and displayed (below).
A very large Visit 1 - Visit 2 difference (increase) has been identified for lactate dehydrogenase for site 32. Visit 1 mean = 338.5 Visit 2 mean = 441 with Mean of V1 minus V2 Differences = -102.5. So there is an increase of 102.5 units which divided by the standard error gives a standardized difference of -205. This is a large change considering the observed variability and suggests further investigation.
Action Buttons
Action buttons, provide you with an easy way to drill down into your data. The following action buttons are generated by this report:
| • | Show Summary Statistics: Shows the rows of the data table for the selected points from the volcano plot (see above). |
General and Drill Down Buttons
Action buttons, provide you with an easy way to drill down into your data. The following action buttons are generated by this report:
| • | Click  to reset all report options to default settings. |
| • | Click  to view the associated data tables. Refer to Show Tables/View Data for more information. |
| • | Click  to generate a standardized pdf- or rtf-formatted report containing the plots and charts of selected sections. |
| • | Click  to generate a JMP Live report. Refer to Create Live Report for more information. |
| • | Click  to take notes, and store them in a central location. Refer to Add Notes for more information. |
| • | Click  to read user-generated notes. Refer to View Notes for more information. |
| • | Click  to open and view the Review Subject Filter. |
| • | Click  to specify Derived Population Flags that enable you to divided the subject population into two distinct groups based on whether they meet very specific criteria. |
Report Options
Findings Analysis
By default the report is set to analyze all tests from all findings domains. You can opt however, to restrict the search to specific Findings Tests.
You can specify whether to search all results in original units when you Analyze: the data or restrict the search to either character results (in standard format) or numeric results (in standard units).
You can opt to Consider BY variables in the analysis. This option, which assumes that BY variables (left vs. right arm for collecting blood pressure data, for example) are included in the experimental design, is selected by default. You can uncheck this option to ignore BY variables.
Use the Only include BY variables if they are domain keys option to subset the available variables to only include those variables that are domain keys. If the option is unchecked, the report uses the cross-classification of xxCAT, xxSCAT, xxLOC, xxMETHOD, xxPOS, xxSPEC, and xxTPT for creating by groups for all variables that are available (as it had in the past).
The Summarize sites with at least this many subjects: option enables you to set a minimal threshold for the sites to be analyzed. Only those sites which exceed the specified number of subjects are included. This feature is useful because it enables you to exclude smaller sites, where small differences due to random events are more likely to appear more significant than they truly are. In larger sites, observed differences from expected attendance due to random events are more likely to be significant because any deviations due to random events are less likely to be observed.
You must specify the two visits to use for calculating differences that are used for determining bias. While the first two visits in the study are specified as and , respectively, by default, you can select any pair of visits.
The Alpha option is used to specify the significance level by which to judge the validity of the outliers revealed by this report. The meaning of alpha depends on the adjustment method that you select. Alpha can be set to any number between 0 and 1, but is most typically set at 0.001, 0.01, 0.05, or 0.10. The higher the alpha, the higher the error rate but also higher the power for detecting significant differences. You will need to decide on the best trade-off for your experiment.
Filtering the Data:
Filters enable you to restrict the analysis to a specific subset of subjects and/or adverse events, based on values within variables. You can also filter based on population flags (Safety is selected by default) within the study data.
See Select the analysis population, Select saved subject filter, and Additional Filter to Include Subjects