{"id":19,"date":"2019-04-10T13:28:08","date_gmt":"2019-04-10T13:28:08","guid":{"rendered":"https:\/\/wp.media.unc.edu\/biostatistics\/?page_id=19"},"modified":"2020-07-08T15:50:56","modified_gmt":"2020-07-08T15:50:56","slug":"lesson-4-measurement-considerations","status":"publish","type":"page","link":"https:\/\/wp.media.unc.edu\/biostatistics\/lesson-4-measurement-considerations\/","title":{"rendered":"Lesson 4: Measurement Considerations"},"content":{"rendered":"<div class=\"\"><ul class=\"nav nav-tabs\" id=\"oscitas-tabs-0\"><li class=\"active\"><a class=\"\" href=\"#pane-0-0\" data-toggle=\"tab\">Introduction<\/a><\/li><li class=\"\"><a class=\"\" href=\"#pane-0-1\" data-toggle=\"tab\">Terminology<\/a><\/li><li class=\"\"><a class=\"\" href=\"#pane-0-2\" data-toggle=\"tab\">Basic Concepts<\/a><\/li><li class=\"\"><a class=\"\" href=\"#pane-0-3\" data-toggle=\"tab\">Reported Results<\/a><\/li><li class=\"\"><a class=\"\" href=\"#pane-0-4\" data-toggle=\"tab\">Assessment<\/a><\/li><\/ul><div class=\"tab-content\"><div class=\"tab-pane active\" id=\"pane-0-0\"><div class=\"field field-name-body field-type-text-with-summary field-label-hidden\">\n<div class=\"field-items\">\n<div class=\"field-item even\">\n<div class=\"tex2jax\">\n<div class=\"intro\">\n<div class=\"introtopper\">This lesson reviews some measurement considerations, including the difference between parametric and nonparametric data. By the end of this lesson, you will be able to:<\/div>\n<div class=\"objectives\">\n<ol>\n<li>Define and differentiate between bias, validity, reliability, sensitivity, and specificity<\/li>\n<li>Contrast correlated and independent variables<\/li>\n<li>Identify when to use parametric or nonparametric statistics<\/li>\n<\/ol>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div><\/div><div class=\"tab-pane \" id=\"pane-0-1\"><div id=\"quicktabs-tabpage-lesson_4_-1\" class=\"quicktabs-tabpage quicktabs-hide\">\n<article id=\"node-90\" class=\"node node-book clearfix\">\n<header><\/header>\n<div class=\"field field-name-body field-type-text-with-summary field-label-hidden\">\n<div class=\"field-items\">\n<div class=\"field-item even\">\n<div class=\"tex2jax\">\n<div class=\"terminology\">\n<p>Terms that appear frequently throughout this lesson are defined below:<\/p>\n<table class=\"table\">\n<tbody>\n<tr>\n<td class=\"termdef\"><strong>Term<\/strong><\/td>\n<td class=\"termdef\"><strong>Definition<\/strong><\/td>\n<\/tr>\n<tr>\n<td class=\"tableseparator\"><strong>Data quality<\/strong><\/td>\n<td class=\"tableseparator\">&nbsp;<\/td>\n<\/tr>\n<tr>\n<td>\n<p style=\"margin-left: 40px;\"><strong>Bias<\/strong><\/p>\n<\/td>\n<td>Systematic error introduced by selecting or encouraging one outcome over others<\/td>\n<\/tr>\n<tr>\n<td>\n<p style=\"margin-left: 40px;\"><strong>Validity<\/strong><\/p>\n<\/td>\n<td>Extent to which a measure actually represents what it claims to measure<\/td>\n<\/tr>\n<tr>\n<td>\n<p style=\"margin-left: 40px;\"><strong>Reliability<\/strong><\/p>\n<\/td>\n<td>Degree to which results are stable and consistent<\/td>\n<\/tr>\n<tr>\n<td>\n<p style=\"margin-left: 40px;\"><strong>Sensitivity<\/strong><\/p>\n<\/td>\n<td>Proportion of positives that are correctly identified<\/td>\n<\/tr>\n<tr>\n<td>\n<p style=\"margin-left: 40px;\"><strong>Specificity<\/strong><\/p>\n<\/td>\n<td>Proportion of negatives that are correctly identified<\/td>\n<\/tr>\n<tr>\n<td class=\"tableseparator\"><strong>Data relationships<\/strong><\/td>\n<td class=\"tableseparator\">&nbsp;<\/td>\n<\/tr>\n<tr>\n<td>\n<p style=\"margin-left: 40px;\"><strong>Correlated<\/strong><\/p>\n<\/td>\n<td>A statistical relationship existing between two variables or datasets that reflects a dependence between the two<\/td>\n<\/tr>\n<tr>\n<td>\n<p style=\"margin-left: 40px;\"><strong>Independent<\/strong><\/p>\n<\/td>\n<td>The occurrence of one variable does not influence the probability of another variable<\/td>\n<\/tr>\n<tr>\n<td class=\"tableseparator\"><strong>Data parametrics<\/strong><\/td>\n<td class=\"tableseparator\">&nbsp;<\/td>\n<\/tr>\n<tr>\n<td>\n<p style=\"margin-left: 40px;\"><strong>Parametric<\/strong><\/p>\n<\/td>\n<td>Data with an underlying normal distribution<\/td>\n<\/tr>\n<tr>\n<td>\n<p style=\"margin-left: 40px;\"><strong>Nonparametric<\/strong><\/p>\n<\/td>\n<td>Data for which the probability distribution is unknown or known not to be normal<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/article>\n<\/div><\/div><div class=\"tab-pane \" id=\"pane-0-2\"><div id=\"quicktabs-tabpage-lesson_4_-2\" class=\"quicktabs-tabpage quicktabs-hide\">\n<article id=\"node-91\" class=\"node node-book clearfix\">\n<header><\/header>\n<div class=\"field field-name-body field-type-text-with-summary field-label-hidden\">\n<div class=\"field-items\">\n<div class=\"field-item even\">\n<div class=\"tex2jax\">\n<h2>I. Data quality<\/h2>\n<p>A number of <span class=\"boldwords\">quality standards<\/span> should be considered when collecting, analyzing, and reporting data:<\/p>\n<ol>\n<li><strong>Bias<\/strong> &#8211; Bias is any error that is introduced into a study by promoting or selecting one outcome over others. It can occur at any phase of research, including study design, data collection, analysis, and publication (<span class=\"seefigure\">see figure below<\/span>). When conducting or reading about research, you must consider the degree to which bias interfered with the study and influenced the conclusions.\n<p style=\"text-align: center;\"><a class=\"colorbox-load init-colorbox-load-processed cboxElement\" href=\"\/biostatistics\/wp-content\/uploads\/sites\/2\/2019\/04\/trial_progression.png\"><img decoding=\"async\" style=\"width: 80%; max-width: 781px;\" src=\"\/biostatistics\/wp-content\/uploads\/sites\/2\/2019\/04\/trial_progression.png\" alt=\"Major sources of bias in clinical research.\"><\/a><\/p>\n<p class=\"citation\"><a href=\"\/biostatistics\/detaileddescriptions\/#descL4F1\">Click here for a detailed description. <\/a>Borrowed from: Pannucci CJ,&nbsp; Wilkins EG. <a href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC2917255\/\" rel=\"noopener noreferrer\">Identifying and avoiding bias in research. <\/a><cite>Plast Reconstr Surg.<\/cite> 2010;126(2):619-625.<\/p>\n<\/li>\n<li><strong>Validity<\/strong> &#8211; Validity is the extent to which a measure actually represents what it claims to measure. You will see many types of validity talked about in the literature. Common types of validity include:\n<ul>\n<li><strong>External validity<\/strong> &#8211; The extent to which a finding can be generalized beyond the research<\/li>\n<li><strong>Internal validity<\/strong> &#8211; The extent to which the research itself upholds the highest standards of quality and limits possible confounders<\/li>\n<li><strong>Construct validity<\/strong> &#8211; How well a test or experiment measures a specific construct; <em>convergent validity<\/em> means constructs that should be related are related; <em>divergent validity <\/em>means that constructs that should not be related are not related<\/li>\n<li><strong>Content validity<\/strong> &#8211; The extent to which an instrument or test represents all elements of a given construct<\/li>\n<li><strong>Face validity<\/strong> &#8211; The extent to which an instrument, project, or measure appears to measure what it is intended to measure<\/li>\n<\/ul>\n<\/li>\n<li><strong>Reliability<\/strong> &#8211; Reliability is the consistency of a measure. Factors that can impact consistency may include maturation, fatigue, motivation, distraction, test conditions or context, and test or instrument quality. Common types of reliability include:\n<ul>\n<li><strong>Inter-rater reliability<\/strong> &#8211; The extent of agreement between two or more raters<\/li>\n<li><strong>Test-retest reliability<\/strong> &#8211; The degree to which test or instrument scores are consistent from one point in time to the next (the test taker and test conditions must be the same at both points in time)<\/li>\n<li><strong>Internal consistency reliability<\/strong> &#8211; The consistency of responses across items on a single instrument or test<\/li>\n<\/ul>\n<p style=\"text-align: center;\"><a class=\"colorbox-load init-colorbox-load-processed cboxElement\" href=\"\/biostatistics\/wp-content\/uploads\/sites\/2\/2019\/04\/dartboard1_0.png\" target=\"_blank\" rel=\"noopener noreferrer\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone\" style=\"width: 80%; max-width: 700px;\" src=\"\/biostatistics\/wp-content\/uploads\/sites\/2\/2019\/04\/dartboard1_0.png\" alt=\"A visual representation of reliability and validity; reliability relates to consistency of data, while validity relates to its accuracy.\" width=\"700\" height=\"246\"><\/a><\/p>\n<p class=\"citation\" align=\"center\">Adapted from experiment-resources.com<\/p>\n<\/li>\n<li><strong>Sensitivity<\/strong> (also called the <em>true positive rate<\/em>) &#8211; The proportion of actual positives correctly identified as so. For example, the proportion of sick people who are correctly identified as sick<\/li>\n<li><strong>Specificity<\/strong> (also called the <em>true negative rate<\/em>) &#8211; The proportion of actual negatives correctly identified as so. For example, the proportion of healthy people who are correctly identified as not having the condition<br \/>\n<table class=\"table\" style=\"width: 50%; position: relative; margin: 0 auto;\">\n<tbody>\n<tr>\n<td>&nbsp;<\/td>\n<td>Disease Positive<\/td>\n<td>Disease Negative<\/td>\n<\/tr>\n<tr>\n<td style=\"vertical-align: middle;\">Test Positive<\/td>\n<td class=\"boldCell\">a<\/td>\n<td class=\"boldCell\">b<\/td>\n<\/tr>\n<tr>\n<td style=\"vertical-align: middle;\">Test Negative<\/td>\n<td class=\"boldCell\">c<\/td>\n<td class=\"boldCell\">d<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>In the table above, <span class=\"boldwords\">sensitivity = a\/(a+c) <\/span>or the proportion of disease cases accurately determined to be positive by the test. <span class=\"boldwords\">Specificity = d\/(b+d)<\/span> or the proportion of non-disease cases accurately determined to be negative by the test.<\/li>\n<\/ol>\n<h2>II. Data relationships<\/h2>\n<ol>\n<li><strong>Correlated<\/strong> &#8211; A statistical relationship existing between two variables or datasets that reflects a dependence between the two. For example, human height is positively correlated with shoe size.<\/li>\n<li><strong>Independence<\/strong> (Also called <em>statistically independent<\/em> or <em>probabilistic independence<\/em>) &#8211; The occurrence of one variables does not influence the probability of another variable. For example, shoe size is statistically independent from volume of ice cream consumption.<\/li>\n<\/ol>\n<p style=\"text-align: center;\"><a class=\"colorbox-load init-colorbox-load-processed cboxElement\" href=\"\/biostatistics\/wp-content\/uploads\/sites\/2\/2019\/04\/data_relationships_0.png\" target=\"_blank\" rel=\"noopener noreferrer\"><img decoding=\"async\" style=\"width: 80%; max-width: 626px;\" src=\"\/biostatistics\/wp-content\/uploads\/sites\/2\/2019\/04\/data_relationships_1.png\" alt=\"Two charts illustrating the difference between results that are statistically independent and those that are correlated.\"><\/a><\/p>\n<p class=\"citation\" style=\"text-align: center;\"><a href=\"\/biostatistics\/detaileddescriptions\/#descL4F2\">Click here for a detailed description. <\/a><\/p>\n<h2>III. Data Parametrics<\/h2>\n<p style=\"text-align: center;\"><a class=\"colorbox-load init-colorbox-load-processed cboxElement\" href=\"\/biostatistics\/wp-content\/uploads\/sites\/2\/2019\/04\/parametrics.png\"><img decoding=\"async\" style=\"width: 80%; max-width: 762px;\" src=\"\/biostatistics\/wp-content\/uploads\/sites\/2\/2019\/04\/parametrics.png\" alt=\"Three charts demonstrating negative skew, when the large tail is to the left, positive skew, when the large tail is to the right, and kurtosis, the height of the curve. Taller curves illustrate positive Kurtosis. Shorter curves illustrate negative kurtosis.\"><\/a><\/p>\n<p class=\"citation\" style=\"text-align: center;\"><a href=\"\/biostatistics\/detaileddescriptions\/#descL4F3\">Click here for a detailed description. <\/a><\/p>\n<ol>\n<li><strong>Parametric<\/strong> &#8211; Data that follows an approximately normal distribution is considered parametric. When data is determined to meet the assumptions of normality, parametric statistics can be used. Common approaches to determining whether or not data is approximately normal include:\n<ul>\n<li>Visual examination of the data<\/li>\n<li>Evaluation of the <span class=\"boldwords\">skew <\/span>(i.e., how far left or right the data distribution leans) and <span class=\"boldwords\">kurtosis<\/span> (i.e., how high or low data distribution peak goes); common convention allows for some skew and kurtosis since data rarely follow an exactly normal distribution<\/li>\n<\/ul>\n<\/li>\n<li><strong>Nonparametric<\/strong> &#8211; Data with an unknown distribution or a distribution known to be not normal (e.g., multiple peaks, skew or kurtosis outside of an acceptable range) is considered nonparametric. Nonparametric statistics make no assumptions about the probability distributions of the variables being examined. When data fails to meet the assumptions of normality or consists of a small sample size (n&lt;30, for example), nonparametric statistical tests should be used.<\/li>\n<\/ol>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/article>\n<\/div><\/div><div class=\"tab-pane \" id=\"pane-0-3\"><div id=\"quicktabs-tabpage-lesson_4_-3\" class=\"quicktabs-tabpage quicktabs-hide\">\n<article id=\"node-92\" class=\"node node-book clearfix\">\n<header><\/header>\n<div class=\"field field-name-body field-type-text-with-summary field-label-hidden\">\n<div class=\"field-items\">\n<div class=\"field-item even\">\n<div class=\"tex2jax\">\n<h2>Example 1: Sensitivity and Specificity<\/h2>\n<p style=\"text-align: center;\"><strong>Colorectal Cancer Screening: Guaiac-Based FOBT vs. FIT<\/strong><\/p>\n<div class=\"table-responsive\">\n<table class=\"table\" style=\"width: 60%;\">\n<tbody>\n<tr>\n<td>&nbsp;<\/td>\n<th style=\"text-align: center;\" colspan=\"2\" rowspan=\"1\" scope=\"colgroup\">Guaiac-Based FOBT<\/th>\n<th style=\"text-align: center;\" colspan=\"2\" rowspan=\"1\" scope=\"colgroup\">Fecal Immunochemical Test<br \/>\n(100-ng\/mL cut point)<\/th>\n<\/tr>\n<tr>\n<td>&nbsp;<\/td>\n<th style=\"text-align: center;\" scope=\"col\"><strong>Sensitivity<\/strong><\/th>\n<th style=\"text-align: center;\" scope=\"col\"><strong>Specificity<\/strong><\/th>\n<th style=\"text-align: center;\" scope=\"col\"><strong>Sensitivity<\/strong><\/th>\n<th style=\"text-align: center;\" scope=\"col\"><strong>Specificity<\/strong><\/th>\n<\/tr>\n<tr>\n<th style=\"text-align: left;\" scope=\"row\">Advanced adenomas<\/th>\n<td style=\"text-align: center;\">13.6%<\/td>\n<td style=\"text-align: center;\">92.4%<\/td>\n<td style=\"text-align: center;\">33.9%<\/td>\n<td style=\"text-align: center;\">90.6%<\/td>\n<\/tr>\n<tr>\n<th style=\"text-align: left;\" scope=\"row\">Cancer<\/th>\n<td style=\"text-align: center;\">30.8%<\/td>\n<td style=\"text-align: center;\">92.4%<\/td>\n<td style=\"text-align: center;\">92.3%<\/td>\n<td style=\"text-align: center;\">90.1%<\/td>\n<\/tr>\n<tr>\n<th style=\"text-align: left;\" scope=\"row\">Advanced colorectal neoplasias<\/th>\n<td style=\"text-align: center;\">16.7%<\/td>\n<td style=\"text-align: center;\">92.9%<\/td>\n<td style=\"text-align: center;\">44.4%<\/td>\n<td style=\"text-align: center;\">82.1%<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p class=\"note\">Sensitivity was much higher, but specificity was slightly lower with FIT than with guaiac-based FOBT.<\/p>\n<p>Seven hundred seventy consecutive average-risk patients from four centers who were undergoing screening colonoscopy also provided stool samples. Findings suggest that the FIT provides a higher sensitivity for detecting advanced colorectal neoplasias and cancer than the guaiac-based FOBT, and has an acceptable specificity.<\/p>\n<p style=\"text-align: center;\">&nbsp;<\/p>\n<h2>Example 2: Correlated vs Independent<\/h2>\n<p style=\"text-align: center;\"><a class=\"colorbox-load init-colorbox-load-processed cboxElement\" href=\"\/biostatistics\/wp-content\/uploads\/sites\/2\/2019\/04\/relative_viability.png\"><img decoding=\"async\" style=\"width: 70%; max-width: 700px;\" src=\"\/biostatistics\/wp-content\/uploads\/sites\/2\/2019\/04\/relative_viability.png\" alt=\"Two figures. Figure A represents a scatterplot of two correlated variables. Figure B represents a scatterplot of statistically independent variables. \"><\/a><\/p>\n<p class=\"citation\" style=\"text-align: center;\"><a href=\"\/biostatistics\/detaileddescriptions\/#descL4F4\">Click here for a detailed description. <\/a><\/p>\n<p>Figure A represents a scatter plot of two correlated variables: CEPH LCLs sensitivity toward rituximab versus ofatumumab. Figure B is a scatter plot of rituximab sensitivity versus CD20 gene expression, which appear to be statistically independent.<\/p>\n<h2>Example 3: Data Distribution<\/h2>\n<p style=\"text-align: center;\"><a class=\"colorbox-load init-colorbox-load-processed cboxElement\" href=\"\/biostatistics\/wp-content\/uploads\/sites\/2\/2019\/04\/cholesterol_distribution.png\"><img decoding=\"async\" style=\"width: 70%; max-width: 700px;\" src=\"\/biostatistics\/wp-content\/uploads\/sites\/2\/2019\/04\/cholesterol_distribution.png\" alt=\"Six charts of approximately normal data distributions for cholesterol levels. These charts illustrate differing levels of kurtosis.\"><\/a><\/p>\n<p class=\"\u201ccitation\u201d\" style=\"text-align: center;\"><a href=\"\/biostatistics\/detaileddescriptions\/#descL4F5\">Click here for a detailed description. <\/a><\/p>\n<p>Approximately normal data distributions for cholesterol levels. Notice that the peaks for <strong>underweight <\/strong>individuals are <em>skewed<\/em> slightly (the peak is to the left of the center line) and demonstrate higher<em> kurtosis<\/em> (the peak is higher than the overweight and normal weight individuals).<\/p>\n<p style=\"text-align: center;\">&nbsp;<\/p>\n<div class=\"well moreinfo\">\n<p>For more information<\/p>\n<ul>\n<li class=\"citation\">Example 1: <a href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/20502450\" target=\"_blank\" rel=\"noopener noreferrer\">Park et al. <cite>Am J Gastroenterol.<\/cite> 2010 Sep;105(9):2017-25.<\/a><\/li>\n<li class=\"citation\">Example 2: <a href=\"https:\/\/peerj.com\/articles\/31\/\" target=\"_blank\" rel=\"noopener noreferrer\">Small GW et al. <span class=\"self-citation-title\">Peer J. 2013; 1:e31. <\/span><\/a><\/li>\n<li class=\"citation\">Cholesterol graphic borrowed from SAS\/GRAPH(R) 9.2: <cite>Graph Template Language User&#8217;s Guide,<\/cite> Second Edition.<\/li>\n<\/ul>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/article>\n<\/div><\/div><div class=\"tab-pane \" id=\"pane-0-4\"><div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-4\" class=\"h5p-iframe\" data-content-id=\"4\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"Assessment (For Lesson 4)\"><\/iframe><\/div><\/div><\/div><\/div>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"_links":{"self":[{"href":"https:\/\/wp.media.unc.edu\/biostatistics\/wp-json\/wp\/v2\/pages\/19"}],"collection":[{"href":"https:\/\/wp.media.unc.edu\/biostatistics\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/wp.media.unc.edu\/biostatistics\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/wp.media.unc.edu\/biostatistics\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/wp.media.unc.edu\/biostatistics\/wp-json\/wp\/v2\/comments?post=19"}],"version-history":[{"count":52,"href":"https:\/\/wp.media.unc.edu\/biostatistics\/wp-json\/wp\/v2\/pages\/19\/revisions"}],"predecessor-version":[{"id":1231,"href":"https:\/\/wp.media.unc.edu\/biostatistics\/wp-json\/wp\/v2\/pages\/19\/revisions\/1231"}],"wp:attachment":[{"href":"https:\/\/wp.media.unc.edu\/biostatistics\/wp-json\/wp\/v2\/media?parent=19"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}