<?xml version="1.0" encoding="UTF-8"?>

<article>
<meta-data>
<journal-meta>
<journal-name>
International Journal of Clinical Biostatistics and Biometrics
</journal-name>
<journal-shortname>Int J Clin Biostat Biom </journal-shortname>
<journal-doi>10.23937/2469-5831</journal-doi>
<issn>2469-5831</issn>
<publisher>
<publisher-name>ClinMed International Library</publisher-name>
<publisher-location>Wilmington, USA</publisher-location>
<publisher-doi-prefix>10.23937</publisher-doi-prefix>
</publisher>
</journal-meta>
<article-meta>
<article-title>
Nonparametric Method for Estimation of Controlled Correlations in Studies of VEGF-Hypoxia Relationship
</article-title>
<citation_author>Kodryan MS</citation_author>
<article-doi>10.23937/2469-5831/1510024</article-doi>
<article-description>
It is known that vascular endothelial growth factor (VEGF) expression is a response to hypoxia. On the other hand hypoxia may be detected by oximetry parameters including venous CO-oximetry indices or corresponding partial pressures of O2 and CO2. 
</article-description>
</article-meta>
</meta-data>
<body>
<article-type>Research Article</article-type>
<volume>6</volume>
<issue>1</issue>
<access-type>OPEN ACCESS</access-type>
<article-doi>10.23937/2469-5831/1510024</article-doi>
<article-title>
Nonparametric Method for Estimation of Controlled Correlations in Studies of VEGF-Hypoxia Relationship
</article-title>
<Author-Group>
<aut id="aut1">
<label>Author-1</label>
<name>Maxim S Kodryan</name>
<affiliation>
Lomonosov Moscow State University, Russia
</affiliation>
</aut>
<aut id="aut2">
<label>Author-2</label>
<name>Anna V Kuznetsova</name>
<affiliation>
Emanuel Institute of Biochemical Physics, Russian Academy of Sciences, Russia
</affiliation>
</aut>
<aut id="aut3">
<label>Author-3</label>
<name>Luidmila L Klimenko</name>
<affiliation>
Semenov Institute of Chemical Physics, Russian Academy of Sciences, Russia
</affiliation>
</aut>
<aut id="aut4">
<label>Author-4</label>
<name>Aksana N Mazilina</name>
<affiliation>
Department of Neurology of Clinic Hospital, Federal Medical and Biological Agency of Russia, Moscow, Russia
</affiliation>
</aut>
<aut id="aut5">
<label>Author-5</label>
<name>Ivan V Baskakov</name>
<affiliation>
Semenov Institute of Chemical Physics, Russian Academy of Sciences, Russia
</affiliation>
</aut>
<aut id="aut6">
<label>Author-6</label>
<name>Oleg V Senko</name>
<affiliation>
Federal Research Center/Research Center of Informatics and Control, Russian Academy of Sciences, Moscow, Russia
</affiliation>
</aut>
</Author-Group>
<author-notes>
<corres-author>
<label>Corresponding-Author</label>
<name>Oleg V Senko</name>
<address>
Federal Research Center/Research Center of Informatics and Control, Russian Academy of Sciences, Moscow, Russia
</address>
</corres-author>
</author-notes>
<history>
<published-date>
<day>04</day>
<month>March </month>
<year>2020</year>
</published-date>
</history>
<citation>
<author-names>
<name>Kodryan MS</name>
</author-names>
<published-year>2020</published-year>
<article-title>
Nonparametric Method for Estimation of Controlled Correlations in Studies of VEGF-Hypoxia Relationship
</article-title>
<journal-short-name>Int J Clin Biostat Biom </journal-short-name>
<article-doi>10.23937/2469-5831/1510023</article-doi>
</citation>
<permissions>
<copyright>
<copyright-year>2020</copyright-year>
<copyright-holder>Kodryan MS</copyright-holder>
<copyright-notes>
© This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
</copyright-notes>
</copyright>
</permissions>
<article-content>
<Abstract>
<p>It is known that vascular endothelial growth factor (VEGF) expression is a response to hypoxia. On the other hand hypoxia may be detected by oximetry parameters including venous CO-oximetry indices or corresponding partial pressures of O2 and CO2. However significant correlation ties between VEGF levels and oximetry parameters were not found in groups of patients with ischemic stroke and transient ischemic attack. At that some effect related to the relationship between VEGF and sO2 was observed at corresponding scatter plots. Correlation between VEGF and proteins S100 levels in serum existed only in group with severe hypoxia where sO2 is less threshold close to 39-40%. So the relationship between VEGF level and saturation index sO2 exists in conjunction with additional factor that is S100 level in serum. To assess statistical significance of observed regularity it is necessary to test three null hypotheses about independence of one of involved factors on two another. The relationship may be manifestation of hypoxia effect on VEGF. To assess significance of hypoxia effect as a whole all three null hypotheses were tested with the help of developed technique based on random permutations and involving nonparametric combinations of criteria related to single oximetry parameters. The statistical significance assessments also involved multiplicity adjustment aimed to take into account multiple search of additional factors among variety of biological indices from analyzed data set. As a result of developed technique application all three considered null hypotheses were rejected at adjusted level p &#60; 0.02 when effect of hypoxia on correlation between VEGF and complement component C4 was evaluated.
</p></Abstract>
<Keywords>
<p>VEGF, Hypoxia, Controlled correlations, Permutation test, Nonparametric combinations, Multiple testing
</p></Keywords>
<Introduction>
<p>Angiogenesis may be a biological response to insufficient oxygen supply resulting in hypoxia. The key mediator of angiogenesis and probably neurogenesis [1] is vascular endothelial growth factor (VEGF) which is homodimeric glycoprotein with a molecular weight of approximately 45 kDa. VEGF expression is activated as a response to stabilization and nuclear translocation of hypoxia-inducible factor-1 (HIF-1) when intracellular oxygen level is reduced [2]. Existence of HIF-1, VEGF signalling pathways is confirmed by high levels of VEGF in patients with chronic obstructive pulmonary disease (CHOPD) [3] and asthma [4] or in subjects with "plateau red face" [5]. It is known that immune system is involved in angiogenesis via secreting VEGF and other pro-angiogenic factors by macrophages, neutrophyles and other immune cells [6-8]. Oxygen saturation index sO2 and other CO-oximetry parameters in venous blood reflect balance between oxygen delivery and oxygen consumption [9]. Low sO2 correspond to tissue hypoxia [10]. However correlation coefficients between CO-oximetry parameters and VEGF levels were small and not statistically significant in groups of patients with severe neurological disorders. Corresponding data set is discussed below. Correlation coefficients between VEGF and partial pressures of O2 and CO2 were also not significant. Lack of reliable ties may be attributed among other things to complexity of existing dependence when relationship between two factors is controlled by the third one. Previous study of the data set with the help of OVP method [11,12] and visual analysis of related sparse diagrams uncover complex effect involving sO2 and levels in serum of VEGF and proteins from S100 family.
</p>
<p>Left scatter diagram from Figure 1 corresponds to group with sO2 lower than 38.4%. This diagram conforms to existence of linear dependence of VEGF on S100 level. The only exception is one object that is marked with a red circle. At that there is no noticeable correlation between VEGF and S100 in the right diagram. This diagram corresponds to group with sO2 greater than 38.4%. It may be suggested that the correlation observed in the left diagram may be caused by severe hypoxia existing when sO2 is below 38.4%. The relationship from Figure 1 may be described by following equations:
</p>
<figure-1>
				<label>Figure 1</label>
				<title>Correlation between S100 and VEGF levels are compared in groups with sO2 &#60; 38.4% (left scatter plot) and sO2 > 38.4% (right scatter plot). </title>
				<graphic-link> https://www.clinmedjournals.org/articles/ijcbb/ijcbb-6-024-001.jpg</graphic-link>
			</figure-1>

<p>yj = βl0 + βl1xij + ∈lj i f zkj &#60; δ                              (1)yj = βr0 + βr1xij + ∈rj i f zkj ≥ δ
</p><p>Model (1) evidently is equivalent to standard piece-wise regression if Xi is equal to Zk. It is supposed that the verification procedure must satisfy following demands:
</p>
<p>• Verification procedure must include testing significance of both variables X and Z.
</p>
<p>• Hypoxia is assessed by several oximetry parameters. It may be expected that statistical technique evaluating the effect of hypoxia on relationship between VEGF and additional factor Xi would be more powerful if it implements combination of statistical tests assessing effect each of oximetry parameters on relationship between Y and Xi.
</p>
<p>• Effect from Figure 1 was found via testing variety of factors. So multiple testing must be taken into account when statistical significance is estimated.
</p>
<p>Permutation test is an approach capable of meeting the listed demands due to following advantages. Permutation test may be implemented regardless whether or not underlying distributions of test statistics are known. There are no limitations on data sets sizes. Different permutation tests were proposed for assessing importance of each predictor in multiple regression models. Method based on testing significance of corresponding partial correlation coefficients may be mentioned in this regard [13]. Permutation test was used to make a choice between piece-wise regression and a simple linear regression [14]. However mentioned techniques are not suitable to evaluated significance of the effect considered in the paper. Verification is possible with the help of discussed below procedure based on testing several null hypotheses.
</p>
<p>Effective methods calculating nonparametric combination (NPC) of several dependent permutation tests [15] may be used for assessing significance of hypoxia effect by several oximetry parameters. Also permutation tests are widely used to control multiplicity in various applied tasks including high-dimensional tasks related to DNA microarray experiments [16-19]. At that there are different ways to control FWER. Single step or stepwise procedures may be used to receive adjusted p-values from previously received raw p-values by min P correcting procedure or to calculate adjusted p-values directly from distributions of test statistics by maxT technique [20-22]. Unlike the mentioned works our paper is focused at problems associated with multiplicity control and combinations of several criteria when more complicated multifactor regularities are studied.
</p></Introduction>
<Data-Set-and-Preliminary-Results>
<p>Effect of hypoxia on relationship between VEGF and 138 different biochemical, clinical or biophysical parameters was studied in a group of 88 patients of age from 33 to 88 with ischemic stroke and transient ischemic attack. Hypoxia level was assessed by partial pressures of O2 and CO2 and also by CO-oximetry parameters in venous blood that were measured with ABL80 FLEX CO-OX analyser. Serum levels of VEGF, S100 and complement component C4 were measured by the enzyme-linked immunosorbent assay (ELISA). CO-oximetry parameters together with partial pressures of O2 and CO2 in venous blood will be for the simplicity further referred to as oximetry parameters.
</p>
<p>Results of standard correlation analysis are given in Table 1.
</p>
<table-1>
				<label>Table 1</label>
				<title>Correlation coefficients between partial pressures of O2 and CO2 and CO-oximetry parameters in venous blood and VEGF levels.</title>
				<graphic-link> https://www.clinmedjournals.org/articles/ijcbb/ijcbb-6-024-table1.html</graphic-link>
			</table-1>
<p>It can be seen from Table 1 that statistically significant linear ties between VEGF levels and hypoxia are absent.
</p>
<p>It is quite possible that linear ties nevertheless may exist in combination with some additional factors. Such supposition is supported by the effect of oxygen saturation index (sO2) on relationship between VEGF and proteins S100 levels in serum. This effect was discovered with the help of OVP technique [11] and visual analysis of corresponding scatter plots. Left scatter plot from Figure 1 presents strong linear relationship between VEGF and S100 in group with saturation level sO2 less than 38.4. It is seen from right scatter plot that noticeable linear dependence between VEGF and S100 is absent in the group with saturation level sO2 greater than 38.4.
</p>
<p>It may be supposed from Figure 1 that hypoxia leads to correlation between VEGF (Y ) and S100 (Xi). So S100 may be considered as additional factor. Our goal is to assess statistical significance of the assumed effect.
</p></Data-Set-and-Preliminary-Results>
<Verification-of-the-Effect>
<p>Complex dependencies testing: The above supposition is too complex to test using a single null hypothesis. In fact the effect contradicts the following three hypotheses:
</p>
<p>a) H10(k,i) -Yis independent of vector (Zk, Xi);
</p>
<p>b) H20(k,i) - Xi is independent of vector (Y, Zk);
</p>
<p>c) H30(k,i) - Zk is independent of vector (Y, Xi).
</p>
<p>All three hypotheses must be rejected to be sure that the supposition is perfectly correct. Otherwise the observed pattern may be explained simpler. For example it may be attributed to existence of linear relationship between Y and Xi when H30(k,i) is in fact true.
</p>
<p>Testing single hypothesis: The discussed effect is associated with great difference between ρl(Y,Xi) and ρr(Y,Xi) great value of one of the two correlation coefficients. High correlation values are achieved randomly in small groups. So the two conditions above may be a convincing evidence of the effect only when sizes of both groups are great enough. Thus the mentioned conditions correspond to great values of the following functional:
</p>
<p>Q2ρ(δ) = mlmr||ρl(Y,Xi)| − |ρr(Y,Xi)| |1 − max {ρ2l(Y,Xi), ρ2r(Y,Xi)},                  (2)
</p><p>Where ml is the number of patients in group s˜l with Zk &#60; δ and mr is the number of patients in group s˜r with Zk > δ. The threshold δ is initially unknown. It is proposed to use the optimal threshold δ0 that is calculated as δ0 = arg max Qˆ2ρ(δ). Maximum of the functional Q2ρ(δ) may be searched by trying all boundaries between distinct values of Zk existing in full group s˜. Great values of Q2ρ(δ0) better testify against each of 3 null hypotheses H10i(k,i), H20(k,i) and H30(k,i) if δ0 is searched inside interval (δ1; δr) including only such thresholds for Zk that provide simultaneous validity of inequalities ml > mthr and mr > mthr. The narrowed search interval is used because of the high probability of great Q2ρ(δ0) values when null hypotheses are true but one of the groups is small. Probability of great correlation coefficients in small groups evidently is higher. Full compensation of this probability increase is impossible by using multiplier mlmr only.
</p>
<p>Existence of outlying observations such as observation circled in red on the left part of Figure 1 reduces Q2ρ and so may hinder correct statistical evaluation of the studied effect. So it is better to use robust Pearson correlation coefficient.
</p>
<p>Robust correlation coefficient: Suppose that dependence of variable U on variable V is studied on data set s˜ = {(uj, vj) | j = 1, . . . , m}. At the first step simple linear regression model U = β0 + β1V + e is calculated by s˜. Let s˜out be the set of all 3σ outliers or s˜out = {(uj, vj) || uj - β0 - β1vj| > 3σe }, where σe is standard error of regression model. Robust correlation coefficient ρˆ is calculated as standard Pearson correlation coefficient ρ by set s˜ \ s˜out.
</p>
<p>The robust version of the functional 2 can be written as
</p>
<p>Qˆ2ρ(δ) = mlmr||ρˆl(Y,Xi)| − |ρˆr(Y,Xi)||1 − max {ρˆ2l(Y,Xi), ρˆ2r(Y,Xi)},               (3)
Where ρˆl and ρˆr are robust correlation coefficients in groups s˜l and
s˜r
</p><p>. Optimal threshold δ0 is calculated now as δ0 = argmaxδ∈(δl,δr)Qˆ2ρ(δ). Functional Qˆ2ρ(δ0) is used as statistics for testing null hypotheses H10(k,i), H20(k,i) and H30(k,i). Then p-values for these null hypotheses are calculated according to the following Procedure I:
</p>
<p>• Calculate optimal threshold δ0 on data set S˜t as argmax(δl,δr)Qˆ2ρ(δ). The observed statistics value T0 is taken equal to Qˆ2ρ(δ0).
</p>
<p>To test H10(k,i) repeat independently steps a1 and a2 for r = 1, . . . , N.
</p>
<p>• a1) Take a random permutation S˜rt of S˜t. This is obtained by considering a random permutation ur = (ur1,...,urm) of objects labels (1, . . . , m).
</p>
<p>Let S˜rt = {(yur1, x1i, z1k),...,(yurm, xmi, zmk)}.
</p>
<p>• a2) Calculate optimal threshold δ0 on training set S˜rt as argmaxδ∈(δl,δr)Qˆ2ρ(δ). The statistics value Tr is taken equal to Qˆ2ρ(δ0).
</p>
<p>• Then calculate estimate of p-value for the null H10(k,i) as pˆ1(k,i) = ∑1≤r≤N∥(Tr≥T0)N.
</p>
<p>To H20(k,i) repeat independently steps a3 and a2 for r = 1, . . . , N.
</p>
<p>• a3) Take a random permutation S˜rt of S˜t as S˜rt = {(y1,xur1i,z1k),...,(ym,xurmi,zmk)} Where ur = (ur1,...,urm) is a random permutation of {1, . . . , m}.
</p>
<p>• Implement step (a2).
</p>
<p>• Then calculate estimate of p-value for the null H20(k,i) as pˆ2(k,i) = ∑1 &#60; r &#60; N∥(Tr>T0)N.
</p>
<p>To test H30(k,i) repeat independently steps a4 and a2 for r = 1, . . . , N.
</p>
<p>• a4) Take a random permutation S˜rt of S˜t as S˜rt = {(y1,x11,zur1),...,(ym,xm1,zurm)} Where ur = (ur1,...,urm) is a random permutation of {1, . . . , m}.
</p>
<p>• Implement step (a2).
</p>
<p>• Then calculate estimate of p-value for null hypothesis H30(k,i) as pˆ3(k,i) = ∑1 &#60; r &#60; N∥(Tr>T0)N.
</p>
<p>A regularity for combination of factors (Y, Xk, Zi) similar to the one in Figure 1 is supposed to be significant at level α if all three inequalities pˆ1(k,i) &#60; α,pˆ2(k,i) &#60; α and pˆ3(k,i) &#60; α hold. It is difficult to make a theoretical conclusion about unbiasedness and consistency of the described test. However its performance can be assessed in experiments with simulated data.
</p>
<subtitle>Experiments with simulated data</subtitle>
<p>Design of experiments: Experiments were designed to imitate regularity from Figure 1 only for certain groups of variables while for the remaining ones such regularities were absent. Scenario includes generating variables Y, Z1, . . . , Z7, X1, . . . , Xn. VariablesYand e1, . . . , en were independently sampled from N(0,1), variable X1, Ug and variables U2, ..., U7 are independently sampled from continuous uniform distribution U(0,1). Variables X1, . . . , Xn are calculated fromY, e1, . . . , en, Z1 and Ug. Variables Z2, . . . , Z7 are calculated from Z1 and U2, . . . , U7.
</p>
<p>1) Variables X1, . . . , X30 for an observation j were calculated as Xij = Yj−δ1 ∗ eij if Z1j &#60; 0.4 and as Xij = δ2 ∗ eij otherwise. In groups with Z1j &#60; 0.4 correlation level betweenYand Xi is determined by parameter δ1. Experiments with δ1 = 0.75 and δ1 = 0.57 were conducted. Choice δ1 = 0.75 provides generating data with ρ(Y, Xi) = 0.8 and choice δ1 = 0.57 corresponds to ρ(Y, Xi) = 0.87. Parameter δ2 was taken equal to 1 + δ21−−−−−√. Observations with Z1j ≥ 0.4 were generated from distribution with ρ(Y, Xi) = 0.
</p>
<p>Thus in the first experiment data was sampled from distribution with ρ(Y, Xi) = 0.8, σY = 1 and σXi = 1 + 0.752−−−−−−−−√ when Z1 &#60; 0.4 and from distribution with ρ(Y, Xi) = 0, σY = 1 and σXi = 1 + 0.752−−−−−−−−√ when Z1 ≥ 0.4.
</p>
<p>In the second experiment data was sampled from distribution with ρ(Y, Xi) = 0.87, σY = 1 and σXi = 1 + 0.572−−−−−−−−√ when Z1 &#60; 0.4 and from distribution with ρ(Y, Xi) = 0, σY = 1 and σXi = 1 + 0.572−−−−−−−−√ when Z1 ≥ 0.4. So data is generated to provide existence of effect that is similar to effect from Figure 1 for each combination from set {(Y, Xi,Zk)|i = 1, . . . , 30, k = 1, . . . , 7}.
</p>
<p>2) Variables X31, . . . , X60 for the observation j were calculated as Xij = Yj−δ1∗eij if Ug &#60; 0.4 and as Xij = δ2∗eij if Ug ≥ 0.4. So observations are generated from mixture of distributions with ρ(Y, Xi) = 0.8 and ρ(Y, Xi) = 0 in the first experiment and from mixture of distributions with ρ(Y, Xi) = 0:87 and ρ(Y, Xi) = 0 in the second one. Thus data is generated to provide existence of weak mutual correlation for pairs from {(Y, Xi)|i = 31, . . . , 60} and independence of such pairs on Z1, . . . , Zk.
</p>
<p>3) Variables X61, . . . , X90 for the observation j were calculated as Xij = δ2∗eij. SoYis independent on variables X61, . . . , X90 and Z1.
</p>
<p>4) Variables Z2, . . . , Z7 for the observation j were calculated as Zij = Z1j if Ug ≤ 0.9 and as Zij = 1 - Z1j if Ug > 0.9. There are no regularities for combinations (Y,Xk,Zi) when 31 ≤ i ≤ 90 that are similar to regularity from Figure 1. Variables Z1, . . . , Z7 are included in scenario to imitate all 7 oximetry factors. At that for combinations (Y,X1,Zi) regularities are more distinct to compare with regularities for combinations (Y,Xk,Zi) when k > 1. Sets X1, . . . , X30; X31, . . . , X60; X61, . . . , X90 will be referred to as C˜1, C˜2, C˜3 correspondingly.
</p>
<p>Results of experiment: Results of the first and second experiments are presented in Table 2. Columns of the table correspond to significance levels from p &#60; 0.0001 to p &#60; 0.1. Upper part of table corresponds to first experiment (δ1 = 0.75) and lower part of table corresponds to second experiment (δ1 = 0.57). Cell at intersection of row corresponding to significance level α and column corresponding to subset C˜j contains number of triples (Y, Xi,Z1) with Xi ∈ C˜j for which all three null hypotheses were rejected at least at level α. Number of triples from set {(Y,Xi,Zk)∣∣Xi ∈ C˜j,2≤k≤7} for which all three null hypotheses were rejected at level α is given in the same cell in parentheses.
</p>
<table-2>
				<label>Table 2</label>
				<title>Results of experiments with simulated data. </title>
				<graphic-link> https://www.clinmedjournals.org/articles/ijcbb/ijcbb-6-024-table2.html</graphic-link>
			</table-2>
<p>It may be seen from Table 2 that all three null hypotheses were rejected for the majority combinations from the set C˜1 = {(Y,Xi,Zk)|1 ≤ i ≤ 30, k = 1, . . . ,7}. In the first experiment all null hypotheses were rejected at significance level p &#60; 0.01 for all 30 combinations from C˜1 when k = 1 and for 163 combinations from 180 when k = 2, . . . ,7. On the contrary all null hypotheses were rejected only for few combinations from the sets C˜2 = {(Y,Xi,Zk)|31 ≤ i ≤ 60, k = 1, . . . ,7} and C˜3 = {(Y,Xi,Zk)|61 ≤ i ≤ 90, k = 1, . . . ,7}. All null hypotheses were rejected at significance level p &#60; 0.1 only for one combination from C˜2 and for one combination from C˜3 when k = 1. At that number of combinations where all three null hypotheses were rejected equals 6 inside C˜2 and 3 inside C˜3 for k = 2, . . . ,7. In the second experiment number of combinations where three null hypotheses were rejected at level α were higher than number of such combinations practically for all significance levels. So the results of experiments strongly indicate unbiasedness of the developed criterion.
</p>
<subtitle>Experiments with clinical data</subtitle>
<p>The developed technique was applied to find regularities similar to the one shown in Figure 1 on the described above clinical data set. Three null hypotheses were tested for combinations (Y, Xi,Zk) whereYis concentration of VEGF in serum, Z1, . . . , Z7 were oximetry parameters sO2, pO2, pCO2, FCOHb, FO2Hb, FMetHb, FHHb. All 138 variables different from VEGF concentration and oxymetry parameters were tried as additional factors X1, . . . , Xn. The most significant effects were revealed if concentrations of S100 proteins or complement component C4 in serum are used as additional factor X. Table 3 present calculated p-values pˆ1, pˆ2 and pˆ3 correspondingly for all such combinations.
</p>
<table-3>
				<label>Table 3</label>
				<title>Results of the null hypotheses testing when S100 or C4 are additional factors. </title>
				<graphic-link> https://www.clinmedjournals.org/articles/ijcbb/ijcbb-6-024-table3.html</graphic-link>
			</table-3>
<p>It is seen from Table 3 that all null hypotheses are rejected at significance level p &#60; 0.001 for combination (VEGF, pO2, C4), at significance level p &#60; 0.002 for combinations (VEGF, sO2, C4) and (VEGF, FO2Hb, C4), at significance level p &#60; 0.05 for combinations (VEGF, FHHb, C4), (VEGF, sO2, S100), (VEGF, pCO2, S100). Regularity related to effect of hypoxia on correlation between VEGF and S100 is shown at Figure 2.
</p>
<figure-2>
				<label>Figure 2</label>
				<title>Correlations between S100 and VEGF levels are compared in groups with sO2 &#60; 39.75% (left scatter plot) and sO2 > 39.75% (right scatter plot). Boundary point was calculated using Procedure I.</title>
				<graphic-link> https://www.clinmedjournals.org/articles/ijcbb/ijcbb-6-024-002.jpg</graphic-link>
			</figure-2>

<p>Pattern from Figure 2 is similar to the pattern from Figure 1. However boundary point for pattern from Figure 2 is received by procedure I. This boundary differs from boundary for the pattern from Figure 1 that was calculated by OVP method. Correlation coefficient between VEGF and S100 in group of 33 cases with sO2 &#60; 39.75% equals 0.64. Correlation coefficient increases to 0.88 after removing an outlying object highlighted in the left scatter diagram by red circle. No relationship between VEGF and S100 exists in group of 55 cases with sO2 &#60; 39.75% as it may be seen from right diagram. Corresponding correlation coefficient equals 0.03.
</p>
<p>It may be seen from Figure 3 and Figure 4 that effect of hypoxia on relationship between VEGF and C4 is similar to the effect of hypoxia on relationship between VEGF and S100. Correlation coefficient between VEGF and C4 is equal 0.47 in group of 31 cases with sO2 &#60; 39.25% which corresponds to left scatter diagram from Figure 3. Correlation coefficient increases to 0.76 after removing of outlying object which is highlighted at the left scatter diagram by red circle. No significant relationship between VEGF and C4 exists in group of 57 cases with sO2 > 39.25% as it may be seen from the right diagram. Corresponding correlation coefficient equals -0.11. Correlation coefficient increases to 0.05 after removing the highlighted at right diagram outlier.
</p>
<figure-3>
				<label>Figure 3</label>
				<title>Correlation between VEGF and C4 levels are compared in groups with sO2 &#60; 39.25% (left scatter plot) and sO2 > 39.25% (right scatter plot). Boundary point was calculated using Procedure I.</title>
				<graphic-link> https://www.clinmedjournals.org/articles/ijcbb/ijcbb-6-024-003.jpg</graphic-link>
			</figure-3>

			<figure-4>
				<label>Figure 4</label>
				<title>Correlation between VEGF and C4 levels are compared in groups with FHHB &#60; 56.3% (left scatter plot) and FHHB > 56.3% (right scatter plot). Boundary point was calculated using Procedure I. </title>
				<graphic-link> https://www.clinmedjournals.org/articles/ijcbb/ijcbb-6-024-004.jpg</graphic-link>
			</figure-4>

<p>Low saturation index sO2 corresponds to high FHHB values. Strong correlation between VEGF and S100 exists when FHHB is greater than a certain threshold. At that correlation coefficient is close to zero when FHHb is lower than the threshold as can be seen in Figure 4. Correlation coefficient between VEGF and C4 in group of 36 cases with FHHB > 56.3% equals 0.45. Correlation coefficient increases to 0.73 after removing of outlier highlighted at right diagram. No significant relationship between VEGF and C4 exists in group of 52 cases with FHHB &#60; 56.3% as it may be seen from left diagram. Corresponding correlation coefficient is equal -0.1. Correlation coefficient increases to 0.07 after removing of highlighted at left diagram outlier.
</p>
<p>Our goal is testing if hypoxia has effect on VEGF production via controlling relationship between VEGF and some additional factor. Hypoxia effect is manifested via effects associated with different oximetry parameters. Existence of supposed hypoxia effect contradicts simultaneously to several of null hypotheses associated with different oximetry parameters. Hypoxia effect may be assessed by testing global null hypotheses H10c(i) = ∩7k=1H10(k,i), H20c = ∩7k=1H20(k,i) and H30c = ∩7k=1H30(k,i) [15]. Last global hypotheses may be tested with the help of nonparametric combinations (NPC) methodology [15]. To test global hypothesis Hgc0(i) (g = 1, . . . , 3) on data set S˜t = {(y1, x1i, z11, . . . , z17), . . . , (ym, xmi, zm1, . . . , zm7)} following NPC procedure was used.
</p>
<p>Procedure II: Repeat steps (b1), . . . , (b4) for k = 1, . . . , 7.
</p>
<p>• b1) Calculate T0 according to step a0 from Procedure I on data set {(y1,x1i,z1k), . . . , (ym,xmi,zmk)}
</p>
<p>• b2) For r = 1, . . . , N repeat step if is tested, g = 1, . . . , 3.
</p>
<p>- b12) Take random permutation S˜rt = {(yur1,x1i,z1k), . . . , (yurm,xmi,zmk)} of S˜t according to step (a1) from Procedure I and implement step a2 from Procedure I to calculate statistics Tr by S˜rt.
</p>
<p>- b22) Take random permutation S˜rt = {(y1,xur1i,z1k), . . . , (ym,xurmi,zmk)} of S˜t according to step (a3) from Procedure I and implement step a2 from Procedure I to calculate statistics Tr by S˜rt.
</p>
<p>- b32) Take random permutation S˜rt = {(y1,x1i,zur1k), . . . , (ym,xmi,zurmk)} of S˜t according to step (a4) from Procedure I and implement step a2 from Procedure I to calculate statistics Tr by S˜rt.
</p>
<p>• b3) Calculate pˆ(k,i) = ∑1≤j≤N∥(Tj(i)≥T0(i))N.
</p>
<p>• b4) Calculate λ(k,r,i) = ∑1≤j≤N∥[Tj(i)≥Tr(i)]N r = 1, . . . , N
</p>
<p>• Calculate statistics T0c(i) = ψ[pˆ(1,i), . . . , pˆ(7,i)]
</p>
<p>• Calculate statistics Trc(i) = ψ[λ(1,r,i), . . . , λ(7,r,i)]
</p>
<p>• Then calculate pˆc(i) = ∑1≤j≤N∥[Trc(i)≥T0c(i)]N that is p-value testing hypothesis Hg0c when step bg2.
</p>
<p>Test statistics in Procedure II is calculated as a combining function of p-values related to partial tests. Several combining functions are discussed in [15]. The best performance is achieved according to our experiments when slightly modified Fisher combining function ψ is used. Let pˆ1, . . . , pˆk are some p-values calculated by permutation test with N random permutations. Then ψ(pˆ1, . . . , pˆk) = −2∑ki=1logpˆ′i, where pˆ′i = pˆi if pˆi > 0 and pˆ′i = 1/2N otherwise.
</p>
<p>Results of the Procedure II applied to the studied data set are presented in Table 4. It can be seen that the global null hypotheses H10c and H20c are rejected at level p &#60; 0.0005 when additional factors are C4 and S100 concentrations. Global null hypothesis H30c is rejected at p = 0.0001 when additional factor is C4 concentration. But H30c is not rejected when additional factor is S100 concentration.
</p></Verification-of-the-Effect>
<Multiplicity-Control>
<p>It was necessary to test global null hypotheses from set {H10c, H20c, H30c|i = 1, . . . , n} to reveal the supposed effect of hypoxia on relationship between concentration of VEGF and concentrations of C4 or S100. So a multiple testing procedure must be used to assess true statistical significance of revealed effects. It is sufficient to use a single-step procedure because only two global null hypotheses associated with C4 and S100 as initial factors were rejected. Methods min P and max T are effective tools of multiplicity control [22]. More universal min P procedure is preferable for discussed task because max T technique is based on unjustified supposition about approximate equality of test statistics distribution.
</p>
<p>Adjusted p-values were calculated by the represented below Procedure III.
</p>
<p>Repeat steps (c1), (c2) and (c3) for i = 1, . . . , n.
</p>
<p>• c1) Use Procedure II to calculate statistics T0c(i), T1c, . . . , TNc by S˜t and random permutations {S˜rt|r = 1, . . . , N} correspondingly. At that step bg2 is implemented when Hg0c(i) is tested, g = 1, . . . , 3.
</p>
<p>• c2) Calculate λc(0,i) = ∑1≤j≤N∥(Tjc(i)≥T0c(i))N
</p>
<p>• c3) Calculate λc(r,i) = ∑1≤j≤N∥(Tjc(i)≥Trc(i))N
</p>
<p>• c4) Calculate pˆmt = ∑1≤r≤N∥[mini∈{1,...,n}λrc(i)≤pˆ0c(i)]N
</p>
<p>• c5) pˆmt is equal to pˆgmt that is adjusted p-value testing global null hypothesis Hg0c when (bg2) is used at step (c1).
</p>
<p>The described Procedure III provides weak FWE control. Procedure III was applied to calculate adjusted p-values for global null hypotheses H10c, H20c and H30c. Results are presented in Table 4.
</p>
<table-4>
				<label>Table 4</label>
				<title>Results of the global null hypothesis testing with NPC and multiplicity control with Procedure III.</title>
				<graphic-link> https://www.clinmedjournals.org/articles/ijcbb/ijcbb-6-024-table4.html</graphic-link>
			</table-4>
<p>It is seen from Table 4 that the global null hypotheses H10c, and H20c are rejected when concentrations of C4 and S100 are additional factors. At that H30c is not rejected if additional factor is concentration of S100. So it is possible that pattern from the Figure 2 may be related only to existence of linear relationship between VEGF and S100 levels in serum which is not controlled by hypoxia. On the other hand set of relationships that are represented at Figure 3 and Figure 4 or are mentioned in Table 3 where concentrations of C4 is additional factor cannot be explained with the help of some simpler effect. These relationships cannot be reduced to linear correlation between VEGF and C4. Also they cannot be explained by effect of hypoxia on VEGF only or on C4 only. So supposition that relationship between VEGF and C4 levels in serum is controlled by hypoxia is in accordance with data.
</p></Multiplicity-Control>
<Conclusion>
<p>Results may be shortly summarized as follows. A method was developed which is aimed to discover relationships of the following type in data: Significant linear correlation between two factorsYand Xi exists only if third factor Zk belongs to interval from one side of some threshold δ. At that from another side of δ Pearson correlation coefficient is close to zero.
</p>
<p>It was suggested to consider such three-factor relationship as statistically significant when rejecting three null hypotheses: H10c, H20c and H30c. Nonparametric permutation tests with statistics that is optimal value of special quality functional were used to test these hypotheses.
</p>
<p>Performance of the method was evaluated in tasks with simulated data. Good concordance between found regularities and patterns provided by the experiment scenario is seen from Table 2.
</p>
<p>The method was applied to test supposition that hypoxia control relationship between serum VEGF concentration and some factor from the analyzed clinical database. It was supposed that hypoxia is manifested by oximetry parameters. Three null hypotheses were rejected for set of triples (Y, Xi,Zk) whereYis VEGF concentration, Xi is some additional factor and Zk is some of oximetry parameters.
</p>
<p>Significance of hypoxia effect on correlation between VEGF level and additional factor Xi may be assessed as combined significance of effects related to different oximetry parameters. Combined significance was evaluated with the help of NPC method testing intersection of null hypotheses related to set of triples {(Y,Xi,Zk)|k = 1, . . . , 7}. A single-step permutations based FWE control was implemented to take into account that additional factor is searched among 138 variables.
</p>
<p>It was shown that three combined null hypotheses were rejected at significance level p &#60; 0.02 when concentration of complement C4 is the additional factor. Developed technique may be used in variety of biomedical tasks where it is necessary to assess effect of some factor or some group of factors on existing linear ties.
</p></Conclusion>
<Acknowledgement>
<p>This study was supported by RFBR grant 20-01-00609.
</p></Acknowledgement>
</article-content>
<article-references>
<title>References</title>
<ref id="ref1">
				<label>Reference-1</label>
				<mixed-citation>
				Han W, Song X, He R, Li T, Cheng L, et al. (2017) VEGF regulates hippocampal neurogenesis and reverses cognitive deficits in immature rats after status epilepticus through the VEGF R2 signaling pathway. Epilepsy Behav 68: 159-167.https://www.ncbi.nlm.nih.gov/pubmed/28193596
				</mixed-citation>
			</ref>
			
			<ref id="ref2">
				<label>Reference-2</label>
				<mixed-citation>
				<em>Z<sub>i</sub></em>ello JE, Jovin IS, Huang<em>Y</em>(2007) Hypoxia-Inducible Factor (HIF)-1 regulatory pathway and its potential for therapeutic intervention in malignancy and ischemia. Yale J Biol Med 80: 51-60.https://www.ncbi.nlm.nih.gov/pubmed/18160990
				</mixed-citation>
			</ref>
			
			<ref id="ref3">
				<label>Reference-3</label>
				<mixed-citation>
				Pavlisa G, Pavlisa G, Kusec V, Kolonic SO, Markovic AS, et al. (2010) Serum levels of VEGF and bFGF in hypoxic patients with exacerbated COPD. Eur Cytokine Netw 21: 92-98.https://www.ncbi.nlm.nih.gov/pubmed/20504760
				</mixed-citation>
			</ref>
			
			<ref id="ref4">
				<label>Reference-4</label>
				<mixed-citation>
				Asai K, Kanazawa H, Kamoi H, Shirashi S, Hirata K, et al. (2003) Increased levels of vascular endothelial growth factor in induced sputum in asthmatic patients. Clin Exp Allergy 33: 595-599.https://www.ncbi.nlm.nih.gov/pubmed/12752587
				</mixed-citation>
			</ref>
			
			<ref id="ref5">
				<label>Reference-5</label>
				<mixed-citation>
				L Ma,<em>Y</em>Chen, G Jin,<em>Y</em>Yang, Q Ga, et al. (2015) Vascular endothelial growth factor as a prognostic parameter in subjects with "Plateau Red Face". High Alt Med Biol 16: 147-153.https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4490706/
				</mixed-citation>
			</ref>
			
			<ref id="ref6">
				<label>Reference-6</label>
				<mixed-citation>
				Pollard JW (2004) Tumour-educated macrophages promote tumour progression and metastasis. Nat Rev Cancer 4: 71-78.https://www.ncbi.nlm.nih.gov/pubmed/14708027
				</mixed-citation>
			</ref>
			
			<ref id="ref7">
				<label>Reference-7</label>
				<mixed-citation>
				Ribatti D, Crivellato E (2009) Immune cells and angiogenesis. J Cell Mol Med 13: 2822-2833.https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4498938/
				</mixed-citation>
			</ref>
			
			<ref id="ref8">
				<label>Reference-8</label>
				<mixed-citation>
				Hoeres T, Wilhelm M, Smetak M, Holzmann E, Schulze-Tanzil G, et al. (2018) Immune cells regulate VEGF signalling via release of VEGF and antagonistic soluble VEGF receptor-1. Clin Exp Immunol 192: 54-67.https://www.ncbi.nlm.nih.gov/pubmed/29235095
				</mixed-citation>
			</ref>
			
			<ref id="ref9">
				<label>Reference-9</label>
				<mixed-citation>
				Van Beest P, Wietasch G, Scheeren T, Spronk P, Kuiper M (2011) Clinical review: Use of venous oxygen saturations as a goal - a yet unfinished puzzle. Crit Care 15: 232.https://www.ncbi.nlm.nih.gov/pubmed/22047813
				</mixed-citation>
			</ref>
			
			<ref id="ref10">
				<label>Reference-10</label>
				<mixed-citation>
				Nebout S, Pirracchio R (2011) Should we monitor ScVO2 in critically ill patients? Cardiol Res Pract 2012: 370697.https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3177360/
				</mixed-citation>
			</ref>
			
			<ref id="ref11">
				<label>Reference-11</label>
				<mixed-citation>
				Senko OV, Kuznetsova AV (2006) The optimal valid partitioning procedures. Statistics on the Internet.http://statjournals.net/InterStat/YEAR/2006/abstracts/0604002.php?Name=604002
				</mixed-citation>
			</ref>

			<ref id="ref12">
				<label>Reference-12</label>
				<mixed-citation>
				Kuznetsova AV, Kostomarova IV, Senko OV (2013) Modification of the method of optimal valid partitioning for comparison of patterns related to the occurrence of ischemic stroke in two groups of patients. Pattern Recognition and Image Analysis 22: 10-25.
				</mixed-citation>
			</ref>
			
			<ref id="ref13">
				<label>Reference-13</label>
				<mixed-citation>
				Anderson MJ, Robinson J (2001) Permutation tests for linear models. Aust N Z J Stat 43: 75-88.https://www.uvm.edu/~statdhtx/StatPages/R/RandomizationTestsWithR/permut2.pdf
				</mixed-citation>
			</ref>
			
			<ref id="ref14">
				<label>Reference-14</label>
				<mixed-citation>
				Kim HJ, Fay MP, Feuer EJ, Midthune DN (2000) Permutation tests for jointpoint regression with applications to cancer rates. Stat Med 19: 335-351.https://www.ncbi.nlm.nih.gov/pubmed/10649300
				</mixed-citation>
			</ref>
			
			<ref id="ref15">
				<label>Reference-15</label>
				<mixed-citation>
				Pesarin F, Salmaso L (2010) Permutation tests for complex data: Theory, Applications and Software. John Wiley and Sons, Ltd.
				</mixed-citation>
			</ref>

			<ref id="ref16">
				<label>Reference-16</label>
				<mixed-citation>
				Dudoit S, Popper Shaffer J, Boldrick JC (2003) Multiple hypothesis testing in microarray experiments. Statistical Science 18: 71-103.https://projecteuclid.org/euclid.ss/1056397487
				</mixed-citation>
			</ref>

			<ref id="ref17">
				<label>Reference-17</label>
				<mixed-citation>
				Tusher VG, Tibshirani R, Chu G (2001) Significance analysis of microarrays applied to the ionizing radiation response. Proc Natl Acad Sci U S A 98: 5116-5121.https://www.ncbi.nlm.nih.gov/pubmed/11309499
				</mixed-citation>
			</ref>

			<ref id="ref18">
				<label>Reference-18</label>
				<mixed-citation>
				Ge Y, Sealfon SC, Speed TP (2009) Multiple testing and its applications to microarrays. Stat Meth Med Res 18: 543-563.https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4131454/
				</mixed-citation>
			</ref>

			<ref id="ref19">
				<label>Reference-19</label>
				<mixed-citation>
				Goeman JJ, Solari A (2014) Multiple hypothesis testing in genomics. Statist Med 33: 1946-1978.https://onlinelibrary.wiley.com/doi/abs/10.1002/sim.6082
				</mixed-citation>
			</ref>
			
			<ref id="ref20">
				<label>Reference-20</label>
				<mixed-citation>
				Westfall PH, Young SS (1993) Resampling-based multiple testing: Examples and methods for p-value adjustment. John Wiley &#38; Sons.
				</mixed-citation>
			</ref>
			
			<ref id="ref21">
				<label>Reference-21</label>
				<mixed-citation>
				Ge Y, Dudoit S, Speed TP (2003) Resampling-based multiple testing for microarray data analysis. Test 12: 1-77.https://link.springer.com/article/10.1007/BF02595811
				</mixed-citation>
			</ref>
			
			<ref id="ref22">
				<label>Reference-22</label>
				<mixed-citation>
				Westfall PH, Troendle JF (2008) Multiple testing with minimal assumptions. Biom J 50: 745-755.https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3117234/
				</mixed-citation>
			</ref>
</article-references>
</body>
</article>