Get Permission Shukla, Kashikar, and Desai: Analysis of diffusion tensor imaging metrics for glioma grading at 3T: Comparison with histopathology as gold standard


Introduction

Accurate diagnosis and grading of brain tumors is crucial as the management and prognosis of different grades of tumors is different.1 Pathological analysis of biopsy samples is the current gold standard for tumor grading. However, common potential pitfalls in neuropathology must be considered, such as the possible under sampling of a heterogenous glioma, which could lead to underestimation of the tumor grade2 and the possible difficulty to obtain a range of samples if the tumor is inaccessible to the neurosurgeon based on the location. Recent advances in the treatment of cerebral gliomas have increased the demands of non-invasive neuroimaging for the diagnosis, therapeutic planning, tumor monitoring, and patient outcome prediction. Magnetic resonance imaging (MRI) and computed tomography (CT) can display the anatomical appearance of brain tumor, but fails to provide physiologic and functional information that is crucial for tumor grading, predicting clinical outcome and response to therapy.3

Diffusion Tensor Imaging (DTI), a step further ahead in advanced MRI-based neuroimaging techniques, makes it possible to estimate the magnitude, orientation, and anisotropy of the brain's white matter tracts. Diffusion imaging examines the motion of water molecules, which is normally Brownian in the unimpeded, isotropic state. DTI takes advantages of the preferential diffusion of water in brain tissue, which is decreased perpendicular to the myelin sheaths and cell membranes of white matter axons.4 Various DTI metrics can be derived from the imaging data to provide information about the orientation and architecture of tissue microstructure at the voxel level.3 The most commonly derived DTI metrics are apparent diffusion coefficient (ADC) also known as mean diffusivity (MD) and fractional anisotropy (FA).5

Primary brain tumors are treated with a combination of surgery, radiation, and chemotherapy.6 The best treatment for an individual patient takes into account the tumor location, tumor grade, potential symptoms, and potential benefits versus risks of the different treatment options (modalities). Glioma grading is very important both in treatment decision and evaluation of prognosis.7, 8, 9 Current evidence supports a role for DTI in tumor grading and multimodal navigation during tumour surgery.

Aim

To analyse Diffusion Tensor Imaging metrics for glioma grading at 3T: comparison with histopathology as gold standard

Objectives

  1. To assess the diagnostic accuracy of axial diffusivity (AD), radial diffusivity (RD), apparent diffusion coefficient (ADC), fractional anisotropy (FA), linear isotropy coefficient (CL), planar isotropy coefficient (CP) and spherical isotropy coefficient (CS) values derived from DTI for grading of glial tumors.

  2. Sensitivity, specificity, positive and negative predictive values (PPV and NPV) and accuracy;

  3. Assess the association between ADC, FA, AD, RD, CL, CP, CS derived from DTI metrics and tumor grade.

  4. Predict range of different DTI metrics found in different grades of glioma.

Diffusion tensor imaging

Diffusion can be described as random thermic motion, or Brownian motion. Diffusion imaging examines the motion of water molecules, which is normally Brownian in the unimpeded, isotropic state.5, 10 The technique utilizes the fact that in tissue, diffusion is not necessarily random due to barriers that limit diffusion in one or more directions. Unhindered diffusion of water molecules is referred to as isotropic diffusion. Restriction of movement along only one axis is called anisotropic diffusion. Among others, the measured diffusion process depends on the applied magnetic gradients and the axis of myelinated white matter tracts.

Diffusion in White Matter (WM) is less restricted along the axon and tends to be anisotropic (directionally-dependent) whereas in Gray Matter (GM) is usually less anisotropic and in the Cerebrospinal fluid (CSF) is unrestricted in all directions (isotropic). Based on this assumption, Basser and colleagues (1994a,b) modelled the diffusion process by an ellipsoid, which can mathematically be represented by a 3×3 symmetric matrix, also known as tensor (hence DTI’s name origin).11

Technical and Biophysical Considerations of DTI

Various cellular structures—for example, cell membranes and intracellular organelles—impede the random motion of water molecules in the brain and instead cause them to move with some form of directionality called “anisotropy”.12, 13 This biological property is essential to understanding DTI, because the directionality of water molecules as they move within white matter tracts is a key component of fibre tracking.

The orientation of white matter tracts causes anisotropy, because water diffuses in a direction parallel to the axonal fibres as a result of the myelin sheaths, which create a barrier to the diffusion of water perpendicular to the axonal membranes. Collectively, this information is known as the “diffusion tensor,” a 3D ellipsoid model of water diffusion. The diffusion tensor directly represents the direction (anisotropy) of water and indirectly represents the orientation of white matter fibres. It is described as a 3D ellipsoid and is subjected to a linear algebraic procedure known as “diagonalization.” The diffusion tensor can then be represented by 3 Eigen values (l1 ≥ l2 ≥ l3), which are measures of the magnitude of diffusion, and subsequently by 3 eigenvectors (v1, v2, v3), which are orthogonal to each other and represent the direction of diffusion.7 So the basic concept behind DTI is that water molecules diffuse differently along the tissues depending on its type, integrity, architecture, and presence of barriers, giving information about its orientation and quantitative anisotropy.

DTI metrics

With DTI analysis it is possible to infer, in each voxel, properties such as the molecular diffusion rate [Mean Diffusivity (MD) or Apparent Diffusion Coefficient (ADC)], the directional preference of diffusion [Fractional Anisotropy (FA)], the axial (diffusion rate along the main axis of diffusion), and radial (rate of diffusion in the transverse direction)diffusivity.8

Figure 0
https://typeset-prod-media-server.s3.amazonaws.com/article_uploads/8f5b6c1f-6802-426b-9ed9-5ddd3f4fcc5c/image/d5a5500d-1476-4bab-816d-04f53c4395d1-uimage.png

Definitions of different DTI derived tensor metrics: ADC (apparent diffusion coefficient) is related to the integrity of the brain tissue.5 Also known as mean diffusivity (MD). In a MD or ADC map, all three eigen values of a voxel's tensor are simply averaged (or summed) to quantify the amount of diffusion.9

FA (fractional anisotropy is a measure of diffusion anisotropy that is derived from the standard deviation of the 3 eigen values, and ranges from 0 (isotropy) to 1 (maximum anisotropy).5

Axial (AD) and radial (RD) diffusivity are DTI parameters that represent diffusion properties along the axial and radial directions, respectively.5

A set of three metrics has been described that can be used to measure the directional dependence of diffusion: linear anisotropy (CL), planar anisotropy (CP), and spherical anisotropy (CS).3

The most commonly derived DTI metrics are apparent diffusion coefficient (ADC) also known as mean diffusivity (MD) and fractional anisotropy (FA).

Apparent Diffusion Coefficient

ADC (also known as MD) is related to the integrity of the brain tissue. 5 MD measures the magnitude of diffusion. Mean diffusivity is comparable and mathematically equivalent to the ADC in standard diffusion-weighted imaging. It is calculated as the mean of the 3 Eigen values, representing the directionally averaged diffusivity of water, which is affected by changes in the structure of brain tissue. 10, 7 Generally speaking, MD values are inversely correlated to FA values. High MD is expected in voxels with low anisotropy.8

ADC and gliomas

Tumor cellularity has been reported to be a major determinant of ADC values in brain tumors.14 As the ability of water molecules to diffuse within tissue in high-grade tumors decreases, ADC values decrease.5 It has been suggested that the regions with minimum ADCs reflect the sites of highest cellularity within heterogeneous tumors, and, therefore, these sites may be of diagnostic value in identifying high-grade tumor components.15, 16, 17 Sugahara et al hypothesized that if cell swelling restricts the motion of water in the interstitium and reduces the ADC value, the ADC of gliomas (except for the cyst/necrosis component) would be affected by tumor cellularity because most affected areas would be almost completely replaced by tumor cells: more highly cellular gliomas would have smaller interstitial space. In addition, through identification of the areas of highest cellularity with this technique, it might be possible to establish the grading of the gliomas, because cellularity is one of the most important factors for determining grade.

Fractional Anisotropy

Fractional anisotropy is the measurement of the tendency of water to diffuse in one direction (anisotropy), Fractional anisotropy is calculated from the standard deviation of the 3 eigen values, ranging from 0 (isotropy with 0 net direction) to 1 (maximum anisotropy along 1 eigenvector).18 This directionality is typically presented in a color-coded map or via fibre tractography whereby the colour hue indicates directionality and brightness is proportional to the FA.7 High FA values are expected in white matter tracts that move along a single axis, while low FA values are expected in free water areas such as ventricles.8

FA and gliomas

Mathematic indices such as fractional anisotropy (FA) derived from DTI data can imply microstructural integrity of brain tissue. However, measurements of FA for tumor grading may show conflicting results. Inoue et al. reported that the FA values of low-grade gliomas are significantly lower than those of high-grade by a threshold of 0.188, 19 while Goebell et al. showed low FA ratios in the tumor centres of both low-grade and high-grade gliomas. 20 In the peritumoral region, the T2-weighted hyperintense area surrounding the high-grade glioma, the FA value is typically reduced resulting from a combination of perifocal edema, tumor mass effect, and invasion of tumor cells. 21 Low-grade gliomas tend to deviate, rather than destruct or infiltrate the adjacent white matter. 22 Therefore, FA value is less reduced in low-grade gliomas. 23

Stadlbauer et al, in their study, concluded that FA is better than mean diffusivity for assessment and delineation of different degrees of pathologic changes (ie, TI) in glioma.24

Various studies using DTI have also found no difference in FA measurements in the peritumoral tissue of high-grade gliomas compared with minimally or non-infiltrating tumors such as metastases or meningiomas but have found differences in other parameters such as the visual appearance of the FA maps, mean diffusivity, and the magnitude of the principal eigen values. FA can be altered by changes in either the anisotropic or isotropic components of the tensor.

ADC and FA studies in glioma

From a clinical standpoint, FA values are lower and MD values are higher in damaged white matter when compared to healthy tissue. Depending on the specific condition, this is thought to be due to edema, axonal disruption, or a combination of the two.8

Previous studies have shown there is no significant difference in intra tumoral tensor measurements between gliomas and metastases, although one study found FA to be higher in glioblastomas when compared to metastases, and another study found apparent diffusion coefficient (ADC) within the tumors to be lower in gliomas than metastases.8

Studies have also been done to understand DTI patterns of white matter surrounding tumours. They considered the following DTI patterns of white matter surrounding the tumors: edematous, displaced, infiltrated and disrupted. The classification of such different patterns was based on the FA values and on the direction and integrity of the white matter tracts adjacent to the tumors.

White matter disruption by the tumour: isotropic or near isotropic diffusion so that tract is not identifiable on fractional anisotropy (FA) or directionally encoded colour maps.

Tumour infiltrated white matter tracts: reduction of FA (25%) with increased apparent diffusion coefficient (ADC) with abnormal colour hues not as a result of bulk movement.

Oedematous white matter tracts: reduction of FA (25%) with increased ADC with normal direction and location (i.e. colour hues) on directionally encoded maps. There is some doubt if this differs much from the infiltrated tracts described above.

Displacement of white matter tracts: normal or mildly decreased (25%) FA values compared with contralateral side, but alteration in either position or direction of fibres on directionally encoded colour maps.

Axial diffusivity(AD) and radial (RD) diffusivity

Axial (AD) and radial (RD) diffusivity are DTI parameters that represent diffusion properties along the axial and radial directions, respectively. 5

A set of three metrics has been described that can be used to measure the directional dependence of diffusion: linear anisotropy (CL), planar anisotropy (CP), and spherical anisotropy (CS). 3 Jiang L et al concluded that AD in the tumor zone and Cs and Cl in WM adjacent to edema provide additional information to better classify gliomas. 25 These metrics may be complementary to the traditional tensor metrics, such as ADC, FA, and MD.

Server et al(2014) in their study to assessed the diagnostic accuracy of axial diffusivity (AD), radial diffusivity (RD), apparent diffusion coefficient (ADC) and fractional anisotropy (FA) values derived from DTI for grading of glial tumors in 78 patients , estimated the correlation between DTI parameters and tumor grades. They found that ADC, RD and AD were useful DTI parameters for differentiation between low- and high-grade gliomas with a diagnostic accuracy of more than 90% and can be used as reliable non-invasive imaging markers in grading of gliomas. 5

Technical limitations of the technique

Current DTI techniques fall short on spatial resolution, signal to noise ratio (SNR) and susceptibility to a heterogenic magnetic field.

Materials and Methods

Study Population

All patients diagnosed with glioma on conventional MRI/ MR perfusion imaging / MR spectroscopy and coming to the Radiology department for imaging were asked to participate in the study.

Sampling technique and sample size

Sample size

A study by Andrés Server a, Bjørn A. Graff b, Roger Josefsenc, Tone E.D. Orheimd et al showed that Adct, Adt, RDt, and glial tumor grade were strongly correlated with Pearson r = -0.739. Using this correlation value with an α = 0.5, Power = 80 % and δ = -0.30, we estimated the sample size using the sample size formula for single correlation. Based on these estimates the sample size was found to be 38. Sample size was estimated using Stata Version 13.

Sampling technique

Consecutive Sampling Technique was used to choose the study subjects.

Study eligibility

Inclusion criteria

  1. Age group – 15 - 65 years

  2. Gender – both males and females

Exclusion criteria

  1. Claustrophobic

  2. Pacemaker implanted

  3. Patients who are not undergoing biopsy/ surgical removal of glioma

Study duration

The study was carried out from May 2017 to April 2019.

Study design

Diagnostic Accuracy study

Consent

The protocol was explained to the patients in the language best understood by them and an informed written consent was obtained from all patients prior to the MRI examination.

Data collection method

38 consecutive cases fulfilling eligibility criteria were taken for study after taking informed consent. A detailed history regarding Demographic data and brief clinical history was recorded. Patients’ identifiers were removed from image data before analysis. Patient or relatives were informed that data collected would be used in a study and that issues related to confidentiality and anonymity would be taken due care of.

MRI DTI Imaging

Siemens 3T MAG TRIO A Tim Sys MRI machine was used to perform the MRI. Each patient was examined in the supine position. The following sequences with corresponding parameters were performed:

Table 0

Sequence

TR

TE

SLICE thickness

PHASE

MATRIX

FOV

GAP

NEX

B value

DTI

3000

93

5 MM

A >> P

128 X 128

230

1.5

4

1000

Image analysis

We transferred the diffusion tensor data to an independent workstation for post- processing using dedicated software. Circular ROI of approximately 30 mm² was placed on most solid and lowest signal intensity part of tumor on ADC maps, peritumoral edema corresponding to area adjacent to tumor (area of low signal intensity on T1 weighted images and high signal intensity on T2 weighted images) and normal appearing white matter in the corresponding contralateral hemisphere (which displayed no abnormal signal on T1 weighted or T2 weighted images, contact with grey matter was avoided). The ROIs were carefully placed to avoid cystic, necrotic and hemorrhagic regions which might influence DTI metrics values. ROIs were then automatically transfered to corresponding λ1, λ2, λ3 and FA maps. FA, ADC, AD, RD, Cp, Cs and Cl was obtained in each of these regions.

Data entry and statistical analysis

DTI parameters and tumor grades were analyzed statistically.

Data was entered in MS Excel, corrected for typographic errors and analysed using SPSS software version 20.

The results were re-arranged in MS Word. Graphical representation of the results was done using MS Excel.

The difference between means was compared using t-test and for non-parametric data we used Mann Whitney U test. Pearson’s correlation was calculated, the diagnostic test properties were assessed by Sensitivity, Specificity, Positive Predictive Value (PPV), Negative Predictive Value (NPV), Diagnostic accuracy and Area under the Curve (AUC). A P value of < 0.5 was considered as statistically significant.

Ethics

The study was performed in accordance with the guidelines of the ethical committee at our institution, which is equivalent to an institutional review board. The committee approved this study.

Results and Discussion

Gliomas are the most common primary brain tumors, representing 80% of primary brain tumors.26 The study included 38 patients with glioma of which 13 patients had histologically verified grade II (9 low-grade astrocytomas, 1 oligodendrogliomas, and 3 oligoastrocytomas), 10 patients had histologically verified grade III (7 anaplastic astrocytomas and 3 anaplastic oligoastrocytomas), and 15 patients had histologically verified grade IV (glioblastoma multiforme).

We compared DTI metrics using 21 parameters in our study. Scatter plots (1-7) summarize the correlation between tumor grades and DTI metrics. Overall, there was a strong, negative correlation between ADC(T), ADC (PT), AD (T), RD (T), CL(PT) and tumour grades and positive correlation between CP (T), CP (PT) and tumor grades. ADC (T), ADC (PT), AD (T), RD (T), CL (T) and CL (PT) values were significantly higher in low-grade gliomas compared with high-grade gliomas, except for the DTI CP (T), CP (PT) which was higher in the high grade (Table 5).

A significant difference with high CP (Table 5) value in the solid tumoral parts of high-grade gliomas was reported by Lee et al which was similar to our study.27

When comparing minimum FA (T), we found no difference between low- and high-grade gliomas, in accordance with other authors.5 This could be attributed to the fact that most high- grade gliomas arise from dedifferentiated lower grade ones.28 On the other hand, Inoue et al.,19 Kinoshita et al.,29 Beppu et al.,30 and Liu et al.31 found higher FA values in high grade gliomas compared with low-grade gliomas. While Inoue et al. reported that the FA values of low-grade gliomas are significantly lower than those of high-grade by a threshold of 0.188, 19 Goebell et al. showed low FA ratios in the tumor centres of both low-grade and high-grade gliomas. 20 A possible reason for these conflicting results could be the difference in the regions studied from the tumor. A study by Lee HY reported no significant differences in the FA ratios between high grade and low grade gliomas. 27 Another study added that higher anisotropic values within the solid parts of high-grade compared to low-grade gliomas may be attributed to the high cellularity of high-grade gliomas. 32

When correlating individual parameters with tumor grade, (Table 7) we found that AD (T) had the highest Pearson correlation factor at -0.73 followed by ADC (T) at -0.641. The other parameters like ADC (PT), CL (PT), CP (T) and CP (PT) were also found to be significantly associated. We found a significant negative correlation between all these factors except CP(T) and CP (PT). (Table 5) This finding was similar to a study done in Norway.

We used threshold values of ADC (T) = 1.115, AD (T) =1.075 and RD (T) = 0.930 as was reported in literature,5 to calculate sensitivity, specificity, NPV, PPV and Diagnostic Accuracy. (Table 6) The sensitivity and NPV of ADC (T) in our study was 100%, indicating that this parameter is an excellent tool for the discrimination of Low grade from high grades tumours.

ROC analysis (Table 8) yielded AUC values of 83.1% for ADC (T) and 75.1% for ADC (PT) for discrimination of high grade from low grade tumours. AUC was 94.9% for AD (T), 88.9% for RD (T), 81.4% for CL (T), 80% for CL (PT) and 92% for CP (T) and CP (PT). In comparison, ADC (T), ADC (PT) and CP (PT) with a AUC of 95.7%, 69.4% and 73.4% was reported by El-Serougy L.26

ROC analysis yielded AUC values of 98.5% (ADCt) and 97.2% (ADCt/n) for distinguishing high grade from low grade tumours. 5

The cut off value of 1.078 for ADC (T) provided a sensitivity of 96% and specificity of 76.9% for differentiation of high grade from low grade tumors. (Table 9, Table 10) A Server et al. reports that the cut off value of 1.055 (10−3 mm2/s) for the minimum ADC (T) provided the best combination of sensitivity (100%) and specificity (94.4%) for discrimination of grade II from IV. Murakami et al.defined a threshold minimum ADC value of 1.01 and obtained sensitivity and specificity 83 and 91% respectively, in the differentiation between grade III versus grade IV tumors. 5

In the current study, RD (T) was a DTI parameter that enables distinction between High grade and low grades with a sensitivity of 100% indicating high true-positive and low false-negative rates. The high NPV, 100% for RD (T) is likewise a significant finding, as glial tumors with higher RD (>1.055) are unlikely to have high-grade components. A Server reports similar findings for a cut off of 0.930. 5

AD (T) was a DTI parameter that enables distinction between High grade and low grades with a sensitivity of 96% indicating high true-positive and low false-negative rates. (Table 9, Table 10) The high NPV, 90.9% for AD (T) is likewise a significant finding, as glial tumors with higher RD (>1.33) are unlikely to have high-grade components. A Server reports similar findings for a cut off of 1.225. 5

CP (Peritumoral) with a sensitivity of 68.4%, 81.3%, AUC of 72.4% was reported by El-Serougy L for a cut off of 0.32. 26

A diagnostic accuracy of 92.1% was obtained for ADC (T) (Cut off 1.115). (Table 6) Predicted range of cut off values also revealed diagnostic accuracy of 89.47% for ADC (T), AD (T), RD (T) and CP(T). (Table 9, Table 10) Another study added that ADC, RD and AD are useful DTI metrics for the differentiation between low-grade and high-grade gliomas with a diagnostic accuracy of more than 90%, and can be used as non invasive reliable biomarkers in the grading of gliomas. 5

As seen in our study as well as various previous studies including one by Ma L et al, it can be seen that rather than individual DTI metrics, combined DTI metrics can function in effect as a non-invasive measure to distinguish between low-grade and high-grade gliomas.33

However, our findings do indicate that it may be advantageous to switch from the commonly used DWI protocol that only allows for the extraction of the ADC/MD, to a DTI protocol that also yields the AD. With current state-of-the-art scanners, this can be realized without significantly increasing the measurement time.

Table 1

Distribution of Type of tumours found in the study subjects.

Grade of tumour

HPE Examination

Number

Percentage

Grade 2

Astrocytomas

9

23.68%

Oligodendroglioma

1

2.63%

Oligoastrocytoma

3

7.89%

Grade 3

Anaplastic Astrocytomas

7

18.42%

Anaplastic Oligoastrocytomas

3

7.89%

Grade 4

Glioblastoma Multiforme

15

39.47%

Total

38

100

Chart 1

Pie chart showing Distribution of Type of tumours.

https://typeset-prod-media-server.s3.amazonaws.com/article_uploads/8f5b6c1f-6802-426b-9ed9-5ddd3f4fcc5c/image/9b8e918c-d897-4206-8ea2-84ab08be073c-uimage.png

For statistical purposes all astrocytic, oligodendroglial, and oligoastrocytic tumors were categorized as low-grade tumors (diffuse astrocytomas, oligodendrogliomas, or oligoastrocytomas, WHO grade II) and high-grade glial tumors (anaplastic astrocytomas or anaplastic oligoastrocytomas, WHO grade III, and glioblastoma multiforme, WHO grade IV).

Table 2

Mean Age of the study subjects according to thetumour grade.

Tumour Grade

Age

Mean

SD

Low Grade Tumours (N= 13)

48.54

14.706

High Grade Tumours (N= 25)

55.44

11.424

Diagram 1

Mean Distribution of age of the two groups.

https://typeset-prod-media-server.s3.amazonaws.com/article_uploads/8f5b6c1f-6802-426b-9ed9-5ddd3f4fcc5c/image/37076f99-f47b-4f71-a643-37bd948cd56e-uimage.png

Table 3

Sex wise distribution of the study subjectsaccording to the tumour grade.

Tumour Grade

Sex

Frequency

Percentage

Low Grade Tumours (N= 13)

Females

4

30.80%

Males

9

69.20%

High Grade Tumours (N= 25)

Females

11

44%

Males

14

56%

Diagram 2

Distribution of males and females in the two groups.

https://typeset-prod-media-server.s3.amazonaws.com/article_uploads/8f5b6c1f-6802-426b-9ed9-5ddd3f4fcc5c/image/31aefa0d-af31-4afe-8def-a7770726609d-uimage.png

Table 4

Table showing different DTI metrics according to tumour grades.

Parameters

Low Grade Tumours (N=13)

High Grade tumours (N=25)

t value

P value

Mean

SD

Mean

SD

FA (T)

0.159

0.114

0.123

0.096

1.038

0.306

FA (PT)

0.148

0.060

0.123

0.063

1.175

0.248

ADC (T)

1.318

0.287

0.952

0.144

5.261

<0.001

ADC (PT)

1.582

0.129

1.423

0.201

2.589

0.014

AD (T)

1.419

0.180

0.956

0.204

6.887

<0.001

AD (PT)

1.877

0.120

1.789

0.202

1.444

0.157

RD (T)

1.210

0.304

0.728

0.172

6.266

<0.001

RD (PT)

1.418

0.132

1.310

0.233

1.539

0.133

FA (WM)

5.285

0.633

5.336

0.697

-0.224

0.824

ADC (WM)

8.016

0.958

7.766

0.953

0.768

0.448

CL (T)

0.069

0.011

0.079

0.013

-2.385

0.022

CL (PT)

0.079

0.013

0.069

0.009

2.884

0.007

CP (T)

0.080

0.014

0.110

0.014

-6.368

<0.001

CP (PT)

0.071

0.016

0.106

0.017

-6.133

<0.001

CS (T)

0.868

0.035

0.822

0.097

1.668

0.104

CS (PT)

0.866

0.040

0.817

0.098

1.745

0.09

AD (WM)

1.233

0.047

1.254

0.076

-0.865

0.393

RD (WM)

0.506

0.042

0.485

0.084

0.967

0.392

CP (WM)

0.189

0.0451

0.194

0.044

-0.313

0.756

CS (WM)

0.496

0.071

0.496

0.079

-0.025

0.981

CL (WM)

0.3108

0.039

0.313

0.062

-0.127

0.899

Table 5

Sensitivity, specificity, positive and negative predictive values (PPV and NPV), and accuracy of DTI Metrics.

Threshold Values

Sensitivity (%)

Specificity

PPV

NPV

Diagnostic Accuracy

ADC (T)= 1.115

100%

76.90%

89.30%

100%

92.10%

AD (T) = 1.075

72%

100%

100%

65%

81.50%

RD (T) = 0.930

12%

100%

100%

34.20%

42.10%

Table 6

Table showing DTI metrics and its correlation with the grades of tumour

DTI Metrics v/s Grade of tumour

Pearson's Correlation

P value

FA (T)

-0.192

0.248

FA (PT)

-0.2

0.229

ADC (T)

-0.641

<0.001

ADC (PT)

-0.386

0.017

AD (T)

-0.73

<0.001

AD (PT)

-0.083

0.622

RD (T)

-0.625

<0.001

RD (PT)

-0.241

0.145

FA (WM)

0.084

0.616

ADC (WM)

0.289

0.079

CL (T)

0.308

0.06

CL (PT)

-0.395

0.014

CP (T)

0.592

<0.001

CP (PT)

0.561

<0.001

CS (T)

-0.068

0.685

CS (PT)

-0.058

0.729

AD (WM)

0.039

0.815

RD (WM)

-0.122

0.467

CP (WM)

0.039

0.816

CS (WM)

0.105

0.529

CL (WM)

0.043

0.800

Table 7

Prediction of different range of DTI metrics.

Parameters

AUC

P Value

FA (T)

0.615

0.249

FA (PT)

0.606

0.288

ADC (T)

0.831

0.001

ADC (PT)

0.751

0.012

AD (T)

0.949

<0.001

AD (PT)

0.622

0.224

RD (T)

0.889

<0.001

RD (PT)

0.629

0.196

FA (WM)

0.468

0.747

ADC (WM)

0.543

0.667

CL (T)

0.814

0.002

CL (PT)

0.80

0.003

CP (T)

0.92

<0.001

CP (PT)

0.92

<0.001

CS (T)

0.645

0.148

CS (PT)

0.675

0.079

AD (WM)

0.54

0.689

RD (WM)

0.418

0.415

CP (WM)

0.531

0.758

CS (WM)

0.500

1

CL (WM)

0.494

0.951

Table 8

Optimum cut off values of differentmetrices of the tumoral and peri-tumoral regions with highest accuracy selected to differentiate the high grade from low grade gliomas

Parameter

Cut off Value

Sensitivity

1- Specificity

ADC (T)

1.078

0.96

0.231

ADC (PT)

1.536

0.76

0.308

AD (T)

1.33

0.96

0.231

RD (T)

1.055

1

0.308

CL (T)

0.0685

0.92

0.308

CL (PT)

0.0725

0.80

0.308

CP (T)

0.0949

0.88

0.077

Table 9

Sensitivity, Specificity, NPV, PPV and Diagnostic Accuracy.

Parameter

Cut off

Sensitivity (%)

Specificity (%)

PPV (%)

NPV (%)

Diagnostic Accuracy (%)

ADC (T)

1.078

96

76.9

88.9

90.9

89.47

ADC (PT)

1.536

76

69.2

82.6

60

73.68

AD (T)

1.33

96

76.9

88.9

90.9

89.47

RD (T)

1.055

100

69.2

86.2

100

89.47

CL (T)

0.0685

92

69.2

85.2

81.8

84.21

CL (PT)

0.0725

76

76.9

86.4

62.5

76.31

CP (T)

0.0949

88

92.3

95.7

80

89.47

Graph 1

Scatterplot showing correlation between ADC (T) and the tumour grades. Scatter plot 2:

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/b5def762-0a0a-4a98-906f-81a401ed974bimage5.png

Graph 2

Scatterplot showing correlation between ADC (PT) and the tumour grades.

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/b5def762-0a0a-4a98-906f-81a401ed974bimage6.png

Graph 3

Scatterplot showing correlation between AD (T) and the tumour grades.

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/b5def762-0a0a-4a98-906f-81a401ed974bimage7.png

Graph 4

Scatterplot showing correlation between RD (T) and the tumour grades.

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/b5def762-0a0a-4a98-906f-81a401ed974bimage8.png

Graph 5

Scatterplot showing correlation between CL (PT) and the tumour grades.

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/b5def762-0a0a-4a98-906f-81a401ed974bimage9.png

Graph 6

Scatterplot showing correlation between CP (T) and the tumour grades.

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/b5def762-0a0a-4a98-906f-81a401ed974bimage10.png

Graph 7

Scatterplot showing correlation between CP (PT) and the tumour grades.

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/b5def762-0a0a-4a98-906f-81a401ed974bimage11.png

Graph 8

ROC curve 1: Graph showing receiver operating characteristics (ROC) curves of ADC (T) for differentiation of high grade from low grade tumours.

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/b5def762-0a0a-4a98-906f-81a401ed974bimage12.png

Graph 9

ROC curve 2: Graph showing receiver operating characteristics (ROC) curves of ADC (PT) for differentiation of high grade from low grade tumours.

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/b5def762-0a0a-4a98-906f-81a401ed974bimage13.png

Graph 10

ROC curve 3: Graph showing receiver operating characteristics (ROC) curves of AD (T) for differentiation of high grade from low grade tumours.

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/b5def762-0a0a-4a98-906f-81a401ed974bimage14.png

Graph 11

ROC curve 4: Graph showing receiver operating characteristics (ROC) curves of RD (T) for differentiation of high grade from low grade tumours.

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/b5def762-0a0a-4a98-906f-81a401ed974bimage15.png

Graph 12

ROC curve 5: Graph showing receiver operating characteristics (ROC) curves of CL (T) for differentiation of high grade from low grade tumours.

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/b5def762-0a0a-4a98-906f-81a401ed974bimage16.png

Graph 13

ROC curve 6: Graph showing receiver operating characteristics (ROC) curves of CL (PT) for differentiation of high grade from low grade tumours.

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/b5def762-0a0a-4a98-906f-81a401ed974bimage17.png

Graph 14

ROC curve 7: Graph showing receiver operating characteristics (ROC) curves of CP (T) for differentiation of high grade from low grade tumours.

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/b5def762-0a0a-4a98-906f-81a401ed974bimage18.png

Graph 15

ROC curve 8: Graph showing receiver operating characteristics (ROC) curves of CP (PT) for differentiation of high grade from low grade tumours.

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/b5def762-0a0a-4a98-906f-81a401ed974bimage19.png
Figure 1

A-H (from left to right) - MRI of a 48 year old male with weakness of left upper limb and lower limb, imbalance while walking and diminution of left sided eye vision, revealed aheterogenous predominantly T2 (A) hyperintense T1 (B) isointense heterogeneously enhancing (C) mass lesion in right temporo-parietal lobe with areas of necrosis and haemorrhage (D) within. (E-H) DTI with ADC and FA maps demonstrating the lesion. Histopathology confirmed Glioblastoma multiforme.

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/b5def762-0a0a-4a98-906f-81a401ed974bimage20.png
Figure 2

A-H (left to right) MRI of a 51 years old female with long standing on and off headache, vomiting and giddiness, imbalance while walking and complex partial seizures since 3 to 4 days showed a T1, T2 (A,B)heterogenous lesion in right high fronto- parietal lobe with significant perilesional edema. (C-F) DTI with ADC and FA maps demonstrating the lesion. (G,H) HPE revealed tumour composed of fibrillary astrocytes showing mildly enlarged oval nuclei. In regions rare oligodendroglial cells, cystic changes and foci of hemorrhages seen. No significant mitotic activity, necrosis or increase in the endothelial cells of vessels suggestive of DIFFUSE ASTROCYTOMA, GRADE II

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/b5def762-0a0a-4a98-906f-81a401ed974bimage21.png
Figure 3

A-H (left to right) MRI of a 69 year old male with slurring of speech, deviation of angle of mouth to the left side since last 2-3 months showed (A) T2 heterogeneous lesion in the leftfronto-parietal area showing (B) heterogenous post contrast enhancement and (C,D) restricted diffusion. (E-H) DTI with ADC and FA maps (E,F,G,H) demonstrating the lesion. (I,J) HPE revealed tumour composed of gemistocytes, oligodendroglial cells and plenty of giant cells. Admixed are vessels showing endothelial cell proliferation. In regions few oval cells showing small round nuclei. No definite tumour necrosis is observed. Few giant cells show markedly bizarre nuclei. Findings suggested DIFFUSE ASTROCYTOMA GRADE – III.

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/b5def762-0a0a-4a98-906f-81a401ed974bimage22.png

Figure 4

A-G (left to right) MRI of 45 year old male with headache and seizure revealed (A) T2 weighted images -heterogenous lesion with significant perilesional edema in left temporo- parietal area causing mass effect on midbrain. DTI with ADC and FA maps (B,C,D,E)) demonstrating the lesion. HPE (F,G) revealed tumorconsisting of sheets of oval cells showing markedly vacuolated cytoplasm. The centrally placed nuclei are rather pleomorphic in areas. Interspersed are islands of calcification and a few giant cells. In regions glomeruloid vessels and cells showing mitotic activity are observed. No necrosis is seen. Findings suggested ANAPLASTIC OLIGODENDROGLIOMA.

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/b5def762-0a0a-4a98-906f-81a401ed974bimage23.png
Figure 5

A-J (left to right) - MRI of a 77 year old female with headache and giddiness since one weekrevelaed heterogenously hyperintense lesion on t2 (A) and hypointense on T1 (B) in high parietal lobe. SWI (C) showed areas of hemorrhage within this lesion. Post contrast T1 W images (D) revelaed heterogeous peripheral enhancement. DTI with ADC and FA maps (E,F,G,H) demonstrating the lesion. (I,J) HPE revealed focally necrotic cellular tumour consisting of fibrillary astrocytes, focally appearing round which reveal pleomorphic, mitotically active nuclei. Admixed are plenty of vessels showing rather plump endothelial cells. No definite giant cells are seen. Findings suggested DIFFUSE ASTROCYTOMA GRADE 4

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/b5def762-0a0a-4a98-906f-81a401ed974bimage24.png
Figure 6

A-G (left to right) - MRI of 28 year oldmalewith headache since 10 years, generalised tonic clonic convulsions since one year , vomitting since one year and irrelevant talking since the last 2 days revealed large t2 (A) heterogeneously hyperintense lesion showing minimal patchy enhancement on post contrast T1 (C) occupying frontal horn and body of both lateral ventricles extending into right frontal lobe and right basal ganglia, causing perilesional edema and significant mass effect. DTI with ADC and FA maps (D,E,G,H) demonstrating the lesion. HPE revealed tumour composed of fibrillary astrocytes showing mildly enlarged oval nuclei. In regions rare oligodendroglial cells, cystic changes and foci of hemorrhages noted. No significant mitotic activity, necrosis or increase in the endothelial cells of vessels are seen. Findings suggested DIFFUSE ASTROCYTOMA, GRADE II

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/b5def762-0a0a-4a98-906f-81a401ed974bimage25.png
Figure 7

A-I (left to right) - MRI of a 53 year old female with weakness in the left upper lower limb since 1 month revealed a T2hyperintense (A), peripherally enhancing (B) centrally necrotic mass in right parafalcine perirolandic subcortical white matter, infiltrating into peritrigonal region, basal ganglia, thalamus, insular cortex, body and splenium of corpus callosum with extension to contralateral hemisphere showing SWI hypointensities within (C) and restricted diffusion (F,G) representing high grade primary brain neoplasm. DTI with ADC and FA maps (C,D,H,I) demonstrating the lesion.

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/b5def762-0a0a-4a98-906f-81a401ed974bimage26.png
Figure 8

A-H (left to right) - MRI of a 60 year old male with headache and seizures revealed aheterogenous predominantly T2 hyperintense (A) T1 isointense (B) lesion in right temporal lobe showing restricted diffusion (C,D). DTI with ADC and FA maps (E,F,G,H) demonstrating the lesion.

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/b5def762-0a0a-4a98-906f-81a401ed974bimage27.png
Figure 9

A-H (left to right) - MRI of 57 year old female revealed aheterogenous predominantly T2 hyperintense (A), T1 isointense (B) lesion in left parietal lobe crossing the midline and extending to the left parietal lobe. DTI with ADC and FA maps (C,D,E,F) demonstrating the lesion. HPE confirmed Glioblastoma Multiforme.

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/b5def762-0a0a-4a98-906f-81a401ed974bimage28.png
Figure 10

A-H (left to right) MRI of a 61 year old female withepilepsia partialis continua for 40 minutes and heaviness of left face and tongue for 1 weekshowed a T2 and FLAIR hyperintense (A,B) intensely homogeneously enhancing (B) lesion in right prerolandic gyri. DTI with ADC and FA maps (C,D,E,F) demonstrating the lesion. HPE showed GRADE 4 ASTROCYTOMA.

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/b5def762-0a0a-4a98-906f-81a401ed974bimage29.png

Conclusion

We have demonstrated the utility of DTI for the differentiation of High Grade from Low grade tumours. Our study confirms a good diagnostic performance for differentiating high-grade glioma from low grade tumours. Prediction of the cut off values of DTI metrics revealed high diagnostic accuracy and sensitivity for ADC(T), ADC(PT), AD (T), RD(T), CL(T), CL(PT) and CP(T) to differentiate High Grade from Low Grade Tumours.

Limitations

Since the sample of this study was relatively small, we need to be cautious when interpreting the results of this study. Also we were unable to recruit cases of Grade 1 glioma in our study.

Recommendations

We recommend further studies including a larger number of cases including fair number of all grades of glioma. With future research, DTI imaging modality may be further understood and optimized, for a better understanding in order to optimize patient outcomes.

Abbreviations

DTI: Diffusion Tensor Imaging, ADC: Apparent Diffusion Coefficient, MD: Mean Diffusivity, FA: Fractional Anisotropy, AD: Axial Diffusivity, RD: Radial Diffusivity, CL: Linear isotropy coefficient, CP: Planar isotropy coefficient, CS: Spherical isotropy coefficient, PPV: Positive Predictive Value, NPV: Negative Predictive Value, GBM: Glioblastoma Multiforme, WHO: World Health Organization, LGG: Low Grade Tumor, HGG: High Grade Tumor, WM: White Matter, NAWM: Normal Appearance White Matter, PT: Peri Tumoral, T: Tumor, AUC: Area Under The Curve, ROC: Receiver operating characteristics.

Source of Funding

No financial support was received for the work within this manuscript.

Conflict of Interest

The authors declare that they have no conflict of interest.

References

1 

A. Giese M. Westphal Treatment of malignant glioma: a problem beyond the margins of resectionJ Cancer Res Clin Oncol200112742172510.1007/s004320000188

2 

S J Price J H Gillard Imaging biomarkers of brain tumour margin and tumour invasionBr J Radiol2011842S1596710.1259/bjr/26838774

3 

S Wang S Kim E R Melhem Diffusion Tensor Imaging: Introduction and Applications to Brain Tumor CharacterizationFunctional Brain Tumor Imaging20132738

4 

S J Price R Jena N G Burnet P J Hutchinson A F Dean A Peña Improved delineation of glioma margins and regions of infiltration with the use of diffusion tensor imaging: an image-guided biopsy studyAJNR Am J Neuroradiol2006279196974

5 

A Server BA Graff R Josefsen TED Orheim T Schellhorn W Nordhøy Analysis of diffusion tensor imaging metrics for gliomas grading at 3TEur J Radiol2014833e156e16510.1016/j.ejrad.2013.12.023

6 

R B Daroff J Jankovic J C Mazziotta S L Pomeroy Bradley's Neurology in Clinical Practice E-BookElsevier Health Sciences2015

7 

KG Abdullah D Lubelski PGP Nucifora S Brem Use of diffusion tensor imaging in glioma resectionNeurosurgical Focus2013344E110.3171/2013.1.focus12412

8 

KS Holly B J Barker D Murcia R Bennett P Kalakoti C Ledbetter High-grade Gliomas Exhibit Higher Peritumoral Fractional Anisotropy and Lower Mean Diffusivity than Intracranial MetastasesFront Surg2017410.3389/fsurg.2017.00018

10 

A Gupta A Shah R J Young A I Holodny Imaging of Brain Tumors: Functional Magnetic Resonance Imaging and Diffusion Tensor ImagingNeuroimag Clin North Am20102037940010.1016/j.nic.2010.04.004

11 

J M Soares P Marques V Alves N Sousa A hitchhiker's guide to diffusion tensor imagingFront Neurosci2013710.3389/fnins.2013.00031

12 

S Saksena R Jain J Narang L Scarpace L R Schultz NL Lehman Predicting survival in glioblastomas using diffusion tensor imaging metricsJ Magn Reson Imaging20103247889510.1002/jmri.22304

13 

P W Schaefer P E Grant R G Gonzalez Diffusion-weighted MR Imaging of the BrainRadiol200021723314510.1148/radiology.217.2.r00nv24331

14 

S Wang S Kim S Chawla R L Wolf W-G Zhang D M Orourke Differentiation between glioblastomas and solitary brain metastases using diffusion tensor imagingNeuroImage200944365360

15 

R Murakami T Hirai T Sugahara H Fukuoka R Toya S Nishimura Grading Astrocytic Tumors by Using Apparent Diffusion Coefficient Parameters: Superiority of a One- versus Two-Parameter Pilot MethodRadiol200925138384510.1148/radiol.2513080899

16 

T Sugahara Y Korogi M Kochi I Ikushima Y Shigematu T Hirai Usefulness of diffusion-weighted MRI with echo-planar technique in the evaluation of cellularity in gliomasJ Magn Reson Imaging199991536010.1002/(sici)1522-2586(199901)9:1<53::aid-jmri7>3.0.co;2-2.

17 

R Murakami T Sugahara H Nakamura T Hirai M Kitajima Y Hayashida Malignant Supratentorial Astrocytoma Treated with Postoperative Radiation Therapy: Prognostic Value of Pretreatment Quantitative Diffusion-weighted MR ImagingRadiol20072432493910.1148/radiol.2432060450

18 

T. E. Conturo N. F. Lori T. S. Cull E. Akbudak A. Z. Snyder J. S. Shimony Tracking neuronal fiber pathways in the living human brainProce Natl Acad Sci1999961810422710.1073/pnas.96.18.10422

19 

T Inoue K Ogasawara T Beppu A Ogawa H Kabasawa Diffusion tensor imaging for preoperative evaluation of tumor grade in gliomasClin Neurol Neurosurg2005107317418010.1016/j.clineuro.2004.06.011

20 

E Goebell S Paustenbach O Vaeterlein D Xiao-Qi O Heese J Fiehler Low-Grade and Anaplastic Gliomas: Differences in Architecture Evaluated with Diffusion-Tensor MR ImagingRadiol2006239121722210.1148/radiol.2383050059

21 

S.J. Price N.G. Burnet T. Donovan H.A.L. Green A. Peña N.M. Antoun Diffusion Tensor Imaging of Brain Tumours at 3T: A Potential Tool for Assessing White Matter Tract Invasion?Clin Radiol20035864556210.1016/s0009-9260(03)00115-6

22 

ARE Potgieser RJM Groen Functional differentiation of the premotor cortex: behavioural and brain imaging studies in humansGroningen: Rijksuniversiteit Groningen2015

23 

K Hung-Wen C Shih-Wei C Hsiao-Wen FY Tsai C Cheng-Yu Advanced MR Imaging of Gliomas: An UpdateBio Med Res Int2013201311410.1155/2013/970586

24 

A Stadlbauer O Ganslandt R Buslei T Hammen S Gruber E Moser Gliomas: Histopathologic Evaluation of Changes in Directionality and Magnitude of Water Diffusion at Diffusion-Tensor MR ImagingRadiol200624038031010.1148/radiol.2403050937

25 

L Jiang C-Y Xiao Q Xu J Sun H Chen Y-C Chen Analysis of DTI-Derived Tensor Metrics in Differential Diagnosis between Low-grade and High-grade GliomasFront Aging Neurosci2017910.3389/fnagi.2017.00271

26 

L El-Serougy A A K A Razek A Ezzat H Eldawoody A El-Morsy Assessment of diffusion tensor imaging metrics in differentiating low-grade from high-grade gliomasNeuroradiol J2016295400710.1177/1971400916665382

27 

DJ Brat EGV Meir Vaso-occlusive and prothrombotic mechanisms associated with tumor hypoxia, necrosis, and accelerated growth in glioblastomaLab Investig200484439740510.1038/labinvest.3700070

28 

M. D. Budde M. Xie A. H. Cross S.-K. Song Axial Diffusivity Is the Primary Correlate of Axonal Injury in the Experimental Autoimmune Encephalomyelitis Spinal Cord: A Quantitative Pixelwise AnalysisJ Neurosci200929928051310.1523/jneurosci.4605-08.2009

29 

M Kinoshita N Hashimoto T Goto N Kagawa H Kishima S Izumoto Fractional anisotropy and tumor cell density of the tumor core show positive correlation in diffusion tensor magnetic resonance imaging of malignant brain tumorsNeuroImage2008431293510.1016/j.neuroimage.2008.06.041

30 

T Beppu T Inoue Y Shibata N Yamada A Kurose K Ogasawara Fractional anisotropy value by diffusion tensor magnetic resonance imaging as a predictor of cell density and proliferation activity of glioblastomasSurg Neurol2005631566110.1016/j.surneu.2004.02.034

31 

X. Liu W. Tian B. Kolar G. A. Yeaney X. Qiu M. D. Johnson MR diffusion tensor and perfusion-weighted imaging in preoperative grading of supratentorial nonenhancing gliomasNeuro-Oncol20111344475510.1093/neuonc/noq197

32 

T.S. Papageorgiou D. Chourmouzi A. Drevelengas K. Kouskouras A. Siountas Diffusion Tensor Imaging in brain tumors: A study on gliomas and metastasesPhysica Med20153177677310.1016/j.ejmp.2015.03.010

33 

L Ma Z J Song Differentiation between low-grade and high-grade glioma using combined diffusion tensor imaging metricsClin Neurol Neurosurg201311512248995



jats-html.xsl


This is an Open Access (OA) journal, and articles are distributed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 License, which allows others to remix, tweak, and build upon the work non-commercially, as long as appropriate credit is given and the new creations are licensed under the identical terms.

  • Article highlights
  • Article tables
  • Article images

Article History

Received : 11-02-2021

Accepted : 27-02-2021


View Article

PDF File   Full Text Article


Copyright permission

Get article permission for commercial use

Downlaod

PDF File   XML File   ePub File


Digital Object Identifier (DOI)

Article DOI

https://doi.org/ 10.18231/j.ijn.2021.009


Article Metrics






Article Access statistics

Viewed: 1727

PDF Downloaded: 788