key: cord-0495074-ezg1zpna
authors: Shelton, Jacquelyn; Polewski, Przemyslaw; Yao, Wei
title: In the Danger Zone: U-Net Driven Quantile Regression can Predict High-risk SARS-CoV-2 Regions via Pollutant Particulate Matter and Satellite Imagery
date: 2021-05-06
journal: nan
DOI: nan
sha: 0963272fe205730a08824eb92254d3ba949d0e97
doc_id: 495074
cord_uid: ezg1zpna

Since the outbreak of COVID-19 policy makers have been relying upon non-pharmacological interventions to control the outbreak. With air pollution as a potential transmission vector there is need to include it in intervention strategies. We propose a U-net driven quantile regression model to predict $PM_{2.5}$ air pollution based on easily obtainable satellite imagery. We demonstrate that our approach can reconstruct $PM_{2.5}$ concentrations on ground-truth data and predict reasonable $PM_{2.5}$ values with their spatial distribution, even for locations where pollution data is unavailable. Such predictions of $PM_{2.5}$ characteristics could crucially advise public policy strategies geared to reduce the transmission of and lethality of COVID-19.

Since the outbreak of the Severe Acute Respiratory Syndrome Corona Virus 2 (SARS-CoV-2), popularly referred to as COVID-19, many questions have been asked around the disease. Of particular interest are the questions of transmission methods, and characteristics that identify vulnerable populations. Studies into these properties are made more complex by the lack of information around the behavior of the virus, E.g. the percent of cases that are asymptomatic. However, as indicated by the inclusion in the CDC's vulnerable Population index, asthma and chronic lung disease seem to be a major factor in the severity of the cases. For example, in (Conticini et al., 2020) the connections between the lethality rate in Lombardy and Emilia Romagna, areas with high level of atmospheric pollution, are explored. In particular, the paper studies the correlation between pollution, which is a known instigator of chronic lung disease even in young and other wise healthy subjects, and the lethality of SARS-CoV-2. A similar result for the lethality in the United States (Wu et al., 2020) using county level fatality rate, and county level long term air pollution, shows that, after adjusting for other known factors, that there is a strong correlation between the concentration of particulate matter 2.5 micrometers or less in diameter, or P M 2.5 , and the county level lethality. Specifically, a 1 µg m 3 increase in P M 2.5 corresponds to an 8% increase in the fatality rate.

However, as observed in (Coccia, 2020) , there is also a correlation between particulate matter (P M ) air pollution and the number of reported cases. This suggests that pollutionto-human may serve as another transmission dynamic for SARS-CoV-2. These two results suggest a two factor vulnerability to SARS-CoV-2 caused by increased particulate matter in the air: On one hand it increases the likelihood of having a more sever reaction to infection, and the other it serves a transmission vector.

Traditionally, P M 2.5 concentration data can be obtained from ground sensors and measurement stations. However, the spatial resolution of these measurements is greatly limited by the sparsity of sensor networks. Thus, detailed pollution maps have been developed that integrate heterogeneous data sources (see e.g. van Donkelaar et al. (2019)), to create a database of estimated monthly pollutant concentrations over several countries. This data was used by Wu et al. (2020) linking P M 2.5 concentrations to COVID-19 mortality rates. Although this historical data helped establish this causality relationship, up-to-date/live pollution information is still needed to monitor pollutant P M 2.5 . By knowing where pollution is we can better understand the impacts of social segregation policy on subpopulations in order to e.g. allocate medical funds to the most vulnerable populaces. The health needs for a population often require very granular data about their circumstances, and air pollution is one such measure that is only sporadically known in poorer areas and thus is insufficiently represented in modeling the health situation. In order to properly control COVID-19 hotspots there is a need to predict the spread and intensity of COVID-19. While contact tracing and non- pharmacological interventions (NPIs) have shown value, there is mounting evidence that there are other transmission vectors, including via pollution particles, as discussed earlier. Therefore there is mounting need to understand local pollution dynamics in order to correctly deal with the pandemic. In order to properly understand the effectiveness of a given NPI it is essential we understand the main transmission vectors. It is, therefore, vital we gain understanding of the strength of air pollution as a transmission vector in order to understand and design NPIs efficiently.

The goal of the present work is to model air pollution P M 2.5 concentrations using readily available satellite imagery. The aim is to aid in any planning for efficacious COVID-19 geared strategies. The paper is organized as follows: Sec. 2 introduces the proposed U-net model, Sec. 3 presents the data, Sec. 4 describes the experiments and results, and finally Sec. 5 provides a summary and outlook.

We build upon the well known U-net architecture (Ronneberger et al., 2015) to predict dense (per-pixel) P M 2.5 concentrations from multispectral satellite imagery. Since its introduction in 2015, the U-net has been successfully applied to various semantic segmentation tasks, E.g. in medical imaging (Dong et al., 2017) and astronomy (Akeret et al., 2017) . The U-net consists of two symmetrical parts. The encoder path downsamples the original image into meaningful features by means of convolutional filters and pooling operations, whereas the upsampling path aims at decoding these features into a full-sized output map using transposed convolution operations, driven by an appropriate loss function. Moreover, upsampling layers are augmented with feature maps from the downsampling path at the corresponding resolution, to provide more context information. The original U-net was meant for classification and featured a softmax layer after the top-level upsampling layer's output, trained using a cross-entropy objective with discrete ground-truth labels. Yet the U-net has also been used for dense regression by removing the softmax layer and optimizing the squared difference between the upsampled output and a continuous target variable (Yao et al., 2018; Payer et al., 2016) .

It is well known that least squares regression estimates the conditional mean of the response variable given the predictors, and is therefore sensitive to outliers. Alternatively, Quantile regression (Koenker, 2005) is more robust to out-

variable vectors x and matching continuous response variables y sampled from their respective distributions X , Y. Let f (x|θ) indicate the prediction function parameterized by θ, and let 0 < q < 1 refer to the quantile level. In this work, we consider losses of the form:

In the above, [a] denotes the indicator function for event a, whereas the term ρ q (r) is the check function (Koenker, 2005) . To better quantify the approximated distribution, we learn 3 quantiles q l < q m = 0.5 < q u simultaneously, which allows us to obtain both a point-wise estimate from the median q m and a (q u − q l )−confidence interval for the value. We cast the aggregate loss function as a linear combination of partial L q terms with coefficients γ l , γ u , in a simple multi-task learning setting (Gong et al., 2019):

To mirror the structure of the loss function, the U-net architecture was extended to include a separate sequence of convolutional filters at the top level of the upsampling path per quantile loss term (see Fig. 1 ). One disadvantage of using the loss L q (Eq. 1) is the fact that the check function ρ q is not differentiable at zero. Moreover, the derivative is piecewise constant on R + , R − . This might pose a challenge to gradient-based optimization schemes (E.g. back propagation in neural networks) because the gradient norm does not get smaller as the optimization converges to a local minimum. To alleviate that, some approximations of the check function have been proposed. The Huber loss (Hastie et al., 2001) combines quadratic behavior within a δ−neighborhood of 0 with linear behavior on R \ [−δ; δ]. This can be used to approximate ρ 0.5 . Recently, Gupta et al. (2020) introduced an asymmetric version of the Huber loss:

This loss function is differentiable everywhere. The parameters δ l , δ u control both the slope of the linear functions on their respective sides of the real axis, and the locations where the function starts to show quadratic behavior. We propose to approximate ρ q with R α

where α is a parameter which controls the location of the change from linear to quadratic characteristics. See Fig. 2 for a comparison of loss functions.

In order to address this problem, we use satellite imagery as a source of predictor variables, and approximate P Satellite data. Our work used Landsat 8 satellite imagery published by the United States Geological Survey (Lan, 2016). Landsat 8 is the latest in a series of Earth observation missions containing a total of 11 spectral bands, ranging in wavelengths from 0.435µm to 12.51µm, with spatial resolution between 15 to 100m depending on the band.

Pollution data. We downloaded monthly P M 2.5 concentration maps for North America from (Don). Readily available, these maps contain 0.01 degrees per pixel and use a standard WGS84 coordinate reference system. We used the data made available immediately after Landsat 8 mission launched, namely from March 2013 to December 2018.

Preprocessing. The Landsat imagery was first reprojected to the WGS84 coordinate system, and downsampled to the ground-truth resolution of 0.01 degrees (the panchromatic band was dropped). To match the temporal resolution of the ground-truth, we computed per-band average images grouped by month of acquisition. Next, we derived a perpixel mask of regions within the image covered by cirrus clouds and hence not suitable for analysis, based on the estimated cloud cover percentage (Foga et al., 2017) . Finally, we combined the cloud cover mask with the data availability mask from the ground-truth P M 2.5 maps. Also, pixels corresponding to the top and bottom 1% of ground-truth values were masked out as outliers. All input imagery bands were normalized to the interval [0; 1] individually per band.

We selected an initial number N = 133 Landsat images, spanning March 2013 to December 2018, of 24 major cities from representative regions of the United States (see Fig. 3 , green boxes) and preprocessed them as described in Sec. 3. Next, we defined our ground-truth data as these images paired with corresponding P M 2.5 images from which we use an 80:20% random split to create training/testing set of 106:27 images. A U-net based on adapting the implementation by Akeret et al. (2017) was trained using an ADAM optimized over 1000 epochs with minibatch size of 15 and 100 internal iterations, with the following parameterization: dropout ratio was 0.5, learning rate 0.00005, regression quantiles q l = 0.1, q r = 0.9. For the Huber loss function (3), all aggregates (2) contributed in equal proportion and the parameter controlling the function shape was α = 2. 4.1: Sanity check with ground-truth. The network converged to a state which produced a mean absolute error of ≈ 1µg/m 3 between predicted and ground-truth values on the training set (see Fig. 4 ). The median width of the predicted confidence intervals (upper bound -lower bound) for training data was 1.94µg/m 3 , and 70% of ground-truth values fell into the predicted interval. The number of groundtruth values above the lower bound and below the upper bound was respectively 88% and 82%. This demonstrates that the model was able to approximate the 0.1 and 0.9 quantiles well, and also to provide quality point-estimates. Correspondingly, our approach can predict P M 2.5 pollution where the U-net was generalized to cities at times not present in the training data but locations it has been trained on. Error with the GT data converges to M AE ≈ 1 and the error with validation data converges to M AE ≈ 2. This shows that the U-net can generalize well to temporally novel data. maps that match the structure and approximate concentrations of ground-truth reconstructions. See Fig. 5 for some examples.

4.2: Generalizability to temporally novel data. To assess the ability of our model to generalize in the temporal domain, we utilized 27 previously unseen images that overlapped with the training set spatially but not temporally. The test set contained images from 15 of the 24 cities. The mean absolute validation error followed the same trend as Exp. 4.1 with GT training data, however it converged to about 2µg/m 3 (see Fig. 4 ). The performance of the predicted confidence intervals degraded to 40% of contained ground-truth values, whereas the median interval width remained low at 2.06µg/m 3 . This indicates a degree of overfitting, however the predicted P M 2.5 concentrations are still within reasonable distance of the ground-truth.

Cities with similar pollution profile. We selected 28 new images at 20 additional locations within the United States, showing visually similar distributions of groundtruth P M 2.5 within the Landsat image frames to the original training cities, in order to evaluate the performance of predicting the P M 2.5 concentrations at locations unseen during training. The obtained mean absolute error was 2.81µg/m 3 , and the predicted confidence intervals contained 31% of ground-truth values. This shows that it is harder to generalize in the spatial than in the temporal domain.

The goal of the fourth experiment is to verify that our model can predict expected P M 2.5 concentration trends at time points before and after the government mandated lock-down in March 2020 intended to hinder the spread of SARS-CoV-2 (which consequently e.g. drastically reduced industrial emissions). We applied the U-net learned in Exp. 4.3 to satellite images of Los Angeles, CA from 2018, 2019, and early 2020. The results, shown in Fig. 6 , illustrate that the U-net was able to learn P M 2.5 concentrations consistent with world events at the time. Namely, the pollution is inferred to be notably higher before the lock-down than after the lock-down, shown by the considerable shift of the predicted P M 2.5 distribution's 0.9 quantile between October 2019 and April 2020 -the quantile shifted from 13.2 to 9.7, respectively. Additionally, our approach was able to successfully isolate regions in LA that are the most densely populated by predicting higher pollutant P M 2.5 values. This suggests that our approach can generalize to new data and reliably predict pollutant P M 2.5 concentrations and their spatial structure, which informs on the presence and lethality of SARS-CoV-2.

SARS-CoV-2 lethality has been concretely linked to the concentration of pollutant particulate matter, where a slight increase in P M 2.5 can drastically enhance the morbidity rate. We have proposed a means of learning the structure, spatial distribution, and physical concentration of pollutant particulate matter P M 2.5 based solely on global satellite imagery and monthly P M 2.5 values from the years 2013-2018. Our approach proposes a U-net convolutional network with quantile regression loss to learn dense per-pixel P M 2.5 prediction maps. We have demonstrated not only that our approach can successfully reconstruct P M 2.5 concentrations with low error, but it can also generalize to completely unseen locations for which pollutant data is not available. As pollution has been shown to be a main vector of SARS-CoV-2 transmission, this ability to identify regions where it may be particularly transmissible and lethal can provide critical advice to implementable public health strategies, such as the ability to monitor, understand, and design NPIs efficiently.

Given that our approach passes several sanity checks by demonstrating that its P M 2.5 concentration predictions reflect ground-truth values/measurements, it would follow that it can make meaningful predictions for locations for which there has never been recordings of the particulate matter (only satellite imagery available). Additionally, although we currently do not have rigorous methodology to quantify what makes satellite imagery of different cities 'similar', we could address this e.g. with dependence tests such as kernel two-sample tests (Gretton et al., 2012) . Also, data from multiple satellites could be included to provide greater temporal resolution, such as from the Sentinel-2 mission (Drusch et al., 2012) . With larger satellite datasets we can expect an increase in the accuracy of our predictions.

Landsat-Earth observation satellites

Radio frequency interference mitigation using deep convolutional neural networks

Two mechanisms for accelerated diffusion of COVID-19 outbreaks in regions with high intensity of population and polluting industrialization: the air pollution-to-human and human-to-human transmission dynamics. medRxiv

Can atmospheric pollution be considered a co-factor in extremely high level of SARS-CoV-2 lethality in Northern Italy?

Automatic Brain Tumor Detection and Segmentation Using U-Net Based Fully Convolutional Networks

Sentinel-2: Esa's optical high-resolution mission for gmes operational services. Remote Sensing of Environment

Cloud detection algorithm comparison and validation Predicting High-risk SARS-CoV-2 Regions with U-Net Driven Quantile Regression for operational landsat data products

A kernel two-sample test

Robust regularized extreme learning machine with asymmetric Huber loss function. Neural Computing and Applications

The Elements of Statistical Learning. Springer Series in Statistics

Regressing Heatmaps for Multiple Landmark Localization using CNNs

Regional Estimates of Chemical Composition of Fine Particulate Matter Using a Combined Geoscience-Statistical Method with Information from Satellites, Models, and Monitors

Exposure to air pollution and COVID-19 mortality in the United States: A nationwide cross-sectional study. medRxiv

Pixel-wise regression using U-Net and its application on pansharpening