Learn R Programming

⚠️There's a newer version (0.10.0) of this package.Take me there.

bioRad

bioRad provides standardized methods for extracting and reporting biological signals from weather radars. It includes functionality to inspect low-level radar data, process these data into meaningful biological information on animal speeds and directions at different altitudes in the atmosphere, visualize these biological extractions, and calculate further summary statistics.

To get started, see:

More vignettes:

  • Range correction: estimate spatial images of vertically integrated density corrected for range effects.

Documentation for the latest development version can be found here.

Installation

bioRad depends on packages from both the CRAN and Bioconductor repositories. Enable both with:

setRepositories(ind = 1:2)

The following system libraries are required before installing bioRad on Linux systems. In terminal, install these with:

sudo apt install libcurl4-openssl-dev
sudo apt install libssl-dev
sudo apt install libgdal-dev

You can install the released version of bioRad from CRAN with:

install.packages("bioRad")

Alternatively, you can install the latest development version from GitHub with:

# install.packages("devtools")
devtools::install_github("adokter/bioRad")

Then load the package with:

library(bioRad)
#> Welcome to bioRad version 0.6.2
#> Docker daemon running, Docker functionality enabled (vol2bird version 0.5.0.9169, MistNet available)

Docker (optional)

You need to install Docker to:

  • Process radar data into vertical profiles of biological targets with calculate_vp().
  • Read NEXRAD radar data or IRIS RAW data with read_pvolfile(). Docker is not required for reading ODIM radar data.
  • Convert NEXRAD radar data to ODIM format with nexrad_to_odim().
  • Use the MistNet neural network with calculate_vp() or apply_mistnet()

Why? bioRad makes use of a C implementation of the vol2bird algorithm through Docker to do the above. All other bioRad functions will work without a Docker installation.

  1. Go to Docker Desktop.
  2. Download Docker for Windows or Mac (free login required) and follow the installation instructions. Note that Docker for Windows requires Microsoft Windows 10 Professional or Enterprise 64-bit: installing Docker Toolbox for previous Windows versions will not work.
  3. Open the Docker application. The Docker (whale) icon will appear in your menu or task bar and indicate if it is running correctly.
  4. Make local drive(s) available for Docker containers:
    • On Windows: right click the Docker icon > Settings > Shared drives > Select the drive(s) where you will be processing radar files > Click Apply.
    • On Mac: click the Docker icon > Preferences > File sharing > Add the drive(s) where you will be processing radar files > Click Apply & Restart.
  5. In R do check_docker().
  6. You can now use the bioRad functionality that requires Docker.
  1. Hyper-V / Virtualbox conflicts on Windows. Docker requires Hyper-V enabled, but Hyper-V can not run together with Virtualbox. To use Virtualbox you will need to disable Hyper-V, which also disables Docker, and requires a reboot of the system.
  2. For firewall issues on Windows, see this issue
  3. For permission issues when running docker, specifically the error Got permission denied while trying to connect to the Docker daemon socket at unix:///var/run/docker.sock, see this solution. Running sudo usermod -a -G docker $USER in a terminal will fix this problem.

Usage

Radar data example

bioRad can read weather radar data (= polar volumes) in the ODIM format and formats supported by the RSL library, such as NEXRAD data. NEXRAD data (US) are available as open data and on AWS.

Here we read an example polar volume data file with read_pvolfile(), extract the scan/sweep at elevation angle 3 with get_scan(), project the data to a plan position indicator with project_as_ppi() and plot the radial velocity of detected targets with plot():

library(tidyverse) # To pipe %>% the steps below
system.file("extdata", "volume.h5", package = "bioRad") %>%
  read_pvolfile() %>%
  get_scan(3) %>%
  project_as_ppi() %>%
  plot(param = "VRADH") # VRADH = radial velocity in m/s

Radial velocities towards the radar are negative, while radial velocities away from the radar are positive, so in this plot there is movement from the top right to the bottom left.

Vertical profile data example

Weather radar data can be processed into vertical profiles of biological targets using calculate_vp(). This type of data is available as open data for over 100 European weather radars.

Once vertical profile data are loaded into bioRad, these can be bound into time series using bind_into_vpts(). Here we read an example time series, project it on a regular time grid with regularize_vpts() and plot it with plot():

example_vpts %>%
  regularize_vpts() %>%
  plot()
#> projecting on 300 seconds interval grid...

The gray bars in the plot indicate gaps in the data.

The altitudes in the profile can be integrated with integrate_profile() resulting in a dataframe with rows for datetimes and columns for quantities. Here we plot the quantity migration traffic rate (column mtr) with plot():

my_vpi <- integrate_profile(example_vpts)

plot(my_vpi, quantity = "mtr") # mtr = migration traffic rate

To know the total number of birds passing over the radar during the full time series, we use the last value of the cumulative migration traffic (column mt):

my_vpi %>%
  pull(mt) %>% # Extract column mt as a vector
  last()
#> [1] 129491.5

For more exercises, see this tutorial.

Meta

  • We welcome contributions including bug reports.
  • License: MIT
  • Get citation information for bioRad in R doing citation("bioRad").
  • Please note that this project is released with a Contributor Code of Conduct. By participating in this project you agree to abide by its terms.

Copy Link

Version

Install

install.packages('bioRad')

Monthly Downloads

576

Version

0.6.2

License

MIT + file LICENSE

Issues

Pull Requests

Stars

Forks

Maintainer

Adriaan M. Dokter

Last Published

December 17th, 2022

Functions in bioRad (0.6.2)

check_docker

Check if Docker is running
check_date_format

Check if character date is in specific format
bind_into_vpts

Bind vertical profiles (vp) into time series (vpts)
calculate_param

Calculate a new scan parameter
check_night

Check if it is night at a given time and place
bioRad-package

bioRad: Biological Analysis and Visualization of Weather Radar Data
bioRad-deprecated

Deprecated bioRad functions and data
check_radar_codes

Check if radar codes are exactly 5 characters
example_scan

Scan (scan) example
eta_to_dbz

Convert reflectivity to reflectivity factor
download_pvolfiles

Download polar volume (pvol) files from the NEXRAD archive
download_basemap

Download a basemap for map(ppi)
example_vpts

Time series of vertical profiles (vpts) example
get_scan

Get a scan (scan) from a polar volume (pvol)
get_elevation_angles

Get elevation angles of a polar volume (pvol), scan (scan) or parameter (param)
get_iris_raw_task

Check task of IRIS RAW file
get_quantity

Get a quantity from a vertical profile (vp) or time series of vertical profiles (vpts)
example_vp

Vertical profile (vp) example
download_vpfiles

Download vertical profile (vp) files from the ENRAM data repository
doy_noy

Look up day of year (doy) or night of year (noy)
gaussian_beam_profile

Gaussian beam profile as a function of height
convert_legacy

Convert legacy bioRad objects
filter_vpts

Time and night/day selection in a time series of vertical profiles ('vpts')
dbz_to_eta

Convert reflectivity factor to reflectivity
composite_ppi

Create a composite of multiple plan position indicators (ppi)
get_odim_object_type

Check the data object contained in a ODIM HDF5 file
is.vpfile

Check if a file is a vertical profile (vp)
integrate_profile

Vertically integrate profiles (vp or vpts) to an integrated profile (vpi)
proj_to_wgs

A wrapper for spTransform.
nexrad_to_odim

Convert a NEXRAD polar volume file to an ODIM polar volume file
project_as_ppi

Project a scan (scan) or parameter (param) to a plan position indicator (ppi)
map

Map a plan position indicator (ppi)
integrate_to_ppi

Calculate a plan position indicator (ppi) of vertically integrated density adjusted for range effects
plot.scan

Plot a scan (scan) in polar coordinates
get_param

Get a parameter (param) from a scan (scan)
plot.vpi

Plot an integrated profile (vpi)
match_filenames

Match a set of regular expressions to a list of files
plot.vpts

Plot a time series of vertical profiles (vpts)
is.pvolfile

Check if a file is a polar volume (pvol)
plot.vp

Plot a vertical profile (vp)
regularize_vpts

Regularize a time series of vertical profiles (vpts) on a regular time grid
read_vpts

Read a time series of vertical profiles (vpts) from file
select_vpfiles

Select vertical profile (vp) files from computer
skip_if_no_docker

Skip test if no docker
is.nan.data.frame

Identify NaN in a dataframe
read_vp

Read a vertical profile (vp) from file
scan_to_spatial

convert a polar scan into a spatial object.
scan_to_raster

convert a polar scan into a raster
read_cajun

Read a vertical profile (vp) from UMASS Cajun text file
plot.ppi

Plot a plan position indicator (ppi)
rcs<-

Set radar cross section
rcs

Get radar cross section
nyquist_velocity

Nyquist velocity for a given pulse repetition frequency (PRF)
read_pvolfile

Read a polar volume (pvol) from file
sd_vvp_threshold<-

Set threshold of the radial velocity standard deviation
sunrise_sunset

Calculate sunrise or sunset for a time and place
summary.param

Inspect a parameter (param)
summary.vp

Inspect a vertical profile (vp)
sd_vvp_threshold

Get threshold of the radial velocity standard deviation
summary.vpi

Inspect an integrated profile (vpi)
summary.vpts

Inspect a time series of vertical profiles (vpts)
wgs_to_proj

A wrapper for spTransform.
write_pvolfile

Write a polar volume (pvol) object to ODIM HDF5 file
read_vpfiles

Read a vertical profile (vp) or a list of vertical profiles (vp) from files
vplist_to_vpts

Bind vertical profiles (vp) into time series (vpts)
summary.ppi

Inspect a plan position indicator (ppi)
update_docker

Update Docker image from Docker hub
vol2bird_version

Check version of the vol2bird algorithm used by bioRad
summary.pvol

Inspect a polar volume (pvol)
summary.scan

Inspect a scan (scan)
[.ppi

Subset a plan position indicator (ppi)
[.vpts

Subset a time series of vertical profiles (vpts)
beam_distance

Calculate radar beam distance
as.data.frame.vp

Convert a vertical profile (vp) or time series of vertical profiles (vpts) to a data frame
attribute_table

Extract a volume coverage pattern table with all attributes
add_expected_eta_to_scan

adds expected eta to a scan
beam_profile

Calculate vertical radiation profile
Math.scan

Mathematical and arithmetic operations on param's, scan's and pvol's
beam_profile_overlap

Calculate overlap between a vertical profile ('vp') of biological scatterers and the vertical radiation profile emitted by the radar
beam_height

Calculate radar beam height
beam_range

Calculate radar beam range
apply_mistnet

Apply MistNet segmentation to a polar volume
calculate_vp

Calculate a vertical profile (vp) from a polar volume (pvol) file
beam_width

Calculate radar beam width
c.vp

Concatenate vertical profiles (vp) into a list of vertical profiles