Learn R Programming

dataprep (version 0.1.8)

data: Example data (particle number concentrations in SMEAR I Varrio forest)

Description

Particle number size distribution (PNSD) and auxiliary variables measured at the SMEAR I Varrio forest station in Finland. The raw data were downloaded from https://smear.avaa.csc.fi/download and subset to two months (January and July 2020) for package size reasons.

Usage

data

Arguments

Format

A data frame with 7,640 observations on the following 65 variables.

date

a POSIXct vector, sampling time (10-minute resolution).

tconc

a numeric vector, total number concentration.

TPNC

a numeric vector, total particle number concentration.

monthyear

a character vector, e.g. "January 2020".

1

a numeric vector, particle diameter in nm (1 nm).

1.12

a numeric vector, particle diameter in nm.

1.26

a numeric vector, particle diameter in nm.

1.41

a numeric vector, particle diameter in nm.

1.58

a numeric vector, particle diameter in nm.

1.78

a numeric vector, particle diameter in nm.

2

a numeric vector, particle diameter in nm.

2.24

a numeric vector, particle diameter in nm.

2.51

a numeric vector, particle diameter in nm.

2.82

a numeric vector, particle diameter in nm.

3.16

a numeric vector, particle diameter in nm.

3.55

a numeric vector, particle diameter in nm.

3.98

a numeric vector, particle diameter in nm.

4.47

a numeric vector, particle diameter in nm.

5.01

a numeric vector, particle diameter in nm.

5.62

a numeric vector, particle diameter in nm.

6.31

a numeric vector, particle diameter in nm.

7.08

a numeric vector, particle diameter in nm.

7.94

a numeric vector, particle diameter in nm.

8.91

a numeric vector, particle diameter in nm.

10

a numeric vector, particle diameter in nm.

11.2

a numeric vector, particle diameter in nm.

12.6

a numeric vector, particle diameter in nm.

14.1

a numeric vector, particle diameter in nm.

15.8

a numeric vector, particle diameter in nm.

17.8

a numeric vector, particle diameter in nm.

20

a numeric vector, particle diameter in nm.

22.4

a numeric vector, particle diameter in nm.

25.1

a numeric vector, particle diameter in nm.

28.2

a numeric vector, particle diameter in nm.

31.6

a numeric vector, particle diameter in nm.

35.5

a numeric vector, particle diameter in nm.

39.8

a numeric vector, particle diameter in nm.

44.7

a numeric vector, particle diameter in nm.

50.1

a numeric vector, particle diameter in nm.

56.2

a numeric vector, particle diameter in nm.

63.1

a numeric vector, particle diameter in nm.

70.8

a numeric vector, particle diameter in nm.

79.4

a numeric vector, particle diameter in nm.

89.1

a numeric vector, particle diameter in nm.

100

a numeric vector, particle diameter in nm.

112

a numeric vector, particle diameter in nm.

126

a numeric vector, particle diameter in nm.

141

a numeric vector, particle diameter in nm.

158

a numeric vector, particle diameter in nm.

178

a numeric vector, particle diameter in nm.

200

a numeric vector, particle diameter in nm.

224

a numeric vector, particle diameter in nm.

251

a numeric vector, particle diameter in nm.

282

a numeric vector, particle diameter in nm.

316

a numeric vector, particle diameter in nm.

355

a numeric vector, particle diameter in nm.

398

a numeric vector, particle diameter in nm.

447

a numeric vector, particle diameter in nm.

501

a numeric vector, particle diameter in nm.

562

a numeric vector, particle diameter in nm.

631

a numeric vector, particle diameter in nm.

708

a numeric vector, particle diameter in nm.

794

a numeric vector, particle diameter in nm.

891

a numeric vector, particle diameter in nm.

1000

a numeric vector, particle diameter in nm.

Details

The 61 numeric channels between 1 and 1000 are size bins of the differential particle number size distribution, approximately logarithmically spaced. Column names are the geometric mean diameter in nanometres, written in the shortest form that R accepts as a name (so 1 rather than 1.00, and 10 rather than 10.0). Values are number concentrations in cm\(^{-3}\). tconc and TPNC are integrals of the size distribution; monthyear is the month label used for group-wise cleaning.

The smallest seven size bins (1 through 2) and the largest three (794, 891, 1000) are entirely NA in this two-month subset, so varidele() will drop them even at a permissive fraction.

The data are the raw input for the cleaning pipeline described in vignette("dataprep-cleaning"). They contain:

  • size bins with substantial missing fractions (especially the smallest and largest bins),

  • observations with long consecutive missing runs,

  • extreme values that are not always genuine outliers.

After running dataprep on this table, a smaller, cleaner table is returned. The data1 dataset is the already-aggregated seven-column version; it has no long gaps and no obvious outliers, and is not a useful input for the cleaning pipeline.

References

Liang, C.-S., Wu, H., Li, H.-Y., Zhang, Q., Li, Z. & He, K.-B. (2020). Efficient data preprocessing, episode classification, and source apportionment of particle number concentrations. Science of the Total Environment, 741, 140923. tools:::Rd_expr_doi("10.1016/j.scitotenv.2020.140923")

Examples

Run this code
data

dim(data)
names(data)[1:6]

# Per-column missing fraction, ordered by severity.
# The smallest and largest size bins have the most missing data.
na_frac <- sort(colMeans(is.na(data)), decreasing = TRUE)
head(na_frac, 10)

# The 61 size bins run from column 5 to column 65.
size_bins <- 5:65
summary(data[, size_bins[1:3]])

Run the code above in your browser using DataLab