Learn R Programming

EGRET

Exploration and Graphics for RivEr Trends (EGRET): An R-package for the analysis of long-term changes in water quality and streamflow, including the water-quality method Weighted Regressions on Time, Discharge, and Season (WRTDS).

Look for new and improved documentation here: https://doi-usgs.github.io/EGRET/

The link for the official USGS publication user guide is here:

https://pubs.usgs.gov/tm/04/a10/

A companion package EGRETci implements a set of approaches to the analysis of uncertainty associated with WRTDS trend analysis.

If you are familiar with the traditional EGRET workflow, check out the [Overview and Updates](https://doi-usgs.github.io/EGRET/articles/Overview.html to see how all the latest updates relate.

Recent introduction to WRTDS and the EGRET package at the 12th National Monitoring Conference April 19, 2021:

New capabilities

Package Installation

To install the EGRET package, you must be using R 3.0 or greater and run the following command:

install.packages("EGRET")

Background:

Evaluating long-term changes in river conditions (water quality and discharge) is an important use of hydrologic data. To carry out such evaluations, the hydrologist needs tools to facilitate several key steps in the process: acquiring the data records from a variety of sources, structuring it in ways that facilitate the analysis, routines that will process the data to extract information about changes that may be happening, and graphical techniques that can display findings about change. The R package EGRET (Exploration and Graphics for RivEr Trends) was developed for carrying out each of these steps in an integrated manner. It is designed to accept easily data from three sources: U.S. Geological Survey hydrologic data, Water Quality Portal Data (currently including U.S. Environmental Protection Agency (EPA) STORET data, and USDA STEWARDS data), and user-supplied flat files. The EGRET package has components oriented towards the description of long-term changes in streamflow statistics (high flow, average flow, and low flow) as well as changes in water quality. For the water-quality analysis, it uses Weighted Regressions on Time, Discharge and Season (WRTDS) to describe long-term trends in both concentration and flux. EGRET also creates a wide range of graphical presentations of the water-quality data and of the WRTDS results. The following report serves as a user guide, providing detailed guidance on installation and use of the software, documentation of the analysis methods used, as well as guidance on some of the kinds of questions and approaches that the software can facilitate.

EGRET includes statistics and graphics for streamflow history, water quality trends, and the statistical modeling algorithm Weighted Regressions on Time, Discharge, and Season (WRTDS). Please see the official EGRET User Guide for more information on the EGRET package:

https://doi.org/10.3133/tm4A10 The best ways to learn about the WRTDS approach is to read the User Guide and two journal articles. These articles are available, for free, from the journals in which they were published. The first relates to nitrate and total phosphorus data for 9 rivers draining to Chesapeake Bay. The URL is:

https://onlinelibrary.wiley.com/doi/full/10.1111/j.1752-1688.2010.00482.x.

The second is an application to nitrate data for 8 monitoring sites on the Mississippi River or its major tributaries. The URL is:

https://pubs.acs.org/doi/abs/10.1021/es201221s

For a thorough discussion of the generalized flow normalization method implemented in the EGRET enhancements, see the paper: “Tracking changes in nutrient delivery to western Lake Erie: Approaches to compensate for variability and trends in streamflow” (doi:10.1016/j.jglr.2018.11.012).

Sample Workflow

WRTDS on the Choptank River at Greensboro MD, for Nitrate:

library(EGRET)

############################
# Gather discharge data:
siteID <- "01491000" #Choptank River at Greensboro, MD
startDate <- "" #Gets earliest date
endDate <- "2011-09-30"
# Gather sample data:
parameter_cd<-"00631" #5 digit USGS code
Sample <- readNWISSample(siteID,parameter_cd,startDate,endDate)
#Gets earliest date from Sample record:
#This is just one of many ways to assure the Daily record
#spans the Sample record
startDate <- min(as.character(Sample$Date)) 
# Gather discharge data:
Daily <- readNWISDaily(siteID,"00060",startDate,endDate)
# Gather site and parameter information:

# Here user must input some values for
# the default (interactive=TRUE)
INFO<- readNWISInfo(siteID,parameter_cd)
INFO$shortName <- "Choptank River at Greensboro, MD"

# Merge discharge with sample data:
eList <- mergeReport(INFO, Daily, Sample)
library(EGRET)
# Sample data included in package:
eList <- Choptank_eList

boxConcMonth(eList)

boxQTwice(eList)

plotConcTime(eList)

plotConcQ(eList)

multiPlotDataOverview(eList)

# Run WRTDS model:
eList <- modelEstimation(eList)
#> 
#>  first step running estCrossVal may take about 1 minute
#>  estCrossVal % complete:
#> 0    1   2   3   4   5   6   7   8   9   10  
#> 11   12  13  14  15  16  17  18  19  20  
#> 21   22  23  24  25  26  27  28  29  30  
#> 31   32  33  34  35  36  37  38  39  40  
#> 41   42  43  44  45  46  47  48  49  50  
#> 51   52  53  54  55  56  57  58  59  60  
#> 61   62  63  64  65  66  67  68  69  70  
#> 71   72  73  74  75  76  77  78  79  80  
#> 81   82  83  84  85  86  87  88  89  90  
#> 91   92  93  94  95  96  97  98  99  
#> Next step running  estSurfaces with survival regression:
#> Survival regression (% complete):
#> 0    1   2   3   4   5   6   7   8   9   10  
#> 11   12  13  14  15  16  17  18  19  20  
#> 21   22  23  24  25  26  27  28  29  30  
#> 31   32  33  34  35  36  37  38  39  40  
#> 41   42  43  44  45  46  47  48  49  50  
#> 51   52  53  54  55  56  57  58  59  60  
#> 61   62  63  64  65  66  67  68  69  70  
#> 71   72  73  74  75  76  77  78  79  80  
#> 81   82  83  84  85  86  87  88  89  90  
#> 91   92  93  94  95  96  97  98  99  
#> Survival regression: Done

#eList:
plotConcTimeDaily(eList)
#> plotGenConc = TRUE requires running WRTDSKalman
#>               on eList. Switching to WRTDS concentration.

plotFluxTimeDaily(eList)
#> plotGenFlux = TRUE requires running WRTDSKalman
#>               on eList. Switching to WRTDS concentration.

plotConcPred(eList)

plotFluxPred(eList)

plotResidPred(eList)

plotResidQ(eList)

plotResidTime(eList)

boxResidMonth(eList)

boxConcThree(eList)

plotConcHist(eList)

plotFluxHist(eList)

# Multi-line plots:
date1 <- "1985-09-01"
date2 <- "1997-09-01"
date3 <- "2010-09-01"
qBottom<-0.2
qTop<-10
plotConcQSmooth(eList, date1, date2, date3, qBottom, qTop, 
                   concMax=2,legendTop = 0.85)

q1 <- 2
q2 <- 10
q3 <- 20
centerDate <- "07-01"
yearEnd <- 1980
yearStart <- 2010
plotConcTimeSmooth(eList, q1, q2, q3, centerDate, yearStart, yearEnd, legendTop = 0.55, legendLeft = 1990)

# Multi-plots:
fluxBiasMulti(eList)

#Contour plots:
clevel<-seq(0,2,0.5)
yearStart <- 1980
yearEnd <- 2010

plotContours(eList, yearStart,yearEnd,qBottom=0.5,
             qTop = 20, contourLevels = clevel)


plotDiffContours(eList, year0 = 1990,
                 year1 = 2010,
                 qBottom = 0.5,
                 qTop = 20,
                 maxDiff = 0.6)

Sample workflow for a flowHistory application for the entire record

library(EGRET)

# Flow history analysis
# Gather discharge data:
siteID <- "01491000" #Choptank River at Greensboro, MD
startDate <- "" # Get earliest date
endDate <- "" # Get latest date
Daily <- readNWISDaily(siteID, "00060", startDate, endDate)
#> GET: https://waterservices.usgs.gov/nwis/dv/?site=01491000&format=rdb%2C1.0&ParameterCd=00060&StatCd=00003&startDT=1851-01-01
#> There are 28235 data points, and 28235 days.
# Gather site and parameter information:
# Here user must input some values for
# the default (interactive=TRUE)
INFO <- readNWISInfo(siteID, "00060")
#> GET: https://waterservices.usgs.gov/nwis/site/?siteOutput=Expanded&format=rdb&site=01491000
#> Your site for streamflow data is:
#>  01491000 .
#> Your site name is CHOPTANK RIVER NEAR GREENSBORO, MD 
#> but you can modify this to a short name in a style you prefer. 
#> This name will be used to label graphs and tables. 
#> If you want the program to use the name given above, just do a carriage return,
#> otherwise enter the preferred short name(no quotes):
#> 
#> The latitude and longitude of the site are:  38.99719 ,  -75.78581 (degrees north and west).
#> 
#> The drainage area at this site is  113 square miles
#>  which is being stored as 292.6687 square kilometers.
#> 
#> It is helpful to set up a station abbreviation when doing multi-site studies,
#> enter a unique id (three or four characters should work). It is case sensitive.  
#> Even if you don't feel you need an abbreviation for your site you need to enter something(no quotes):
#> 
#> Your water quality data are for parameter number:
#> 00060 
#> which has the name:' Discharge, cubic feet per second '.
#> Typically you will want a shorter name to be used in graphs and tables.
#> The suggested short name is:' Stream flow, mean. daily '.
#> If you would like to change the short name, enter it here, 
#> otherwise just hit enter (no quotes):
#> The units for the water quality data are:  ft3/s .
#> It is helpful to set up a constiuent abbreviation, enter a unique id 
#> three or four characters should work something like tn or tp or NO3).
#> Even if you don't feel you need an abbreviation you need to enter something (no quotes):
#> 
#> Required concentration units are mg/l. 
#> The INFO dataframe indicates: ft3/s 
#> Flux calculations will be wrong if units are not consistent.
INFO$shortName <- "Choptank River at Greensboro, MD"
eList <- as.egret(INFO, Daily, NA, NA)

# Check flow history data:
plotFlowSingle(eList, istat = 7,qUnit = "thousandCfs")

plotSDLogQ(eList)

plotQTimeDaily(eList, qLower = 1, qUnit = 3)

plotFour(eList, qUnit=3)

plotFourStats(eList, qUnit=3)

Reporting bugs

Please consider reporting bugs and asking questions on the Issues page: https://github.com/DOI-USGS/EGRET/issues

Subscribe

Please email questions, comments, and feedback to: egret_comments@usgs.gov

Additionally, to subscribe to an email list concerning updates to these R packages, please send a request to egret_comments@usgs.gov.

Package Support

The Water Mission Area of the USGS has supported the development and maintenance of the EGRET R-package. Further maintenance is expected to be stable through October 2025. Resources are available primarily for maintenance and responding to user questions. Priorities on the development of new features are determined by the EGRET development team.

Sunset date

Funding for EGRET currently expires fall 2025. Expectations are that maintenance and customer service will continue to be supported past that date.

How to cite EGRET:

citation(package = "EGRET")
#> To cite EGRET in publications, please use:
#> 
#>   Hirsch, R.M., De Cicco, L.A., Murphy, J., 2025, Exploration and
#>   Graphics for RivEr Trends (EGRET), version 3.0.11,
#>   doi:10.5066/P9CC9JEX
#> 
#> A BibTeX entry for LaTeX users is
#> 
#>   @Manual{,
#>     author = {Robert Hirsch and Laura DeCicco and Jennifer Murphy},
#>     title = {Exploration and Graphics for RivEr Trends (EGRET)},
#>     publisher = {U.S. Geological Survey},
#>     year = {2025},
#>     url = {https://pubs.usgs.gov/tm/04/a10/},
#>   }

References

See this list for WRTDS applications in print:

https://doi-usgs.github.io/EGRET/articles/References_WRTDS.html

Disclaimer

This software is preliminary or provisional and is subject to revision. It is being provided to meet the need for timely best science. The software has not received final approval by the U.S. Geological Survey (USGS). No warranty, expressed or implied, is made by the USGS or the U.S. Government as to the functionality of the software and related material nor shall the fact of release constitute any such warranty. The software is provided on the condition that neither the USGS nor the U.S. Government shall be held liable for any damages resulting from the authorized or unauthorized use of the software.

Copy Link

Version

Install

install.packages('EGRET')

Monthly Downloads

815

Version

3.0.11

License

CC0

Maintainer

Laura DeCicco

Last Published

April 29th, 2025

Functions in EGRET (3.0.11)

concUnit-class

concUnit class
censoredSegments

Generic plotting function to create censored line segments
dataOverview

Data Overview for WRTDS
cumQdate

Cumulative flow calculation
checkStartEndDate

checkStartEndDate
compressData

Compress sample data frame
checkSurfaceSpan

checkSurfaceSpan
cleanUp

cleanUp eList
dateFormatCheck

Check date format
decimalDate

decimalDate
decimalHighLow

decimalHighLow
estSurfaces

Estimate the three surfaces (for yHat, SE and ConcHat) as a function of DecYear and logQ and store in the three-dimensional object called surfaces
flexFN

Flexible Flow Normalization
flexPlotAddOn

Flexible Flow Normalization Plot Add On
errorStats

Error statistics
flowDuration

Computes several values of the flow duration curve for streamflow centered on a specific date of the year
estDailyFromSurfaces

Estimates all daily values of Concentration, Flux, Flow-Normalized Concentration, and Flow Normalized Flux
estCrossVal

Jack-Knife cross validation of the WRTDS (Weighted Regressions on Time, Discharge, and Season)
fluxUnit-class

fluxUnit class
makeDateInfo

makeDateInfo
getSample

Get Sample dataframe from EGRET object
getInfo

Get INFO dataframe from EGRET object
fluxBiasMulti

Produces 8-panel plot that is useful for determining if there is a flux bias problem
genericEGRETDotPlot

Generic EGRET plotting function
fixSampleFrame

Update Sample dataframe
generalAxis

Axis generation for log discharge
jitterSam

jitter Sample
fluxBiasStat

Compute the flux bias statistic: (mean of estimated flux - mean of observed flux) / mean of estimated flux
genmissing

genmissing
is.egret

Check for EGRET object
getDaily

Get Daily dataframe from EGRET object
print.egret

EGRET helper functions
getSurfaces

Get surfaces matrix from EGRET object
monthLabel-class

monthLabel class
modelEstimation

Estimation process for the WRTDS (Weighted Regressions on Time, Discharge, and Season)
logPretty1

Sets up tick marks for an axis with a log scale, where the graph is small
makeAnnualSeries

Produces annual series of 8 streamflow statistics (and a lowess smooth of them) from daily streamflow data
makeAugmentedSample

Create randomized residuals and observations for data sets that have some censored data
plotConcQSmooth

Plot up to three curves representing the concentration versus discharge relationship. Each curve is a different point in time.
mergeReport

mergeReport
multiPlotDataOverview

Produces a 4 panel plot that gives an overview of the data set prior to any processing
plotConcTimeDaily

Plot of the time series of daily concentration estimates and the sample values for the days that were sampled
plot15

Makes 15 graphs of streamflow statistics on a single page. These encompass the 7-day minimum, mean, and 1-day maximum for each of the following 5 Periods of Analysis: Annual, Fall, Winter, Spring and Summer.
plotConcTimeSmooth

Plot up to three curves representing the concentration versus time relationship, each curve representing a different flow.
logPretty3

Sets up tick marks for an axis with a log scale
plot1of15

plots 1 of the 15 graphs of streamflow statistics on a single page
plotConcHist

Graph of annual concentration and flow normalized concentration versus year
plotConcTime

Plot of Observed Concentration versus Time
plotFluxHist

Graph of annual flux and flow normalized flux versus year
plotFluxTimeDaily

Plot of the time series of daily flux estimates and the sample values for the days that were sampled
plotFlowSingle

Creates a plot of a time series of a particular flow statistic and a loess smooth of that flow statistic
plotFour

Makes four graphs of streamflow statistics on a single page
plotMonthTrend

Plot monthly trend result from runPairs
plotFourStats

Makes four graphs of annual streamflow statistics on a single page
plotConcPred

Plot of Observed Concentration versus Estimated Concentration
plotConcQ

Plot of Observed Concentration versus Discharge
plotQTimeDaily

Plot of the discharge time series
plotWRTDSKalman

plotWRTDSKalman
plotContours

Color contour plot of the estimated surfaces as a function of discharge and time (surfaces include log concentration, standard error, and concentration)
plotDiffContours

Plots the difference between two years from a contour plot created by plotContours
plotResidPred

Plot of the residuals from WRTDS versus the estimated values (all in log concentration units)
plotResidQ

Plot of the residuals from WRTDS (in log concentration units) versus the discharge
printqUnitCheatSheet

Reminder to user of flow Unit properties such as cubic meters per second or thousands of cubic feet per second.
populateSiteINFO

Populate Site Information Columns
plotTimeSlice

plotTimeSlice
populateSampleColumns

Populate Sample Columns
plotSDLogQ

Graph of the standard deviation of the log of daily discharge versus year
printPairs

Print information about pairs analysis
printSeries

Print annual results for a given streamflow statistic
processQWData

Processing of Water Quality Data
removeDuplicates

Remove duplicates values from Sample data frame.
plotResidTime

Plot of the residuals from WRTDS (in log concentration units) versus time
runGroups

Runs a comparison of any group of years in the record.
populateDailySamp

Merge concentration to Daily
readNWISSample

Import USGS Sample Data for EGRET analysis
plotFluxPred

Graph of observed versus estimated flux
readUserDaily

Import user daily data for EGRET analysis
populateDaily

Populate Daily data frame
plotFluxQ

Sample data plot: observed log flux vs log discharge
populateConcentrations

Populate Concentration Columns
printGroups

Print information about group analysis
populateDateColumns

Populate Date Columns
populateParameterINFO

Populate Parameter Information Columns
readUserSample

Import user-supplied sample data for EGRET analysis
readWQPSample

Import Sample Data from the Water Quality Portal for WRTDS
printFluxUnitCheatSheet

Reminder to user of flux unit properties (such as kg/day, tons/year, etc).
readNWISDaily

Import NWIS Daily Data for EGRET analysis
runPairs

Runs a comparison of any two years in the record.
runSeries

Annual series of flow-normalized concentration and flow-normalized flux
readDataFromFile

Basic Data Import for Water Flow Data
setSeasonLabelByUser

Creates a character variable that describes the period of analysis, when the period of analysis is being set by the user and not from AnnualResults
setUpEstimation

setUpEstimation
selectDays

Creates a subset Daily data frame that only contains daily estimates for the specified period of analysis
qUnit-class

qUnit class
randomSubset

randomSubset
triCube

Tricube weight function
tableFlowChange

Prints table of change metrics for a given streamflow statistic
setPA

Sets up the period of analysis (the portion of the year being evaluated).
tableResults

Table of annual results for discharge, concentration and flux
surfaceStartEnd

Surface date limits
WRTDSKalman

WRTDS-Kalman
saveResults

A utility program for saving the contents of the workspace This function saves the workspace. Future versions of EGRET will not include this function, use saveRDS to save individual eList objects. It assigns the file a name using the abbreviations for station and constituent.
runSurvReg

Run the weighted survival regression for a set of estimation points (defined by DecYear and Log(Q))
Choptank_eList

Example eList
startEnd

startEnd
tableChange

Create a table of the changes in flow-normalized values between various points in time in the record
stitch

stitch surfaces
yPretty

Sets up tick marks for an axis for a graph with an arithmetic scale which starts at zero
setSeasonLabel

Create a character variable that describes the period of analysis, when period of analysis has already been set in AnnualResults
setupYears

Creates the AnnualResults data frame from the Daily data frame
surfaceIndex

Compute the 6 parameters needed to lay out the grid for the surfaces computed in estSurfaces
calculateMonthlyResults

Calculates monthly mean values of Q, Conc, FNConc, Flux, and FNFlux for the entire record. If WRTDSKalman has been run it also includes the monthly mean values of GenConc and GenFlux.
blankTime

Deletes the computed values during periods of time when there are no sample data
boxResidMonth

A box plot of WRTDS residuals by month
EGRET-package

EGRET package includes WRTDS and flowHistory
INFOdataframe

Import metadata to create INFO data frame
boxQTwice

Two box plots side-by-side, discharge on sample days, and discharge on all days
boxConcThree

Three box plots side-by-side
Constants

Constants included with EGRET
boxConcMonth

Box plot of the water quality data by month
as.egret

Create named list for EGRET analysis