Learn R Programming

⚠️There's a newer version (0.2.8) of this package.Take me there.

output: word_document: default html_document: default

PriceIndices – a Package for Bilateral and Multilateral Price Index Calculations

author: Jacek Białek, University of Lodz, Statistics Poland

Goals of PriceIndices are as follows: a) data processing before price index calculations; b) bilateral and multilateral price index calculations; c) extending multilateral price indices. You can download the package documentation from here. Too read more about the package please see (and cite :)) papers:

Białek, J. (2021). PriceIndices – a New R Package for Bilateral and Multilateral Price Index Calculations, Statistika – Statistics and Economy Journal, Vol. 2/2021, 122-141, Czech Statistical Office, Praga.

Białek, J. (2022). Scanner data processing in a newest version of the PriceIndices package, Statistical Journal of the IAOS, 38 (4), 1369-1397, DOI: 10.3233/SJI-220963.

Installation

You can install the released version of PriceIndices from CRAN with:

install.packages("PriceIndices")

You can install the development version of PriceIndices from GitHub with:

library("remotes")
remotes::install_github("JacekBialek/PriceIndices")

The functionality of this package can be categorized as follows:

  1. Data sets included in the package and generating artificial scanner data sets
  2. Functions for data processing
  3. Functions providing dataset characteristics
  4. Functions for bilateral unweighted price index calculations
  5. Functions for bilateral weighted price index calculations
  6. Functions for chain price index calculations
  7. Functions for multilateral price index calculations
  8. Functions for extending multilateral price indices by using splicing methods
  9. Functions for extending multilateral price indices by using the FBEW method
  10. Functions for extending multilateral price indices by using the FBMW method
  11. General functions for price index calculations
  12. Functions for comparisons of price indices
  13. Functions for price and quantity indicator calculations

Data sets included in the package and generating artificial scanner data sets

This package includes seven data sets: artificial and real.

1) dataAGGR

The first one, dataAGGR, can be used to demonstrate the data_aggregating function. This is a collection of artificial scanner data on milk products sold in three different months and it contains the following columns: time - dates of transactions (Year-Month-Day: 4 different dates); prices - prices of sold products (PLN); quantities - quantities of sold products (liters); prodID - unique product codes (3 different prodIDs); retID - unique codes identifying outlets/retailer sale points (4 different retIDs); description - descriptions of sold products (two subgroups: goat milk, powdered milk).

2) dataMATCH

The second one, dataMATCH, can be used to demonstrate the data_matching function and it will be described in the next part of the guidelines. Generally, this artificial data set contains the following columns: time - dates of transactions (Year-Month-Day); prices - prices of sold products; quantities - quantities of sold products; codeIN - internal product codes from the retailer; codeOUT - external product codes, e.g. GTIN or SKU in the real case; description - descriptions of sold products, eg. 'product A', 'product B', etc.

3) dataCOICOP

The third one, dataCOICOP, is a ollection of real scanner data on the sale of milk products sold in a period: Dec, 2020 - Feb, 2022. It is a data frame with 10 columns and 139600 rows. The used variables are as follows: time - dates of transactions (Year-Month-Day); prices - prices of sold products (PLN); quantities - quantities of sold products; description - descriptions of sold products (original: in Polish); codeID - retailer product codes; retID - IDs of retailer outlets; grammage - product grammages; unit - sales units, e.g. 'kg', 'ml', etc.; category - product categories (in English) corresponding to COICOP 6 levels; coicop6 - identifiers of local COICOP 6 groups (6 levels). Please note that this data set can serve as a training or testing set in product classification using machine learning methods (see the functions: model_classification and data_classifying).

4) milk

This data set, milk, is a collection of scaner data on the sale of milk in one of Polish supermarkets in the period from December 2018 to August 2020. It is a data frame with 6 columns and 4386 rows. The used variables are as follows: time - dates of transactions (Year-Month-Day); prices - prices of sold products (PLN); quantities - quantities of sold products (liters); prodID - unique product codes obtained after product matching (data set contains 68 different prodIDs); retID - unique codes identifying outlets/retailer sale points (data set contains 5 different retIDs); description - descriptions of sold milk products (data set contains 6 different product descriptions corresponding to subgroups of the milk group).

5) coffee

This data set, coffee, is a collection of scanner data on the sale of coffee in one of Polish supermarkets in the period from December 2017 to October 2020. It is a data frame with 6 columns and 42561 rows. The used variables are as follows: time - dates of transactions (Year-Month-Day); prices - prices of sold products (PLN); quantities - quantities of sold products (kg); prodID - unique product codes obtained after product matching (data set contains 79 different prodIDs); retID - unique codes identifying outlets/retailer sale points (data set contains 20 different retIDs); description - descriptions of sold coffee products (data set contains 3 different product descriptions corresponding to subgroups of the coffee group).

6) sugar

This data set, sugar, is a collection of scanner data on the sale of coffee in one of Polish supermarkets in the period from December 2017 to October 2020. It is a data frame with 6 columns and 7666 rows. The used variables are as follows: time - dates of transactions (Year-Month-Day); prices - prices of sold products (PLN); quantities - quantities of sold products (kg); prodID - unique product codes obtained after product matching (data set contains 11 different prodIDs); retID - unique codes identifying outlets/retailer sale points (data set contains 20 different retIDs); description - descriptions of sold sugar products (data set contains 3 different product descriptions corresponding to subgroups of the sugar group).

7) dataU

This data set, dataU, is a collection of artificial scanner data on 6 products sold in Dec, 2018. Product descriptions contain the information about their grammage and unit. It is a data frame with 5 columns and 6 rows. The used variables are as follows: time - dates of transactions (Year-Month-Day); prices - prices of sold products (PLN); quantities - quantities of sold products (item); prodID - unique product codes; description - descriptions of sold products (data set contains 6 different product descriptions).

The set milk represents a typical data frame used in the package for most calculations and is organized as follows:

library(PriceIndices)
head(milk)
#>         time prices quantities prodID retID   description
#> 1 2018-12-01   8.78        9.0  14215  2210 powdered milk
#> 2 2019-01-01   8.78       13.5  14215  2210 powdered milk
#> 3 2019-02-01   8.78        0.5  14215  1311 powdered milk
#> 4 2019-02-01   8.78        8.0  14215  2210 powdered milk
#> 5 2019-03-01   8.78        0.5  14215  1311 powdered milk
#> 6 2019-03-01   8.78        1.5  14215  2210 powdered milk

Available subgroups of sold milk are

unique(milk$description)
#> [1] "powdered milk"             "low-fat milk pasteurized" 
#> [3] "low-fat milk UHT"          "full-fat milk pasteurized"
#> [5] "full-fat milk UHT"         "goat milk"

Generating artificial scanner data sets in the package

The package includes the generate function which provides an artificial scanner data sets where prices and quantities are lognormally distributed. The characteristics for these lognormal distributions are set by pmi, sigma, qmi and qsigma parameters. This function works for the fixed number of products and outlets (see n and r parameters). The generated data set is ready for further price index calculations. For instance:

dataset<-generate(pmi=c(1.02,1.03,1.04),psigma=c(0.05,0.09,0.02),
                  qmi=c(3,4,4),qsigma=c(0.1,0.1,0.15),
                  start="2020-01")
head(dataset)
#>         time prices quantities prodID retID
#> 1 2020-01-01   2.78         23      1     1
#> 2 2020-01-01   2.75         19      2     1
#> 3 2020-01-01   2.88         21      3     1
#> 4 2020-01-01   2.66         19      4     1
#> 5 2020-01-01   2.58         20      5     1
#> 6 2020-01-01   2.61         18      6     1

From the other hand you can use tindex function to obtain the theoretical value of the unweighted price index for lognormally distributed prices (the month defined by start parameter plays a role of the fixed base period). The characteristics for these lognormal distributions are set by pmi and sigma parameters. The ratio parameter is a logical parameter indicating how we define the theoretical unweighted price index. If it is set to TRUE then the resulting value is a ratio of expected price values from compared months; otherwise the resulting value is the expected value of the ratio of prices from compared months.The function provides a data frame consisting of dates and corresponding expected values of the theoretical unweighted price index. For example:

tindex(pmi=c(1.02,1.03,1.04),psigma=c(0.05,0.09,0.02),start="2020-01",ratio=FALSE)
#>      date   tindex
#> 1 2020-01 1.000000
#> 2 2020-02 1.012882
#> 3 2020-03 1.019131

The User may also generate an artificial scanner dataset where prices are lognormally distributed and quantities are calculated under the assumption that consumers have CES (Constant Elasticity of Substitution) preferences and their spending on all products is fixed (see the generate_CES function). Please watch the following example:

#Generating an artificial dataset (the elasticity of substitution is 1.25)
df<-generate_CES(pmi=c(1.02,1.03),psigma=c(0.04,0.03),
elasticity=1.25,start="2020-01",n=100,days=TRUE)
head(df)
#>         time prices quantities prodID retID
#> 1 2020-01-09   2.98   1.447739      1     1
#> 2 2020-01-25   2.89   4.001540      2     1
#> 3 2020-01-12   2.90   2.068384      3     1
#> 4 2020-01-14   2.72   1.437393      4     1
#> 5 2020-01-04   2.75   5.446941      5     1
#> 6 2020-01-28   2.80   7.435235      6     1

Now, we can verify the value of elasticity of substitution using this generated dataset:

#Verifying the elasticity of substitution
elasticity(df, start="2020-01",end="2020-02")
#> [1] 1.25

Functions for data processing

data_preparing

This function returns a prepared data frame based on the user's data set (you can check if your data set it is suitable for further price index calculation by using data_check function). The resulting data frame is ready for further data processing (such as data selecting, matching or filtering) and it is also ready for price index calculations (if only it contains the required columns). The resulting data frame is free from missing values, negative and (optionally) zero prices and quantities. As a result, the column time is set to be Date type (in format: 'Year-Month-01'), while the columns prices and quantities are set to be numeric. If the description parameter is set to TRUE then the column description is set to be character type (otherwise it is deleted). Please note that the milk set is an already prepared dataset but let us assume for a moment that we want to make sure that it does not contain missing values and we do not need the column description for further calculations. For this purpose, we use the data_preparing function as follows:

head(data_preparing(milk, time="time",prices="prices",quantities="quantities"))
#>         time prices quantities
#> 1 2018-12-01   8.78        9.0
#> 2 2019-01-01   8.78       13.5
#> 3 2019-02-01   8.78        0.5
#> 4 2019-02-01   8.78        8.0
#> 5 2019-03-01   8.78        0.5
#> 6 2019-03-01   8.78        1.5

data_imputing

This function imputes missing prices (unit values) and (optionally) zero prices by using carry forward/backward prices. The imputation can be done for each outlet separately or for aggragated data (see the outlets parameter). If a missing product has a previous price then that previous price is carried forward until the next real observation. If there is no previous price then the next real observation is found and carried backward. The quantities for imputed prices are set to zeros. The function returns a data frame which is ready for price index calculations, for instance:

#Creating a data frame with zero prices (df)
data<-dplyr::filter(milk,time>=as.Date("2018-12-01") & time<=as.Date("2019-03-01"))
sample<-dplyr::sample_n(data, 100)
rest<-setdiff(data, sample)
sample$prices<-0
df<-rbind(sample, rest)
#The Fisher price index calculated for the original data set
fisher(df, "2018-12","2019-03")
#> [1] 0.9406833
#Zero price imputations:
df2<-data_imputing(df, start="2018-12", end="2019-03",
              zero_prices=TRUE,
              outlets=TRUE)
#The Fisher price index calculated for the data set with imputed prices:
fisher(df2, "2018-12","2019-03")
#> [1] 0.9403425

data_aggregating

The function aggregates the user's data frame over time and/or over outlets. Consequently, we obtain monthly data, where the unit value is calculated instead of a price for each prodID observed in each month (the time column gets the Date format: "Year-Month-01"). If paramter join_outlets is TRUE, then the function also performs aggregation over outlets (retIDs) and the retID column is removed from the data frame. The main advantage of using this function is the ability to reduce the size of the data frame and the time needed to calculate the price index. For instance, let us consider the following data set:

dataAGGR
#>         time prices quantities prodID retID   description
#> 1 2018-12-01     10        100 400032  4313     goat milk
#> 2 2018-12-01     15        100 400032  1311     goat milk
#> 3 2018-12-01     20        100 400032  1311     goat milk
#> 4 2020-07-01     20        100 400050  1311     goat milk
#> 5 2020-08-01     30         50 400050  1311     goat milk
#> 6 2020-08-01     40         50 400050  2210     goat milk
#> 7 2018-12-01     15        200 403249  2210 powdered milk
#> 8 2018-12-01     15        200 403249  2210 powdered milk
#> 9 2018-12-01     15        300 403249  2210 powdered milk

After aggregating this data set over time and outlets we obtain:

data_aggregating(dataAGGR)
#> # A tibble: 4 x 4
#>   time       prodID prices quantities
#>   <date>      <int>  <dbl>      <int>
#> 1 2018-12-01 400032     15        300
#> 2 2018-12-01 403249     15        700
#> 3 2020-07-01 400050     20        100
#> 4 2020-08-01 400050     35        100

data_unit

The function returns the user's data frame with two additional columns: grammage and unit (both are character type). The values of these columns are extracted from product descriptions on the basis of provided units. Please note, that the function takes into consideration a sign of the multiplication, e.g. if the product description contains: '2x50 g', we will obtain: grammage: 100 and unit: g for that product (for multiplication set to 'x'). For example:

data_unit(dataU,units=c("g","ml","kg","l"),multiplication="x")
#>         time prices quantities prodID          description grammage unit
#> 1 2018-12-01   8.00        200  40033 drink 0,75l 3% corma     0.75    l
#> 2 2018-12-01   5.20        300  12333          sugar 0.5kg      0.5   kg
#> 3 2018-12-01  10.34        100  20345         milk 4x500ml     2000   ml
#> 4 2018-12-01   2.60        500  15700 xyz 3 4.34 xyz 200 g      200    g
#> 5 2018-12-01  12.00       1000  13022                  abc        1 item
#> 6 2019-01-01   3.87        250  10011     ABC 2A/350 g mnk      350    g

data_norm

The function returns the user's data frame with two transformed columns: grammage and unit, and two rescaled columns: prices and quantities. The above-mentioned transformation and rescaling take into consideration the user rules. Recalculated prices and quantities concern grammage units defined as the second parameter in the given rule. For instance:

# Preparing a data set
data<-data_unit(dataU,units=c("g","ml","kg","l"),multiplication="x")
# Normalization of grammage units
data_norm(data, rules=list(c("ml","l",1000),c("g","kg",1000)))
#>         time   prices quantities prodID          description grammage unit
#> 1 2018-12-01  5.17000      200.0  20345         milk 4x500ml        2    l
#> 2 2018-12-01 10.66667      150.0  40033 drink 0,75l 3% corma     0.75    l
#> 3 2018-12-01 13.00000      100.0  15700 xyz 3 4.34 xyz 200 g      0.2   kg
#> 4 2019-01-01 11.05714       87.5  10011     ABC 2A/350 g mnk     0.35   kg
#> 5 2018-12-01 10.40000      150.0  12333          sugar 0.5kg      0.5   kg
#> 6 2018-12-01 12.00000     1000.0  13022                  abc        1 item

data_selecting

The function returns a subset of the user's data set obtained by selection based on keywords and phrases defined by parameters: include, must and exclude (an additional column coicop is optional). Providing values of these parameters, please remember that the procedure distinguishes between uppercase and lowercase letters only when sensitivity is set to TRUE.

For instance, please use

subgroup1<-data_selecting(milk, include=c("milk"), must=c("UHT"))
head(subgroup1)
#>         time prices quantities prodID retID      description
#> 1 2018-12-01   2.97         78  17034  1311 low-fat milk uht
#> 2 2018-12-01   2.97        167  17034  2210 low-fat milk uht
#> 3 2018-12-01   2.97        119  17034  6610 low-fat milk uht
#> 4 2018-12-01   2.97         32  17034  7611 low-fat milk uht
#> 5 2018-12-01   2.97         54  17034  8910 low-fat milk uht
#> 6 2019-01-01   2.95         71  17034  1311 low-fat milk uht

to obtain the subset of milk limited to UHT category:

unique(subgroup1$description)
#> [1] "low-fat milk uht"  "full-fat milk uht"

You can use

subgroup2<-data_selecting(milk, must=c("milk"), exclude=c("past","goat"))
head(subgroup2)
#>         time prices quantities prodID retID   description
#> 1 2018-12-01   8.78        9.0  14215  2210 powdered milk
#> 2 2019-01-01   8.78       13.5  14215  2210 powdered milk
#> 3 2019-02-01   8.78        0.5  14215  1311 powdered milk
#> 4 2019-02-01   8.78        8.0  14215  2210 powdered milk
#> 5 2019-03-01   8.78        0.5  14215  1311 powdered milk
#> 6 2019-03-01   8.78        1.5  14215  2210 powdered milk

to obtain the subset of milk with products which are not pasteurized and which are not goat:

unique(subgroup2$description)
#> [1] "powdered milk"     "low-fat milk uht"  "full-fat milk uht"

data_classifying

This function predicts product COICOP levels (or any other defined product levels) using the selected machine learning model (see the model parameter). It provides the indicated data set with an additional column, i.e. coicop_predicted. The selected model must be built previously (see the model_classification function) and after the training process it can be saved on your disk (see the save_model function) and then loaded at any time (see the load_model function). Please note that the machine learning process is based on the XGBoost algorithm (from the XGBoost package) which is an implementation of gradient boosted decision trees designed for speed and performance. For example, let us build a machine learning model

my.grid=list(eta=c(0.01,0.02,0.05),subsample=c(0.5,0.8))
data_train<-dplyr::filter(dataCOICOP,dataCOICOP$time<=as.Date("2021-10-01"))
data_test<-dplyr::filter(dataCOICOP,dataCOICOP$time==as.Date("2021-11-01"))
ML<-model_classification(data_train,
                         data_test,
                         coicop="coicop6",
                         grid=my.grid,
                         indicators=c("description","codeIN","grammage"),
                         key_words=c("uht"), 
                         rounds=60)

We can watch the results of the whole training process:

ML$figure_training

or we can observe the importance of the used indicators:

ML$figure_importance

Now, let us save the model on the disk. After saving the model we can load it and use at any time:

#Setting a temporary directory as a working directory
wd<-tempdir()
setwd(wd)
#Saving and loading the model
save_model(ML, dir="My_model")
ML_fromPC<-load_model("My_model")
#Prediction
data_predicted<-data_classifying(ML_fromPC, data_test)
head(data_predicted)
#>         time prices quantities                            description codeIN
#> 1 2021-11-01   3.03        379 g/wydojone mleko bez laktozyuht 3,2%1l  60001
#> 2 2021-11-01   3.03        856 g/wydojone mleko bez laktozyuht 3,2%1l  60001
#> 3 2021-11-01   3.03        369 g/wydojone mleko bez laktozyuht 3,2%1l  60001
#> 4 2021-11-01   3.03        617 g/wydojone mleko bez laktozyuht 3,2%1l  60001
#> 5 2021-11-01   3.03        613 g/wydojone mleko bez laktozyuht 3,2%1l  60001
#> 6 2021-11-01   3.03        261 g/wydojone mleko bez laktozyuht 3,2%1l  60001
#>   retID grammage unit       category coicop6 coicop_predicted
#> 1     2        1    l UHT whole milk 11411_1          11411_1
#> 2     3        1    l UHT whole milk 11411_1          11411_1
#> 3     4        1    l UHT whole milk 11411_1          11411_1
#> 4     5        1    l UHT whole milk 11411_1          11411_1
#> 5     6        1    l UHT whole milk 11411_1          11411_1
#> 6     7        1    l UHT whole milk 11411_1          11411_1

data_matching

If you have a dataset with information about products sold but they are not matched you can use the data_matching function. In an optimal situation, your data frame contains the codeIN, codeOUT and description columns (see documentation), which in practice will contain retailer codes, GTIN or SKU codes and product labels, respectively. The data_matching function returns a data set defined in the first parameter (data) with an additional column (prodID). Two products are treated as being matched if they have the same prodID value. The procedure of generating the above-mentioned additional column depends on the set of chosen columns for matching (see documentation for details). For instance, let us suppose you want to obtain matched products from the following, artificial data set:

head(dataMATCH)
#>         time    prices quantities codeIN codeOUT retID description
#> 1 2018-12-01  9.416371        309      1       1     1   product A
#> 2 2019-01-01  9.881875        325      1       5     1   product A
#> 3 2019-02-01 12.611826        327      1       1     1   product A
#> 4 2018-12-01  9.598252        309      3       2     1   product A
#> 5 2019-01-01  9.684900        325      3       2     1   product A
#> 6 2019-02-01  9.358420        327      3       2     1   product A

Let us assume that products with two identical codes (codeIN and codeOUT) or one of the codes identical and an identical description are automatically matched. Products are also matched if they have one of the codes identical and the Jaro-Winkler similarity of their descriptions is bigger than the fixed precision value (see documentation - Case 1). Let us also suppose that you want to match all products sold in the interval: December 2018 - February 2019. If you use the data_matching function (as below), an additional column (prodID) will be added to your data frame:

data1<-data_matching(dataMATCH, start="2018-12",end="2019-02", codeIN=TRUE, codeOUT=TRUE, precision=.98, interval=TRUE)
head(data1)
#>         time    prices quantities codeIN codeOUT retID description prodID
#> 1 2018-12-01  9.416371        309      1       1     1   product A      4
#> 2 2019-01-01  9.881875        325      1       5     1   product A      4
#> 3 2019-02-01 12.611826        327      1       1     1   product A      4
#> 4 2018-12-01  9.598252        309      3       2     1   product A      8
#> 5 2019-01-01  9.684900        325      3       2     1   product A      8
#> 6 2019-02-01  9.358420        327      3       2     1   product A      8

Let us now suppose you do not want to consider codeIN while matching and that products with an identical description are to be matched too:

data2<-data_matching(dataMATCH, start="2018-12",end="2019-02", 
                     codeIN=FALSE, onlydescription=TRUE, interval=TRUE)
head(data2)
#>         time    prices quantities codeIN codeOUT retID description prodID
#> 1 2018-12-01  9.416371        309      1       1     1   product A      7
#> 2 2019-01-01  9.881875        325      1       5     1   product A      7
#> 3 2019-02-01 12.611826        327      1       1     1   product A      7
#> 4 2018-12-01  9.598252        309      3       2     1   product A      7
#> 5 2019-01-01  9.684900        325      3       2     1   product A      7
#> 6 2019-02-01  9.358420        327      3       2     1   product A      7

Now, having a prodID column, your datasets are ready for further price index calculations, e.g.:

fisher(data1, start="2018-12", end="2019-02")
#> [1] 1.018419
jevons(data2, start="2018-12", end="2019-02")
#> [1] 1.074934

data_filtering

This function returns a filtered data set, i.e. a reduced user's data frame with the same columns and rows limited by a criterion defined by the filters parameter (see documentation). If the set of filters is empty then the function returns the original data frame (defined by the data parameter). On the other hand, if all filters are chosen, i.e. filters=c(extremeprices, dumpprices, lowsales), then these filters work independently and a summary result is returned. Please note that both variants of the extremeprices filter can be chosen at the same time, i.e. plimits and pquantiles, and they work also independently. For example, let us assume we consider three filters: filter1 is to reject 1% of the lowest and 1% of the highest price changes comparing March 2019 to December 2018, filter2 is to reject products with the price ratio being less than 0.5 or bigger than 2 in the same time, filter3 rejects the same products as filter2 rejects and also products with relatively low sale in compared months, filter4 rejects products with the price ratio being less than 0.9 and with the expenditure ratio being less than 0.8 in the same time.

filter1<-data_filtering(milk,start="2018-12",end="2019-03",
                        filters=c("extremeprices"),pquantiles=c(0.01,0.99))
filter2<-data_filtering(milk,start="2018-12",end="2019-03",
                        filters=c("extremeprices"),plimits=c(0.5,2))
filter3<-data_filtering(milk,start="2018-12",end="2019-03",
                        filters=c("extremeprices","lowsales"),plimits=c(0.5,2))
filter4<-data_filtering(milk,start="2018-12",end="2019-03",
                        filters=c("dumpprices"),dplimits=c(0.9,0.8))

These three filters differ from each other with regard to the data reduction level:

data_without_filters<-data_filtering(milk,start="2018-12",end="2019-03",filters=c())
nrow(data_without_filters)
#> [1] 413
nrow(filter1)
#> [1] 378
nrow(filter2)
#> [1] 381
nrow(filter3)
#> [1] 170
nrow(filter4)
#> [1] 374

You can also use data_filtering for each pair of subsequent months from the considered time interval under the condition that this filtering is done for each outlet (retID) separately, e.g.

filter1B<-data_filtering(milk,start="2018-12",end="2019-03",
                         filters=c("extremeprices"),pquantiles=c(0.01,0.99),
                         interval=TRUE, retailers=TRUE)
nrow(filter1B)
#> [1] 773

Functions providing dataset characteristics

available

The function returns all values from the indicated column (defined by the type parameter) which occur at least once in one of compared periods or in a given time interval. Possible values of the type parameter are: retID, prodID, codeIN, codeOUT or description (see documentation). If the interval parameter is set to FALSE, then the function compares only periods defined by period1 and period2. Otherwise the whole time period between period1 and period2 is considered. For example:

available(milk, period1="2018-12", period2="2019-12", type="retID",interval=TRUE)
#> [1] 2210 1311 6610 7611 8910

matched

The function returns all values from the indicated column (defined by the type parameter) which occur simultaneously in the compared periods or in a given time interval.Possible values of the type parameter are: retID, prodID, codeIN, codeOUT or description (see documentation). If the interval parameter is set to FALSE, then the function compares only periods defined by period1 and period2. Otherwise the whole time period between period1 and period2 is considered. For example:

matched(milk, period1="2018-12", period2="2019-12", type="prodID",interval=TRUE)
#>  [1]  14216  15404  17034  34540  60010  70397  74431  82827  82830  82919
#> [11]  94256 400032 400033 400189 400194 400195 400196 401347 401350 402263
#> [21] 402264 402293 402569 402570 402601 402602 402609 403249 404004 404005
#> [31] 405419 405420 406223 406224 406245 406246 406247 407219 407220 407669
#> [41] 407670 407709 407859 407860 400099

matched_index

The function returns a ratio of values from the indicated column that occur simultaneously in the compared periods or in a given time interval to all available values from the above-mentioned column (defined by the type parameter) at the same time. Possible values of the type parameter are: retID, prodID, codeIN, codeOUT or description (see documentation). If the interval parameter is set to FALSE, then the function compares only periods defined by period1 and period2. Otherwise the whole time period between period1 and period2 is considered. The returned value is from 0 to 1. For example:

matched_index(milk, period1="2018-12", period2="2019-12", type="prodID",interval=TRUE)
#> [1] 0.7258065

matched_fig

The function returns a data frame or a figure presenting the matched_index function calculated for the column defined by the type parameter and for each month from the considered time interval. The interval is set by the start and end parameters. The returned object (data frame or figure) depends on the value of the figure parameter. Examples:

matched_fig(milk, start="2018-12", end="2019-12", type="prodID")
matched_fig(milk, start="2018-12", end="2019-04", type="prodID", figure=FALSE)
#>      date  fraction
#> 1 2018-12 1.0000000
#> 2 2019-01 0.9629630
#> 3 2019-02 0.9444444
#> 4 2019-03 0.9074074
#> 5 2019-04 0.8727273

products

This function detects and summarises available, matched, new and disappearing products on the basis of their prodIDs. It compares products from the base period (start) with products from the current period (end). It returns a list containing the following objects: details with prodIDs of available, matched, new and disappearing products, statistics with basic statistics for them and figure with a pie chart describing a contribution of matched, new and disappearing products in a set of available products. Please see the following example:

list<-products(milk, "2018-12","2019-12")
list$statistics
#>       products volume shares
#> 1    available     61 100.00
#> 2      matched     47  77.05
#> 3          new      8  13.11
#> 4 disappearing      6   9.84
list$figure

products_fig

This function returns a figure with plots of volume (or contributions) of available, matched, new as well as disappearing products. The User may control which groups of products are to be taken into consideration. Available options are available, matched, new and disappearing. Please follow the example:

products_fig(milk, "2018-12","2019-12", 
fixed_base=TRUE, contributions=FALSE,
show=c("new","disappearing","matched","available"))

prices

The function returns prices (unit value) of products with a given ID (prodID column) and being sold in the time period indicated by the period parameter. The set parameter means a set of unique product IDs to be used for determining prices of sold products. If the set is empty the function returns prices of all products being available in the period. Please note that the function returns the price values for sorted prodIDs and in the absence of a given prodID in the data set, the function returns nothing (it does not return zero).To get prices (unit values) of all available milk products sold in July, 2019, please use:

prices(milk, period="2019-06")
#>  [1]  8.700000  8.669455  1.890000  2.950000  1.990000  2.990000  2.834464
#>  [8]  4.702051  2.163273  2.236250  2.810000  2.860000  2.400000  2.588644
#> [15]  3.790911  7.980000 64.057143  7.966336 18.972121 12.622225  9.914052
#> [22]  7.102823  3.180000  2.527874  1.810000  1.650548  2.790000  2.490000
#> [29]  2.590000  7.970131  9.901111 15.266667 19.502286  2.231947  2.674401
#> [36]  2.371819  2.490000  6.029412  6.441176  2.090000  1.990000  1.890000
#> [43]  1.450000  2.680000  2.584184  2.683688  2.390000  3.266000  2.813238

quantities

The function returns quantities of products with a given ID (prodID column) and being sold in the time period indicated by the period parameter. The set parameter means a set of unique product IDs to be used for determining prices of sold products. If the set is empty the function returns quantities of all products being available in the period. Please note that the function returns the quantity values for sorted prodIDs and in the absence of a given prodID in the data set, the function returns nothing (it does not return zero). To get a data frame containing quantities of milk products with prodIDs: 400032, 71772 and 82919, and sold in July, 2019, please use:

quantities(milk, period="2019-06", set=c(400032, 71772, 82919), ID=TRUE)
#> # A tibble: 3 x 2
#>       by     q
#>    <int> <dbl>
#> 1  71772  117 
#> 2  82919  102 
#> 3 400032  114.

sales

The function returns values of sales of products with a given ID (prodID column) and being sold in the time period indicated by period parameter. The set parameter means a set of unique product IDs to be used for determining prices of sold products. If the set is empty the function returns values of sales of all products being available in the period (see also expenditures function which returns the expenditure values for sorted prodIDs). To get values of sales of milk products with prodIDs: 400032, 71772 and 82919, and sold in July, 2019, please use:

sales(milk, period="2019-06", set=c(400032, 71772, 82919))
#> [1] 913.71 550.14 244.80

sales_groups

The function returns values of sales of products from one or more datasets or the corresponding barplot for these sales (if barplot is set to TRUE). Alternatively, it calculates the sale shares (if the shares parameter is set to TRUE). Please see also the sales_groups2 function. As an example, let us create 3 subgroups of milk products and let us find out their sale shares for the time interval: April, 2019 - July, 2019. We can obtain precise values for the given period:

ctg<-unique(milk$description)
categories<-c(ctg[1],ctg[2],ctg[3])
milk1<-dplyr::filter(milk, milk$description==categories[1])
milk2<-dplyr::filter(milk, milk$description==categories[2])
milk3<-dplyr::filter(milk, milk$description==categories[3])
sales_groups(datasets=list(milk1,milk2,milk3),start="2019-04", end="2019-07")
#> [1]  44400.76 152474.55 101470.76
sales_groups(datasets=list(milk1,milk2,milk3),start="2019-04", end="2019-07", shares=TRUE)
#> [1] 0.1488230 0.5110661 0.3401109

or a barplot presenting these results:

sales_groups(datasets=list(milk1,milk2,milk3),start="2019-04", end="2019-07", 
             barplot=TRUE, shares=TRUE, names=categories)

pqcor

The function returns Pearson's correlation coefficient for price and quantity of products with given IDs (defined by the set parameter) and sold in the period. If the set is empty, the function works for all products being available in the period. The figure parameter indicates whether the function returns a figure with a correlation coefficient (TRUE) or just a correlation coefficient (FALSE). For instance:

pqcor(milk, period="2019-05")
#> [1] -0.2047
pqcor(milk, period="2019-05",figure=TRUE)

pqcor_fig

The function returns Pearson's correlation coefficients between price and quantity of products with given IDs (defined by the set parameter) and sold in the time interval defined by the start and end parameters. If the set is empty the function works for all available products. Correlation coefficients are calculated for each month separately. Results are presented in tabular or graphical form depending on the figure parameter. Both cases are presented below:

pqcor_fig(milk, start="2018-12", end="2019-06", figure=FALSE)
#>      date correlation
#> 1 2018-12     -0.1835
#> 2 2019-01     -0.1786
#> 3 2019-02     -0.1805
#> 4 2019-03     -0.1956
#> 5 2019-04     -0.1972
#> 6 2019-05     -0.2047
#> 7 2019-06     -0.2037
pqcor_fig(milk, start="2018-12", end="2019-06")

dissimilarity

This function returns a value of the relative price (dSP) and/or quantity (dSQ) dissimilarity measure. In a special case, when the type parameter is set to pq, the function provides the value of dSPQ measure (relative price and quantity dissimilarity measure calculated as min(dSP,dSQ). For instance:

dissimilarity(milk, period1="2018-12",period2="2019-12",type="pq")
#> [1] 0.00004175192

dissimilarity_fig

This function presents values of the relative price and/or quantity dissimilarity measure over time. The user can choose a benchmark period (defined by benchmark) and the type of dissimilarity measure is to be calculated (defined by type). The obtained results of dissimilarities over time can be presented in a dataframe form or via a figure (the default value of figure is TRUE which results a figure). For instance:

dissimilarity_fig(milk, start="2018-12",end="2019-12",type="pq",benchmark="start")

elasticity

This function returns a value of the elasticity of substitution. If the method parameter is set to lm (it is a default value), the procedure of estimation solves the equation: LM(sigma)-CW(sigma)=0 numerically, where LM denotes the Lloyd-Moulton price index, the CW denotes a current weight counterpart of the Lloyd-Moulton price index, and sigma is the elasticity of substitution parameter, which is estimated. If the method parameter is set to f, the Fisher price index formula is used instead of the CW price index. If the method parameter is set to t, the Tornqvist price index formula is used instead of the CW price index. If the method parameter is set to w, the Walsh price index formula is used instead of the CW price index. If the method parameter is set to sv, the Sato-Vartia price index formula is used instead of the CW price index.The procedure continues until the absolute value of this difference is greater than the value of the 'precision' parameter. For example:

elasticity(coffee, start = "2018-12", end = "2019-01")
#> [1] 4.241791

elasticity_fig

The function provides a data frame or a figure presenting elasticities of substitution calculated for time interval (see the figure parameter). The elasticities of substitution can be calculated for subsequent months or for a fixed base month (see the start parameter) and rest of months from the given time interval (it depends on the fixedbase parameter). The presented function is based on the elasticity function. For instance, to get elasticities of substitution calculated for milk products for subsequent months we run:

elasticity_fig (milk,start="2018-12",end="2019-04",figure=TRUE, 
method=c("lm","f","sv"),names=c("LM","Fisher", "SV"))

Functions for bilateral unweighted price index calculation

This package includes 6 functions for calculating the following bilateral unweighted price indices:

Price IndexFunction
BMW (2007)bmw
Carli (1804)carli
CSWD (1980,1992)cswd
Dutot (1738)dutot
Jevons (1865)jevons
Harmonicharmonic

Each of these functions returns a value (or vector of values) of the choosen unweighted bilateral price index depending on the interval parameter. If the interval parameter is set to TRUE, the function returns a vector of price index values without dates. To get information about both price index values and corresponding dates please see general functions: price_indices or final_index. None of these functions takes into account aggregating over outlets or product subgroups (to consider these types of aggregating please use the final_index function.) Below are examples of calculations for the Jevons index (in the second case a fixed base month is set to December 2018):

jevons(milk, start="2018-12", end="2020-01")
#> [1] 1.028223
jevons(milk, start="2018-12", end="2020-01", interval=TRUE)
#>  [1] 1.0000000 1.0222661 1.0300191 1.0353857 1.0075504 1.0395393 0.9853148
#>  [8] 1.0053100 1.0033727 1.0177604 1.0243906 1.0086291 1.0249373 1.0282234

Functions for bilateral weighted price index calculation

This package includes 30 functions for calculating the following bilateral weighted price indices:

Price IndexFunction
AG Mean (2009)agmean
Banajree (1977)banajree
Bialek (2012,2013)bialek
Davies (1924)davies
Drobisch (1871)drobisch
Fisher (1922)fisher
Geary-Khamis (1958,1970)geary_khamis
Geo-Laspeyresgeolaspeyres
Geo-Lowegeolowe
Geo-Paaschegeopaasche
Geo-Younggeoyoung
Geo-hybrid (2020)geohybrid
Hybrid (2020)hybrid
Laspeyres (1871)laspeyres
Lehr (1885)lehr
Lloyd-Moulton (1975,1996)lloyd_moulton
Lowelowe
Marshall-Edgeworth (1887)marshall_edgeworth
Paasche (1874)paasche
Palgrave (1886)palgrave
Sato-Vartia (1976)sato_vartia
Stuvel (1957)stuvel
Tornqvist (1936)tornqvist
Vartia (1976)vartia
Walsh (1901)walsh
Youngyoung
Quadratic mean of order r price indexQMp
Implicit quadratic mean of order r price indexIQMp
Value Indexvalue_index
Unit Value Indexunit_value_index

and the general quadratic mean of order r quantity index: QMq.

Each of these functions returns a value (or vector of values) of the choosen weighted bilateral price index depending on the interval parameter. If interval parameter is set to TRUE, the function returns a vector of price index values without dates. To get information about both price index values and corresponding dates please see general functions: price_indices or final_index. None of these functions takes into account aggregating over outlets or product subgroups (to consider these types of aggregating please use the final_index function.) Below are examples of calculations for the Fisher, the Lloyd-Moulton and the Lowe indices (in the last case, the fixed base month is set to December 2019 and the prior period is December 2018):

fisher(milk, start="2018-12", end="2020-01")
#> [1] 0.9615501
lloyd_moulton(milk, start="2018-12", end="2020-01", sigma=0.9)
#> [1] 0.9835069
lowe(milk, start="2019-12", end="2020-02", base="2018-12", interval=TRUE)
#> [1] 1.0000000 0.9880546 1.0024443

Functions for chain price index calculation

This package includes 35 functions for calculating the following chain indices (weighted and unweighted):

Price IndexFunction
Chain BMWchbmw
Chain Carlichcarli
Chain CSWDchcswd
Chain Dutotchdutot
Chain Jevonschjevons
Chain Harmonicchharmonic
Chain AG Meanchagmean
Chain Banajreechbanajree
Chain Bialekchbialek
Chain Davieschdavies
Chain Drobischchdrobisch
Chain Fisherchfisher
Chain Geary-Khamischgeary_khamis
Chain Geo-Laspeyreschgeolaspeyres
Chain Geo-Lowechgeolowe
Chain Geo-Paaschechgeopaasche
Chain Geo-Youngchgeoyoung
Chain Geo-hybridchgeohybrid
Chain Hybridchhybrid
Chain Laspeyreschlaspeyres
Chain Lehrchlehr
Chain Lloyd-Moultonchlloyd_moulton
Chain Lowechlowe
Chain Marshall-Edgeworthchmarshall_edgeworth
Chain Paaschechpaasche
Chain Palgravechpalgrave
Chain Sato-Vartiachsato_vartia
Chain Stuvelchstuvel
Chain Tornqvistchtornqvist
Chain Vartiachvartia
Chain Walshchwalsh
Chain Youngchyoung
Chain quadratic mean of order r price indexchQMp
Chain implicit quadratic mean of order r price indexchIQMp
Chain quadratic mean of order r quantity indexchQMq

Each time, the interval parameter has a logical value indicating whether the function is to compare the research period defined by end to the base period defined by start (then interval is set to FALSE and it is a default value) or all fixed base indices are to be calculated. In this second case, all months from the time interval <start,end> are considered and start defines the base period (interval is set to TRUE). Here are examples for the Fisher chain index:

chfisher(milk, start="2018-12", end="2020-01")
#> [1] 0.9618094
chfisher(milk, start="2018-12", end="2020-01", interval=TRUE)
#>  [1] 1.0000000 1.0021692 1.0004617 0.9862756 0.9944042 0.9915704 0.9898026
#>  [8] 0.9876325 0.9981591 0.9968851 0.9786428 0.9771951 0.9874251 0.9618094

Functions for multilateral price index calculation

This package includes 22 functions for calculating multilateral price indices and one additional and general function (QU) which calculates the quality adjusted unit value index, i.e.:

Price IndexFunction
CCDIccdi
GEKSgeks
WGEKSwgeks
GEKS-Jgeksj
GEKS-Wgeksw
GEKS-Lgeksl
WGEKS-Lwgeksl
GEKS-GLgeksgl
WGEKS-GLwgeksgl
GEKS-AQUgeksaqu
WGEKS-AQUwgeksaqu
GEKS-AQIgeksaqi
WGEKS-AQIwgeksaqi
GEKS-GAQIgeksgaqi
GEKS-IQMgeksiqm
GEKS-QMgeksqm
GEKS-LMgekslm
WGEKS-GAQIwgeksgaqi
Geary-Khamisgk
Quality Adjusted Unit ValueQU
Time Product Dummytpd
Unweighted Time Product Dummyutpd
SPQSPQ

The above-mentioned 21 multilateral formulas (the SPQ index is an exception) consider the time window defined by the wstart and window parameters, where window is a length of the time window (typically multilateral methods are based on a 13-month time window). It measures the price dynamics by comparing the end period to the start period (both start and end must be inside the considered time window). To get information about both price index values and corresponding dates, please see functions: price_indices or final_index. These functions do not take into account aggregating over outlets or product subgroups (to consider these types of aggregating please use function: final_index ). Here are examples for the GEKS formula (see documentation):

geks(milk, start="2019-01", end="2019-04",window=10)
#> [1] 0.9912305
geksl(milk, wstart="2018-12", start="2019-03", end="2019-05")
#> [1] 1.002251

The QU function returns a value of the quality adjusted unit value index (QU index) for the given set of adjustment factors. An additional v parameter is a data frame with adjustment factors for at least all matched prodIDs. It must contain two columns: prodID with unique product IDs and value with corresponding adjustment factors (see documentation). The following example starts from creating a data frame which includes sample adjusted factors:

prodID<-base::unique(milk$prodID)
values<-stats::runif(length(prodID),1,2)
v<-data.frame(prodID,values)
head(v)
#>   prodID   values
#> 1  14215 1.472867
#> 2  14216 1.378476
#> 3  15404 1.099301
#> 4  17034 1.129296
#> 5  34540 1.435951
#> 6  51583 1.680332

and the next step is calculating the QU index which compares December 2019 to December 2018:

QU(milk, start="2018-12", end="2019-12", v)
#> [1] 0.962823

Functions for extending multilateral price indices by using splicing methods

This package includes 21 functions for calculating splice indices:

Price IndexFunction
Splice CCDIccdi_splcie
Splice GEKSgeks_splice
Splice weighted GEKSwgeks_splice
Splice GEKS-Jgeksj_splice
Splice GEKS-Wgeksw_splice
Splice GEKS-Lgeksl_splice
Splice weighted GEKS-Lwgeksl_splice
Splice GEKS-GLgeksgl_splice
Splice weighted GEKS-GLwgeksgl_splice
Splice GEKS-AQUgeksaqu_splice
Splice weighted GEKS-AQUwgeksaqu_splice
Splice GEKS-AQIgeksaqi_splice
Splice weighted GEKS-AQIwgeksaqi_splice
Splice GEKS-GAQIgeksgaqi_splice
Splice weighted GEKS-GAQIwgeksgaqi_splice
Splice GEKS-IQMgeksiqm_splice
Splice GEKS-QMgeksqm_splice
Splice GEKS-LMgekslm_splice
Splice Geary-Khamisgk_splice
Splice Time Product Dummytpd_splice
Splice unweighted Time Product Dummyutpd_splice

These functions return a value (or values) of the selected multilateral price index extended by using window splicing methods (defined by the splice parameter). Available splicing methods are: movement splice, window splice, half splice, mean splice and their additional variants: window splice on published indices (WISP), half splice on published indices (HASP) and mean splice on published indices (see documentation). The first considered time window is defined by the start and window parameters, where window is a length of the time window (typically multilateral methods are based on a 13-month time window). Functions measure the price dynamics by comparing the end period to the start period, i.e. if the time interval <start, end> exceeds the defined time window then splicing methods are used. If the interval parameter is set to TRUE, then all fixed base multilateral indices are presented (the fixed base month is defined by start). To get information about both price index values and corresponding dates, please see functions: price_indices or final_index. These functions do not take into account aggregating over outlets or product subgroups (to consider these types of aggregating, please use the final_index function). For instance, let us calculate the extended Time Product Dummy index by using the half splice method with a 10-month time window:

tpd_splice(milk, start="2018-12", end="2020-02",window=10,splice="half",interval=TRUE)
#>  [1] 1.0000000 1.0038893 1.0000284 0.9837053 0.9954196 0.9924919 0.9913655
#>  [8] 0.9866847 0.9998615 0.9949000 0.9806788 0.9808493 0.9888003 0.9628623
#> [15] 1.0021956

Functions for extending multilateral price indices by using the FBEW method

This package includes 21 functions for calculating extensions of multilateral indices by using the Fixed Base Monthly Expanding Window (FBEW) method:

Price IndexFunction
FBEW CCDIccdi_fbew
FBEW GEKSgeks_fbew
FBEW WGEKSwgeks_fbew
FBEW GEKS-Jgeksj_fbew
FBEW GEKS-Wgeksw_fbew
FBEW GEKS-Lgeksl_fbew
FBEW WGEKS-Lwgeksl_fbew
FBEW GEKS-GLgeksgl_fbew
FBEW WGEKS-GLwgeksgl_fbew
FBEW GEKS-AQUgeksaqu_fbew
FBEW WGEKS-AQUwgeksaqu_fbew
FBEW GEKS-AQIgeksaqi_fbew
FBEW WGEKS-AQIwgeksaqi_fbew
FBEW GEKS-GAQIgeksgaqi_fbew
FBEW WGEKS-GAQIwgeksgaqi_fbew
FBEW GEKS-QMgeksqm_fbew
FBEW GEKS-IQMgeksiqm_fbew
FBEW GEKS-LMgekslm_fbew
FBEW Geary-Khamisgk_fbew
FBEW Time Product Dummytpd_fbew
FBEW unweighted Time Product Dummyutpd_fbew

These functions return a value (or values) of the selected multilateral price index extended by using the FBEW method. The FBEW method uses a time window with a fixed base month every year (December). The window is enlarged every month with one month in order to include information from a new month. The full window length (13 months) is reached in December of each year. These functions measure the price dynamics between the end and start periods. A month of the start parameter must be December (see documentation). If the distance between end and start exceeds 13 months, then internal Decembers play a role of chain-linking months. To get information about both price index values and corresponding dates please see functions: price_indices or final_index. These functions do not take into account aggregating over outlets or product subgroups (to consider these types of aggregating, please use the final_index function). For instance, let us calculate the extended GEKS index by using the FBEW method. Please note that December 2019 is the chain-linking month, i.e.:

geks_fbew(milk, start="2018-12", end="2020-03")
#> [1] 0.9891602
  geks_fbew(milk, start="2018-12", end="2019-12")*
  geks_fbew(milk, start="2019-12", end="2020-03")
#> [1] 0.9891602

Functions for extending multilateral price indices by using the FBMW method

This package includes 21 functions for calculating extensions of multilateral indices by using the Fixed Base Moving Window (FBMW) method:

Price IndexFunction
FBMW CCDIccdi_fbmw
FBMW GEKSgeks_fbmw
FBMW WGEKSwgeks_fbmw
FBMW GEKS-Jgeksj_fbmw
FBMW GEKS-Wgeksw_fbmw
FBMW GEKS-Lgeksl_fbmw
FBMW WGEKS-Lwgeksl_fbmw
FBMW GEKS-GLgeksgl_fbmw
FBMW WGEKS-GLwgeksgl_fbmw
FBMW GEKS-AQUgeksaqu_fbmw
FBMW WGEKS-AQUwgeksaqu_fbmw
FBMW GEKS-AQIgeksaqi_fbmw
FBMW WGEKS-AQIwgeksaqi_fbmw
FBMW GEKS-GAQIgeksgaqi_fbmw
FBMW WGEKS-GAQIwgeksgaqi_fbmw
FBMW GEKS-IQMgeksiqm_fbmw
FBMW GEKS-QMgeksqm_fbmw
FBMW GEKS-LMgekslm_fbmw
FBMW Geary-Khamisgk_fbmw
FBMW Time Product Dummytpd_fbmw
FBMW unweighted Time Product Dummyutpd_fbmw

These functions return a value (or values) of the selected multilateral price index extended by using the FBMW method. They measure the price dynamics between the end and start periods and it uses a 13-month time window with a fixed base month taken as year(end)-1. If the distance between end and start exceeds 13 months, then internal Decembers play a role of chain-linking months. A month of the start parameter must be December (see documentation). To get information about both price index values and corresponding dates, please see functions: price_indices or final_index. These functions do not take into account aggregating over outlets or product subgroups (to consider these types of aggregating, please use the final_index function). For instance, let us calculate the extended CCDI index by using the FBMW method. Please note that December 2019 is the chain-linking month, i.e.:

ccdi_fbmw(milk, start="2018-12", end="2020-03")
#> [1] 0.9874252
    ccdi_fbmw(milk, start="2018-12", end="2019-12")*
    ccdi_fbmw(milk, start="2019-12", end="2020-03")
#> [1] 0.9874252

General functions for price index calculations

This package includes 3 general functions for price index calculation. The start and end parameters indicate the base and the research period respectively. These function provide value or values (depending on the interval parameter) of the selected price index formula or formulas. If the interval parameter is set to TRUE then it returns a data frame with two columns: dates and index values. Function price_indices does not take into account aggregating over outlets or product subgroups and to consider these types of aggregating, please use function: final_index.

price_indices

This function allows us to compare many price index formulas by using one command. The general character of this function mean that, for instance, your one command may calculate two CES indices for two different values of sigma parameter (the elasticity of substitution) or you can select several splice indices and calculate them by using different window lengths and different splicing method. You can control names of columns in the resulting data frame by defining additional parameters: names. Please note that this function is not the most general in the package, i.e. all selected price indices are calculated for the same data set defined by the data parameter and the aggregation over subgroups or outlets are not taken into consideration here (to consider it, please use function: final_index).

For instance:

price_indices(milk, 
         start = "2018-12", end = "2019-12",
         formula=c("geks","ccdi","hybrid","fisher",
         "QMp","young","geksl_fbew"),
         window = c(13, 13),
         bas

Copy Link

Version

Install

install.packages('PriceIndices')

Monthly Downloads

669

Version

0.1.7

License

GPL-3

Maintainer

Jacek Bia<c5><82>ek

Last Published

April 11th, 2023

Functions in PriceIndices (0.1.7)

bialek

Calculating the bilateral Bialek price index
ccdi_splice

Extending the multilateral CCDI price index by using window splicing methods.
carli

Calculating the unweighted Carli price index
ccdi

Calculating the multilateral GEKS price index based on the Tornqvist formula (typical notation: GEKS-T or CCDI)
ccdi_fbew

Extending the multilateral CCDI price index by using the FBEW method.
bmw

Calculating the unweighted BMW price index
chQMq

Calculating the monthly chained quadratic mean of order r quantity index
chQMp

Calculating the monthly chained quadratic mean of order r price index
ccdi_fbmw

Extending the multilateral CCDI price index by using the FBMW method.
chdavies

Calculating the monthly chained Davies price index
chIQMp

Calculating the monthly chained implicit quadratic mean of order r price index
chbialek

Calculating the monthly chained Bialek price index
chbmw

Calculating the monthly chained BMW price index
chdrobisch

Calculating the monthly chained Drobisch price index
chcarli

Calculating the monthly chained Carli price index
chcswd

Calculating the monthly chained CSWD price index
chgeary_khamis

Calculating the monthly chained Geary-Khamis price index
chgeohybrid

Calculating the the monthly chained geohybrid price index
chgeoyoung

Calculating the monthly chained geometric Young price index
chgeopaasche

Calculating the monthly chained geo-logarithmic Paasche price index
chfisher

Calculating the monthly chained Fisher price index
chdutot

Calculating the monthly chained Dutot price index
chlaspeyres

Calculating the monthly chained Laspeyres price index
chjevons

Calculating the monthly chained Jevons price index
chagmean

Calculating the monthly chained AG Mean price index
chgeolaspeyres

Calculating the monthly chained geo-logarithmic Laspeyres price index
chpalgrave

Calculating the monthly chained Palgrave price index
chpaasche

Calculating the monthly chained Paasche price index
chgeolowe

Calculating the monthly chained geometric Lowe price index
chbanajree

Calculating the monthly chained Banajree price index
chtornqvist

Calculating the monthly chained Tornqvist price index
chhybrid

Calculating the the monthly chained hybrid price index
chmarshall_edgeworth

Calculating the monthly chained Marshall-Edgeworth price index
chvartia

Calculating the monthly chained Vartia-I price index
chlowe

Calculating the monthly chained Lowe price index
chwalsh

Calculating the monthly chained Walsh price index
compare_distances

Calculating distances between price indices
coffee

A real data set on sold coffee
chharmonic

Calculating the monthly chained harmonic price index
chsato_vartia

Calculating the monthly chained Vartia-II (Sato-Vartia) price index
cswd

Calculating the unweighted CSWD price index
chyoung

Calculating the monthly chained Young price index
data_classifying

Predicting product COICOP levels via the machine learning model
chstuvel

Calculating the monthly chained Stuvel price index
data_check

Checking the user's data frame
dataAGGR

A small artificial scanner data set for a demonstration of data aggregation
data_aggregating

Aggregating the user's data frame
dataCOICOP

A real scanner data set for the product classification
dataU

An artificial, small scanner data set
dissimilarity

Calculating the relative price and/or quantity dissimilarity measure between periods
dissimilarity_fig

Presenting the relative price and/or quantity dissimilarity measure over time
dataMATCH

An artificial scanner data set for product matching
compare_to_target

Calculating distances between considered price indices and the target price index
chlehr

Calculating the monthly chained Lehr price index
elasticity

Calculating the elasticity of substitution
compare_indices_list

A general function for graphical comparison of price indices
chlloyd_moulton

Calculating the monthly chained Lloyd-Moulton price index
drobisch

Calculating the bilateral Drobisch price index
data_filtering

Filtering a data set for further price index calculations
elasticity_fig

Presenting elasticities of substitution for time interval
davies

Calculating the bilateral Davies price index
data_unit

Providing information about the grammage and unit of products
data_imputing

Imputing missing and (optionally) zero prices.
geks_fbmw

Extending the multilateral GEKS price index by using the FBMW method.
dutot

Calculating the unweighted Dutot price index
geks_splice

Extending the multilateral GEKS price index by using window splicing methods.
expenditures

Providing expenditures of sold products
geksgaqi

Calculating the multilateral GEKS-GAQI price index
geks_fbew

Extending the multilateral GEKS price index by using the FBEW method.
geksgaqi_fbew

Extending the multilateral GEKS-GAQI price index by using the FBEW method.
geks

Calculating the multilateral GEKS price index
geksaqi_splice

Extending the multilateral GEKS-AQI price index by using window splicing methods.
final_index

A general function to compute a final price index
geksaqi_fbmw

Extending the multilateral GEKS-AQI price index by using the FBMW method.
compare_indices_df

A function for graphical comparison of price indices
data_norm

Normalization of grammage units and recalculation of prices and quantities with respect to these units
data_matching

Matching products
compare_indices_jk

A general function to compare indices by using the jackknife method
geksaqu

Calculating the multilateral GEKS-AQU price index
geksaqu_fbew

Extending the multilateral GEKS-AQU price index by using the FBEW method.
data_selecting

Selecting products from the user's data set for further price index calculations
data_preparing

Preparing a data set for further data processing or price index calculations
geksgl_fbew

Extending the multilateral GEKS-GL price index by using the FBEW method.
geksgl

Calculating the multilateral GEKS-GL price index
fisher

Calculating the bilateral Fisher price index
geary_khamis

Calculating the bilateral Geary-Khamis price index
geksaqu_fbmw

Extending the multilateral GEKS-AQU price index by using the FBMW method.
geksiqm

Calculating the multilateral GEKS-IQM price index
geksiqm_fbmw

Extending the multilateral GEKS-IQM price index by using the FBMW method.
geksiqm_splice

Extending the multilateral GEKS-IQM price index by using window splicing methods.
geksgaqi_fbmw

Extending the multilateral GEKS-GAQI price index by using the FBMW method.
geksaqi_fbew

Extending the multilateral GEKS-AQI price index by using the FBEW method.
geksaqi

Calculating the multilateral GEKS-AQI price index
geksgaqi_splice

Extending the multilateral GEKS-GAQI price index by using window splicing methods.
geksiqm_fbew

Extending the multilateral GEKS-IQM price index by using the FBEW method.
geksl_fbmw

Extending the multilateral GEKS-L price index by using the FBMW method.
geksl_splice

Extending the multilateral GEKS-L price index by using window splicing methods.
gekslm_fbmw

Extending the multilateral GEKS-LM price index by using the FBMW method.
geksqm_splice

Extending the multilateral GEKS-QM price index by using window splicing methods.
geksgl_fbmw

Extending the multilateral GEKS-GL price index by using the FBMW method.
geksqm_fbmw

Extending the multilateral GEKS-QM price index by using the FBMW method.
gekslm_splice

Extending the multilateral GEKS-LM price index by using window splicing methods.
gekslm_fbew

Extending the multilateral GEKS-LM price index by using the FBEW method.
gekslm

Calculating the multilateral GEKS-LM price index
geksgl_splice

Extending the multilateral GEKS-GL price index by using window splicing methods.
geksaqu_splice

Extending the multilateral GEKS-AQU price index by using window splicing methods.
geksj_fbew

Extending the multilateral GEKS-J price index by using the FBEW method.
geksj

Calculating the multilateral GEKS price index based on the Jevons formula (typical notation: GEKS-J)
geksw_splice

Extending the multilateral GEKS-W price index by using window splicing methods.
geksw_fbmw

Extending the multilateral GEKS-W price index by using the FBMW method.
geksqm

Calculating the multilateral GEKS-QM price index
geksqm_fbew

Extending the multilateral GEKS-QM price index by using the FBEW method.
geksj_fbmw

Extending the multilateral GEKS-J price index by using the FBMW method.
geksj_splice

Extending the multilateral GEKS-J price index by using window splicing methods.
generate_CES

Generating an artificial scanner dataset in the CES model
generate

Generating an artificial scanner dataset
gk_fbew

Extending the multilateral Geary-Khamis price index by using the FBEW method.
geoyoung

Calculating the bilateral geometric Young price index
lowe

Calculating the bilateral Lowe price index
gk

Calculating the multilateral Geary-Khamis price index
gk_splice

Extending the multilateral Geary-Khamis price index by using window splicing methods.
matched

Providing values from the indicated column that occur simultaneously in the compared periods or in a given time interval.
harmonic

Calculating the unweighted harmonic price index
geopaasche

Calculating the bilateral geo-logarithmic Paasche price index
geolowe

Calculating the bilateral geometric Lowe price index
gk_fbmw

Extending the multilateral Geary-Khamis price index by using the FBMW method.
load_model

Loading the machine learning model from the disk
lloyd_moulton

Calculating the bilateral Lloyd-Moulton price index
lehr

Calculating the bilateral Lehr price index
laspeyres

Calculating the bilateral Laspeyres price index
matched_fig

Providing a time dependent matched_index() function
geksl

Calculating the multilateral GEKS-L price index
geksl_fbew

Extending the multilateral GEKS-L price index by using the FBEW method.
geksw_fbew

Extending the multilateral GEKS-W price index by using the FBEW method.
geohybrid

Calculating the bilateral geohybrid price index
geksw

Calculating the multilateral GEKS price index based on the Walsh formula (GEKS-W)
geolaspeyres

Calculating the bilateral geo-logarithmic Laspeyres price index
marshall_edgeworth

Calculating the bilateral Marshall-Edgeworth price index
montgomery

Calculating the Montgomery price and quantity indicators
model_classification

Building the machine learning model for product classification
pqcor

Providing a correlation coefficient for price and quantity of sold products
pqcor_fig

Providing correlations between price and quantity of sold products
mmontgomery

Calculating the multilateral Montgomery price and quantity indicators
milk

A real data set on sold milk
hybrid

Calculating the bilateral hybrid price index
sato_vartia

Calculating the bilateral Vartia-II (Sato-Vartia) price index
jevons

Calculating the unweighted Jevons price index
save_model

Saving the machine learning model on the disk
sales_groups

Providing information about sales of products from one or more datasets
price_indices

A general function to compute one or more price indices
prices

Providing prices (unit values) of sold products
tpd_splice

Extending the multilateral TPD price index by using window splicing methods.
tpd_fbmw

Extending the multilateral TPD price index by using the FBMW method.
sales_groups2

Providing information about sales of products
vartia

Calculating the bilateral Vartia-I price index
value_index

Calculating the value index
utpd_splice

Extending the multilateral unweighted TPD price index by using window splicing methods.
products_fig

Function for graphical comparison of available, matched, new as well as disappearing products.
products

Detecting and summarising available, matched, new and disappearing products.
tpd

Calculating the multilateral TPD price index
tpd_fbew

Extending the multilateral TPD price index by using the FBEW method.
palgrave

Calculating the bilateral Palgrave price index
paasche

Calculating the bilateral Paasche price index
sales

Providing values of product sales
quantities

Providing quantities of sold products
tindex

Calculating theoretical (expected) values of the unweighted price index
matched_index

Providing the ratio of number of matched values from the indicated column to the number of all available values from this column
stuvel

Calculating the bilateral Stuvel price index
wgeks

Calculating the multilateral weighted WGEKS price index
wgeks_fbew

Extending the multilateral weighted GEKS price index by using the FBEW method.
mbennet

Calculating the multilateral Bennet price and quantity indicators
sugar

A real data set on sold sugar
tornqvist

Calculating the bilateral Tornqvist price index
unit_value_index

Calculating the unit value index
wgeksaqu_fbmw

Extending the multilateral weighted GEKS-AQU price index by using the FBMW method.
walsh

Calculating the bilateral Walsh price index
wgeks_fbmw

Extending the multilateral weighted GEKS price index by using the FBMW method.
utpd_fbew

Extending the unweighted multilateral TPD price index by using the FBEW method.
utpd

Calculating the unweighted multilateral TPD price index
utpd_fbmw

Extending the unweighted multilateral TPD price index by using the FBMW method.
wgeksaqu_splice

Extending the multilateral weighted GEKS-AQU price index by using window splicing methods.
wgeksgaqi

Calculating the multilateral weighted WGEKS-GAQI price index
wgeksgaqi_fbmw

Extending the multilateral weighted GEKS-GAQI price index by using the FBMW method.
wgeks_splice

Extending the multilateral weighted GEKS price index by using window splicing methods.
wgeksgaqi_fbew

Extending the multilateral weighted GEKS-GAQI price index by using the FBEW method.
wgeksgaqi_splice

Extending the multilateral weighted GEKS-GAQI price index by using window splicing methods.
wgeksaqi

Calculating the multilateral weighted WGEKS-AQI price index
wgeksaqi_splice

Extending the multilateral weighted GEKS-AQI price index by using window splicing methods.
wgeksl_fbmw

Extending the multilateral weighted GEKS-L price index by using the FBMW method.
wgeksaqi_fbmw

Extending the multilateral weighted GEKS-AQI price index by using the FBMW method.
wgeksl_splice

Extending the multilateral weighted GEKS-L price index by using window splicing methods.
wgeksaqi_fbew

Extending the multilateral weighted GEKS-AQI price index by using the FBEW method.
wgeksgl

Calculating the multilateral weighted WGEKS-GL price index
wgeksaqu

Calculating the multilateral weighted WGEKS-AQU price index
wgeksl_fbew

Extending the multilateral weighted GEKS-L price index by using the FBEW method.
wgeksaqu_fbew

Extending the multilateral weighted GEKS-AQU price index by using the FBEW method.
wgeksl

Calculating the multilateral weighted WGEKS-L price index
wgeksgl_splice

Extending the multilateral weighted GEKS-GL price index by using window splicing methods.
young

Calculating the bilateral Young price index
wgeksgl_fbew

Extending the multilateral weighted GEKS-GL price index by using the FBEW method.
wgeksgl_fbmw

Extending the multilateral weighted GEKS-GL price index by using the FBMW method.
QMq

Calculating the quadratic mean of order r quantity index
QMp

Calculating the quadratic mean of order r price index
banajree

Calculating the bilateral Banajree price index
agmean

Calculating the bilateral AG Mean price index
PriceIndices

The list of package functions and their demonstration
QU

Calculating the quality adjusted unit value index (QU index)
IQMp

Calculating the implicit quadratic mean of order r price index
available

Providing values from the indicated column that occur at least once in one of the compared periods or in a given time interval
bennet

Calculating the Bennet price and quantity indicators
SPQ

Calculating the multilateral SPQ price index