Motivation

Health policy in the United States is complicated, and several forms of healthcare coverage exist, including both coverage by federal goverment-led healthcare policy, and by private insurance companies. Before making any inference about the relationship between health condition and health policy, it is important for us to have a general idea about healthcare economics in the United States. Thus, we are interested in getting sense of healthcare coverage and healthcare spending across States. More specifically, the questions are:

  1. Is there a relationship between healthcare coverage and healthcare spending in the United States?
  2. How does the spending distribution change across geographic regions in the United States?
  3. Does the relationship between healthcare coverage and healthcare spending in the United States change from 2013 to 2014?

In this case study, we’ll walk you through collecting data, importing data, cleaning data, wrangling data, and visualizing the data, using well-established and commonly used packages, including datasets, tidyr, dplyr, ggplot2, and ggrepel.

What is the data?

Image source from US Department of Health and Human Services

Healthcare data

We will be using the data from the Henry J Kaiser Family Foundation (KFF).

We have downloaded, re-named and saved these files in the GitHub repository under the data/KFF/ directory.

Now, before we dig into the data analysis, we need to introduce a set of R packages that we will use to analyze the data.

Data Import

Introduction to “Tidy data”

The tidyverse is “an opinionated collection of R packages designed for data science. All packages share an underlying philosophy and common APIs.”

Another way of putting it is that it’s a set of packages that are useful specifically for data manipulation, exploration and visualization with a common philosophy.

What is this common philosophy?

The common philosophy is called “tidy” data. It is a standard way of mapping the meaning of a dataset to its structure.

In tidy data:

  • Each variable forms a column.
  • Each observation forms a row.
  • Each type of observational unit forms a table.

Below, we are interested in transforming the table on the right to the the table on the left, which is considered “tidy”.

Working with tidy data is useful because it creates a structured way of organizing data values within a data set. This makes the data analysis process more efficient and simplifies the development of data analysis tools that work together. In this way, you can focus on the problem you are investigating, rather than the uninteresting logistics of data.

1. What is in the tidyverse?

We can install and load the set of R packages using install.packages("tidyverse") function.

When we load the tidyverse package using library(tidyverse), there are six core R packages that load:

  • readr, for data import.
  • tidyr, for data tidying.
  • dplyr, for data wrangling.
  • ggplot2, for data visualisation.
  • purrr, for functional programming.
  • tibble, for tibbles, a modern re-imagining of data frames.

Here, we load in the tidyverse.

These packages are highlighted in bold here:

Because these packages all share the “tidy” philosophy, the data analysis workflow is easier as you move from package to package.

Here, we will focus on the readr, tidyr and dplyr R packages to import data, to transform data to the “tidy” format, and to wrangle data.

Next, we will give a brief description of the features in each of these packages.

There are several base R functions that allow you read in data into R, which you may be familiar with such as read.table(), read.csv(), and read.delim(). Instead of using these, we will use the functions in the readr R package. The main reasons for this are

  1. Compared to equivalent base R functions, the functions in readr are around 10x faster.
  2. You can specify the column types (e.g character, integer, double, logical, date, time, etc)
  3. All parsing problems are recorded in a data frame.

Read data using the readr R package

The main functions in readr are:

readr functions Description
read_delim() reads in a flat file data with a given character to separate fields
read_csv() reads in a CSV file
read_tsv() reads in a file with values separated by tabs
read_lines() reads only a certain number of lines from the file
read_file() reads a complete file into a string
write_csv() writes data frame to CSV

A useful cheatsheet for the functions in the readr package can be found on RStudio’s website:

1. Read in data

Read in health healthcare coverage data

Let’s try reading in some data. We will begin by reading in the healthcare-coverage.csv data.

If we want to see what the header of the file looks like, we can use the read_lines() function to peak at the first few lines.

 [1] "\"Title: Health Insurance Coverage of the Total Population | The Henry J. Kaiser Family Foundation\""                                                                                                                                                                                                                                                                                                                                                                                                                                                                        
 [2] "\"Timeframe: 2013 - 2016\""                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  
 [3] "\"Location\",\"2013__Employer\",\"2013__Non-Group\",\"2013__Medicaid\",\"2013__Medicare\",\"2013__Other Public\",\"2013__Uninsured\",\"2013__Total\",\"2014__Employer\",\"2014__Non-Group\",\"2014__Medicaid\",\"2014__Medicare\",\"2014__Other Public\",\"2014__Uninsured\",\"2014__Total\",\"2015__Employer\",\"2015__Non-Group\",\"2015__Medicaid\",\"2015__Medicare\",\"2015__Other Public\",\"2015__Uninsured\",\"2015__Total\",\"2016__Employer\",\"2016__Non-Group\",\"2016__Medicaid\",\"2016__Medicare\",\"2016__Other Public\",\"2016__Uninsured\",\"2016__Total\""
 [4] "\"United States\",\"155696900\",\"13816000\",\"54919100\",\"40876300\",\"6295400\",\"41795100\",\"313401200\",\"154347500\",\"19313000\",\"61650400\",\"41896500\",\"5985000\",\"32967500\",\"316159900\",\"155965800\",\"21816500\",\"62384500\",\"43308400\",\"6422300\",\"28965900\",\"318868500\",\"157381500\",\"21884400\",\"62303400\",\"44550200\",\"6192200\",\"28051900\",\"320372000\""                                                                                                                                                                           
 [5] "\"Alabama\",\"2126500\",\"174200\",\"869700\",\"783000\",\"85600\",\"724800\",\"4763900\",\"2202800\",\"288900\",\"891900\",\"718400\",\"143900\",\"522200\",\"4768000\",\"2218000\",\"291500\",\"911400\",\"719100\",\"174600\",\"519400\",\"4833900\",\"2263800\",\"262400\",\"997000\",\"761200\",\"128800\",\"420800\",\"4834100\""                                                                                                                                                                                                                                      
 [6] "\"Alaska\",\"364900\",\"24000\",\"95000\",\"55200\",\"60600\",\"102200\",\"702000\",\"345300\",\"26800\",\"130100\",\"55300\",\"37300\",\"100800\",\"695700\",\"355700\",\"22300\",\"128100\",\"60900\",\"47700\",\"90500\",\"705300\",\"324400\",\"20300\",\"145400\",\"68200\",\"55600\",\"96900\",\"710800\""                                                                                                                                                                                                                                                             
 [7] "\"Arizona\",\"2883800\",\"170800\",\"1346100\",\"842000\",\"N/A\",\"1223000\",\"6603100\",\"2835200\",\"333500\",\"1639400\",\"911100\",\"N/A\",\"827100\",\"6657200\",\"2766500\",\"278400\",\"1711500\",\"949000\",\"189300\",\"844800\",\"6739500\",\"3010700\",\"377000\",\"1468400\",\"1028000\",\"172500\",\"833700\",\"6890200\""                                                                                                                                                                                                                                     
 [8] "\"Arkansas\",\"1128800\",\"155600\",\"600800\",\"515200\",\"67600\",\"436800\",\"2904800\",\"1176500\",\"231700\",\"639200\",\"479400\",\"82000\",\"287200\",\"2896000\",\"1293700\",\"200200\",\"641400\",\"484500\",\"63700\",\"268400\",\"2953000\",\"1290900\",\"252900\",\"618600\",\"490000\",\"67500\",\"225500\",\"2945300\""                                                                                                                                                                                                                                        
 [9] "\"California\",\"17747300\",\"1986400\",\"8344800\",\"3828500\",\"675400\",\"5594100\",\"38176400\",\"17703700\",\"2778800\",\"9618800\",\"4049000\",\"634400\",\"3916700\",\"38701300\",\"17718300\",\"3444200\",\"10138100\",\"4080100\",\"752700\",\"2980600\",\"39113900\",\"18116200\",\"3195400\",\"9853800\",\"4436000\",\"556100\",\"3030800\",\"39188300\""                                                                                                                                                                                                         
[10] "\"Colorado\",\"2852500\",\"426300\",\"697300\",\"549700\",\"118100\",\"654000\",\"5297800\",\"2489400\",\"397900\",\"1053700\",\"619500\",\"214000\",\"602900\",\"5377400\",\"2706000\",\"346900\",\"1036600\",\"708000\",\"148000\",\"475700\",\"5421300\",\"2872600\",\"370000\",\"855800\",\"692400\",\"190100\",\"528400\",\"5509200\""                                                                                                                                                                                                                                  

It looks like the first two lines are descriptive and are not useful. We will tell R to skip reading these in using the skip argument in read_csv(). The third line looks like it contains the column names and starting on the fourth line is where the data starts.

# A tibble: 6 x 29
  Location `2013__Employer` `2013__Non-Grou… `2013__Medicaid` `2013__Medicare`
  <chr>               <dbl>            <dbl>            <dbl>            <dbl>
1 United …        155696900         13816000         54919100         40876300
2 Alabama           2126500           174200           869700           783000
3 Alaska             364900            24000            95000            55200
4 Arizona           2883800           170800          1346100           842000
5 Arkansas          1128800           155600           600800           515200
6 Califor…         17747300          1986400          8344800          3828500
# … with 24 more variables: `2013__Other Public` <chr>,
#   `2013__Uninsured` <dbl>, `2013__Total` <dbl>, `2014__Employer` <dbl>,
#   `2014__Non-Group` <dbl>, `2014__Medicaid` <dbl>, `2014__Medicare` <dbl>,
#   `2014__Other Public` <chr>, `2014__Uninsured` <dbl>, `2014__Total` <dbl>,
#   `2015__Employer` <dbl>, `2015__Non-Group` <dbl>, `2015__Medicaid` <dbl>,
#   `2015__Medicare` <dbl>, `2015__Other Public` <chr>,
#   `2015__Uninsured` <dbl>, `2015__Total` <dbl>, `2016__Employer` <dbl>,
#   `2016__Non-Group` <dbl>, `2016__Medicaid` <dbl>, `2016__Medicare` <dbl>,
#   `2016__Other Public` <chr>, `2016__Uninsured` <dbl>, `2016__Total` <dbl>
# A tibble: 6 x 29
  Location `2013__Employer` `2013__Non-Grou… `2013__Medicaid` `2013__Medicare`
  <chr>               <dbl>            <dbl>            <dbl>            <dbl>
1 <NA>                   NA               NA               NA               NA
2 *Uninsu…               NA               NA               NA               NA
3 <NA>                   NA               NA               NA               NA
4 For exa…               NA               NA               NA               NA
5 <NA>                   NA               NA               NA               NA
6 *N/A*: …               NA               NA               NA               NA
# … with 24 more variables: `2013__Other Public` <chr>,
#   `2013__Uninsured` <dbl>, `2013__Total` <dbl>, `2014__Employer` <dbl>,
#   `2014__Non-Group` <dbl>, `2014__Medicaid` <dbl>, `2014__Medicare` <dbl>,
#   `2014__Other Public` <chr>, `2014__Uninsured` <dbl>, `2014__Total` <dbl>,
#   `2015__Employer` <dbl>, `2015__Non-Group` <dbl>, `2015__Medicaid` <dbl>,
#   `2015__Medicare` <dbl>, `2015__Other Public` <chr>,
#   `2015__Uninsured` <dbl>, `2015__Total` <dbl>, `2016__Employer` <dbl>,
#   `2016__Non-Group` <dbl>, `2016__Medicaid` <dbl>, `2016__Medicare` <dbl>,
#   `2016__Other Public` <chr>, `2016__Uninsured` <dbl>, `2016__Total` <dbl>

It looks like we now have the right header, but there are a bunch of NAs in the end of the data frame because most of it isn’t useful data.

Let’s take a closer look at the last 30 lines

# A tibble: 30 x 29
   Location `2013__Employer` `2013__Non-Grou… `2013__Medicaid` `2013__Medicare`
   <chr>               <dbl>            <dbl>            <dbl>            <dbl>
 1 "Washin…          3541600           309000          1026800           879000
 2 "West V…           841300            42600           382500           329400
 3 "Wiscon…          3154500           225300           907600           812900
 4 "Wyomin…           305900            19500            74200            65400
 5 "Notes"                NA               NA               NA               NA
 6 "The ma…               NA               NA               NA               NA
 7  <NA>                  NA               NA               NA               NA
 8 "In thi…               NA               NA               NA               NA
 9  <NA>                  NA               NA               NA               NA
10 "Data e…               NA               NA               NA               NA
# … with 20 more rows, and 24 more variables: `2013__Other Public` <chr>,
#   `2013__Uninsured` <dbl>, `2013__Total` <dbl>, `2014__Employer` <dbl>,
#   `2014__Non-Group` <dbl>, `2014__Medicaid` <dbl>, `2014__Medicare` <dbl>,
#   `2014__Other Public` <chr>, `2014__Uninsured` <dbl>, `2014__Total` <dbl>,
#   `2015__Employer` <dbl>, `2015__Non-Group` <dbl>, `2015__Medicaid` <dbl>,
#   `2015__Medicare` <dbl>, `2015__Other Public` <chr>,
#   `2015__Uninsured` <dbl>, `2015__Total` <dbl>, `2016__Employer` <dbl>,
#   `2016__Non-Group` <dbl>, `2016__Medicaid` <dbl>, `2016__Medicare` <dbl>,
#   `2016__Other Public` <chr>, `2016__Uninsured` <dbl>, `2016__Total` <dbl>

It looks like there is a line with a string Notes in it and everything below that line should not be read in. We can use the n_max argument here.

# A tibble: 6 x 29
  Location `2013__Employer` `2013__Non-Grou… `2013__Medicaid` `2013__Medicare`
  <chr>               <dbl>            <dbl>            <dbl>            <dbl>
1 Vermont            317700            26200           123400            96600
2 Virginia          4661600           364800           773200           968000
3 Washing…          3541600           309000          1026800           879000
4 West Vi…           841300            42600           382500           329400
5 Wiscons…          3154500           225300           907600           812900
6 Wyoming            305900            19500            74200            65400
# … with 24 more variables: `2013__Other Public` <chr>,
#   `2013__Uninsured` <dbl>, `2013__Total` <dbl>, `2014__Employer` <dbl>,
#   `2014__Non-Group` <dbl>, `2014__Medicaid` <dbl>, `2014__Medicare` <dbl>,
#   `2014__Other Public` <chr>, `2014__Uninsured` <dbl>, `2014__Total` <dbl>,
#   `2015__Employer` <dbl>, `2015__Non-Group` <dbl>, `2015__Medicaid` <dbl>,
#   `2015__Medicare` <dbl>, `2015__Other Public` <chr>,
#   `2015__Uninsured` <dbl>, `2015__Total` <dbl>, `2016__Employer` <dbl>,
#   `2016__Non-Group` <dbl>, `2016__Medicaid` <dbl>, `2016__Medicare` <dbl>,
#   `2016__Other Public` <chr>, `2016__Uninsured` <dbl>, `2016__Total` <dbl>

That’s better!

Read in healthcare spending data

Now because we are also going to want to use in healthcare-spending.csv, let’s read it in now.

# A tibble: 6 x 25
  Location `1991__Total He… `1992__Total He… `1993__Total He… `1994__Total He…
  <chr>               <dbl>            <dbl>            <dbl>            <dbl>
1 Vermont              1330             1421             1522             1625
2 Virginia            14829            15599            16634            17637
3 Washing…            12674            13859            14523            15303
4 West Vi…             4672             5159             5550             5891
5 Wiscons…            12694            13669            14636            15532
6 Wyoming              1023             1067             1171             1265
# … with 20 more variables: `1995__Total Health Spending` <dbl>, `1996__Total
#   Health Spending` <dbl>, `1997__Total Health Spending` <dbl>, `1998__Total
#   Health Spending` <dbl>, `1999__Total Health Spending` <dbl>, `2000__Total
#   Health Spending` <dbl>, `2001__Total Health Spending` <dbl>, `2002__Total
#   Health Spending` <dbl>, `2003__Total Health Spending` <dbl>, `2004__Total
#   Health Spending` <dbl>, `2005__Total Health Spending` <dbl>, `2006__Total
#   Health Spending` <dbl>, `2007__Total Health Spending` <dbl>, `2008__Total
#   Health Spending` <dbl>, `2009__Total Health Spending` <dbl>, `2010__Total
#   Health Spending` <dbl>, `2011__Total Health Spending` <dbl>, `2012__Total
#   Health Spending` <dbl>, `2013__Total Health Spending` <dbl>, `2014__Total
#   Health Spending` <dbl>

2. Take a glimpse() at your data

One last thing in this section. One way to look at our data would be to use head() or tail(), as we just saw. Another one you might have heard of is the str() function. One you might not have heard of is the glimpse() function. It’s used for a special type of object in R called a tibble. Let’s read the help file to learn more.

It’s kind of like print() where it shows you columns running down the page. Let’s try it out. If we look at our data, say the coverage data frame, we see that it is not “tidy”:

Rows: 52
Columns: 29
$ Location             <chr> "United States", "Alabama", "Alaska", "Arizona",…
$ `2013__Employer`     <dbl> 155696900, 2126500, 364900, 2883800, 1128800, 17…
$ `2013__Non-Group`    <dbl> 13816000, 174200, 24000, 170800, 155600, 1986400…
$ `2013__Medicaid`     <dbl> 54919100, 869700, 95000, 1346100, 600800, 834480…
$ `2013__Medicare`     <dbl> 40876300, 783000, 55200, 842000, 515200, 3828500…
$ `2013__Other Public` <chr> "6295400", "85600", "60600", "N/A", "67600", "67…
$ `2013__Uninsured`    <dbl> 41795100, 724800, 102200, 1223000, 436800, 55941…
$ `2013__Total`        <dbl> 313401200, 4763900, 702000, 6603100, 2904800, 38…
$ `2014__Employer`     <dbl> 154347500, 2202800, 345300, 2835200, 1176500, 17…
$ `2014__Non-Group`    <dbl> 19313000, 288900, 26800, 333500, 231700, 2778800…
$ `2014__Medicaid`     <dbl> 61650400, 891900, 130100, 1639400, 639200, 96188…
$ `2014__Medicare`     <dbl> 41896500, 718400, 55300, 911100, 479400, 4049000…
$ `2014__Other Public` <chr> "5985000", "143900", "37300", "N/A", "82000", "6…
$ `2014__Uninsured`    <dbl> 32967500, 522200, 100800, 827100, 287200, 391670…
$ `2014__Total`        <dbl> 316159900, 4768000, 695700, 6657200, 2896000, 38…
$ `2015__Employer`     <dbl> 155965800, 2218000, 355700, 2766500, 1293700, 17…
$ `2015__Non-Group`    <dbl> 21816500, 291500, 22300, 278400, 200200, 3444200…
$ `2015__Medicaid`     <dbl> 62384500, 911400, 128100, 1711500, 641400, 10138…
$ `2015__Medicare`     <dbl> 43308400, 719100, 60900, 949000, 484500, 4080100…
$ `2015__Other Public` <chr> "6422300", "174600", "47700", "189300", "63700",…
$ `2015__Uninsured`    <dbl> 28965900, 519400, 90500, 844800, 268400, 2980600…
$ `2015__Total`        <dbl> 318868500, 4833900, 705300, 6739500, 2953000, 39…
$ `2016__Employer`     <dbl> 157381500, 2263800, 324400, 3010700, 1290900, 18…
$ `2016__Non-Group`    <dbl> 21884400, 262400, 20300, 377000, 252900, 3195400…
$ `2016__Medicaid`     <dbl> 62303400, 997000, 145400, 1468400, 618600, 98538…
$ `2016__Medicare`     <dbl> 44550200, 761200, 68200, 1028000, 490000, 443600…
$ `2016__Other Public` <chr> "6192200", "128800", "55600", "172500", "67500",…
$ `2016__Uninsured`    <dbl> 28051900, 420800, 96900, 833700, 225500, 3030800…
$ `2016__Total`        <dbl> 320372000, 4834100, 710800, 6890200, 2945300, 39…

Read the State information using the datasets R package

Since our goal is to get sense of the health expenditure, including healthcare coverage and healthcare spending, across States, it would be nice add some information about each state. Namely, the state abbreviation and state region (i.e. north, south, etc).

For this we use the state dataset in the datasets R package.

Before we begin, let’s look at what states are there:

 [1] "United States"        "Alabama"              "Alaska"              
 [4] "Arizona"              "Arkansas"             "California"          
 [7] "Colorado"             "Connecticut"          "Delaware"            
[10] "District of Columbia" "Florida"              "Georgia"             
[13] "Hawaii"               "Idaho"                "Illinois"            
[16] "Indiana"              "Iowa"                 "Kansas"              
[19] "Kentucky"             "Louisiana"            "Maine"               
[22] "Maryland"             "Massachusetts"        "Michigan"            
[25] "Minnesota"            "Mississippi"          "Missouri"            
[28] "Montana"              "Nebraska"             "Nevada"              
[31] "New Hampshire"        "New Jersey"           "New Mexico"          
[34] "New York"             "North Carolina"       "North Dakota"        
[37] "Ohio"                 "Oklahoma"             "Oregon"              
[40] "Pennsylvania"         "Rhode Island"         "South Carolina"      
[43] "South Dakota"         "Tennessee"            "Texas"               
[46] "Utah"                 "Vermont"              "Virginia"            
[49] "Washington"           "West Virginia"        "Wisconsin"           
[52] "Wyoming"             

We see there are more than 50 states because “United States” and “District of Columbia” are both included.

Let’s look what states are inside the state dataset.

 [1] "Alabama"        "Alaska"         "Arizona"        "Arkansas"      
 [5] "California"     "Colorado"       "Connecticut"    "Delaware"      
 [9] "Florida"        "Georgia"        "Hawaii"         "Idaho"         
[13] "Illinois"       "Indiana"        "Iowa"           "Kansas"        
[17] "Kentucky"       "Louisiana"      "Maine"          "Maryland"      
[21] "Massachusetts"  "Michigan"       "Minnesota"      "Mississippi"   
[25] "Missouri"       "Montana"        "Nebraska"       "Nevada"        
[29] "New Hampshire"  "New Jersey"     "New Mexico"     "New York"      
[33] "North Carolina" "North Dakota"   "Ohio"           "Oklahoma"      
[37] "Oregon"         "Pennsylvania"   "Rhode Island"   "South Carolina"
[41] "South Dakota"   "Tennessee"      "Texas"          "Utah"          
[45] "Vermont"        "Virginia"       "Washington"     "West Virginia" 
[49] "Wisconsin"      "Wyoming"       

Ah, ok. So let’s start by dealing with DC as a special case.

We will deal with the “United States” in the next section.

Data Wrangling

What is “Tidy Data”?

Glance at “Tidy Data”

A subset of the data analysis process can be thought about in the following way:

where each of these steps needs its own tools and software to complete.

After we import the data into R, if we are going to take advantage of the “tidyverse”, this means we need to transform the data into a form that is “tidy”. If you recall, in tidy data:

  • Each variable forms a column.
  • Each observation forms a row.
  • Each type of observational unit forms a table.

For example, consider the following dataset:

Here:

  • each row represents one company (row names are companies)
  • each column represent one time point
  • the stock prices are defined for each row/column pair

Alternatively, a data set can be structured in the following way:

  • each row represents one time point (but no row names)
  • the first column defines the time variable and the last three columns contain the stock prices for three companies

In both cases, the data is the same, but the structure is different. This can be frustrating to deal with as an analyst because the meaning of the values (rows and columns) in the two data sets are different. Providing a standardized way of organizing values within a data set would alleviate a major portion of this frustration.

For motivation, a tidy version of the stock data we looked at above looks like this: (we’ll learn how the functions work in just a moment)

In this “tidy” data set, we have three columns representing three variables (time, company name and stock price). Every row represents contains one stock price from a particular time and for a specific company.

If we consider our coverage dataframe, we see it is also not in a tidy format. Each row contains information about the coverage level by Location across years and types of coverage.

# A tibble: 5 x 5
  Location   `2013__Employer` `2013__Non-Grou… `2013__Medicaid` `2013__Medicare`
  <chr>                 <dbl>            <dbl>            <dbl>            <dbl>
1 United St…        155696900         13816000         54919100         40876300
2 Alabama             2126500           174200           869700           783000
3 Alaska               364900            24000            95000            55200
4 Arizona             2883800           170800          1346100           842000
5 Arkansas            1128800           155600           600800           515200

Now, let’s use the tidyr R package to transform our data into a tidy format.

The tidyr R package

1. What is the tidyr R package ?

tidyr is an R package that transforms data sets to a tidy format.

This package is installed and loaded when you load the tidyverse using library(tidyverse). However, you can also just load the library by itself.

The main functions in tidyr are:

tidyr functions Description
gather() takes multiple columns, and gathers them into key-value pairs, making “wide” data longer
separate() turns a single character column into multiple columns, making “long” data wider
spread() spread rows into multiple columns, transforming “long” data into “wide” format

We’ll explore what it means to go between a “wide” and “long” data format using gather() , separate(), and spread().

A tidyr cheatsheet for the functions in the tidyr package can be found on RStudio’s website:

2. Convert data from wide format to long format using gather()

Let’s start by looking at the gather() help file

This function gathers multiple columns and collapses them into new key-value pairs. This transform data from wide format into a long format.

  • The key is the name of the new column that you are creating which contains the values of the column headings that you are gathering
  • The value is the name of the new column that will contain the values themselves
  • The third argument defines the columns to gather

For example, here we create a column titled year_type and coverage. We also want to keep the Location column as it is because it also contains observational level data.

# A tibble: 1,456 x 3
   Location             year_type      tot_coverage
   <chr>                <chr>          <chr>       
 1 United States        2013__Employer 155696900   
 2 Alabama              2013__Employer 2126500     
 3 Alaska               2013__Employer 364900      
 4 Arizona              2013__Employer 2883800     
 5 Arkansas             2013__Employer 1128800     
 6 California           2013__Employer 17747300    
 7 Colorado             2013__Employer 2852500     
 8 Connecticut          2013__Employer 2030500     
 9 Delaware             2013__Employer 473700      
10 District of Columbia 2013__Employer 324300      
# … with 1,446 more rows

Now we see each row contains one observation. Namely, a Location, a year_type and coverage. It would be nice to separate out the information in the year_type column into two columns. We can implement same techniques to the healthcare spending dataset.

Convert healthcare spending data to a long format (tidy format)

Let’s do the same for the spending data. In this case I will use year and spending for the key and value. We also want to keep Location like before.

# A tibble: 1,248 x 3
   Location             year                        tot_spending
   <chr>                <chr>                              <dbl>
 1 United States        1991__Total Health Spending       675896
 2 Alabama              1991__Total Health Spending        10393
 3 Alaska               1991__Total Health Spending         1458
 4 Arizona              1991__Total Health Spending         9269
 5 Arkansas             1991__Total Health Spending         5632
 6 California           1991__Total Health Spending        81438
 7 Colorado             1991__Total Health Spending         8460
 8 Connecticut          1991__Total Health Spending        10950
 9 Delaware             1991__Total Health Spending         1938
10 District of Columbia 1991__Total Health Spending         2800
# … with 1,238 more rows

We will explore how to do that in the Data Wrangling section below. For now let’s learn more about the tidyr package.

3. Convert data from long format to wide format using spread()

In contrast to gathering multiple columns into key-value pairs, we can spread a key-value pair across multiple columns.

The function spread() does just that. It transforms data from a long format into a wide format.

  • The key is the name of the column in your data set that contains the values of the column headings that you are spreading across multiple columns
  • The value is the name of the column that contains the values for the multiple columns
# A tibble: 52 x 29
   Location `2013__Employer` `2013__Medicaid` `2013__Medicare` `2013__Non-Grou…
   <chr>    <chr>            <chr>            <chr>            <chr>           
 1 Alabama  2126500          869700           783000           174200          
 2 Alaska   364900           95000            55200            24000           
 3 Arizona  2883800          1346100          842000           170800          
 4 Arkansas 1128800          600800           515200           155600          
 5 Califor… 17747300         8344800          3828500          1986400         
 6 Colorado 2852500          697300           549700           426300          
 7 Connect… 2030500          532000           475300           126800          
 8 Delaware 473700           192700           141300           25100           
 9 Distric… 324300           174900           59900            30400           
10 Florida  8023400          3190900          3108800          968200          
# … with 42 more rows, and 24 more variables: `2013__Other Public` <chr>,
#   `2013__Total` <chr>, `2013__Uninsured` <chr>, `2014__Employer` <chr>,
#   `2014__Medicaid` <chr>, `2014__Medicare` <chr>, `2014__Non-Group` <chr>,
#   `2014__Other Public` <chr>, `2014__Total` <chr>, `2014__Uninsured` <chr>,
#   `2015__Employer` <chr>, `2015__Medicaid` <chr>, `2015__Medicare` <chr>,
#   `2015__Non-Group` <chr>, `2015__Other Public` <chr>, `2015__Total` <chr>,
#   `2015__Uninsured` <chr>, `2016__Employer` <chr>, `2016__Medicaid` <chr>,
#   `2016__Medicare` <chr>, `2016__Non-Group` <chr>, `2016__Other
#   Public` <chr>, `2016__Total` <chr>, `2016__Uninsured` <chr>

In the real world, analyzing data rarely involves data that can be easily imported and ready for analysis. According to Wikipedia:

Data munging or data wrangling is loosely the process of manually converting or mapping data from one “raw” form into another format that allows for more convenient consumption of the data with the help of semi-automated tools.

As you may see in class or here from data scientists on Twitter, one of the most time-consuming aspects of the data analysis process is “data wrangling”. This is also is a trendy term for cleaning up a messy data set.

R provides incredibly powerful and flexible language for data wrangling. However, the syntax is somewhat hard to get used to. We will therefore introducing a package that makes the syntax much more like the English language. This package is dplyr.

The dplyr R package

1. What is the dplyr R package ?

dplyr is a powerful R-package to transform and summarize tabular data with rows and columns.

The package contains a set of functions (or “verbs”) to perform common data manipulation operations such as filtering for rows, selecting specific columns, re-ordering rows, adding new columns and summarizing data.

In addition, dplyr contains a useful function to perform another common task which is the is the “split-apply-combine” concept. We will discuss that in a little bit.

2. Compare dplyr R package compare with base functions R

If you are familiar with R, you are probably familiar with base R functions such as split(), subset(), apply(), sapply(), lapply(), tapply() and aggregate(). Compared to base functions in R, the functions in dplyr are easier to work with, are more consistent in the syntax and are targeted for data analysis around data frames instead of just vectors.

The important dplyr verbs to remember are:

dplyr verbs Description
select() select columns
filter() filter rows
arrange() re-order or arrange rows
mutate() create new columns
summarize() summarize values
group_by() allows for group operations in the “split-apply-combine” concept

3. Pipe operator: %>%

Before we go any further, let’s introduce the pipe operator: %>%. In our stocks example, we briefly saw this symbol. It is called the pipe operator. dplyr imports this operator from another package (magrittr) see help file here. This operator allows you to pipe the output from one function to the input of another function. Instead of nesting functions (reading from the inside to the outside), the idea of of piping is to read the functions from left to right.

Now in stocks example, we pipe the stocks data frame to the function that will gather multiple columns into key-value pairs.

dplyr verbs in action: separate(), unite(), …

First, let’s separate the year_type column in the coverage dataset to two columns: year and health coverage type.

To do this, we will use the separate() function in the tidyr package.

Note:

  • separate() = separate one column into multiple columns
  • unite() = unite multiple columns into one

Learn separate() and unite() in the spending dataset

# A tibble: 1,456 x 4
   Location             year  type     tot_coverage
   <chr>                <chr> <chr>    <chr>       
 1 United States        2013  Employer 155696900   
 2 Alabama              2013  Employer 2126500     
 3 Alaska               2013  Employer 364900      
 4 Arizona              2013  Employer 2883800     
 5 Arkansas             2013  Employer 1128800     
 6 California           2013  Employer 17747300    
 7 Colorado             2013  Employer 2852500     
 8 Connecticut          2013  Employer 2030500     
 9 Delaware             2013  Employer 473700      
10 District of Columbia 2013  Employer 324300      
# … with 1,446 more rows

We see that we now have two columns, except the year column was converted to a character. If we look at the help file ?separate, we see we can use the convert=TRUE argument to convert the character to an integer.

# A tibble: 1,456 x 4
   Location              year type     tot_coverage
   <chr>                <int> <chr>    <chr>       
 1 United States         2013 Employer 155696900   
 2 Alabama               2013 Employer 2126500     
 3 Alaska                2013 Employer 364900      
 4 Arizona               2013 Employer 2883800     
 5 Arkansas              2013 Employer 1128800     
 6 California            2013 Employer 17747300    
 7 Colorado              2013 Employer 2852500     
 8 Connecticut           2013 Employer 2030500     
 9 Delaware              2013 Employer 473700      
10 District of Columbia  2013 Employer 324300      
# … with 1,446 more rows

Next, we see that the tot_coverage column is also a character. Gah!

Let’s fix that. We can use the mutate_at() function to do this. We are asking R to take tot_coverage column and convert it to an integer and then replace the old column with the new converted column

# A tibble: 1,456 x 6
   Location              year type     tot_coverage abb   region   
   <chr>                <int> <chr>           <int> <chr> <fct>    
 1 United States         2013 Employer    155696900 <NA>  <NA>     
 2 Alabama               2013 Employer      2126500 AL    South    
 3 Alaska                2013 Employer       364900 AK    West     
 4 Arizona               2013 Employer      2883800 AZ    West     
 5 Arkansas              2013 Employer      1128800 AR    South    
 6 California            2013 Employer     17747300 CA    West     
 7 Colorado              2013 Employer      2852500 CO    West     
 8 Connecticut           2013 Employer      2030500 CT    Northeast
 9 Delaware              2013 Employer       473700 DE    South    
10 District of Columbia  2013 Employer       324300 DC    South    
# … with 1,446 more rows

The coverage data looks good now. We see that there are different years and different types of healthcare coverage.

Also, you may want to link the coverage data with our location information.

# A tibble: 1,456 x 6
   Location              year type     tot_coverage abb   region   
   <chr>                <int> <chr>           <int> <chr> <fct>    
 1 United States         2013 Employer    155696900 <NA>  <NA>     
 2 Alabama               2013 Employer      2126500 AL    South    
 3 Alaska                2013 Employer       364900 AK    West     
 4 Arizona               2013 Employer      2883800 AZ    West     
 5 Arkansas              2013 Employer      1128800 AR    South    
 6 California            2013 Employer     17747300 CA    West     
 7 Colorado              2013 Employer      2852500 CO    West     
 8 Connecticut           2013 Employer      2030500 CT    Northeast
 9 Delaware              2013 Employer       473700 DE    South    
10 District of Columbia  2013 Employer       324300 DC    South    
# … with 1,446 more rows

(*) What is the range of years and types of healthcare in the coverage dataset?

              
               2013 2014 2015 2016
  Employer       52   52   52   52
  Medicaid       52   52   52   52
  Medicare       52   52   52   52
  Non-Group      52   52   52   52
  Other Public   52   52   52   52
  Total          52   52   52   52
  Uninsured      52   52   52   52

Implement separate() and unite() in the spending dataset

Next, we will look at the spending data. We see the year column has information that we do not want. We only care about the year.

# A tibble: 1,248 x 3
   Location             year                        tot_spending
   <chr>                <chr>                              <dbl>
 1 United States        1991__Total Health Spending       675896
 2 Alabama              1991__Total Health Spending        10393
 3 Alaska               1991__Total Health Spending         1458
 4 Arizona              1991__Total Health Spending         9269
 5 Arkansas             1991__Total Health Spending         5632
 6 California           1991__Total Health Spending        81438
 7 Colorado             1991__Total Health Spending         8460
 8 Connecticut          1991__Total Health Spending        10950
 9 Delaware             1991__Total Health Spending         1938
10 District of Columbia 1991__Total Health Spending         2800
# … with 1,238 more rows

Let’s use the separate() function with convert=TRUE to separate the year column into columns. Then, we introduce another dplyr action verb: select().

The two most basic functions are select() and filter() which selects columns and filters rows, respectively.

4. Select columns using select()

In the separate() function, we create two new columns called year and name. Then, we ask to return all the columns, except name. To select all the columns except a specific column, use the “-” (subtraction) operator (also known as negative indexing).

# A tibble: 1,248 x 3
   Location              year tot_spending
   <chr>                <int>        <dbl>
 1 United States         1991       675896
 2 Alabama               1991        10393
 3 Alaska                1991         1458
 4 Arizona               1991         9269
 5 Arkansas              1991         5632
 6 California            1991        81438
 7 Colorado              1991         8460
 8 Connecticut           1991        10950
 9 Delaware              1991         1938
10 District of Columbia  1991         2800
# … with 1,238 more rows

The function select() is much more powerful though. To select a range of columns by name, use the “:” (colon) operator

# A tibble: 1,456 x 2
    year type    
   <int> <chr>   
 1  2013 Employer
 2  2013 Employer
 3  2013 Employer
 4  2013 Employer
 5  2013 Employer
 6  2013 Employer
 7  2013 Employer
 8  2013 Employer
 9  2013 Employer
10  2013 Employer
# … with 1,446 more rows

To select all columns that start with the character string “t”, use the function starts_with()

# A tibble: 1,456 x 2
   type     tot_coverage
   <chr>           <int>
 1 Employer    155696900
 2 Employer      2126500
 3 Employer       364900
 4 Employer      2883800
 5 Employer      1128800
 6 Employer     17747300
 7 Employer      2852500
 8 Employer      2030500
 9 Employer       473700
10 Employer       324300
# … with 1,446 more rows

Some additional options to select columns based on a specific criteria include

  1. ends_with() = Select columns that end with a character string
  2. contains() = Select columns that contain a character string
  3. matches() = Select columns that match a regular expression
  4. one_of() = Select columns names that are from a group of names

5. Select rows using filter()

Let’s say we want to know how many peopled had health insurance coverage in Maryland?

First, we can filter the rows for years in 2007.

# A tibble: 28 x 6
   Location  year type         tot_coverage abb   region
   <chr>    <int> <chr>               <int> <chr> <fct> 
 1 Maryland  2013 Employer          3172400 MD    South 
 2 Maryland  2013 Non-Group          320800 MD    South 
 3 Maryland  2013 Medicaid           889800 MD    South 
 4 Maryland  2013 Medicare           751500 MD    South 
 5 Maryland  2013 Other Public       124400 MD    South 
 6 Maryland  2013 Uninsured          682000 MD    South 
 7 Maryland  2013 Total             5940900 MD    South 
 8 Maryland  2014 Employer          3558800 MD    South 
 9 Maryland  2014 Non-Group          361700 MD    South 
10 Maryland  2014 Medicaid           807900 MD    South 
# … with 18 more rows

Note: you can use the Boolean operators (e.g. >, <, >=, <=, !=, %in%) to create logical tests.

For example, if we wanted only years after 2014, we can add a second criteria within filter():

# A tibble: 14 x 6
   Location  year type         tot_coverage abb   region
   <chr>    <int> <chr>               <int> <chr> <fct> 
 1 Maryland  2015 Employer          3431400 MD    South 
 2 Maryland  2015 Non-Group          371400 MD    South 
 3 Maryland  2015 Medicaid           856800 MD    South 
 4 Maryland  2015 Medicare           705500 MD    South 
 5 Maryland  2015 Other Public       141200 MD    South 
 6 Maryland  2015 Uninsured          394300 MD    South 
 7 Maryland  2015 Total             5900500 MD    South 
 8 Maryland  2016 Employer          3210600 MD    South 
 9 Maryland  2016 Non-Group          443000 MD    South 
10 Maryland  2016 Medicaid           926300 MD    South 
11 Maryland  2016 Medicare           827000 MD    South 
12 Maryland  2016 Other Public       153800 MD    South 
13 Maryland  2016 Uninsured          372100 MD    South 
14 Maryland  2016 Total             5932800 MD    South 

(*) Has the number of uninsured has increased or decreased in Maryland between 2013 and 2016?

# A tibble: 4 x 6
  Location  year type      tot_coverage abb   region
  <chr>    <int> <chr>            <int> <chr> <fct> 
1 Maryland  2013 Uninsured       682000 MD    South 
2 Maryland  2014 Uninsured       343000 MD    South 
3 Maryland  2015 Uninsured       394300 MD    South 
4 Maryland  2016 Uninsured       372100 MD    South 

What happened between 2013 and 2014?

Probably this is due to ACA

6. Arrange or re-order rows using arrange()

Now, let’s say we want to see the states ordered from lowest to highest tot_coverage.

To arrange (or re-order) rows by a particular column you’ll use the arrange() function:

# A tibble: 1,456 x 6
   Location       year type         tot_coverage abb   region       
   <chr>         <int> <chr>               <int> <chr> <fct>        
 1 Vermont        2013 Other Public         9900 VT    Northeast    
 2 Vermont        2014 Other Public         9900 VT    Northeast    
 3 Rhode Island   2013 Other Public        12100 RI    Northeast    
 4 Wyoming        2014 Other Public        13600 WY    West         
 5 Delaware       2013 Other Public        13800 DE    South        
 6 Vermont        2016 Other Public        14600 VT    Northeast    
 7 New Hampshire  2013 Other Public        15100 NH    Northeast    
 8 Wyoming        2016 Other Public        16400 WY    West         
 9 Vermont        2015 Other Public        16500 VT    Northeast    
10 North Dakota   2014 Other Public        17300 ND    North Central
# … with 1,446 more rows

(*) In 2016, what were the top three states with the largest Employer type of healthcare coverage?

Hint: use the desc() function inside of arrange() to order rows in a descending order.

# A tibble: 3 x 6
  Location    year type     tot_coverage abb   region   
  <chr>      <int> <chr>           <int> <chr> <fct>    
1 California  2016 Employer     18116200 CA    West     
2 Texas       2016 Employer     13607200 TX    South    
3 New York    2016 Employer      9767500 NY    Northeast

7. Join two datasets using join()

Here, we’re going to demonstrate how to join two datasets using series of join() function, including left_join(), right_join(), inner_join(), …

Up until now, we have been working with three datasets coverage and spending separately. Next, we will combine these together.

If we want to combine, say, coverage and spending together, we have to decide a few things. Both share a Location column and a year column. However, the range of years is different between datasets.


2013 2014 2015 2016 
 364  364  364  364 

1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 
  52   52   52   52   52   52   52   52   52   52   52   52   52   52   52   52 
2007 2008 2009 2010 2011 2012 2013 2014 
  52   52   52   52   52   52   52   52 

Do we want a dataset with all the years available or only a portion of it? Because there is spending information from 1991-2014, and coverage information from 2013-2016.

dplyr has a list of join functions that are useful to combine datasets. To read more about them, Jenny Bryan has created a nice cheatsheet.

If we look at the help file

We see there are several options for us to pick from. Let’s try one out. We’ll start with left_join() and see what that does.

# A tibble: 6 x 7
  Location       year type     tot_coverage abb   region tot_spending
  <chr>         <int> <chr>           <int> <chr> <fct>         <dbl>
1 United States  2013 Employer    155696900 <NA>  <NA>        2435624
2 Alabama        2013 Employer      2126500 AL    South         33788
3 Alaska         2013 Employer       364900 AK    West           7684
4 Arizona        2013 Employer      2883800 AZ    West          41481
5 Arkansas       2013 Employer      1128800 AR    South         20500
6 California     2013 Employer     17747300 CA    West         278168
# A tibble: 6 x 7
  Location       year type  tot_coverage abb   region        tot_spending
  <chr>         <int> <chr>        <int> <chr> <fct>                <dbl>
1 Vermont        2016 Total       622500 VT    Northeast               NA
2 Virginia       2016 Total      8175000 VA    South                   NA
3 Washington     2016 Total      7297300 WA    West                    NA
4 West Virginia  2016 Total      1814100 WV    South                   NA
5 Wisconsin      2016 Total      5766100 WI    North Central           NA
6 Wyoming        2016 Total       571700 WY    West                    NA

What did it do? We see that the new hc dataset includes all the years from 2013-2016 (as that is the range of years in coverage), but because the spending dataset only goes to 2014, the tot_spending is reported as NA for years 2015 and 2016.

What about a right_join()?

# A tibble: 6 x 7
  Location       year type     tot_coverage abb   region tot_spending
  <chr>         <int> <chr>           <int> <chr> <fct>         <dbl>
1 United States  2013 Employer    155696900 <NA>  <NA>        2435624
2 Alabama        2013 Employer      2126500 AL    South         33788
3 Alaska         2013 Employer       364900 AK    West           7684
4 Arizona        2013 Employer      2883800 AZ    West          41481
5 Arkansas       2013 Employer      1128800 AR    South         20500
6 California     2013 Employer     17747300 CA    West         278168
# A tibble: 6 x 7
  Location       year type  tot_coverage abb   region tot_spending
  <chr>         <int> <chr>        <int> <chr> <fct>         <dbl>
1 Vermont        2012 <NA>            NA <NA>  <NA>           5827
2 Virginia       2012 <NA>            NA <NA>  <NA>          58535
3 Washington     2012 <NA>            NA <NA>  <NA>          51443
4 West Virginia  2012 <NA>            NA <NA>  <NA>          16270
5 Wisconsin      2012 <NA>            NA <NA>  <NA>          46158
6 Wyoming        2012 <NA>            NA <NA>  <NA>           4518

Here, we see every row in the spending dataset is there, but with NAs for the years that there was no coverage data.

There is also a full_join() and inner_join(). If we want the intersection of years from coverage and spending (meaning only 2013 and 2014), we should use inner_join().

# A tibble: 6 x 7
  Location       year type     tot_coverage abb   region tot_spending
  <chr>         <int> <chr>           <int> <chr> <fct>         <dbl>
1 United States  2013 Employer    155696900 <NA>  <NA>        2435624
2 Alabama        2013 Employer      2126500 AL    South         33788
3 Alaska         2013 Employer       364900 AK    West           7684
4 Arizona        2013 Employer      2883800 AZ    West          41481
5 Arkansas       2013 Employer      1128800 AR    South         20500
6 California     2013 Employer     17747300 CA    West         278168
# A tibble: 6 x 7
  Location       year type  tot_coverage abb   region        tot_spending
  <chr>         <int> <chr>        <int> <chr> <fct>                <dbl>
1 Vermont        2014 Total       617000 VT    Northeast             6389
2 Virginia       2014 Total      8258800 VA    South                62847
3 Washington     2014 Total      7085000 WA    West                 55819
4 West Virginia  2014 Total      1825500 WV    South                17491
5 Wisconsin      2014 Total      5747200 WI    North Central        50109
6 Wyoming        2014 Total       572000 WY    West                  4856

Yes, that’s what we want!

Next, if we are only interested in looking at US states, we can remove the rows corresponding to the Location == "United States"

Another problem is that inside our hc dataset, we have seen there are multiple types of healthcare coverage.


    Employer     Medicaid     Medicare    Non-Group Other Public        Total 
         102          102          102          102          102          102 
   Uninsured 
         102 

The total type is not really a formal type of healthcare coverage. It really represents just the total number of people in the state. This is useful information and we can include it as a column called tot_pop. How can we do this?

Well, one way would be to use the join functions again in dplyr.

# A tibble: 102 x 3
   Location              year tot_coverage
   <chr>                <int>        <int>
 1 Alabama               2013      4763900
 2 Alaska                2013       702000
 3 Arizona               2013      6603100
 4 Arkansas              2013      2904800
 5 California            2013     38176400
 6 Colorado              2013      5297800
 7 Connecticut           2013      3578900
 8 Delaware              2013       909300
 9 District of Columbia  2013       652100
10 Florida               2013     19429000
# … with 92 more rows
# A tibble: 612 x 8
   Location         year type    tot_coverage abb   region  tot_spending tot_pop
   <chr>           <int> <chr>          <int> <chr> <fct>          <dbl>   <int>
 1 Alabama          2013 Employ…      2126500 AL    South          33788  4.76e6
 2 Alaska           2013 Employ…       364900 AK    West            7684  7.02e5
 3 Arizona          2013 Employ…      2883800 AZ    West           41481  6.60e6
 4 Arkansas         2013 Employ…      1128800 AR    South          20500  2.90e6
 5 California       2013 Employ…     17747300 CA    West          278168  3.82e7
 6 Colorado         2013 Employ…      2852500 CO    West           34090  5.30e6
 7 Connecticut      2013 Employ…      2030500 CT    Northe…        34223  3.58e6
 8 Delaware         2013 Employ…       473700 DE    South           9038  9.09e5
 9 District of Co…  2013 Employ…       324300 DC    South           7443  6.52e5
10 Florida          2013 Employ…      8023400 FL    South         150547  1.94e7
# … with 602 more rows

We can check to make sure that the total is no longer listed as a type of healthcare coverage.


    Employer     Medicaid     Medicare    Non-Group Other Public    Uninsured 
         102          102          102          102          102          102 

We are now ready to try answering our first question that we asked:

  1. Is there a relationship between healthcare coverage and healthcare spending in the United States?

Let’s pick out the type==Employer and year==2013.

We see there is a strong relationship. However, we also see that healthcare coverage and spending is also strongly related to population size

This means we need to take into account the population size of each state when we are comparing the healthcare coverage and spending.

8. Add columns using mutate()

Instead of the absolute number of people who are covered (tot_coverage), we will calculate the proportion of people who are coverage in each state, year and type.

For this, we will use the mutate() function in dplyr.

# A tibble: 612 x 9
   Location  year type  tot_coverage abb   region tot_spending tot_pop
   <chr>    <int> <chr>        <int> <chr> <fct>         <dbl>   <int>
 1 Alabama   2013 Empl…      2126500 AL    South         33788  4.76e6
 2 Alaska    2013 Empl…       364900 AK    West           7684  7.02e5
 3 Arizona   2013 Empl…      2883800 AZ    West          41481  6.60e6
 4 Arkansas  2013 Empl…      1128800 AR    South         20500  2.90e6
 5 Califor…  2013 Empl…     17747300 CA    West         278168  3.82e7
 6 Colorado  2013 Empl…      2852500 CO    West          34090  5.30e6
 7 Connect…  2013 Empl…      2030500 CT    North…        34223  3.58e6
 8 Delaware  2013 Empl…       473700 DE    South          9038  9.09e5
 9 Distric…  2013 Empl…       324300 DC    South          7443  6.52e5
10 Florida   2013 Empl…      8023400 FL    South        150547  1.94e7
# … with 602 more rows, and 1 more variable: prop_coverage <dbl>

We need to add another column to our dataset. We will add the spending per capita (or spending per person) in dollars and name this column spending_capita.

How we will do this?

The tot_spending column is reported in millions (1e6). Therefore, to calculate spending_capita we will need to adjust for this scaling factor to report it on the original scale (just dollars) and then divide by tot_pop.

Now we are ready to go back to our first question.

  1. Is there a relationship between healthcare coverage and healthcare spending in the United States?

Yes, it looks like there is a relationship for Employer healthcare coverage in 2013.

We will continue to explore the other types of coverages later on. For now, we get back to to learning more action verbs in dplyr.

Our second question that we were interested in was:

  1. Which US states spend the most and which spend the least on healthcare? How does the spending distribution change across geographic regions in the United States?

To answer these questions, we need to learn how to calculate summary statistics in our data.

9. Create summaries of columns using summarize()

The summarize() function in dplyr will create summary statistics for a given column in the data frame such as finding the max, min, average. For example, to compute the average spending per capita, we can apply the mean() function to the column spending_captia and call the summary value avg_spending_capita.

# A tibble: 1 x 1
  avg_spending_capita
                <dbl>
1               8246.

There are many other summary statistics you could consider such sd(), min(), median(), mean(), sum(), n() (returns the length of vector), first() (returns first value in vector), last() (returns last value in vector) and n_distinct() (number of distinct values in vector).

Also note, this is the average across all states, and all years. This is not very informative.

If you recall, our question asked about which states spent the most, so we want an average spending per capita for each state.

For this, we need to introduce another function in dplyr called group_by().

10. Group operations using group_by()

The group_by() verb is and incredibly powerful function in dplyr. As we mentioned before it’s related to concept of “split-apply-combine”.

In our example above, we want to split the data frame by some variable (e.g. Location), apply a function to the individual data frames (mean) and then combine the output back into a summary data frame.

Let’s see how that would look

# A tibble: 51 x 2
   Location             avg_spending_capita
   <chr>                              <dbl>
 1 Alabama                            7244.
 2 Alaska                            11331.
 3 Arizona                            6397.
 4 Arkansas                           7324.
 5 California                         7416.
 6 Colorado                           6602.
 7 Connecticut                        9730.
 8 Delaware                          10127.
 9 District of Columbia              11698.
10 Florida                            7945.
# … with 41 more rows

That’s better. Here we are averaging across the years 2013 and 2014.

(*) What are the top 3 states that have the largest average spending per capita? What about the top 3 states with the smallest average spending per capita?

# A tibble: 3 x 2
  Location avg_spending_capita
  <chr>                  <dbl>
1 Utah                   5842.
2 Arizona                6397.
3 Georgia                6513.
# A tibble: 3 x 2
  Location             avg_spending_capita
  <chr>                              <dbl>
1 District of Columbia              11698.
2 Alaska                            11331.
3 Massachusetts                     10535.

(*) How does the spending distribution change across geographic regions in the United States?

Hint: Calculate the mean and standard deviation of spending per capita for each geographic region in the US.

# A tibble: 4 x 3
  region        avg_spending_capita sd_spending_capita
  <fct>                       <dbl>              <dbl>
1 North Central               8404.               541.
2 Northeast                   9592.               546.
3 South                       7994.              1273.
4 West                        7498.              1329.

Another way to visualize distributions is to use boxplots.

Create four boxplots representing the spending per capita distribution for each of the four regions using the boxplot() function in R.

Now that we have our data in a tidy format, next, we will learn about how to do this using the ggplot2 R package in the tidyverse.

Data Visualization

As you have already seen, there are many functions available in base R that can create plots (e.g. plot(), boxplot()). Others include: hist(), qqplot(), etc. These functions are great because they come with a basic installation of R and can be quite powerful when you need a quick visualization of something when you are exploring data.

We are choosing to introduce ggplot2 because, in our opinion, it’s one of the simplest ways for beginners to create relatively complicated plots that are intuitive and aesthetically pleasing.

The ggplot2 R package

The reasons ggplot2 is generally intuitive for beginners is the use of grammar of graphics or the gg in ggplot2. The idea is that you can construct many sentences by learning just a few nouns, adjectives, and verbs. There are specific “words” that we will need to learn and once we do, you will be able to create (or “write”) hundreds of different plots.

The critical part to making graphics using ggplot2 is the data needs to be in a tidy format. Given that we have just spend the last two lectures learning about how to work with tidy data, we are primed to take advantage of all that ggplot2 has to offer!

We will show how it’s easy to pipe tidy data (output) as input to other functions that creates plots. This all works because we are working within the tidyverse.

ggplot2 cheatsheet

The cheatsheet looks like the following:

1. What is the ggplot() function?

As explained by Hadley Wickham:

the grammar tells us that a statistical graphic is a mapping from data to aesthetic attributes (colour, shape, size) of geometric objects (points, lines, bars). The plot may also contain statistical transformations of the data and is drawn on a specific coordinates system.

ggplot2 Terminology

  • ggplot - the main function where you specify the data set and variables to plot (this is where we define the x and y variable names)
  • geoms - geometric objects
    • e.g. geom_point(), geom_bar(), geom_line(), geom_histogram()
  • aes - aesthetics
    • shape, transparency, color, fill, linetype
  • scales - define how your data will be plotted
    • continuous, discrete, log, etc

There are three ways to initialize a ggplot() object.

An empty ggplot object

A ggplot object associated with a dataset

or a ggplot object with a dataset and x and y defined

2. Create scatter plots using geom_point()

The function aes() is an aesthetic mapping function inside the ggplot() object. We use this function to specify plot attributes (e.g. x and y variable names) that will not change as we add more layers.

Anything that goes in the ggplot() object becomes a global setting. From there, we use the geom objects to add more layers to the base ggplot() object. These will define what we are interested in illustrating using the data.

If you recall, our first question that we were interested in was

  1. Is there a relationship between healthcare coverage and healthcare spending in the United States?

Before, we were using base R to create something like this:

Let’s re-create this plot with ggplot2 using the geom_point() geometry.

We used the xlab() and ylab() functions in ggplot2 to specify the x-axis and y-axis labels.

Note, we do not have to assign (<-) the plot to anything:

It’s also simple to fit a linear regression model and plot it on top of scatter plot using the geom_smooth() (or stat_smooth()) functions.

The standard error bounds are computed and included in the plot.

It would be nice to know which state is represented by which state. For this, we will introduce another geom called geom_text().

3. Add layers of text using geom_text()

In our dataset, we have information about the abbreviation for each state. We could add the abbreviations for each state next to the point on the plot to assess which states have a higher or lower coverage for a given amount of money they spend per capita.

That is cool, but it would be even better if we could nudge the text over a bit. Let’s look at the help file for geom_text():

We see there is an argument called nudge_x and nudge_y. We can use these to nudge the text over a bit so the text is not directly on top of the points.

4. Facet across a variable using facet_wrap

Ok, getting back to our original question:

  1. Is there a relationship between healthcare coverage and healthcare spending in the United States?

We saw there was a positive relationship, but this was only for one type of healthcare coverage (Employer) and one year. What about the other types?

For this, we will introduce facets. The idea of faceting is to stratify the data by some variable and make the same plot for each strata.

For example, if we wanted to facet by the type variable, we will add a layer to our ggplot() object using the facet_grid() or facet_wrap() functions. The function expects the row and column variables to be separated by a ~.

We see that the proportion of people covered have different scales in the y-axis. Let’s read the help file to see if there is some way to not restrict the y-axis to be the same.

Yes, we see there is an argument called scales that can be free_y, (free columns), free_x (free rows), and free (both). Let’s try free_y and look at a different year (year=="2014"):

Given we know Other Public refers to the military or Veterans Administration, we can see states like HI, VA, NV have a larger proportion of military or VA Other Public type coverage. While a state like AK has a similar proportion of Other Public coverage, it has a much larger spending per capita.

We also see a negative relationship with the Uninsured type. The more states spend, the less uninsured people in the state.

5. Create boxplots using geom_boxplot()

Next, let’s revisit the second question.

  1. Which US states spend the most and which spend the least on healthcare? How does the spending distribution change across geographic regions in the United States?

Let’s try making a boxplot with ggplot2. If you recall, the way to do this in base R was:

Now, we introduce the geom_boxplot() function. Note, we needed to tell ggplot2 what needs to be along the x and y axis in aes().

6. Facet by two variables using facet_grid

  1. Does the relationship between healthcare coverage and healthcare spending in the United States change from 2013 to 2014?

Let’s try faceting by both year and type. Note that we can facet by rows putting a column name before the ~ and facet by columns putting a column name after the ~. We are also using facet_grid() instead of facet_wrap().

Summary

The total healthcare expenditure is associated with the population. To make a fair comparison, we create “healthcare expenditure per capita.” Further, the exploratory analysis via data visualization showed higher spending in healthcare per capita is positively associated with higher employer coverage proportion and is negatively associated with the proportion of uninsured population across the States.

LS0tCnRpdGxlOiAiT3BlbiBDYXNlIFN0dWRpZXM6IEV4cGxvcmluZyBoZWFsdGggZXhwZW5kaXR1cmUgdXNpbmcgc3RhdGUtbGV2ZWwgZGF0YSBpbiB0aGUgVW5pdGVkIFN0YXRlcyIKb3V0cHV0OgogIGh0bWxfZG9jdW1lbnQ6CiAgICBjb2RlX2Rvd25sb2FkOiB5ZXMKICAgIGhpZ2hsaWdodDogdGFuZ28KICAgIG51bWJlcl9zZWN0aW9uczogbm8KICAgIHRoZW1lOiBjb3NtbwogICAgdG9jOiB5ZXMKICAgIHRvY19mbG9hdDogeWVzCiAgcGRmX2RvY3VtZW50OgogICAgdG9jOiB5ZXMKICB3b3JkX2RvY3VtZW50OgogICAgdG9jOiB5ZXMKLS0tCgpgYGB7ciBzZXR1cCwgaW5jbHVkZT1GQUxTRX0Ka25pdHI6Om9wdHNfY2h1bmskc2V0KGluY2x1ZGUgPSBUUlVFLCBjb21tZW50ID0gTkEsIGVjaG8gPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgbWVzc2FnZSA9IEZBTFNFLCB3YXJuaW5nID0gRkFMU0UpCmBgYAoKYGBge3IgZWNobz1GQUxTRSwgb3V0LndpZHRoPScxMDAlJ30Ka25pdHI6OmluY2x1ZGVfZ3JhcGhpY3MoJy4vaW1nL1N1bW1hcnlQbG90LnBuZycpCgpgYGAKCiMgTW90aXZhdGlvbiAgCgpIZWFsdGggcG9saWN5IGluIHRoZSBVbml0ZWQgU3RhdGVzIGlzIGNvbXBsaWNhdGVkLCBhbmQgc2V2ZXJhbCAKZm9ybXMgb2YgaGVhbHRoY2FyZSBjb3ZlcmFnZSBleGlzdCwgaW5jbHVkaW5nIGJvdGggY292ZXJhZ2UgYnkgZmVkZXJhbCAKZ292ZXJtZW50LWxlZCBoZWFsdGhjYXJlIHBvbGljeSwgYW5kIGJ5IHByaXZhdGUgaW5zdXJhbmNlIGNvbXBhbmllcy4gQmVmb3JlIG1ha2luZyBhbnkgaW5mZXJlbmNlIGFib3V0IAp0aGUgcmVsYXRpb25zaGlwIGJldHdlZW4gaGVhbHRoIGNvbmRpdGlvbiBhbmQgaGVhbHRoIHBvbGljeSwgaXQgaXMgaW1wb3J0YW50IGZvciB1cyB0byAKaGF2ZSBhIGdlbmVyYWwgaWRlYSBhYm91dCBoZWFsdGhjYXJlIGVjb25vbWljcyBpbiB0aGUgVW5pdGVkIFN0YXRlcy4gVGh1cywgd2UgYXJlIGludGVyZXN0ZWQgaW4gCmdldHRpbmcgc2Vuc2Ugb2YgaGVhbHRoY2FyZSBjb3ZlcmFnZSBhbmQgaGVhbHRoY2FyZSBzcGVuZGluZyBhY3Jvc3MgU3RhdGVzLiBNb3JlIHNwZWNpZmljYWxseSwgdGhlIHF1ZXN0aW9ucyBhcmU6ICAKCjEuIElzIHRoZXJlIGEgcmVsYXRpb25zaGlwIGJldHdlZW4gaGVhbHRoY2FyZSBjb3ZlcmFnZSBhbmQgaGVhbHRoY2FyZSBzcGVuZGluZyBpbiB0aGUgVW5pdGVkIFN0YXRlcz8gICAKMi4gSG93IGRvZXMgdGhlIHNwZW5kaW5nIGRpc3RyaWJ1dGlvbiBjaGFuZ2UgYWNyb3NzIGdlb2dyYXBoaWMgcmVnaW9ucyBpbiB0aGUgVW5pdGVkIFN0YXRlcz8gIAozLiBEb2VzIHRoZSByZWxhdGlvbnNoaXAgYmV0d2VlbiBoZWFsdGhjYXJlIGNvdmVyYWdlIGFuZCBoZWFsdGhjYXJlIHNwZW5kaW5nIGluIHRoZSBVbml0ZWQgU3RhdGVzIGNoYW5nZSBmcm9tIDIwMTMgdG8gMjAxND8gIAoKSW4gdGhpcyBjYXNlIHN0dWR5LCB3ZSdsbCB3YWxrIHlvdSB0aHJvdWdoIGNvbGxlY3RpbmcgZGF0YSwgCmltcG9ydGluZyBkYXRhLCBjbGVhbmluZyBkYXRhLCB3cmFuZ2xpbmcgZGF0YSwgYW5kIHZpc3VhbGl6aW5nIHRoZSBkYXRhLCB1c2luZyAKd2VsbC1lc3RhYmxpc2hlZCBhbmQgY29tbW9ubHkgdXNlZCBwYWNrYWdlcywgaW5jbHVkaW5nIGBkYXRhc2V0c2AsIGB0aWR5cmAsIGBkcGx5cmAsIGBnZ3Bsb3QyYCwgYW5kIGBnZ3JlcGVsYC4gICAgCiAKIyBXaGF0IGlzIHRoZSBkYXRhPyAgICAKCmBgYHtyIG91dC53aWR0aCA9ICI5NSUiLCBlY2hvID0gRkFMU0UsIG91dC53aWR0aD0nOTAlJ30Ka25pdHI6OmluY2x1ZGVfZ3JhcGhpY3MoImh0dHBzOi8vYXNwZS5oaHMuZ292L3N5c3RlbS9maWxlcy9pbWFnZXMtcmVwb3J0cy1iYXNpYy83MDQ0MS9maWcxLmpwZyIpCmBgYApbSW1hZ2Ugc291cmNlIGZyb20gVVMgRGVwYXJ0bWVudCBvZiBIZWFsdGggYW5kIEh1bWFuIFNlcnZpY2VzXShodHRwczovL2FzcGUuaGhzLmdvdi9iYXNpYy1yZXBvcnQvb3ZlcnZpZXctdW5pbnN1cmVkLXVuaXRlZC1zdGF0ZXMtc3VtbWFyeS0yMDExLWN1cnJlbnQtcG9wdWxhdGlvbi1zdXJ2ZXkpCgojIyBIZWFsdGhjYXJlIGRhdGEKCldlIHdpbGwgYmUgdXNpbmcgdGhlIGRhdGEgZnJvbSB0aGUgW0hlbnJ5IEogS2Fpc2VyIEZhbWlseSBGb3VuZGF0aW9uIChLRkYpXShodHRwczovL3d3dy5rZmYub3JnKS4gCgoqIFtIZWFsdGggSW5zdXJhbmNlIENvdmVyYWdlIG9mIHRoZSBUb3RhbCBQb3B1bGF0aW9uXShodHRwczovL3d3dy5rZmYub3JnL290aGVyL3N0YXRlLWluZGljYXRvci90b3RhbC1wb3B1bGF0aW9uLykgLSBJbmNsdWRlcyB5ZWFycyAyMDEzLTIwMTYKKiBbSGVhbHRoIENhcmUgRXhwZW5kaXR1cmVzIGJ5IFN0YXRlIG9mIFJlc2lkZW5jZSAoaW4gbWlsbGlvbnMpXShodHRwczovL3d3dy5rZmYub3JnL290aGVyL3N0YXRlLWluZGljYXRvci9oZWFsdGgtY2FyZS1leHBlbmRpdHVyZXMtYnktc3RhdGUtb2YtcmVzaWRlbmNlLWluLW1pbGxpb25zLykgLSBJbmNsdWRlcyB5ZWFycyAxOTkxLTIwMTQKIApXZSBoYXZlIGRvd25sb2FkZWQsIHJlLW5hbWVkIGFuZCBzYXZlZCB0aGVzZSBmaWxlcyBpbiB0aGUgCltHaXRIdWIgcmVwb3NpdG9yeV0oaHR0cHM6Ly9naXRodWIuY29tL29wZW5jYXNlc3R1ZGllcy9vY3MtaGVhbHRoZXhwZW5kaXR1cmUpIHVuZGVyIHRoZSBgZGF0YS9LRkYvYCBkaXJlY3RvcnkuIAoKTm93LCBiZWZvcmUgd2UgZGlnIGludG8gdGhlIGRhdGEgYW5hbHlzaXMsIHdlIG5lZWQgdG8gaW50cm9kdWNlIGEgc2V0IG9mIFIgcGFja2FnZXMgdGhhdCB3ZSB3aWxsIHVzZSB0byBhbmFseXplIHRoZSBkYXRhLiAKCgojIERhdGEgSW1wb3J0IAogCiMjIEludHJvZHVjdGlvbiB0byAiVGlkeSBkYXRhIgoKVGhlIFt0aWR5dmVyc2VdKGh0dHBzOi8vd3d3LnRpZHl2ZXJzZS5vcmcpIGlzIF8iYW4gb3BpbmlvbmF0ZWQgCmNvbGxlY3Rpb24gb2YgUiBwYWNrYWdlcyBkZXNpZ25lZCBmb3IgZGF0YSBzY2llbmNlLiBBbGwgcGFja2FnZXMgCnNoYXJlIGFuIHVuZGVybHlpbmcgcGhpbG9zb3BoeSBhbmQgY29tbW9uIEFQSXMuIl8gCgpBbm90aGVyIHdheSBvZiBwdXR0aW5nIGl0IGlzIHRoYXQgaXQncyBhIHNldCBvZiBwYWNrYWdlcyAKdGhhdCBhcmUgdXNlZnVsIHNwZWNpZmljYWxseSBmb3IgZGF0YSBtYW5pcHVsYXRpb24sIApleHBsb3JhdGlvbiBhbmQgdmlzdWFsaXphdGlvbiB3aXRoIGEgY29tbW9uIHBoaWxvc29waHkuIAoKIyMjIyBXaGF0IGlzIHRoaXMgY29tbW9uIHBoaWxvc29waHk/IAoKVGhlIGNvbW1vbiBwaGlsb3NvcGh5IGlzIGNhbGxlZCBfInRpZHkiXyBkYXRhLiBJdCBpcyAKYSBzdGFuZGFyZCB3YXkgb2YgbWFwcGluZyB0aGUgbWVhbmluZyBvZiBhIGRhdGFzZXQKdG8gaXRzIHN0cnVjdHVyZS4KCkluIF90aWR5XyBkYXRhOgoKKiBFYWNoIHZhcmlhYmxlIGZvcm1zIGEgY29sdW1uLgoqIEVhY2ggb2JzZXJ2YXRpb24gZm9ybXMgYSByb3cuCiogRWFjaCB0eXBlIG9mIG9ic2VydmF0aW9uYWwgdW5pdCBmb3JtcyBhIHRhYmxlLgoKYGBge3Igb3V0LndpZHRoID0gIjk1JSIsIGVjaG8gPSBGQUxTRX0Ka25pdHI6OmluY2x1ZGVfZ3JhcGhpY3MoImh0dHA6Ly9yNGRzLmhhZC5jby5uei9pbWFnZXMvdGlkeS0xLnBuZyIpCmBgYAoKQmVsb3csIHdlIGFyZSBpbnRlcmVzdGVkIGluIHRyYW5zZm9ybWluZyB0aGUgdGFibGUgb24gCnRoZSByaWdodCB0byB0aGUgdGhlIHRhYmxlIG9uIHRoZSBsZWZ0LCB3aGljaCBpcyAKY29uc2lkZXJlZCAidGlkeSIuIAoKYGBge3Igb3V0LndpZHRoID0gIjk1JSIsIGVjaG8gPSBGQUxTRX0Ka25pdHI6OmluY2x1ZGVfZ3JhcGhpY3MoImh0dHA6Ly9yNGRzLmhhZC5jby5uei9pbWFnZXMvdGlkeS05LnBuZyIpCmBgYAoKV29ya2luZyB3aXRoIHRpZHkgZGF0YSBpcyB1c2VmdWwgYmVjYXVzZSBpdCBjcmVhdGVzIGEgc3RydWN0dXJlZCB3YXkgb2YKb3JnYW5pemluZyBkYXRhIHZhbHVlcyB3aXRoaW4gYSBkYXRhIHNldC4gVGhpcyBtYWtlcyB0aGUgZGF0YSBhbmFseXNpcyAKcHJvY2VzcyBtb3JlIGVmZmljaWVudCBhbmQgc2ltcGxpZmllcyB0aGUgZGV2ZWxvcG1lbnQgb2YgZGF0YSBhbmFseXNpcyB0b29scwp0aGF0IHdvcmsgdG9nZXRoZXIuIEluIHRoaXMgd2F5LCB5b3UgY2FuIGZvY3VzIG9uIHRoZSBwcm9ibGVtIHlvdSBhcmUKaW52ZXN0aWdhdGluZywgcmF0aGVyIHRoYW4gdGhlIHVuaW50ZXJlc3RpbmcgbG9naXN0aWNzIG9mIGRhdGEuICAKCiMjIyAxLiBXaGF0IGlzIGluIHRoZSBgdGlkeXZlcnNlYD8gCgpXZSBjYW4gaW5zdGFsbCBhbmQgbG9hZCB0aGUgc2V0IG9mIFIgcGFja2FnZXMgdXNpbmcgCmBpbnN0YWxsLnBhY2thZ2VzKCJ0aWR5dmVyc2UiKWAgZnVuY3Rpb24uIAoKV2hlbiB3ZSBsb2FkIHRoZSB0aWR5dmVyc2UgcGFja2FnZSB1c2luZyBgbGlicmFyeSh0aWR5dmVyc2UpYCwgCnRoZXJlIGFyZSBzaXggY29yZSBSIHBhY2thZ2VzIHRoYXQgbG9hZDoKCiogW3JlYWRyXShodHRwOi8vcmVhZHIudGlkeXZlcnNlLm9yZyksIGZvciBkYXRhIGltcG9ydC4KKiBbdGlkeXJdKGh0dHA6Ly90aWR5ci50aWR5dmVyc2Uub3JnKSwgZm9yIGRhdGEgdGlkeWluZy4KKiBbZHBseXJdKGh0dHA6Ly9kcGx5ci50aWR5dmVyc2Uub3JnKSwgZm9yIGRhdGEgd3JhbmdsaW5nLgoqIFtnZ3Bsb3QyXShodHRwOi8vZ2dwbG90Mi50aWR5dmVyc2Uub3JnKSwgZm9yIGRhdGEgdmlzdWFsaXNhdGlvbi4KKiBbcHVycnJdKGh0dHA6Ly9wdXJyci50aWR5dmVyc2Uub3JnKSwgZm9yIGZ1bmN0aW9uYWwgcHJvZ3JhbW1pbmcuCiogW3RpYmJsZV0oaHR0cDovL3RpYmJsZS50aWR5dmVyc2Uub3JnKSwgZm9yIHRpYmJsZXMsIGEgbW9kZXJuIHJlLWltYWdpbmluZyBvZiBkYXRhIGZyYW1lcy4KCkhlcmUsIHdlIGxvYWQgaW4gdGhlIHRpZHl2ZXJzZS4gCmBgYHtyLCBtZXNzYWdlPUZBTFNFfQpsaWJyYXJ5KHRpZHl2ZXJzZSkKYGBgCgpUaGVzZSBwYWNrYWdlcyBhcmUgaGlnaGxpZ2h0ZWQgaW4gYm9sZCBoZXJlOiAKCmBgYHtyIG91dC53aWR0aCA9ICI5NSUiLCBlY2hvID0gRkFMU0V9CmtuaXRyOjppbmNsdWRlX2dyYXBoaWNzKCJodHRwczovL3J2aWV3cy5yc3R1ZGlvLmNvbS9wb3N0LzIwMTctMDYtMDktV2hhdC1pcy10aGUtdGlkeXZlcnNlX2ZpbGVzL3RpZHl2ZXJzZTEucG5nIikKYGBgCgpCZWNhdXNlIHRoZXNlIHBhY2thZ2VzIGFsbCBzaGFyZSB0aGUgInRpZHkiIHBoaWxvc29waHksIAp0aGUgZGF0YSBhbmFseXNpcyB3b3JrZmxvdyBpcyBlYXNpZXIgYXMgeW91IG1vdmUgZnJvbSAKcGFja2FnZSB0byBwYWNrYWdlLiAKCkhlcmUsIHdlIHdpbGwgZm9jdXMgb24gdGhlIGByZWFkcmAsCmB0aWR5cmAgYW5kIGBkcGx5cmAgUiBwYWNrYWdlcyB0byBpbXBvcnQgZGF0YSwgCnRvIHRyYW5zZm9ybSBkYXRhIHRvIHRoZSAidGlkeSIgZm9ybWF0LCAKYW5kIHRvIHdyYW5nbGUgZGF0YS4gCgpOZXh0LCB3ZSB3aWxsIGdpdmUgYSBicmllZiBkZXNjcmlwdGlvbiBvZiB0aGUgCmZlYXR1cmVzIGluIGVhY2ggb2YgdGhlc2UgcGFja2FnZXMuIAoKVGhlcmUgYXJlIHNldmVyYWwgYmFzZSBSIGZ1bmN0aW9ucyB0aGF0IGFsbG93IHlvdSAKcmVhZCBpbiBkYXRhIGludG8gUiwgd2hpY2ggeW91IG1heSBiZSBmYW1pbGlhciAKd2l0aCBzdWNoIGFzIGByZWFkLnRhYmxlKClgLCBgcmVhZC5jc3YoKWAsIAphbmQgYHJlYWQuZGVsaW0oKWAuIEluc3RlYWQgb2YgdXNpbmcgdGhlc2UsIAp3ZSB3aWxsIHVzZSB0aGUgZnVuY3Rpb25zIGluIHRoZSAKW3JlYWRyXShodHRwczovL3JlYWRyLnRpZHl2ZXJzZS5vcmcvYXJ0aWNsZXMvcmVhZHIuaHRtbCkKUiBwYWNrYWdlLiBUaGUgbWFpbiByZWFzb25zIGZvciB0aGlzIGFyZSAKCjEuIENvbXBhcmVkIHRvIGVxdWl2YWxlbnQgYmFzZSBSIGZ1bmN0aW9ucywgdGhlIApmdW5jdGlvbnMgaW4gYHJlYWRyYCBhcmUgYXJvdW5kIDEweCBmYXN0ZXIuIAoyLiBZb3UgY2FuIHNwZWNpZnkgdGhlIGNvbHVtbiB0eXBlcyAoZS5nIApjaGFyYWN0ZXIsIGludGVnZXIsIGRvdWJsZSwgbG9naWNhbCwgZGF0ZSwgCnRpbWUsIGV0YykKMy4gQWxsIHBhcnNpbmcgcHJvYmxlbXMgYXJlIHJlY29yZGVkIGluIAphIGRhdGEgZnJhbWUuIAoKIyMgUmVhZCBkYXRhIHVzaW5nIHRoZSBgcmVhZHJgIFIgcGFja2FnZSAgCgpgYGB7ciwgbWVzc2FnZT1GQUxTRX0KbGlicmFyeShyZWFkcikKYGBgCgpUaGUgbWFpbiBmdW5jdGlvbnMgaW4gYHJlYWRyYCBhcmU6IAoKYHJlYWRyYCBmdW5jdGlvbnMgfCBEZXNjcmlwdGlvbiB8Ci0tLSB8IC0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0gfApgcmVhZF9kZWxpbSgpYCB8IHJlYWRzIGluIGEgZmxhdCBmaWxlIGRhdGEgd2l0aCBhIGdpdmVuIGNoYXJhY3RlciB0byBzZXBhcmF0ZSBmaWVsZHMgfApgcmVhZF9jc3YoKWAgfCByZWFkcyBpbiBhIENTViBmaWxlIHwKYHJlYWRfdHN2KClgIHwgcmVhZHMgaW4gYSBmaWxlIHdpdGggdmFsdWVzIHNlcGFyYXRlZCBieSB0YWJzIHwKYHJlYWRfbGluZXMoKWAgfCByZWFkcyBvbmx5IGEgY2VydGFpbiBudW1iZXIgb2YgbGluZXMgZnJvbSB0aGUgZmlsZSB8CmByZWFkX2ZpbGUoKWAgfCByZWFkcyBhIGNvbXBsZXRlIGZpbGUgaW50byBhIHN0cmluZyB8CmB3cml0ZV9jc3YoKWAgfCB3cml0ZXMgZGF0YSBmcmFtZSB0byBDU1YgfCAKCkEgdXNlZnVsIGNoZWF0c2hlZXQgZm9yIHRoZSBmdW5jdGlvbnMgaW4gdGhlCmByZWFkcmAgcGFja2FnZSBjYW4gYmUgZm91bmQgb24gUlN0dWRpbydzIHdlYnNpdGU6IAoKIVtdKGh0dHBzOi8vd3d3LnJzdHVkaW8uY29tL3dwLWNvbnRlbnQvdXBsb2Fkcy8yMDE4LzA4L2RhdGEtaW1wb3J0LnBuZykKCgoKIyMjIDEuIFJlYWQgaW4gZGF0YSAKCiMjIyMgUmVhZCBpbiBoZWFsdGggIGhlYWx0aGNhcmUgY292ZXJhZ2UgZGF0YQpMZXQncyB0cnkgcmVhZGluZyBpbiBzb21lIGRhdGEuIFdlIHdpbGwgYmVnaW4gYnkKcmVhZGluZyBpbiB0aGUgYGhlYWx0aGNhcmUtY292ZXJhZ2UuY3N2YCBkYXRhLiAKCklmIHdlIHdhbnQgdG8gc2VlIHdoYXQgdGhlIGhlYWRlciBvZiB0aGUgZmlsZSBsb29rcyBsaWtlLCAKd2UgY2FuIHVzZSB0aGUgYHJlYWRfbGluZXMoKWAgZnVuY3Rpb24gdG8gcGVhayBhdCB0aGUgCmZpcnN0IGZldyBsaW5lcy4gCgpgYGB7ciB3YXJuaW5nPUZBTFNFLG1lc3NhZ2U9RkFMU0V9CnJlYWRfbGluZXMoZmlsZSA9ICIuL2RhdGEvS0ZGL2hlYWx0aGNhcmUtY292ZXJhZ2UuY3N2Iiwgbl9tYXggPSAxMCkKYGBgCgpJdCBsb29rcyBsaWtlIHRoZSBmaXJzdCB0d28gbGluZXMgYXJlIGRlc2NyaXB0aXZlIAphbmQgYXJlIG5vdCB1c2VmdWwuIFdlIHdpbGwgdGVsbCBSIHRvIHNraXAgcmVhZGluZyAKdGhlc2UgaW4gdXNpbmcgdGhlIGBza2lwYCBhcmd1bWVudCBpbiAKYHJlYWRfY3N2KClgLiBUaGUgdGhpcmQgbGluZSBsb29rcyBsaWtlIGl0IGNvbnRhaW5zIHRoZQpjb2x1bW4gbmFtZXMgYW5kIHN0YXJ0aW5nIG9uIHRoZSBmb3VydGggbGluZSBpcwp3aGVyZSB0aGUgZGF0YSBzdGFydHMuIAoKYGBge3IsIG1lc3NhZ2U9RkFMU0V9CmNvdmVyYWdlIDwtIHJlYWRfY3N2KCIuL2RhdGEvS0ZGL2hlYWx0aGNhcmUtY292ZXJhZ2UuY3N2IiwgCiAgICAgICAgICAgICAgICAgICAgIHNraXAgPSAyLCBjb2xfbmFtZXMgPSBUUlVFKQpoZWFkKGNvdmVyYWdlKQp0YWlsKGNvdmVyYWdlKQpgYGAKCkl0IGxvb2tzIGxpa2Ugd2Ugbm93IGhhdmUgdGhlIHJpZ2h0IGhlYWRlciwgYnV0CnRoZXJlIGFyZSBhIGJ1bmNoIG9mIE5BcyBpbiB0aGUgZW5kIG9mIHRoZSBkYXRhIApmcmFtZSBiZWNhdXNlIG1vc3Qgb2YgaXQgaXNuJ3QgdXNlZnVsIGRhdGEuIAoKTGV0J3MgdGFrZSBhIGNsb3NlciBsb29rIGF0IHRoZSBsYXN0IDMwIGxpbmVzCmBgYHtyIHdhcm5pbmc9RkFMU0UsbWVzc2FnZT1GQUxTRX0KdGFpbChjb3ZlcmFnZSwgbj0zMCkKYGBgCgpJdCBsb29rcyBsaWtlIHRoZXJlIGlzIGEgbGluZSB3aXRoIGEgc3RyaW5nIApgTm90ZXNgIGluIGl0IGFuZCBldmVyeXRoaW5nIGJlbG93IHRoYXQgbGluZQpzaG91bGQgbm90IGJlIHJlYWQgaW4uIFdlIGNhbiB1c2UgdGhlIGBuX21heGAgCmFyZ3VtZW50IGhlcmUuCgpgYGB7ciwgbWVzc2FnZT1GQUxTRX0KY292ZXJhZ2UgPC0gcmVhZF9jc3YoIi4vZGF0YS9LRkYvaGVhbHRoY2FyZS1jb3ZlcmFnZS5jc3YiLCAKICAgICAgICAgICAgICAgICAgICAgc2tpcCA9IDIsIGNvbF9uYW1lcyA9IFRSVUUpCmNvdmVyYWdlIDwtIHJlYWRfY3N2KCIuL2RhdGEvS0ZGL2hlYWx0aGNhcmUtY292ZXJhZ2UuY3N2IiwgCiAgICAgICAgICAgICAgICAgICAgIHNraXAgPSAyLCBjb2xfbmFtZXMgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICBuX21heCAgPSB3aGljaChjb3ZlcmFnZSRMb2NhdGlvbiA9PSAiTm90ZXMiKS0xKQp0YWlsKGNvdmVyYWdlKQpgYGAKClRoYXQncyBiZXR0ZXIhIAoKIyMjIyBSZWFkIGluIGhlYWx0aGNhcmUgc3BlbmRpbmcgZGF0YQoKTm93IGJlY2F1c2Ugd2UgYXJlIGFsc28gZ29pbmcgdG8gd2FudCB0byAKdXNlIGluIGBoZWFsdGhjYXJlLXNwZW5kaW5nLmNzdmAsIGxldCdzIApyZWFkIGl0IGluIG5vdy4gCgpgYGB7ciwgbWVzc2FnZT1GQUxTRX0Kc3BlbmRpbmcgPC0gcmVhZF9jc3YoIi4vZGF0YS9LRkYvaGVhbHRoY2FyZS1zcGVuZGluZy5jc3YiLCAKICAgICAgICAgICAgICAgICAgICAgc2tpcCA9IDIsIGNvbF9uYW1lcyA9IFRSVUUpCnNwZW5kaW5nIDwtIHJlYWRfY3N2KCIuL2RhdGEvS0ZGL2hlYWx0aGNhcmUtc3BlbmRpbmcuY3N2IiwgCiAgICAgICAgICAgICAgICAgICAgIHNraXAgPSAyLCBjb2xfbmFtZXMgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICBuX21heCAgPSB3aGljaChzcGVuZGluZyRMb2NhdGlvbiA9PSAiTm90ZXMiKS0xKQp0YWlsKHNwZW5kaW5nKQpgYGAKCgojIyMgMi4gVGFrZSBhIGBnbGltcHNlKClgIGF0IHlvdXIgZGF0YQoKT25lIGxhc3QgdGhpbmcgaW4gdGhpcyBzZWN0aW9uLiAKT25lIHdheSB0byBsb29rIGF0IG91ciBkYXRhIHdvdWxkIGJlIHRvIHVzZSAKYGhlYWQoKWAgb3IgYHRhaWwoKWAsIGFzIHdlIGp1c3Qgc2F3LiAKQW5vdGhlciBvbmUgeW91IG1pZ2h0IGhhdmUgaGVhcmQgb2YgaXMgdGhlCmBzdHIoKWAgZnVuY3Rpb24uIE9uZSB5b3UgbWlnaHQgbm90IGhhdmUgCmhlYXJkIG9mIGlzIHRoZSBgZ2xpbXBzZSgpYCBmdW5jdGlvbi4gSXQncwp1c2VkIGZvciBhIHNwZWNpYWwgdHlwZSBvZiBvYmplY3QgaW4gUiBjYWxsZWQgCmEgYHRpYmJsZWAuIExldCdzIHJlYWQgdGhlIGhlbHAgZmlsZSB0byBsZWFybgptb3JlLiAKCmBgYHtyLCBldmFsPUZBTFNFfQo/dGliYmxlOjp0aWJibGUKYGBgCgpJdCdzIGtpbmQgb2YgbGlrZSBgcHJpbnQoKWAgd2hlcmUgaXQgc2hvd3MgeW91IApjb2x1bW5zIHJ1bm5pbmcgZG93biB0aGUgcGFnZS4gTGV0J3MgdHJ5IGl0IG91dC4gCklmIHdlIGxvb2sgYXQgb3VyIGRhdGEsIHNheSB0aGUgYGNvdmVyYWdlYCAKZGF0YSBmcmFtZSwgd2Ugc2VlIHRoYXQgaXQgaXMgbm90IF8idGlkeSJfOiAKYGBge3Igd2FybmluZz1GQUxTRSxtZXNzYWdlPUZBTFNFfQpnbGltcHNlKGNvdmVyYWdlKQpgYGAKCiMjIFJlYWQgdGhlIFN0YXRlIGluZm9ybWF0aW9uIHVzaW5nIHRoZSBgZGF0YXNldHNgIFIgcGFja2FnZSAKClNpbmNlIG91ciBnb2FsIGlzIHRvIGdldCBzZW5zZSBvZiB0aGUgaGVhbHRoIGV4cGVuZGl0dXJlLCBpbmNsdWRpbmcgaGVhbHRoY2FyZSBjb3ZlcmFnZSBhbmQgCmhlYWx0aGNhcmUgc3BlbmRpbmcsICoqYWNyb3NzIFN0YXRlcyoqLCAKaXQgd291bGQgYmUgbmljZSBhZGQgc29tZSBpbmZvcm1hdGlvbiBhYm91dCBlYWNoIHN0YXRlLiAKTmFtZWx5LCB0aGUgc3RhdGUgYWJicmV2aWF0aW9uIGFuZCBzdGF0ZSByZWdpb24gCihpLmUuIG5vcnRoLCBzb3V0aCwgZXRjKS4gCgpGb3IgdGhpcyB3ZSB1c2UgdGhlIApbc3RhdGVdKGh0dHBzOi8vc3RhdC5ldGh6LmNoL1ItbWFudWFsL1ItZGV2ZWwvbGlicmFyeS9kYXRhc2V0cy9odG1sL3N0YXRlLmh0bWwpCmRhdGFzZXQgaW4gdGhlIGBkYXRhc2V0c2AgUiBwYWNrYWdlLiAKCkJlZm9yZSB3ZSBiZWdpbiwgbGV0J3MgbG9vayBhdCB3aGF0IHN0YXRlcyBhcmUgdGhlcmU6IAoKYGBge3J9CnVuaXF1ZShjb3ZlcmFnZSRMb2NhdGlvbikKYGBgCgpXZSBzZWUgdGhlcmUgYXJlIG1vcmUgdGhhbiA1MCBzdGF0ZXMgYmVjYXVzZSAKIlVuaXRlZCBTdGF0ZXMiIGFuZCAiRGlzdHJpY3Qgb2YgQ29sdW1iaWEiIAphcmUgYm90aCBpbmNsdWRlZC4gCgpMZXQncyBsb29rIHdoYXQgc3RhdGVzIGFyZSBpbnNpZGUgdGhlIGBzdGF0ZWAgZGF0YXNldC4gCmBgYHtyfQpsaWJyYXJ5KGRhdGFzZXRzKQpkYXRhKHN0YXRlKQp1bmlxdWUoc3RhdGUubmFtZSkKYGBgCgpBaCwgb2suIFNvIGxldCdzIHN0YXJ0IGJ5IGRlYWxpbmcgd2l0aApEQyBhcyBhIHNwZWNpYWwgY2FzZS4gCgpgYGB7cn0Kc3RhdGUuYWJiIDwtIGMoc3RhdGUuYWJiLCAiREMiKQpzdGF0ZS5yZWdpb24gPC0gYXMuZmFjdG9yKGMoYXMuY2hhcmFjdGVyKHN0YXRlLnJlZ2lvbiksICJTb3V0aCIpKQpzdGF0ZS5uYW1lIDwtIGMoc3RhdGUubmFtZSwgIkRpc3RyaWN0IG9mIENvbHVtYmlhIikKYGBgCgpXZSB3aWxsIGRlYWwgd2l0aCB0aGUgIlVuaXRlZCBTdGF0ZXMiIGluIAp0aGUgbmV4dCBzZWN0aW9uLiAKCiMgRGF0YSBXcmFuZ2xpbmcgCgojIyBXaGF0IGlzICJUaWR5IERhdGEiPyAgCgojIyMjIEdsYW5jZSBhdCAiVGlkeSBEYXRhIgpBIHN1YnNldCBvZiB0aGUgZGF0YSBhbmFseXNpcyBwcm9jZXNzIGNhbiBiZSB0aG91Z2h0CmFib3V0IGluIHRoZSBmb2xsb3dpbmcgd2F5OgoKYGBge3Igb3V0LndpZHRoID0gIjk1JSIsIGVjaG8gPSBGQUxTRX0Ka25pdHI6OmluY2x1ZGVfZ3JhcGhpY3MoImh0dHA6Ly9yNGRzLmhhZC5jby5uei9kaWFncmFtcy9kYXRhLXNjaWVuY2UucG5nIikKYGBgCgp3aGVyZSBlYWNoIG9mIHRoZXNlIHN0ZXBzIG5lZWRzIGl0cyBvd24gCnRvb2xzIGFuZCBzb2Z0d2FyZSB0byBjb21wbGV0ZS4gCgpBZnRlciB3ZSBpbXBvcnQgdGhlIGRhdGEgaW50byBSLCBpZiB3ZSBhcmUgCmdvaW5nIHRvIHRha2UgYWR2YW50YWdlIG9mIHRoZSBfInRpZHl2ZXJzZSJfLCAKdGhpcyBtZWFucyB3ZSBuZWVkIHRvIF90cmFuc2Zvcm1fIHRoZSBkYXRhIAppbnRvIGEgZm9ybSB0aGF0IGlzIF8idGlkeSJfLiBJZiB5b3UgcmVjYWxsLCAKaW4gX3RpZHlfIGRhdGE6CgoqIEVhY2ggdmFyaWFibGUgZm9ybXMgYSBjb2x1bW4uCiogRWFjaCBvYnNlcnZhdGlvbiBmb3JtcyBhIHJvdy4KKiBFYWNoIHR5cGUgb2Ygb2JzZXJ2YXRpb25hbCB1bml0IGZvcm1zIGEgdGFibGUuCgpGb3IgZXhhbXBsZSwgY29uc2lkZXIgdGhlIGZvbGxvd2luZyBkYXRhc2V0OiAKCiFbXShodHRwczovL2dpdGh1Yi5jb20vZGF0YXNjaWVuY2VsYWJzLzIwMTYvcmF3L21hc3Rlci9sZWN0dXJlcy93cmFuZ2xpbmcvcGljcy9zdG9ja3MtYnktY29tcGFueS5wbmcpCgpIZXJlOiAgCgoqIGVhY2ggcm93IHJlcHJlc2VudHMgb25lIGNvbXBhbnkgKHJvdyBuYW1lcyBhcmUgY29tcGFuaWVzKQoqIGVhY2ggY29sdW1uIHJlcHJlc2VudCBvbmUgdGltZSBwb2ludAoqIHRoZSBzdG9jayBwcmljZXMgYXJlIGRlZmluZWQgZm9yIGVhY2ggcm93L2NvbHVtbiBwYWlyCgpBbHRlcm5hdGl2ZWx5LCBhIGRhdGEgc2V0IGNhbiBiZSBzdHJ1Y3R1cmVkIGluIHRoZSBmb2xsb3dpbmcgd2F5OgoKKiBlYWNoIHJvdyByZXByZXNlbnRzIG9uZSB0aW1lIHBvaW50IChidXQgbm8gcm93IG5hbWVzKQoqIHRoZSBmaXJzdCBjb2x1bW4gZGVmaW5lcyB0aGUgdGltZSB2YXJpYWJsZSBhbmQgdGhlIGxhc3QgdGhyZWUgY29sdW1ucyBjb250YWluIHRoZSBzdG9jayBwcmljZXMgZm9yIHRocmVlIGNvbXBhbmllcyAKCiFbXShodHRwczovL2dpdGh1Yi5jb20vZGF0YXNjaWVuY2VsYWJzLzIwMTYvcmF3L21hc3Rlci9sZWN0dXJlcy93cmFuZ2xpbmcvcGljcy9zdG9ja3MtYnktdGltZS5wbmcpCgpJbiBib3RoIGNhc2VzLCB0aGUgZGF0YSBpcyB0aGUgc2FtZSwgYnV0IHRoZSBzdHJ1Y3R1cmUgaXMgCmRpZmZlcmVudC4gVGhpcyBjYW4gYmUgIF9mcnVzdHJhdGluZ18gdG8gZGVhbCB3aXRoIGFzIGFuIAphbmFseXN0IGJlY2F1c2UgdGhlIG1lYW5pbmcgb2YgdGhlIHZhbHVlcyAocm93cyBhbmQgY29sdW1ucykKaW4gdGhlIHR3byBkYXRhIHNldHMgYXJlIGRpZmZlcmVudC4gUHJvdmlkaW5nIGEgc3RhbmRhcmRpemVkIAp3YXkgb2Ygb3JnYW5pemluZyB2YWx1ZXMgd2l0aGluIGEgZGF0YSBzZXQgd291bGQgYWxsZXZpYXRlIAphIG1ham9yIHBvcnRpb24gb2YgdGhpcyBmcnVzdHJhdGlvbi4gIAoKRm9yIG1vdGl2YXRpb24sIGEgX3RpZHlfIHZlcnNpb24gb2YgdGhlIHN0b2NrIGRhdGEgd2UgCmxvb2tlZCBhdCBhYm92ZSBsb29rcyBsaWtlIHRoaXM6ICh3ZSdsbCBsZWFybiBob3cgdGhlCmZ1bmN0aW9ucyB3b3JrIGluIGp1c3QgYSBtb21lbnQpCgohW10oaHR0cHM6Ly9naXRodWIuY29tL2RhdGFzY2llbmNlbGFicy8yMDE2L3Jhdy9tYXN0ZXIvbGVjdHVyZXMvd3JhbmdsaW5nL3BpY3Mvc3RvY2tzLXRpZHkucG5nKQoKSW4gdGhpcyAidGlkeSIgZGF0YSBzZXQsIHdlIGhhdmUgdGhyZWUgY29sdW1ucyByZXByZXNlbnRpbmcgCnRocmVlIHZhcmlhYmxlcyAodGltZSwgY29tcGFueSBuYW1lIGFuZCBzdG9jayBwcmljZSkuIApFdmVyeSByb3cgcmVwcmVzZW50cyBjb250YWlucyBvbmUgc3RvY2sgcHJpY2UgZnJvbSBhIApwYXJ0aWN1bGFyIHRpbWUgYW5kIGZvciBhIHNwZWNpZmljIGNvbXBhbnkuIAoKSWYgd2UgY29uc2lkZXIgb3VyIGBjb3ZlcmFnZWAgZGF0YWZyYW1lLCB3ZSBzZWUgaXQgCmlzIGFsc28gbm90IGluIGEgdGlkeSBmb3JtYXQuIEVhY2ggcm93IGNvbnRhaW5zIGluZm9ybWF0aW9uCmFib3V0IHRoZSBjb3ZlcmFnZSBsZXZlbCBieSBgTG9jYXRpb25gIGFjcm9zcyB5ZWFycyBhbmQgCnR5cGVzIG9mIGNvdmVyYWdlLiAKCmBgYHtyfQpjb3ZlcmFnZVsxOjUsIDE6NV0KYGBgCgpOb3csIGxldCdzIHVzZSB0aGUgYHRpZHlyYCBSIHBhY2thZ2UgdG8gdHJhbnNmb3JtCm91ciBkYXRhIGludG8gYSBfdGlkeV8gZm9ybWF0LiAKCiMjIFRoZSBgdGlkeXJgIFIgcGFja2FnZQoKIyMjIDEuIFdoYXQgaXMgdGhlIGB0aWR5cmAgUiBwYWNrYWdlID8KCltgdGlkeXJgXShodHRwczovL2NyYW4uci1wcm9qZWN0Lm9yZy93ZWIvcGFja2FnZXMvdGlkeXIvdmlnbmV0dGVzL3RpZHktZGF0YS5odG1sKQppcyBhbiBSIHBhY2thZ2UgdGhhdCB0cmFuc2Zvcm1zIGRhdGEgc2V0cyB0byBhIHRpZHkgZm9ybWF0LiAKClRoaXMgcGFja2FnZSBpcyBpbnN0YWxsZWQgYW5kIGxvYWRlZCB3aGVuIHlvdSBsb2FkIAp0aGUgYHRpZHl2ZXJzZWAgdXNpbmcgYGxpYnJhcnkodGlkeXZlcnNlKWAuIEhvd2V2ZXIsIAp5b3UgY2FuIGFsc28ganVzdCBsb2FkIHRoZSBsaWJyYXJ5IGJ5IGl0c2VsZi4gCgpgYGB7ciwgbWVzc2FnZT1GQUxTRX0KbGlicmFyeSh0aWR5cikKYGBgCgpUaGUgbWFpbiBmdW5jdGlvbnMgaW4gYHRpZHlyYCBhcmU6IAoKYHRpZHlyYCBmdW5jdGlvbnMgfCBEZXNjcmlwdGlvbiB8Ci0tLSB8ICAtLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tIHwKYGdhdGhlcigpYCB8IHRha2VzIG11bHRpcGxlIGNvbHVtbnMsIGFuZCBnYXRoZXJzIHRoZW0gaW50byBrZXktdmFsdWUgcGFpcnMsIG1ha2luZyAid2lkZSIgZGF0YSBsb25nZXIgfApgc2VwYXJhdGUoKWAgfCB0dXJucyBhIHNpbmdsZSBjaGFyYWN0ZXIgY29sdW1uIGludG8gbXVsdGlwbGUgY29sdW1ucywgbWFraW5nICJsb25nIiBkYXRhIHdpZGVyIHwKYHNwcmVhZCgpYCB8IHNwcmVhZCByb3dzIGludG8gbXVsdGlwbGUgY29sdW1ucywgdHJhbnNmb3JtaW5nICJsb25nIiBkYXRhIGludG8gIndpZGUiIGZvcm1hdCB8IAoKV2UnbGwgZXhwbG9yZSB3aGF0IGl0IG1lYW5zIHRvIGdvIGJldHdlZW4gYSAid2lkZSIgYW5kICJsb25nIiAKZGF0YSBmb3JtYXQgdXNpbmcgYGdhdGhlcigpYCAsIGBzZXBhcmF0ZSgpYCwgYW5kIGBzcHJlYWQoKWAuIAoKQSBbYHRpZHlyYCBjaGVhdHNoZWV0XShodHRwczovL3d3dy5yc3R1ZGlvLmNvbS93cC1jb250ZW50L3VwbG9hZHMvMjAxNS8wMi9kYXRhLXdyYW5nbGluZy1jaGVhdHNoZWV0LnBkZikKZm9yIHRoZSBmdW5jdGlvbnMgaW4gdGhlIGB0aWR5cmAgcGFja2FnZSBjYW4gYmUgCmZvdW5kIG9uIFJTdHVkaW8ncyB3ZWJzaXRlOiAKCiMjIyAyLiBDb252ZXJ0IGRhdGEgZnJvbSB3aWRlIGZvcm1hdCB0byBsb25nIGZvcm1hdCB1c2luZyBgZ2F0aGVyKClgIAoKTGV0J3Mgc3RhcnQgYnkgbG9va2luZyBhdCB0aGUgYGdhdGhlcigpYCBoZWxwIGZpbGUKCmBgYHtyLCBldmFsPUZBTFNFfQo/Z2F0aGVyCmBgYAoKVGhpcyBmdW5jdGlvbiBnYXRoZXJzIG11bHRpcGxlIGNvbHVtbnMgYW5kIGNvbGxhcHNlcyB0aGVtIGludG8gbmV3IAoqa2V5LXZhbHVlKiBwYWlycy4gVGhpcyB0cmFuc2Zvcm0gZGF0YSBmcm9tIF93aWRlXyBmb3JtYXQgaW50byAKYSBfbG9uZ18gIGZvcm1hdC4gCgoqIFRoZSBga2V5YCBpcyB0aGUgbmFtZSBvZiB0aGUgX25ld18gY29sdW1uIHRoYXQgeW91IGFyZSBjcmVhdGluZyB3aGljaCAKY29udGFpbnMgdGhlIHZhbHVlcyBvZiB0aGUgY29sdW1uIGhlYWRpbmdzIHRoYXQgeW91IGFyZSBnYXRoZXJpbmcgCiogVGhlIGB2YWx1ZWAgaXMgdGhlIG5hbWUgb2YgdGhlIF9uZXdfIGNvbHVtbiB0aGF0IHdpbGwgY29udGFpbiB0aGUgdmFsdWVzCnRoZW1zZWx2ZXMKKiBUaGUgdGhpcmQgYXJndW1lbnQgZGVmaW5lcyB0aGUgY29sdW1ucyB0byBnYXRoZXIKCkZvciBleGFtcGxlLCBoZXJlIHdlIGNyZWF0ZSBhIGNvbHVtbiB0aXRsZWQgCmB5ZWFyX3R5cGVgIGFuZCBgY292ZXJhZ2VgLiBXZSBhbHNvIHdhbnQgdG8ga2VlcCAKdGhlIGBMb2NhdGlvbmAgY29sdW1uIGFzIGl0IGlzIGJlY2F1c2UgaXQgYWxzbyBjb250YWlucwpvYnNlcnZhdGlvbmFsIGxldmVsIGRhdGEuCgpgYGB7cn0KY292ZXJhZ2UgPC0gZ2F0aGVyKGNvdmVyYWdlLCAieWVhcl90eXBlIiwgInRvdF9jb3ZlcmFnZSIsIC1Mb2NhdGlvbikKY292ZXJhZ2UKYGBgCgpOb3cgd2Ugc2VlIGVhY2ggcm93IGNvbnRhaW5zIG9uZSBvYnNlcnZhdGlvbi4gCk5hbWVseSwgYSBgTG9jYXRpb25gLCBhIGB5ZWFyX3R5cGVgIGFuZCBgY292ZXJhZ2VgLiAKSXQgd291bGQgYmUgbmljZSB0byBzZXBhcmF0ZSBvdXQgdGhlIGluZm9ybWF0aW9uIAppbiB0aGUgYHllYXJfdHlwZWAgY29sdW1uIGludG8gdHdvIGNvbHVtbnMuIFdlIGNhbiAKaW1wbGVtZW50IHNhbWUgdGVjaG5pcXVlcyB0byB0aGUgaGVhbHRoY2FyZSBzcGVuZGluZyAKZGF0YXNldC4gCgojIyMjIENvbnZlcnQgaGVhbHRoY2FyZSBzcGVuZGluZyBkYXRhIHRvIGEgbG9uZyBmb3JtYXQgKHRpZHkgZm9ybWF0KQoKTGV0J3MgZG8gdGhlIHNhbWUgZm9yIHRoZSBgc3BlbmRpbmdgIGRhdGEuIEluIHRoaXMgCmNhc2UgSSB3aWxsIHVzZSBgeWVhcmAgYW5kIGBzcGVuZGluZ2AgZm9yCnRoZSBga2V5YCBhbmQgYHZhbHVlYC4gV2UgYWxzbyB3YW50IHRvIGtlZXAgYExvY2F0aW9uYApsaWtlIGJlZm9yZS4gCgpgYGB7cn0Kc3BlbmRpbmcgPC0gZ2F0aGVyKHNwZW5kaW5nLCAieWVhciIsICJ0b3Rfc3BlbmRpbmciLCAtTG9jYXRpb24pCnNwZW5kaW5nCmBgYAoKCldlIHdpbGwgCmV4cGxvcmUgaG93IHRvIGRvIHRoYXQgaW4gdGhlIERhdGEgV3JhbmdsaW5nIHNlY3Rpb24KYmVsb3cuIEZvciBub3cgbGV0J3MgbGVhcm4gbW9yZSBhYm91dCB0aGUgYHRpZHlyYCAKcGFja2FnZS4gCgojIyMgMy4gQ29udmVydCBkYXRhIGZyb20gbG9uZyBmb3JtYXQgdG8gd2lkZSBmb3JtYXQgdXNpbmcgYHNwcmVhZCgpYCAKCkluIGNvbnRyYXN0IHRvICpnYXRoZXJpbmcqIG11bHRpcGxlIGNvbHVtbnMgaW50byBrZXktdmFsdWUgcGFpcnMsIHdlIGNhbiAKKnNwcmVhZCogYSBrZXktdmFsdWUgcGFpciBhY3Jvc3MgbXVsdGlwbGUgY29sdW1ucy4gIAoKVGhlIGZ1bmN0aW9uIGBzcHJlYWQoKWAgZG9lcyBqdXN0IHRoYXQuIEl0IHRyYW5zZm9ybXMgZGF0YSBmcm9tIGEgX2xvbmdfCmZvcm1hdCBpbnRvIGEgX3dpZGVfIGZvcm1hdC4gCgoqIFRoZSBga2V5YCBpcyB0aGUgbmFtZSBvZiB0aGUgY29sdW1uIGluIHlvdXIgZGF0YSBzZXQgdGhhdCAKY29udGFpbnMgdGhlIHZhbHVlcyBvZiB0aGUgY29sdW1uIGhlYWRpbmdzIHRoYXQgeW91IGFyZSBzcHJlYWRpbmcgYWNyb3NzIAptdWx0aXBsZSBjb2x1bW5zCiogVGhlIGB2YWx1ZWAgaXMgdGhlIG5hbWUgb2YgdGhlIGNvbHVtbiB0aGF0IGNvbnRhaW5zIHRoZSB2YWx1ZXMgZm9yIHRoZSAKbXVsdGlwbGUgY29sdW1ucwoKCmBgYHtyfQpzcHJlYWQoY292ZXJhZ2UsIHllYXJfdHlwZSwgdG90X2NvdmVyYWdlKQpgYGAKCgpJbiB0aGUgcmVhbCB3b3JsZCwgYW5hbHl6aW5nIGRhdGEgcmFyZWx5IGludm9sdmVzIApkYXRhIHRoYXQgY2FuIGJlIGVhc2lseSBpbXBvcnRlZCBhbmQgcmVhZHkgZm9yIAphbmFseXNpcy4gQWNjb3JkaW5nIHRvIFdpa2lwZWRpYToKCj4gRGF0YSBtdW5naW5nIG9yIGRhdGEgd3JhbmdsaW5nIGlzIGxvb3NlbHkgdGhlIHByb2Nlc3MgCm9mIG1hbnVhbGx5IGNvbnZlcnRpbmcgb3IgbWFwcGluZyBkYXRhIGZyb20gb25lICJyYXciIApmb3JtIGludG8gYW5vdGhlciBmb3JtYXQgdGhhdCBhbGxvd3MgZm9yIG1vcmUgY29udmVuaWVudCAKY29uc3VtcHRpb24gb2YgdGhlIGRhdGEgd2l0aCB0aGUgaGVscCBvZiBzZW1pLWF1dG9tYXRlZCAKdG9vbHMuCgpBcyB5b3UgbWF5IHNlZSBpbiBjbGFzcyBvciBoZXJlIGZyb20gZGF0YSBzY2llbnRpc3RzIG9uIFR3aXR0ZXIsIApvbmUgb2YgdGhlIG1vc3QgdGltZS1jb25zdW1pbmcgYXNwZWN0cyBvZiB0aGUgZGF0YSBhbmFseXNpcyAKcHJvY2VzcyBpcyAiZGF0YSB3cmFuZ2xpbmciLiBUaGlzIGlzIGFsc28gCmlzIGEgdHJlbmR5IHRlcm0gZm9yIApfY2xlYW5pbmcgdXAgYSBtZXNzeSBkYXRhIHNldF8uIAoKUiBwcm92aWRlcyBpbmNyZWRpYmx5IHBvd2VyZnVsIGFuZCBmbGV4aWJsZSBsYW5ndWFnZSAKZm9yIGRhdGEgd3JhbmdsaW5nLiBIb3dldmVyLCB0aGUgc3ludGF4IGlzIHNvbWV3aGF0IApoYXJkIHRvIGdldCB1c2VkIHRvLiBXZSB3aWxsIHRoZXJlZm9yZSBpbnRyb2R1Y2luZyAKYSBwYWNrYWdlIHRoYXQgbWFrZXMgdGhlIHN5bnRheCBtdWNoIG1vcmUgbGlrZSAKdGhlIEVuZ2xpc2ggbGFuZ3VhZ2UuIFRoaXMgcGFja2FnZSBpcyBgZHBseXJgLiAKCiMjIFRoZSBgZHBseXJgIFIgcGFja2FnZQoKIyMjIDEuIFdoYXQgaXMgdGhlIGBkcGx5cmAgUiBwYWNrYWdlID8gCgpbYGRwbHlyYF0oaHR0cDovL2NyYW4ucnN0dWRpby5jb20vd2ViL3BhY2thZ2VzL2RwbHlyL3ZpZ25ldHRlcy9pbnRyb2R1Y3Rpb24uaHRtbCkgCmlzIGEgcG93ZXJmdWwgUi1wYWNrYWdlIHRvIHRyYW5zZm9ybSBhbmQgc3VtbWFyaXplIAp0YWJ1bGFyIGRhdGEgd2l0aCByb3dzIGFuZCBjb2x1bW5zLiAKClRoZSBwYWNrYWdlIGNvbnRhaW5zIGEgc2V0IG9mIGZ1bmN0aW9ucyAKKG9yICJ2ZXJicyIpIHRvIHBlcmZvcm0gY29tbW9uIGRhdGEgbWFuaXB1bGF0aW9uCm9wZXJhdGlvbnMgc3VjaCBhcyBmaWx0ZXJpbmcgZm9yIHJvd3MsIHNlbGVjdGluZyAKc3BlY2lmaWMgY29sdW1ucywgcmUtb3JkZXJpbmcgcm93cywgYWRkaW5nIG5ldyAKY29sdW1ucyBhbmQgc3VtbWFyaXppbmcgZGF0YS4gCgpJbiBhZGRpdGlvbiwgYGRwbHlyYCBjb250YWlucyBhIHVzZWZ1bCBmdW5jdGlvbiB0bwpwZXJmb3JtIGFub3RoZXIgY29tbW9uIHRhc2sgd2hpY2ggaXMgdGhlIGlzIHRoZSAKInNwbGl0LWFwcGx5LWNvbWJpbmUiIGNvbmNlcHQuICBXZSB3aWxsIGRpc2N1c3MgCnRoYXQgaW4gYSBsaXR0bGUgYml0LiAKCiMjIyAyLiBDb21wYXJlIGBkcGx5cmAgUiBwYWNrYWdlIGNvbXBhcmUgd2l0aCBiYXNlIGZ1bmN0aW9ucyBSIAoKSWYgeW91IGFyZSBmYW1pbGlhciB3aXRoIFIsIHlvdSBhcmUgcHJvYmFibHkgZmFtaWxpYXIgCndpdGggYmFzZSBSIGZ1bmN0aW9ucyBzdWNoIGFzIGBzcGxpdCgpYCwgYHN1YnNldCgpYCwgCmBhcHBseSgpYCwgYHNhcHBseSgpYCwgYGxhcHBseSgpYCwgYHRhcHBseSgpYCBhbmQgCmBhZ2dyZWdhdGUoKWAuIENvbXBhcmVkIHRvIGJhc2UgZnVuY3Rpb25zIGluIFIsIHRoZSAKZnVuY3Rpb25zIGluIGBkcGx5cmAgYXJlIGVhc2llciB0byB3b3JrIHdpdGgsIGFyZSAKbW9yZSBjb25zaXN0ZW50IGluIHRoZSBzeW50YXggYW5kIGFyZSB0YXJnZXRlZCBmb3IgCmRhdGEgYW5hbHlzaXMgYXJvdW5kIGRhdGEgZnJhbWVzIGluc3RlYWQgb2YganVzdCB2ZWN0b3JzLiAKClRoZSBpbXBvcnRhbnQgYGRwbHlyYCB2ZXJicyB0byByZW1lbWJlciBhcmU6IAoKCmBkcGx5cmAgdmVyYnMgfCBEZXNjcmlwdGlvbiB8Ci0tLSB8IC0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLSB8CmBzZWxlY3QoKWAgfCBzZWxlY3QgY29sdW1ucyAgfApgZmlsdGVyKClgIHwgZmlsdGVyIHJvd3MgfApgYXJyYW5nZSgpYCB8IHJlLW9yZGVyIG9yIGFycmFuZ2Ugcm93cyB8CmBtdXRhdGUoKWAgfCBjcmVhdGUgbmV3IGNvbHVtbnMgfApgc3VtbWFyaXplKClgIHwgc3VtbWFyaXplIHZhbHVlcyB8CmBncm91cF9ieSgpYCB8IGFsbG93cyBmb3IgZ3JvdXAgb3BlcmF0aW9ucyBpbiB0aGUgInNwbGl0LWFwcGx5LWNvbWJpbmUiIGNvbmNlcHQgfAoKCiMjIyAzLiBQaXBlIG9wZXJhdG9yOiAlPiUKCkJlZm9yZSB3ZSBnbyBhbnkgZnVydGhlciwgbGV0J3MgaW50cm9kdWNlIHRoZSAKcGlwZSBvcGVyYXRvcjogYCU+JWAuIEluIG91ciBgc3RvY2tzYCBleGFtcGxlLAp3ZSBicmllZmx5IHNhdyB0aGlzIHN5bWJvbC4gSXQgaXMgY2FsbGVkIHRoZQpwaXBlIG9wZXJhdG9yLiBgZHBseXJgIGltcG9ydHMKdGhpcyBvcGVyYXRvciBmcm9tIGFub3RoZXIgcGFja2FnZSAKKGBtYWdyaXR0cmApCltzZWUgaGVscCBmaWxlIGhlcmVdKGh0dHA6Ly9jcmFuLnItcHJvamVjdC5vcmcvd2ViL3BhY2thZ2VzL21hZ3JpdHRyL3ZpZ25ldHRlcy9tYWdyaXR0ci5odG1sKS4gClRoaXMgb3BlcmF0b3IgYWxsb3dzIHlvdSB0byBwaXBlIHRoZSBvdXRwdXQgCmZyb20gb25lIGZ1bmN0aW9uIHRvIHRoZSBpbnB1dCBvZiBhbm90aGVyCmZ1bmN0aW9uLiBJbnN0ZWFkIG9mIG5lc3RpbmcgZnVuY3Rpb25zIAoocmVhZGluZyBmcm9tIHRoZSBpbnNpZGUgdG8gdGhlIApvdXRzaWRlKSwgdGhlIGlkZWEgb2Ygb2YgcGlwaW5nIGlzIHRvIApyZWFkIHRoZSBmdW5jdGlvbnMgZnJvbSBsZWZ0IHRvIHJpZ2h0LiAKCk5vdyBpbiBgc3RvY2tzYCBleGFtcGxlLCB3ZSBwaXBlIHRoZSBgc3RvY2tzYApkYXRhIGZyYW1lIHRvIHRoZSBmdW5jdGlvbiB0aGF0IHdpbGwgCmdhdGhlciBtdWx0aXBsZSBjb2x1bW5zIGludG8ga2V5LXZhbHVlIHBhaXJzLiAKCiFbXShodHRwczovL2dpdGh1Yi5jb20vZGF0YXNjaWVuY2VsYWJzLzIwMTYvcmF3L21hc3Rlci9sZWN0dXJlcy93cmFuZ2xpbmcvcGljcy9zdG9ja3MtdGlkeS5wbmcpCgoKCgojIyMjICBgZHBseXJgIHZlcmJzIGluIGFjdGlvbjogYHNlcGFyYXRlKClgLCBgdW5pdGUoKWAsIC4uLgoKRmlyc3QsIGxldCdzIHNlcGFyYXRlIHRoZSBgeWVhcl90eXBlYCBjb2x1bW4gCmluIHRoZSBgY292ZXJhZ2VgIGRhdGFzZXQgdG8gdHdvIGNvbHVtbnM6CmB5ZWFyYCBhbmQgaGVhbHRoIGNvdmVyYWdlIGB0eXBlYC4gCgpUbyBkbyB0aGlzLCB3ZSB3aWxsIHVzZSB0aGUgYHNlcGFyYXRlKClgIApmdW5jdGlvbiBpbiB0aGUgYHRpZHlyYCBwYWNrYWdlLiAKCioqTm90ZSoqOiAKCiogYHNlcGFyYXRlKClgID0gc2VwYXJhdGUgb25lIGNvbHVtbiBpbnRvIG11bHRpcGxlIGNvbHVtbnMKKiBgdW5pdGUoKWAgPSB1bml0ZSBtdWx0aXBsZSBjb2x1bW5zIGludG8gb25lCgojIyMjIExlYXJuIGBzZXBhcmF0ZSgpYCBhbmQgYHVuaXRlKClgIGluIHRoZSBgc3BlbmRpbmdgIGRhdGFzZXQKCmBgYHtyfQpjb3ZlcmFnZSAlPiUgCiAgc2VwYXJhdGUoeWVhcl90eXBlLCBzZXA9Il9fIiwgCiAgICAgICAgICAgaW50bz1jKCJ5ZWFyIiwgInR5cGUiKSkKYGBgCgpXZSBzZWUgdGhhdCB3ZSBub3cgaGF2ZSB0d28gY29sdW1ucywgZXhjZXB0IAp0aGUgYHllYXJgIGNvbHVtbiB3YXMgY29udmVydGVkIHRvIGEgY2hhcmFjdGVyLiAKSWYgd2UgbG9vayBhdCB0aGUgaGVscCBmaWxlIGA/c2VwYXJhdGVgLCB3ZSBzZWUKd2UgY2FuIHVzZSB0aGUgYGNvbnZlcnQ9VFJVRWAgYXJndW1lbnQgdG8gCmNvbnZlcnQgdGhlIGNoYXJhY3RlciB0byBhbiBpbnRlZ2VyLiAKCmBgYHtyfQpjb3ZlcmFnZSA8LSAKICBjb3ZlcmFnZSAlPiUgCiAgc2VwYXJhdGUoeWVhcl90eXBlLCBzZXA9Il9fIiwgCiAgICAgICAgICAgaW50bz1jKCJ5ZWFyIiwgInR5cGUiKSwgCiAgICAgICAgICAgY29udmVydCA9IFRSVUUpCmNvdmVyYWdlCmBgYAoKTmV4dCwgd2Ugc2VlIHRoYXQgdGhlIGB0b3RfY292ZXJhZ2VgIGNvbHVtbiBpcyAKYWxzbyBhIGNoYXJhY3Rlci4gR2FoISAKCkxldCdzIGZpeCB0aGF0LiBXZSBjYW4gdXNlIHRoZSBgbXV0YXRlX2F0KClgIApmdW5jdGlvbiB0byBkbyB0aGlzLiBXZSBhcmUgYXNraW5nIFIgdG8gdGFrZQpgdG90X2NvdmVyYWdlYCBjb2x1bW4gYW5kIGNvbnZlcnQgaXQgdG8gYW4KaW50ZWdlciBhbmQgdGhlbiByZXBsYWNlIHRoZSBvbGQgY29sdW1uIHdpdGggCnRoZSBuZXcgY29udmVydGVkIGNvbHVtbiAKCmBgYHtyfQpjb3ZlcmFnZSA8LSAKICBjb3ZlcmFnZSAlPiUgCiAgbXV0YXRlX2F0KCJ0b3RfY292ZXJhZ2UiLCBhcy5pbnRlZ2VyKQoKIyBBZGQgdGhlIGFiYnJldmlhdGlvbiBvZiBTdGF0ZXMKY292ZXJhZ2UkYWJiIDwtIHN0YXRlLmFiYlttYXRjaChjb3ZlcmFnZSRMb2NhdGlvbiwgc3RhdGUubmFtZSldCmNvdmVyYWdlJHJlZ2lvbiA8LSBzdGF0ZS5yZWdpb25bbWF0Y2goY292ZXJhZ2UkTG9jYXRpb24sIHN0YXRlLm5hbWUpXQoKY292ZXJhZ2UKYGBgCgpUaGUgYGNvdmVyYWdlYCBkYXRhIGxvb2tzIGdvb2Qgbm93LiBXZSBzZWUgCnRoYXQgdGhlcmUgYXJlIGRpZmZlcmVudCBgeWVhcmBzIGFuZCBkaWZmZXJlbnQgCmB0eXBlc2Agb2YgaGVhbHRoY2FyZSBjb3ZlcmFnZS4gCgpBbHNvLCB5b3UgbWF5IHdhbnQgdG8gbGluayB0aGUgY292ZXJhZ2UgZGF0YSB3aXRoIG91ciBsb2NhdGlvbiBpbmZvcm1hdGlvbi4gCmBgYHtyfQojIEFkZCB0aGUgYWJicmV2aWF0aW9uIG9mIFN0YXRlcwpjb3ZlcmFnZSRhYmIgPC0gc3RhdGUuYWJiW21hdGNoKGNvdmVyYWdlJExvY2F0aW9uLCBzdGF0ZS5uYW1lKV0KY292ZXJhZ2UkcmVnaW9uIDwtIHN0YXRlLnJlZ2lvblttYXRjaChjb3ZlcmFnZSRMb2NhdGlvbiwgc3RhdGUubmFtZSldCgpjb3ZlcmFnZQpgYGAKCiMjIyMgKCopIFdoYXQgaXMgdGhlIHJhbmdlIG9mIHllYXJzIGFuZCB0eXBlcyBvZiBoZWFsdGhjYXJlIGluIHRoZSBgY292ZXJhZ2VgIGRhdGFzZXQ/ICAgCgpgYGB7cn0KdGFibGUoY292ZXJhZ2UkdHlwZSwgY292ZXJhZ2UkeWVhcikKYGBgCgoKIyMjIyBJbXBsZW1lbnQgIGBzZXBhcmF0ZSgpYCBhbmQgYHVuaXRlKClgIGluIHRoZSBgc3BlbmRpbmdgIGRhdGFzZXQgICAgICAKCk5leHQsIHdlIHdpbGwgbG9vayBhdCB0aGUgYHNwZW5kaW5nYCBkYXRhLiAKV2Ugc2VlIHRoZSBgeWVhcmAgY29sdW1uIGhhcyBpbmZvcm1hdGlvbiB0aGF0IAp3ZSBkbyBub3Qgd2FudC4gV2Ugb25seSBjYXJlIGFib3V0IHRoZSB5ZWFyLiAKCmBgYHtyfQpzcGVuZGluZwpgYGAKCkxldCdzIHVzZSB0aGUgYHNlcGFyYXRlKClgIGZ1bmN0aW9uIHdpdGggYGNvbnZlcnQ9VFJVRWAgCnRvIHNlcGFyYXRlIHRoZSBgeWVhcmAgY29sdW1uIGludG8gY29sdW1ucy4gVGhlbiwgd2UgCmludHJvZHVjZSBhbm90aGVyIGBkcGx5cmAgYWN0aW9uIHZlcmI6IGBzZWxlY3QoKWAuIAoKVGhlIHR3byBtb3N0IGJhc2ljIGZ1bmN0aW9ucyBhcmUgYHNlbGVjdCgpYCBhbmQgCmBmaWx0ZXIoKWAgd2hpY2ggc2VsZWN0cyBjb2x1bW5zIGFuZCBmaWx0ZXJzIApyb3dzLCByZXNwZWN0aXZlbHkuIAoKIyMjIDQuIFNlbGVjdCBjb2x1bW5zIHVzaW5nIGBzZWxlY3QoKWAKCkluIHRoZSBgc2VwYXJhdGUoKWAgZnVuY3Rpb24sIHdlIGNyZWF0ZSB0d28KbmV3IGNvbHVtbnMgY2FsbGVkIGB5ZWFyYCBhbmQgYG5hbWVgLiBUaGVuLCAKd2UgYXNrIHRvIHJldHVybiBhbGwgdGhlIGNvbHVtbnMsIGV4Y2VwdCAKYG5hbWVgLiBUbyBzZWxlY3QgYWxsIHRoZSBjb2x1bW5zICpleGNlcHQqIGEgCnNwZWNpZmljIGNvbHVtbiwgdXNlIHRoZSAiLSIgKHN1YnRyYWN0aW9uKSBvcGVyYXRvciAKKGFsc28ga25vd24gYXMgbmVnYXRpdmUgaW5kZXhpbmcpLiAKCmBgYHtyIHdhcm5pbmc9RkFMU0UsbWVzc2FnZT1GQUxTRX0Kc3BlbmRpbmcgPC0gCiAgc3BlbmRpbmcgJT4lIAogIHNlcGFyYXRlKHllYXIsIHNlcD0iX18iLCBpbnRvPWMoInllYXIiLCAibmFtZSIpLCBjb252ZXJ0ID0gVFJVRSkgJT4lIAogIHNlbGVjdCgtbmFtZSkKc3BlbmRpbmcKYGBgCgpUaGUgZnVuY3Rpb24gYHNlbGVjdCgpYCBpcyBtdWNoIG1vcmUgCnBvd2VyZnVsIHRob3VnaC4gVG8gc2VsZWN0IGEgcmFuZ2UgCm9mIGNvbHVtbnMgYnkgbmFtZSwgdXNlIHRoZSAiOiIgKGNvbG9uKSBvcGVyYXRvcgoKYGBge3Igd2FybmluZz1GQUxTRSxtZXNzYWdlPUZBTFNFfQpjb3ZlcmFnZSAlPiUgCiAgc2VsZWN0KHllYXI6dHlwZSkKYGBgCgpUbyBzZWxlY3QgYWxsIGNvbHVtbnMgdGhhdCBzdGFydCB3aXRoIHRoZSAKY2hhcmFjdGVyIHN0cmluZyAidCIsIHVzZSB0aGUgZnVuY3Rpb24gYHN0YXJ0c193aXRoKClgCgpgYGB7ciB3YXJuaW5nPUZBTFNFLG1lc3NhZ2U9RkFMU0V9CmNvdmVyYWdlICU+JSAKICBzZWxlY3Qoc3RhcnRzX3dpdGgoInQiKSkKYGBgCgpTb21lIGFkZGl0aW9uYWwgb3B0aW9ucyB0byBzZWxlY3QgY29sdW1ucyBiYXNlZCAKb24gYSBzcGVjaWZpYyBjcml0ZXJpYSBpbmNsdWRlCgoxLiBgZW5kc193aXRoKClgID0gU2VsZWN0IGNvbHVtbnMgdGhhdCBlbmQgd2l0aCAKYSBjaGFyYWN0ZXIgc3RyaW5nCjIuIGBjb250YWlucygpYCA9IFNlbGVjdCBjb2x1bW5zIHRoYXQgY29udGFpbiAKYSBjaGFyYWN0ZXIgc3RyaW5nCjMuIGBtYXRjaGVzKClgID0gU2VsZWN0IGNvbHVtbnMgdGhhdCBtYXRjaCBhIApyZWd1bGFyIGV4cHJlc3Npb24KNC4gYG9uZV9vZigpYCA9IFNlbGVjdCBjb2x1bW5zIG5hbWVzIHRoYXQgYXJlIApmcm9tIGEgZ3JvdXAgb2YgbmFtZXMKCgojIyMgNS4gU2VsZWN0IHJvd3MgdXNpbmcgYGZpbHRlcigpYAoKTGV0J3Mgc2F5IHdlIHdhbnQgdG8ga25vdyBob3cgbWFueSBwZW9wbGVkIApoYWQgaGVhbHRoIGluc3VyYW5jZSBjb3ZlcmFnZSBpbiBNYXJ5bGFuZD8gCgpGaXJzdCwgd2UgY2FuIGZpbHRlciB0aGUgcm93cyBmb3IgeWVhcnMgaW4gMjAwNy4gCgpgYGB7ciB3YXJuaW5nPUZBTFNFLG1lc3NhZ2U9RkFMU0V9CmNvdmVyYWdlICU+JSAKICBmaWx0ZXIoTG9jYXRpb24gPT0gIk1hcnlsYW5kIikKYGBgCgoqKk5vdGUqKjogeW91IGNhbiB1c2UgdGhlIEJvb2xlYW4gb3BlcmF0b3JzIAooZS5nLiBgPmAsIGA8YCwgYD49YCwgYDw9YCwgYCE9YCwgYCVpbiVgKSAKdG8gY3JlYXRlIGxvZ2ljYWwgdGVzdHMuCgpGb3IgZXhhbXBsZSwgaWYgd2Ugd2FudGVkIG9ubHkgeWVhcnMgCmFmdGVyIDIwMTQsIHdlIGNhbiBhZGQgYSBzZWNvbmQgY3JpdGVyaWEgd2l0aGluIGBmaWx0ZXIoKWA6IAoKYGBge3Igd2FybmluZz1GQUxTRSxtZXNzYWdlPUZBTFNFfQpjb3ZlcmFnZSAlPiUgCiAgZmlsdGVyKExvY2F0aW9uID09ICJNYXJ5bGFuZCIsIAogICAgICAgICB5ZWFyID4gMjAxNCkKYGBgCgojIyMjICgqKSBIYXMgdGhlIG51bWJlciBvZiB1bmluc3VyZWQgaGFzIGluY3JlYXNlZCBvciBkZWNyZWFzZWQgaW4gTWFyeWxhbmQgYmV0d2VlbiAyMDEzIGFuZCAyMDE2PyAgCgpgYGB7ciB3YXJuaW5nPUZBTFNFLG1lc3NhZ2U9RkFMU0V9CmNvdmVyYWdlICU+JSAKICBmaWx0ZXIoTG9jYXRpb24gPT0gIk1hcnlsYW5kIiwgCiAgICAgICAgIHR5cGUgPT0gIlVuaW5zdXJlZCIpCmBgYAoKV2hhdCBoYXBwZW5lZCBiZXR3ZWVuIDIwMTMgYW5kIDIwMTQ/ICAgCgpbUHJvYmFibHkgdGhpcyBpcyBkdWUgdG8gQUNBXShodHRwczovL2VuLndpa2lwZWRpYS5vcmcvd2lraS9QYXRpZW50X1Byb3RlY3Rpb25fYW5kX0FmZm9yZGFibGVfQ2FyZV9BY3QpCgojIyMgNi4gQXJyYW5nZSBvciByZS1vcmRlciByb3dzIHVzaW5nIGBhcnJhbmdlKClgIAoKTm93LCBsZXQncyBzYXkgd2Ugd2FudCB0byBzZWUgdGhlIHN0YXRlcyBvcmRlcmVkIGZyb20gCmxvd2VzdCB0byBoaWdoZXN0IGB0b3RfY292ZXJhZ2VgLgoKVG8gYXJyYW5nZSAob3IgcmUtb3JkZXIpIHJvd3MgYnkgYSBwYXJ0aWN1bGFyIApjb2x1bW4geW91J2xsIHVzZSB0aGUgYGFycmFuZ2UoKWAgZnVuY3Rpb246CgpgYGB7ciB3YXJuaW5nPUZBTFNFLG1lc3NhZ2U9RkFMU0V9CmNvdmVyYWdlICU+JSAKICAgIGFycmFuZ2UodG90X2NvdmVyYWdlKQpgYGAKCgojIyMjICgqKSBJbiAyMDE2LCB3aGF0IHdlcmUgdGhlIHRvcCB0aHJlZSBzdGF0ZXMgd2l0aCB0aGUgbGFyZ2VzdCBgRW1wbG95ZXJgIHR5cGUgb2YgaGVhbHRoY2FyZSBjb3ZlcmFnZT8gCgoqKkhpbnQqKjogdXNlIHRoZSBgZGVzYygpYCBmdW5jdGlvbiBpbnNpZGUgb2YKYGFycmFuZ2UoKWAgdG8gb3JkZXIgcm93cyBpbiBhIGRlc2NlbmRpbmcgb3JkZXIuIAoKYGBge3Igd2FybmluZz1GQUxTRSxtZXNzYWdlPUZBTFNFfQpjb3ZlcmFnZSAlPiUgCiAgZmlsdGVyKExvY2F0aW9uICE9ICJVbml0ZWQgU3RhdGVzIiwgeWVhciA9PSAyMDE2LCB0eXBlID09ICJFbXBsb3llciIpICU+JSAKICBhcnJhbmdlKGRlc2ModG90X2NvdmVyYWdlKSkgJT4lIAogIGhlYWQobj0zKQpgYGAKCgojIyMgNy4gSm9pbiB0d28gZGF0YXNldHMgdXNpbmcgYGpvaW4oKWAgIAoKCkhlcmUsIHdlJ3JlIGdvaW5nIHRvIGRlbW9uc3RyYXRlIGhvdyB0byAKam9pbiB0d28gZGF0YXNldHMgdXNpbmcgc2VyaWVzIG9mIGBqb2luKClgIGZ1bmN0aW9uLCBpbmNsdWRpbmcgCmBsZWZ0X2pvaW4oKWAsIGByaWdodF9qb2luKClgLCBgaW5uZXJfam9pbigpYCwgLi4uICAKClVwIHVudGlsIG5vdywgd2UgaGF2ZSBiZWVuIHdvcmtpbmcgd2l0aCB0aHJlZQpkYXRhc2V0cyBgY292ZXJhZ2VgIGFuZCBgc3BlbmRpbmdgIHNlcGFyYXRlbHkuIApOZXh0LCB3ZSB3aWxsIGNvbWJpbmUgdGhlc2UgdG9nZXRoZXIuICAKCklmIHdlIHdhbnQgdG8gY29tYmluZSwgc2F5LCBgY292ZXJhZ2VgIGFuZCBgc3BlbmRpbmdgIAp0b2dldGhlciwgd2UgaGF2ZSB0byBkZWNpZGUgYSBmZXcgdGhpbmdzLiBCb3RoIApzaGFyZSBhIGBMb2NhdGlvbmAgY29sdW1uIGFuZCBhIGB5ZWFyYCBjb2x1bW4uIApIb3dldmVyLCB0aGUgcmFuZ2Ugb2YgYHllYXJzYCBpcyBkaWZmZXJlbnQgYmV0d2VlbgpkYXRhc2V0cy4gCgpgYGB7cn0KdGFibGUoY292ZXJhZ2UkeWVhcikKdGFibGUoc3BlbmRpbmckeWVhcikKYGBgCgpEbyB3ZSB3YW50IGEgZGF0YXNldCB3aXRoIGFsbCB0aGUgeWVhcnMgYXZhaWxhYmxlCm9yIG9ubHkgYSBwb3J0aW9uIG9mIGl0PyBCZWNhdXNlIHRoZXJlIGlzIHNwZW5kaW5nCmluZm9ybWF0aW9uIGZyb20gMTk5MS0yMDE0LCAKYW5kIGNvdmVyYWdlIGluZm9ybWF0aW9uIGZyb20gMjAxMy0yMDE2LgoKYGRwbHlyYCBoYXMgYSBsaXN0IG9mIGBqb2luYCBmdW5jdGlvbnMgdGhhdCBhcmUgCnVzZWZ1bCB0byBjb21iaW5lIGRhdGFzZXRzLiBUbyByZWFkIG1vcmUgYWJvdXQgdGhlbSwgCkplbm55IEJyeWFuIGhhcyBjcmVhdGVkIGEgbmljZSAKW2NoZWF0c2hlZXRdKGh0dHA6Ly9zdGF0NTQ1LmNvbS9iaXQwMDFfZHBseXItY2hlYXRzaGVldC5odG1sKS4gCgpJZiB3ZSBsb29rIGF0IHRoZSBoZWxwIGZpbGUKYGBge3J9Cj9kcGx5cjo6am9pbgpgYGAKCldlIHNlZSB0aGVyZSBhcmUgc2V2ZXJhbCBvcHRpb25zIGZvciB1cyB0byBwaWNrIGZyb20uIApMZXQncyB0cnkgb25lIG91dC4gV2UnbGwgc3RhcnQgd2l0aCBgbGVmdF9qb2luKClgCmFuZCBzZWUgd2hhdCB0aGF0IGRvZXMuIAoKYGBge3J9CmhjIDwtIGxlZnRfam9pbihjb3ZlcmFnZSwgc3BlbmRpbmcsIGJ5ID0gYygiTG9jYXRpb24iLCAieWVhciIpKQpoZWFkKGhjKQp0YWlsKGhjKQpgYGAKCldoYXQgZGlkIGl0IGRvPyBXZSBzZWUgdGhhdCB0aGUgbmV3IGBoY2AgZGF0YXNldAppbmNsdWRlcyBhbGwgdGhlIHllYXJzIGZyb20gMjAxMy0yMDE2IChhcyB0aGF0IAppcyB0aGUgcmFuZ2Ugb2YgeWVhcnMgaW4gYGNvdmVyYWdlYCksIGJ1dCBiZWNhdXNlCnRoZSBgc3BlbmRpbmdgIGRhdGFzZXQgb25seSBnb2VzIHRvIDIwMTQsIHRoZSAKYHRvdF9zcGVuZGluZ2AgaXMgcmVwb3J0ZWQgYXMgTkEgZm9yIHllYXJzIDIwMTUgYW5kCjIwMTYuIAoKIyMjIyBXaGF0IGFib3V0IGEgYHJpZ2h0X2pvaW4oKWA/IApgYGB7cn0KaGMgPC0gcmlnaHRfam9pbihjb3ZlcmFnZSwgc3BlbmRpbmcsIGJ5ID0gYygiTG9jYXRpb24iLCAieWVhciIpKQpoZWFkKGhjKQp0YWlsKGhjKQpgYGAKCkhlcmUsIHdlIHNlZSBldmVyeSByb3cgaW4gdGhlIHNwZW5kaW5nIGRhdGFzZXQgaXMgCnRoZXJlLCBidXQgd2l0aCBOQXMgZm9yIHRoZSB5ZWFycyB0aGF0IHRoZXJlIHdhcyBubyAKY292ZXJhZ2UgZGF0YS4gCgpUaGVyZSBpcyBhbHNvIGEgYGZ1bGxfam9pbigpYCBhbmQgCmBpbm5lcl9qb2luKClgLiBJZiB3ZSB3YW50IHRoZSBpbnRlcnNlY3Rpb24gb2YgCmB5ZWFyc2AgZnJvbSBgY292ZXJhZ2VgIGFuZCBgc3BlbmRpbmdgIChtZWFuaW5nIG9ubHkgCjIwMTMgYW5kIDIwMTQpLCB3ZSBzaG91bGQgdXNlIGBpbm5lcl9qb2luKClgLiAKCmBgYHtyfQpoYyA8LSBpbm5lcl9qb2luKGNvdmVyYWdlLCBzcGVuZGluZywgYnkgPSBjKCJMb2NhdGlvbiIsICJ5ZWFyIikpCmhlYWQoaGMpCnRhaWwoaGMpCmBgYAoKWWVzLCB0aGF0J3Mgd2hhdCB3ZSB3YW50ISAKCk5leHQsIGlmIHdlIGFyZSBvbmx5IGludGVyZXN0ZWQgaW4gbG9va2luZyBhdCBVUyAKc3RhdGVzLCB3ZSBjYW4gcmVtb3ZlIHRoZSByb3dzIGNvcnJlc3BvbmRpbmcgdG8gCnRoZSBgTG9jYXRpb24gPT0gIlVuaXRlZCBTdGF0ZXMiYAoKYGBge3J9CmhjIDwtIGhjICU+JSAKICBmaWx0ZXIoTG9jYXRpb24gIT0gIlVuaXRlZCBTdGF0ZXMiKQpgYGAKCkFub3RoZXIgcHJvYmxlbSBpcyB0aGF0IGluc2lkZSBvdXIgYGhjYCAKZGF0YXNldCwgd2UgaGF2ZSBzZWVuIHRoZXJlIGFyZSAKbXVsdGlwbGUgYHR5cGVzYCBvZiBoZWFsdGhjYXJlIGNvdmVyYWdlLgoKYGBge3J9CnRhYmxlKGhjJHR5cGUpCmBgYAoKVGhlIGB0b3RhbGAgdHlwZSBpcyBub3QgcmVhbGx5IGEgZm9ybWFsIHR5cGUgb2YKaGVhbHRoY2FyZSBjb3ZlcmFnZS4gSXQgcmVhbGx5IHJlcHJlc2VudHMganVzdCAKdGhlIHRvdGFsIG51bWJlciBvZiBwZW9wbGUgaW4gdGhlIHN0YXRlLiBUaGlzIGlzIAp1c2VmdWwgaW5mb3JtYXRpb24gYW5kIHdlIGNhbiBpbmNsdWRlIGl0IGFzIGEgCmNvbHVtbiBjYWxsZWQgYHRvdF9wb3BgLiBIb3cgY2FuIHdlIGRvIHRoaXM/IAoKV2VsbCwgb25lIHdheSB3b3VsZCBiZSB0byB1c2UgdGhlIGBqb2luYCBmdW5jdGlvbnMKYWdhaW4gaW4gYGRwbHlyYC4gCgpgYGB7cn0KcG9wIDwtIGhjICU+JSAKICBmaWx0ZXIodHlwZSA9PSAiVG90YWwiKSAlPiUgCiAgc2VsZWN0KExvY2F0aW9uLCB5ZWFyLCB0b3RfY292ZXJhZ2UpCnBvcAoKaGMgPC0gaGMgJT4lIAogIGZpbHRlcih0eXBlICE9ICJUb3RhbCIpICU+JSAKICBsZWZ0X2pvaW4ocG9wLCBieSA9IGMoIkxvY2F0aW9uIiwgInllYXIiKSkgJT4lIAogIHJlbmFtZSh0b3RfY292ZXJhZ2UgPSB0b3RfY292ZXJhZ2UueCwgdG90X3BvcCA9IHRvdF9jb3ZlcmFnZS55KQpoYwpgYGAKCldlIGNhbiBjaGVjayB0byBtYWtlIHN1cmUgdGhhdCB0aGUgYHRvdGFsYAppcyBubyBsb25nZXIgbGlzdGVkIGFzIGEgYHR5cGVgIG9mIGhlYWx0aGNhcmUKY292ZXJhZ2UuIAoKYGBge3J9CnRhYmxlKGhjJHR5cGUpCmBgYAoKV2UgYXJlIG5vdyByZWFkeSB0byB0cnkgYW5zd2VyaW5nIG91ciBmaXJzdCAKcXVlc3Rpb24gdGhhdCB3ZSBhc2tlZDogCgo+IDEuIElzIHRoZXJlIGEgcmVsYXRpb25zaGlwIGJldHdlZW4gaGVhbHRoY2FyZSBjb3ZlcmFnZSBhbmQgaGVhbHRoY2FyZSBzcGVuZGluZyBpbiB0aGUgVW5pdGVkIFN0YXRlcz8KCkxldCdzIHBpY2sgb3V0IHRoZSBgdHlwZT09RW1wbG95ZXJgIAphbmQgYHllYXI9PTIwMTNgLiAKCmBgYHtyfQpoYy5lbXBsb3llci4yMDEzIDwtIGhjICU+JQogIGZpbHRlcih0eXBlID09ICJFbXBsb3llciIsIHllYXIgPT0gIjIwMTMiKQpwbG90KGhjLmVtcGxveWVyLjIwMTMkdG90X3NwZW5kaW5nLCAKICAgICBoYy5lbXBsb3llci4yMDEzJHRvdF9jb3ZlcmFnZSwgbG9nID0gInh5IiwgCiAgICAgeGxhYiA9ICJzcGVuZGluZyIsIHlsYWIgPSAiY292ZXJhZ2UiKQpgYGAKCldlIHNlZSB0aGVyZSBpcyBhIHN0cm9uZyByZWxhdGlvbnNoaXAuIEhvd2V2ZXIsIAp3ZSBhbHNvIHNlZSB0aGF0IGhlYWx0aGNhcmUgY292ZXJhZ2UgYW5kIHNwZW5kaW5nIAppcyBhbHNvIHN0cm9uZ2x5IHJlbGF0ZWQgdG8gcG9wdWxhdGlvbiBzaXplIAoKYGBge3IsIGZpZy53aWR0aD0xMCwgZmlnLmhlaWdodD00fQpwYXIobWZyb3c9YygxLDIpKQpwbG90KGhjLmVtcGxveWVyLjIwMTMkdG90X3BvcCwgCiAgICAgaGMuZW1wbG95ZXIuMjAxMyR0b3RfY292ZXJhZ2UsIGxvZyA9ICJ4eSIsIAogICAgIHhsYWIgPSAicG9wdWxhdGlvbiBzaXplIiwgeWxhYiA9ICJjb3ZlcmFnZSIpCnBsb3QoaGMuZW1wbG95ZXIuMjAxMyR0b3RfcG9wLCAKICAgICBoYy5lbXBsb3llci4yMDEzJHRvdF9zcGVuZGluZywgbG9nID0gInh5IiwgCiAgICAgeGxhYiA9ICJwb3B1bGF0aW9uIHNpemUiLCB5bGFiID0gInNwZW5kaW5nIikKYGBgCgpUaGlzIG1lYW5zIHdlIG5lZWQgdG8gdGFrZSBpbnRvIGFjY291bnQgdGhlIApwb3B1bGF0aW9uIHNpemUgb2YgZWFjaCBzdGF0ZSB3aGVuIHdlIGFyZSAKY29tcGFyaW5nIHRoZSBoZWFsdGhjYXJlIGNvdmVyYWdlIGFuZCBzcGVuZGluZy4gCgojIyMgOC4gQWRkIGNvbHVtbnMgdXNpbmcgYG11dGF0ZSgpYAoKSW5zdGVhZCBvZiB0aGUgYWJzb2x1dGUgbnVtYmVyIG9mIHBlb3BsZSB3aG8gCmFyZSBjb3ZlcmVkIChgdG90X2NvdmVyYWdlYCksIHdlIHdpbGwgY2FsY3VsYXRlCnRoZSBwcm9wb3J0aW9uIG9mIHBlb3BsZSB3aG8gYXJlIGNvdmVyYWdlIGluIAplYWNoIHN0YXRlLCB5ZWFyIGFuZCB0eXBlLiAKCkZvciB0aGlzLCB3ZSB3aWxsIHVzZSB0aGUgYG11dGF0ZSgpYCBmdW5jdGlvbiAKaW4gYGRwbHlyYC4gCgpgYGB7cn0KaGMgPC0gaGMgJT4lIAogICAgbXV0YXRlKHByb3BfY292ZXJhZ2UgPSB0b3RfY292ZXJhZ2UvdG90X3BvcCkgCmhjCmBgYAoKV2UgbmVlZCB0byBhZGQgYW5vdGhlciBjb2x1bW4gdG8gb3VyIGRhdGFzZXQuCldlIHdpbGwgYWRkIHRoZSBzcGVuZGluZyBwZXIgY2FwaXRhIChvciBzcGVuZGluZyAKcGVyIHBlcnNvbikgaW4gZG9sbGFycyBhbmQgbmFtZSB0aGlzIGNvbHVtbiAKYHNwZW5kaW5nX2NhcGl0YWAuIAoKIyMjIyBIb3cgd2Ugd2lsbCBkbyB0aGlzPwoKVGhlIGB0b3Rfc3BlbmRpbmdgIGNvbHVtbiBpcyByZXBvcnRlZCAKaW4gbWlsbGlvbnMgKDFlNikuIFRoZXJlZm9yZSwgdG8gY2FsY3VsYXRlIApgc3BlbmRpbmdfY2FwaXRhYCB3ZSB3aWxsIG5lZWQgdG8gYWRqdXN0IGZvciB0aGlzCnNjYWxpbmcgZmFjdG9yIHRvIHJlcG9ydCBpdCBvbiB0aGUgb3JpZ2luYWwgc2NhbGUKKGp1c3QgZG9sbGFycykgYW5kIHRoZW4gZGl2aWRlIGJ5IGB0b3RfcG9wYC4KCmBgYHtyfQpoYyA8LSBoYyAlPiUgCiAgbXV0YXRlKHNwZW5kaW5nX2NhcGl0YSA9ICh0b3Rfc3BlbmRpbmcqMWU2KSAvIHRvdF9wb3ApCmBgYAoKTm93IHdlIGFyZSByZWFkeSB0byBnbyBiYWNrIHRvIG91ciBmaXJzdCBxdWVzdGlvbi4KCj4gMS4gSXMgdGhlcmUgYSByZWxhdGlvbnNoaXAgYmV0d2VlbiBoZWFsdGhjYXJlIGNvdmVyYWdlIGFuZCBoZWFsdGhjYXJlIHNwZW5kaW5nIGluIHRoZSBVbml0ZWQgU3RhdGVzPyAKCmBgYHtyfQpoYy5lbXBsb3llci4yMDEzIDwtIGhjICU+JQogIGZpbHRlcih0eXBlID09ICJFbXBsb3llciIsIHllYXIgPT0gIjIwMTMiKQpwbG90KGhjLmVtcGxveWVyLjIwMTMkc3BlbmRpbmdfY2FwaXRhLCAKICAgICBoYy5lbXBsb3llci4yMDEzJHByb3BfY292ZXJhZ2UsIGxvZyA9ICJ4eSIsIAogICAgIHhsYWIgPSAic3BlbmRpbmcgcGVyIGNhcGl0YSIsIAogICAgIHlsYWIgPSAicHJvcG9ydGlvbiBvZiBFbXBsb3llciBjb3ZlcmFnZSIpCmBgYAoKWWVzLCBpdCBsb29rcyBsaWtlIHRoZXJlIGlzIGEgcmVsYXRpb25zaGlwIGZvciAKYEVtcGxveWVyYCBoZWFsdGhjYXJlIGNvdmVyYWdlIGluIDIwMTMuIAoKV2Ugd2lsbCBjb250aW51ZSB0byBleHBsb3JlIHRoZSBvdGhlcgp0eXBlcyBvZiBjb3ZlcmFnZXMgbGF0ZXIgb24uIEZvciBub3csIHdlIApnZXQgYmFjayB0byB0byBsZWFybmluZyBtb3JlIGFjdGlvbiB2ZXJicyAKaW4gYGRwbHlyYC4gCgpPdXIgc2Vjb25kIHF1ZXN0aW9uIHRoYXQgd2Ugd2VyZSBpbnRlcmVzdGVkIAppbiB3YXM6IAoKPiAyLiBXaGljaCBVUyBzdGF0ZXMgc3BlbmQgdGhlIG1vc3QgYW5kIHdoaWNoIHNwZW5kIHRoZSBsZWFzdCBvbiBoZWFsdGhjYXJlPyBIb3cgZG9lcyB0aGUgc3BlbmRpbmcgZGlzdHJpYnV0aW9uIGNoYW5nZSBhY3Jvc3MgZ2VvZ3JhcGhpYyByZWdpb25zIGluIHRoZSBVbml0ZWQgU3RhdGVzPwoKVG8gYW5zd2VyIHRoZXNlIHF1ZXN0aW9ucywgd2UgbmVlZCB0byBsZWFybiBob3cgCnRvIGNhbGN1bGF0ZSBzdW1tYXJ5IHN0YXRpc3RpY3MgaW4gb3VyIGRhdGEuIAoKIyMjIDkuICBDcmVhdGUgc3VtbWFyaWVzIG9mIGNvbHVtbnMgdXNpbmcgYHN1bW1hcml6ZSgpYAoKVGhlIGBzdW1tYXJpemUoKWAgZnVuY3Rpb24gaW4gYGRwbHlyYCAKd2lsbCBjcmVhdGUgc3VtbWFyeSBzdGF0aXN0aWNzIGZvciBhIGdpdmVuIApjb2x1bW4gaW4gdGhlIGRhdGEgZnJhbWUgCnN1Y2ggYXMgZmluZGluZyB0aGUgbWF4LCBtaW4sIGF2ZXJhZ2UuIApGb3IgZXhhbXBsZSwgdG8gY29tcHV0ZSB0aGUgYXZlcmFnZSBzcGVuZGluZyAKcGVyIGNhcGl0YSwgd2UgY2FuIGFwcGx5IHRoZSBgbWVhbigpYCBmdW5jdGlvbiAKdG8gdGhlIGNvbHVtbiBgc3BlbmRpbmdfY2FwdGlhYCBhbmQgY2FsbCB0aGUgCnN1bW1hcnkgdmFsdWUgYGF2Z19zcGVuZGluZ19jYXBpdGFgLiAKCmBgYHtyfQpoYyAlPiUgCiAgc3VtbWFyaXplKGF2Z19zcGVuZGluZ19jYXBpdGEgPSBtZWFuKHNwZW5kaW5nX2NhcGl0YSkpCmBgYAoKVGhlcmUgYXJlIG1hbnkgb3RoZXIgc3VtbWFyeSBzdGF0aXN0aWNzIHlvdSAKY291bGQgY29uc2lkZXIgc3VjaCBgc2QoKWAsIGBtaW4oKWAsIGBtZWRpYW4oKWAsIApgbWVhbigpYCwgYHN1bSgpYCwgYG4oKWAgKHJldHVybnMgdGhlIGxlbmd0aCBvZiB2ZWN0b3IpLCAKYGZpcnN0KClgIChyZXR1cm5zIGZpcnN0IHZhbHVlIGluIHZlY3RvciksIApgbGFzdCgpYCAocmV0dXJucyBsYXN0IHZhbHVlIGluIHZlY3RvcikgYW5kIApgbl9kaXN0aW5jdCgpYCAobnVtYmVyIG9mIGRpc3RpbmN0IHZhbHVlcyBpbiB2ZWN0b3IpLiAKCkFsc28gbm90ZSwgdGhpcyBpcyB0aGUgYXZlcmFnZSBhY3Jvc3MgYWxsIHN0YXRlcywKYW5kIGFsbCB5ZWFycy4gVGhpcyBpcyBub3QgdmVyeSBpbmZvcm1hdGl2ZS4gCgpJZiB5b3UgcmVjYWxsLCBvdXIgcXVlc3Rpb24gYXNrZWQgYWJvdXQgCl93aGljaCBzdGF0ZXNfIHNwZW50IHRoZSBtb3N0LCBzbyB3ZSB3YW50IAphbiBhdmVyYWdlIHNwZW5kaW5nIHBlciBjYXBpdGEgZm9yIGVhY2ggc3RhdGUuIAoKRm9yIHRoaXMsIHdlIG5lZWQgdG8gaW50cm9kdWNlIGFub3RoZXIgZnVuY3Rpb24gaW4gCmBkcGx5cmAgY2FsbGVkIGBncm91cF9ieSgpYC4gCgojIyMgMTAuIEdyb3VwIG9wZXJhdGlvbnMgdXNpbmcgYGdyb3VwX2J5KClgCgpUaGUgYGdyb3VwX2J5KClgIHZlcmIgaXMgYW5kIGluY3JlZGlibHkgcG93ZXJmdWwKZnVuY3Rpb24gaW4gYGRwbHlyYC4gQXMgd2UgbWVudGlvbmVkIGJlZm9yZQppdCdzIHJlbGF0ZWQgdG8gY29uY2VwdCBvZiAic3BsaXQtYXBwbHktY29tYmluZSIuIAoKSW4gb3VyIGV4YW1wbGUgYWJvdmUsIHdlIHdhbnQgdG8gc3BsaXQgdGhlIGRhdGEgCmZyYW1lIGJ5IHNvbWUgdmFyaWFibGUgKGUuZy4gYExvY2F0aW9uYCksIAphcHBseSBhIGZ1bmN0aW9uIHRvIHRoZSBpbmRpdmlkdWFsIApkYXRhIGZyYW1lcyAoYG1lYW5gKSBhbmQgdGhlbiBjb21iaW5lIHRoZSBvdXRwdXQKYmFjayBpbnRvIGEgc3VtbWFyeSBkYXRhIGZyYW1lLiAKCkxldCdzIHNlZSBob3cgdGhhdCB3b3VsZCBsb29rCgpgYGB7cn0KaGMgJT4lIAogIGdyb3VwX2J5KExvY2F0aW9uKSAlPiUKICBzdW1tYXJpemUoYXZnX3NwZW5kaW5nX2NhcGl0YSA9IG1lYW4oc3BlbmRpbmdfY2FwaXRhKSkKYGBgCgpUaGF0J3MgYmV0dGVyLiBIZXJlIHdlIGFyZSBhdmVyYWdpbmcgYWNyb3NzIHRoZQp5ZWFycyAyMDEzIGFuZCAyMDE0LiAKCiMjIyMgKCopIFdoYXQgYXJlIHRoZSB0b3AgMyBzdGF0ZXMgdGhhdCBoYXZlIHRoZSBsYXJnZXN0IGF2ZXJhZ2Ugc3BlbmRpbmcgcGVyIGNhcGl0YT8gV2hhdCBhYm91dCB0aGUgdG9wIDMgc3RhdGVzIHdpdGggdGhlIHNtYWxsZXN0IGF2ZXJhZ2Ugc3BlbmRpbmcgcGVyIGNhcGl0YT8gCgpgYGB7cn0KIyBzbWFsbGVzdCAKaGMgJT4lIAogIGdyb3VwX2J5KExvY2F0aW9uKSAlPiUKICBzdW1tYXJpemUoYXZnX3NwZW5kaW5nX2NhcGl0YSA9IG1lYW4oc3BlbmRpbmdfY2FwaXRhKSkgJT4lIAogIGFycmFuZ2UoYXZnX3NwZW5kaW5nX2NhcGl0YSkgJT4lIAogIGhlYWQobj0zKQoKIyBsYXJnZXN0IApoYyAlPiUgCiAgZ3JvdXBfYnkoTG9jYXRpb24pICU+JQogIHN1bW1hcml6ZShhdmdfc3BlbmRpbmdfY2FwaXRhID0gbWVhbihzcGVuZGluZ19jYXBpdGEpKSAlPiUgCiAgYXJyYW5nZShkZXNjKGF2Z19zcGVuZGluZ19jYXBpdGEpKSAlPiUgCiAgaGVhZChuPTMpCmBgYAoKIyMjIyAoKikgSG93IGRvZXMgdGhlIHNwZW5kaW5nIGRpc3RyaWJ1dGlvbiBjaGFuZ2UgYWNyb3NzIGdlb2dyYXBoaWMgcmVnaW9ucyBpbiB0aGUgVW5pdGVkIFN0YXRlcz8gCgoqKkhpbnQqKjogQ2FsY3VsYXRlIHRoZSBtZWFuIGFuZCBzdGFuZGFyZCBkZXZpYXRpb24gb2YKc3BlbmRpbmcgcGVyIGNhcGl0YSBmb3IgZWFjaCBnZW9ncmFwaGljIHJlZ2lvbiBpbiB0aGUgVVMuIAoKYGBge3J9CmhjICU+JSAKICBncm91cF9ieShyZWdpb24pICU+JQogIHN1bW1hcml6ZShhdmdfc3BlbmRpbmdfY2FwaXRhID0gbWVhbihzcGVuZGluZ19jYXBpdGEpLCAKICAgICAgICAgICAgc2Rfc3BlbmRpbmdfY2FwaXRhID0gc2Qoc3BlbmRpbmdfY2FwaXRhKSkKYGBgCgpBbm90aGVyIHdheSB0byB2aXN1YWxpemUgZGlzdHJpYnV0aW9ucyBpcyB0byB1c2UgYm94cGxvdHMuIAoKQ3JlYXRlIGZvdXIgYm94cGxvdHMgcmVwcmVzZW50aW5nIHRoZSBzcGVuZGluZyBwZXIgY2FwaXRhIApkaXN0cmlidXRpb24gZm9yIGVhY2ggb2YgdGhlIGZvdXIgcmVnaW9ucyB1c2luZyAKdGhlIGBib3hwbG90KClgIGZ1bmN0aW9uIGluIFIuCgpgYGB7cn0KYm94cGxvdChoYyRzcGVuZGluZ19jYXBpdGEgfiBoYyRyZWdpb24pCmBgYAoKTm93IHRoYXQgd2UgaGF2ZSBvdXIgZGF0YSBpbiBhIGB0aWR5YCBmb3JtYXQsIG5leHQsIAp3ZSB3aWxsIGxlYXJuIGFib3V0IGhvdyB0byBkbyB0aGlzIHVzaW5nIHRoZSAKYGdncGxvdDJgIFIgcGFja2FnZSBpbiB0aGUgYHRpZHl2ZXJzZWAuIAoKIyBEYXRhIFZpc3VhbGl6YXRpb24gIAoKQXMgeW91IGhhdmUgYWxyZWFkeSBzZWVuLCB0aGVyZSBhcmUgbWFueSBmdW5jdGlvbnMgYXZhaWxhYmxlCmluIGJhc2UgUiB0aGF0IGNhbiBjcmVhdGUgcGxvdHMgKGUuZy4gYHBsb3QoKWAsIGBib3hwbG90KClgKS4gCk90aGVycyBpbmNsdWRlOiBgaGlzdCgpYCwgYHFxcGxvdCgpYCwgZXRjLiBUaGVzZSAKZnVuY3Rpb25zIGFyZSBncmVhdCBiZWNhdXNlIHRoZXkgY29tZSB3aXRoIGEgYmFzaWMgaW5zdGFsbGF0aW9uIApvZiBSIGFuZCBjYW4gYmUgcXVpdGUgcG93ZXJmdWwgd2hlbiB5b3UgbmVlZCBhIHF1aWNrIHZpc3VhbGl6YXRpb24gCm9mIHNvbWV0aGluZyB3aGVuIHlvdSBhcmUgZXhwbG9yaW5nIGRhdGEuIAoKV2UgYXJlIGNob29zaW5nIHRvIGludHJvZHVjZSBgZ2dwbG90MmAgYmVjYXVzZSwgaW4gb3VyIApvcGluaW9uLCBpdCdzIG9uZSBvZiB0aGUgc2ltcGxlc3Qgd2F5cyBmb3IgYmVnaW5uZXJzIHRvIApjcmVhdGUgcmVsYXRpdmVseSBjb21wbGljYXRlZCBwbG90cyB0aGF0IGFyZSBpbnR1aXRpdmUgCmFuZCBhZXN0aGV0aWNhbGx5IHBsZWFzaW5nLiAKCiMjIFRoZSBgZ2dwbG90MmAgUiBwYWNrYWdlCgpUaGUgcmVhc29ucyBbYGdncGxvdDJgXShodHRwOi8vZ2dwbG90Mi50aWR5dmVyc2Uub3JnKSAKaXMgZ2VuZXJhbGx5IGludHVpdGl2ZSBmb3IgYmVnaW5uZXJzIGlzIHRoZSB1c2Ugb2YgCltncmFtbWFyIG9mIGdyYXBoaWNzXShodHRwOi8vdml0YS5oYWQuY28ubnovcGFwZXJzL2xheWVyZWQtZ3JhbW1hci5odG1sKSAKb3IgdGhlIGBnZ2AgaW4gYGdncGxvdDJgLiBUaGUgaWRlYSBpcyB0aGF0IHlvdSBjYW4gY29uc3RydWN0Cm1hbnkgc2VudGVuY2VzIGJ5IGxlYXJuaW5nIGp1c3QgYSBmZXcgbm91bnMsIGFkamVjdGl2ZXMsCmFuZCB2ZXJicy4gVGhlcmUgYXJlIHNwZWNpZmljICJ3b3JkcyIgdGhhdCB3ZSB3aWxsIG5lZWQgdG8gCmxlYXJuIGFuZCBvbmNlIHdlIGRvLCB5b3Ugd2lsbCBiZSBhYmxlIHRvIGNyZWF0ZSAKKG9yICJ3cml0ZSIpIGh1bmRyZWRzIG9mIGRpZmZlcmVudCBwbG90cy4gCgpUaGUgY3JpdGljYWwgcGFydCB0byBtYWtpbmcgZ3JhcGhpY3MgdXNpbmcgYGdncGxvdDJgIGlzIHRoZSAKZGF0YSBuZWVkcyB0byBiZSBpbiBhIF90aWR5XyBmb3JtYXQuIEdpdmVuIHRoYXQgd2UgaGF2ZSAKanVzdCBzcGVuZCB0aGUgbGFzdCB0d28gbGVjdHVyZXMgbGVhcm5pbmcgYWJvdXQgaG93IHRvIAp3b3JrIHdpdGggX3RpZHlfIGRhdGEsIHdlIGFyZSBwcmltZWQgdG8gdGFrZSAKYWR2YW50YWdlIG9mIGFsbCB0aGF0IGBnZ3Bsb3QyYCBoYXMgdG8gb2ZmZXIhIAoKV2Ugd2lsbCBzaG93IGhvdyBpdCdzIGVhc3kgdG8gcGlwZSBfdGlkeV8gZGF0YQoob3V0cHV0KSBhcyBpbnB1dCB0byBvdGhlciBmdW5jdGlvbnMgdGhhdCBjcmVhdGVzCnBsb3RzLiBUaGlzIGFsbCB3b3JrcyBiZWNhdXNlIHdlIGFyZSB3b3JraW5nIAp3aXRoaW4gdGhlIF90aWR5dmVyc2VfLiAKCiMjIyMgYGdncGxvdDJgIGNoZWF0c2hlZXQKClRoZSBbY2hlYXRzaGVldF0oaHR0cHM6Ly93d3cucnN0dWRpby5jb20vd3AtY29udGVudC91cGxvYWRzLzIwMTUvMDMvZ2dwbG90Mi1jaGVhdHNoZWV0LnBkZikgCmxvb2tzIGxpa2UgdGhlIGZvbGxvd2luZzoKYGBge3IsIGVjaG89RkFMU0V9CmtuaXRyOjppbmNsdWRlX2dyYXBoaWNzKCIuL2RvYy9nZ3Bsb3QyY2hlYXRzaGVldC5QTkciKQoKYGBgCgoKIyMjIDEuIFdoYXQgaXMgdGhlIGBnZ3Bsb3QoKWAgZnVuY3Rpb24/IAoKQXMgZXhwbGFpbmVkIGJ5IEhhZGxleSBXaWNraGFtOiAKCj4gdGhlIGdyYW1tYXIgdGVsbHMgdXMgdGhhdCBhIHN0YXRpc3RpY2FsIGdyYXBoaWMgaXMgYSBtYXBwaW5nIGZyb20gZGF0YSB0byBhZXN0aGV0aWMgYXR0cmlidXRlcyAoY29sb3VyLCBzaGFwZSwgc2l6ZSkgb2YgZ2VvbWV0cmljIG9iamVjdHMgKHBvaW50cywgbGluZXMsIGJhcnMpLiBUaGUgcGxvdCBtYXkgYWxzbyBjb250YWluIHN0YXRpc3RpY2FsIHRyYW5zZm9ybWF0aW9ucyBvZiB0aGUgZGF0YSBhbmQgaXMgZHJhd24gb24gYSBzcGVjaWZpYyBjb29yZGluYXRlcyBzeXN0ZW0uCgojIyMjIGBnZ3Bsb3QyYCBUZXJtaW5vbG9neSAKKiAqKmdncGxvdCoqIC0gdGhlIG1haW4gZnVuY3Rpb24gd2hlcmUgeW91IHNwZWNpZnkgdGhlIGRhdGEgc2V0IGFuZCB2YXJpYWJsZXMgdG8gcGxvdCAodGhpcyBpcyB3aGVyZSB3ZSBkZWZpbmUgdGhlIGB4YCBhbmQKYHlgIHZhcmlhYmxlIG5hbWVzKQoqICoqZ2VvbXMqKiAtIGdlb21ldHJpYyBvYmplY3RzCiAgICAqIGUuZy4gYGdlb21fcG9pbnQoKWAsIGBnZW9tX2JhcigpYCwgYGdlb21fbGluZSgpYCwgYGdlb21faGlzdG9ncmFtKClgCiogKiphZXMqKiAtIGFlc3RoZXRpY3MKICAgICogc2hhcGUsIHRyYW5zcGFyZW5jeSwgY29sb3IsIGZpbGwsIGxpbmV0eXBlCiogKipzY2FsZXMqKiAtIGRlZmluZSBob3cgeW91ciBkYXRhIHdpbGwgYmUgcGxvdHRlZAogICAgKiBjb250aW51b3VzLCBkaXNjcmV0ZSwgbG9nLCBldGMKClRoZXJlIGFyZSB0aHJlZSB3YXlzIHRvIGluaXRpYWxpemUgYSBgZ2dwbG90KClgIG9iamVjdC4gCgpBbiBlbXB0eSBnZ3Bsb3Qgb2JqZWN0CmBgYHtyfQpsaWJyYXJ5KGdncGxvdDIpCnAgPC0gZ2dwbG90KCkgICAgICAgICAKYGBgCgpBIGdncGxvdCBvYmplY3QgYXNzb2NpYXRlZCB3aXRoIGEgZGF0YXNldApgYGB7cn0KcCA8LSBoYyAlPiUgCiAgICAgIGZpbHRlcih5ZWFyPT0yMDE0KSAlPiUgCiAgICAgIGdncGxvdCgpCmBgYApvciBhIGdncGxvdCBvYmplY3Qgd2l0aCBhIGRhdGFzZXQgYW5kIGB4YCBhbmQgYHlgIGRlZmluZWQKCmBgYHtyfQpwIDwtIGhjICU+JSAKICAgICAgZmlsdGVyKHllYXI9PTIwMTQpICU+JSAKICAgICAgZ2dwbG90KGFlcyh4ID0gc3BlbmRpbmdfY2FwaXRhLCB5ID0gcHJvcF9jb3ZlcmFnZSkpCmBgYAoKYGBge3IsIGV2YWwgPSBGQUxTRX0KcApgYGAKCiMjIyAyLiBDcmVhdGUgc2NhdHRlciBwbG90cyB1c2luZyBgZ2VvbV9wb2ludCgpYCAKClRoZSBmdW5jdGlvbiBgYWVzKClgIGlzIGFuIGFlc3RoZXRpYyBtYXBwaW5nIApmdW5jdGlvbiBpbnNpZGUgdGhlIGBnZ3Bsb3QoKWAgb2JqZWN0LiBXZSAKdXNlIHRoaXMgZnVuY3Rpb24gdG8gc3BlY2lmeSBwbG90IGF0dHJpYnV0ZXMgCihlLmcuIGB4YCBhbmQgYHlgIHZhcmlhYmxlIG5hbWVzKSB0aGF0IAp3aWxsIG5vdCBjaGFuZ2UgYXMgd2UgYWRkIG1vcmUgbGF5ZXJzLiAgCgpBbnl0aGluZyB0aGF0IGdvZXMgaW4gdGhlIGBnZ3Bsb3QoKWAgb2JqZWN0IGJlY29tZXMKYSBnbG9iYWwgc2V0dGluZy4gRnJvbSB0aGVyZSwgd2UgdXNlIHRoZSBgZ2VvbWAKb2JqZWN0cyB0byBhZGQgbW9yZSBsYXllcnMgdG8gdGhlIGJhc2UgYGdncGxvdCgpYCAKb2JqZWN0LiBUaGVzZSB3aWxsIGRlZmluZSB3aGF0IHdlIGFyZSBpbnRlcmVzdGVkIGluIAppbGx1c3RyYXRpbmcgdXNpbmcgdGhlIGRhdGEuICAKCklmIHlvdSByZWNhbGwsIG91ciBmaXJzdCBxdWVzdGlvbiB0aGF0IHdlIHdlcmUKaW50ZXJlc3RlZCBpbiB3YXMgCgo+IDEuIElzIHRoZXJlIGEgcmVsYXRpb25zaGlwIGJldHdlZW4gaGVhbHRoY2FyZSBjb3ZlcmFnZSBhbmQgaGVhbHRoY2FyZSBzcGVuZGluZyBpbiB0aGUgVW5pdGVkIFN0YXRlcz8KCkJlZm9yZSwgd2Ugd2VyZSB1c2luZyBiYXNlIFIgdG8gY3JlYXRlIHNvbWV0aGluZwpsaWtlIHRoaXM6IAoKYGBge3J9CmhjLmVtcGxveWVyLjIwMTMgPC0gaGMgJT4lIAogIGZpbHRlcih0eXBlID09ICJFbXBsb3llciIsIHllYXIgPT0gIjIwMTMiKQoKcGxvdChoYy5lbXBsb3llci4yMDEzJHNwZW5kaW5nX2NhcGl0YSwgCiAgICAgaGMuZW1wbG95ZXIuMjAxMyRwcm9wX2NvdmVyYWdlLCAKICAgICB4bGFiID0gInNwZW5kaW5nIHBlciBjYXBpdGEiLCAKICAgICB5bGFiID0gImNvdmVyYWdlIHByb3BvcnRpb24iKQpgYGAKCkxldCdzICByZS1jcmVhdGUgdGhpcyBwbG90IHdpdGggYGdncGxvdDJgIAp1c2luZyB0aGUgYGdlb21fcG9pbnQoKWAgZ2VvbWV0cnkuIAoKYGBge3J9CnAgPC0gaGMgJT4lCiAgZmlsdGVyKHR5cGUgPT0gIkVtcGxveWVyIiwgeWVhciA9PSAiMjAxMyIpICU+JSAKICBnZ3Bsb3QoYWVzKHggPSBzcGVuZGluZ19jYXBpdGEsIHkgPSBwcm9wX2NvdmVyYWdlKSkgCnAgKyBnZW9tX3BvaW50KCkgKyAKICB4bGFiKCJzcGVuZGluZyBwZXIgY2FwaXRhIikgKyAKICB5bGFiKCJjb3ZlcmFnZSBwcm9wb3J0aW9uIikKYGBgCgpXZSB1c2VkIHRoZSBgeGxhYigpYCBhbmQgYHlsYWIoKWAgZnVuY3Rpb25zCmluIGBnZ3Bsb3QyYCB0byBzcGVjaWZ5IHRoZSB4LWF4aXMgYW5kIHktYXhpcwpsYWJlbHMuIAoKKipOb3RlKiosIHdlIGRvIG5vdCBoYXZlIHRvIGFzc2lnbiAoYDwtYCkgdGhlIHBsb3QgCnRvIGFueXRoaW5nOiAKCmBgYHtyfQpoYyAlPiUKICBmaWx0ZXIodHlwZSA9PSAiRW1wbG95ZXIiLCB5ZWFyID09ICIyMDEzIikgJT4lIAogIGdncGxvdChhZXMoeCA9IHNwZW5kaW5nX2NhcGl0YSwgeSA9IHByb3BfY292ZXJhZ2UpKSArIAogIGdlb21fcG9pbnQoKSArIAogIHhsYWIoInNwZW5kaW5nIHBlciBjYXBpdGEiKSArIAogIHlsYWIoImNvdmVyYWdlIHByb3BvcnRpb24iKQpgYGAKCgpJdCdzIGFsc28gc2ltcGxlIHRvIGZpdCBhIGxpbmVhciByZWdyZXNzaW9uIG1vZGVsIAphbmQgcGxvdCBpdCBvbiB0b3Agb2Ygc2NhdHRlciBwbG90IHVzaW5nIHRoZSAKYGdlb21fc21vb3RoKClgIChvciBgc3RhdF9zbW9vdGgoKWApIGZ1bmN0aW9ucy4gCgpgYGB7cn0KaGMgJT4lCiAgZmlsdGVyKHR5cGUgPT0gIkVtcGxveWVyIiwgeWVhciA9PSAiMjAxMyIpICU+JSAKICBnZ3Bsb3QoYWVzKHggPSBzcGVuZGluZ19jYXBpdGEsIHkgPSBwcm9wX2NvdmVyYWdlKSkgKyAKICBnZW9tX3BvaW50KCkgKyAKICB4bGFiKCJzcGVuZGluZyBwZXIgY2FwaXRhIikgKyAKICB5bGFiKCJjb3ZlcmFnZSBwcm9wb3J0aW9uIikgKyAKICBnZW9tX3Ntb290aChtZXRob2QgPSAibG0iLCBjb2wgPSAicmVkIikKYGBgCgpUaGUgc3RhbmRhcmQgZXJyb3IgYm91bmRzIGFyZSBjb21wdXRlZCBhbmQgaW5jbHVkZWQgCmluIHRoZSBwbG90LiAKCgpJdCB3b3VsZCBiZSBuaWNlIHRvIGtub3cgd2hpY2ggc3RhdGUgaXMgcmVwcmVzZW50ZWQKYnkgd2hpY2ggc3RhdGUuIEZvciB0aGlzLCB3ZSB3aWxsIGludHJvZHVjZSBhbm90aGVyIApfZ2VvbV8gY2FsbGVkIGBnZW9tX3RleHQoKWAuIAoKIyMjIDMuIEFkZCBsYXllcnMgb2YgdGV4dCB1c2luZyBgZ2VvbV90ZXh0KClgCgpJbiBvdXIgZGF0YXNldCwgd2UgaGF2ZSBpbmZvcm1hdGlvbiBhYm91dCB0aGUgCmFiYnJldmlhdGlvbiBmb3IgZWFjaCBzdGF0ZS4gV2UgY291bGQgYWRkIHRoZSAKYWJicmV2aWF0aW9ucyBmb3IgZWFjaCBzdGF0ZSBuZXh0IHRvIHRoZSBwb2ludCBvbiAKdGhlIHBsb3QgdG8gYXNzZXNzIHdoaWNoIHN0YXRlcyBoYXZlIGEgaGlnaGVyIG9yCmxvd2VyIGNvdmVyYWdlIGZvciBhIGdpdmVuIGFtb3VudCBvZiBtb25leSB0aGV5IApzcGVuZCBwZXIgY2FwaXRhLiAKCmBgYHtyfQpoYyAlPiUgCiAgZmlsdGVyKHR5cGUgPT0gIkVtcGxveWVyIiwgeWVhciA9PSAiMjAxMyIpICU+JSAKICBnZ3Bsb3QoYWVzKHggPSBzcGVuZGluZ19jYXBpdGEsIHkgPSBwcm9wX2NvdmVyYWdlKSkgKyAKICBnZW9tX3BvaW50KCkgKyAKICB4bGFiKCJzcGVuZGluZyBwZXIgY2FwaXRhIikgKyAKICB5bGFiKCJjb3ZlcmFnZSBwcm9wb3J0aW9uIikgKyAKICBnZW9tX3Ntb290aChtZXRob2QgPSAibG0iLCBjb2wgPSAicmVkIikgKyAKICBnZW9tX3RleHQoYWVzKGxhYmVsPWFiYikpCmBgYAoKVGhhdCBpcyBjb29sLCBidXQgaXQgd291bGQgYmUgZXZlbiBiZXR0ZXIgaWYgd2UgCmNvdWxkIF9udWRnZV8gdGhlIHRleHQgb3ZlciBhIGJpdC4gTGV0J3MgbG9vayBhdCAKdGhlIGhlbHAgZmlsZSBmb3IgYGdlb21fdGV4dCgpYDogCgpgYGB7ciwgZXZhbD1GQUxTRX0KP2dncGxvdDI6Omdlb21fdGV4dApgYGAKCldlIHNlZSB0aGVyZSBpcyBhbiBhcmd1bWVudCBjYWxsZWQgCmBudWRnZV94YCBhbmQgYG51ZGdlX3lgLiBXZSBjYW4gdXNlIHRoZXNlIAp0byBfbnVkZ2VfIHRoZSB0ZXh0IG92ZXIgYSBiaXQgc28gdGhlIAp0ZXh0IGlzIG5vdCBkaXJlY3RseSBvbiB0b3Agb2YgdGhlIHBvaW50cy4gCgpgYGB7cn0KaGMgJT4lIAogIGZpbHRlcih0eXBlID09ICJFbXBsb3llciIsIHllYXIgPT0gIjIwMTMiKSAlPiUgCiAgZ2dwbG90KGFlcyh4ID0gc3BlbmRpbmdfY2FwaXRhLCB5ID0gcHJvcF9jb3ZlcmFnZSkpICsgCiAgZ2VvbV9wb2ludCgpICsgCiAgeGxhYigic3BlbmRpbmcgcGVyIGNhcGl0YSIpICsgCiAgeWxhYigiY292ZXJhZ2UgcHJvcG9ydGlvbiIpICsgCiAgZ2VvbV9zbW9vdGgobWV0aG9kID0gImxtIiwgY29sID0gInJlZCIpICsgCiAgZ2VvbV90ZXh0KGFlcyhsYWJlbD1hYmIpLCBudWRnZV94ID0gMTUwKQpgYGAKCiMjIyMgKCopIENvbG9yIGVhY2ggcG9pbnQgKG9yIHN0YXRlKSBieSB3aGF0IHJlZ2lvbiB0aGV5IGFyZSBmcm9tLiAgCgpgYGB7cn0KIyMgYWRkIHlvdXIgY29kZSBoZXJlCgpoYyAlPiUgCiAgZmlsdGVyKHR5cGUgPT0gIkVtcGxveWVyIiwgeWVhciA9PSAiMjAxMyIpICU+JSAKICBnZ3Bsb3QoYWVzKHggPSBzcGVuZGluZ19jYXBpdGEsIHkgPSBwcm9wX2NvdmVyYWdlLCAKICAgICAgICAgICAgIGNvbG9yID0gcmVnaW9uKSkgKyAKICBnZW9tX3BvaW50KCkgKyAKICB4bGFiKCJzcGVuZGluZyBwZXIgY2FwaXRhIikgKyAKICB5bGFiKCJjb3ZlcmFnZSBwcm9wb3J0aW9uIikgKyAKICBnZW9tX3Ntb290aChtZXRob2QgPSAibG0iLCBjb2wgPSAicmVkIikgKyAKICBnZW9tX3RleHQoYWVzKGxhYmVsPWFiYiksIG51ZGdlX3ggPSAxNTApCmBgYAoKIyMjIyAoKikgVHJ5IHRvIGV4cGxvcmUgdGhlIHBhY2thZ2UgYGdncmVwZWxgLCBhbmQgY2hlY2sgaWYgeW91IGNhbiBpbXByb3ZlIHRoZSBxdWFsaXR5IG9mIHZpc3VhbGl6YXRpb24gdXNpbmcgdGhlICpnZW9tX3RleHRfcmVwZWwqIGZyb20gYGdncmVwZWxgIGluc3RlYWQgb2YgKnhfbnVkZ2UqIGZyb20gYGdncGxvdDJgLiAgCgpgYGB7cn0KIyMgYWRkIHlvdXIgY29kZSBoZXJlICAKCmxpYnJhcnkoZ2dyZXBlbCkKCmhjICU+JSAKICBmaWx0ZXIodHlwZSA9PSAiRW1wbG95ZXIiLCB5ZWFyID09ICIyMDEzIikgJT4lIAogIGdncGxvdChhZXMoeCA9IHNwZW5kaW5nX2NhcGl0YSwgeSA9IHByb3BfY292ZXJhZ2UsIAogICAgICAgICAgICAgY29sb3IgPSByZWdpb24pKSArIAogIGdlb21fcG9pbnQoKSArIAogIHhsYWIoInNwZW5kaW5nIHBlciBjYXBpdGEiKSArIAogIHlsYWIoImNvdmVyYWdlIHByb3BvcnRpb24iKSArIAogIGdlb21fc21vb3RoKG1ldGhvZCA9ICJsbSIsIGNvbCA9ICJyZWQiKSArIAogIGdlb21fdGV4dF9yZXBlbChhZXMobGFiZWw9YWJiKSkgIApgYGAKCgojIyMgNC4gRmFjZXQgYWNyb3NzIGEgdmFyaWFibGUgdXNpbmcgYGZhY2V0X3dyYXBgCgpPaywgZ2V0dGluZyBiYWNrIHRvIG91ciBvcmlnaW5hbCBxdWVzdGlvbjogCgo+IDEuIElzIHRoZXJlIGEgcmVsYXRpb25zaGlwIGJldHdlZW4gaGVhbHRoY2FyZSBjb3ZlcmFnZSBhbmQgaGVhbHRoY2FyZSBzcGVuZGluZyBpbiB0aGUgVW5pdGVkIFN0YXRlcz8gCgpXZSBzYXcgdGhlcmUgd2FzIGEgcG9zaXRpdmUgcmVsYXRpb25zaGlwLApidXQgdGhpcyB3YXMgb25seSBmb3Igb25lIHR5cGUgb2YgaGVhbHRoY2FyZSAKY292ZXJhZ2UgKGBFbXBsb3llcmApIGFuZCBvbmUgeWVhci4gCldoYXQgYWJvdXQgdGhlIG90aGVyIHR5cGVzPyAKCkZvciB0aGlzLCB3ZSB3aWxsIGludHJvZHVjZSBgZmFjZXRzYC4gVGhlIGlkZWEgCm9mIF9mYWNldGluZ18gaXMgdG8gc3RyYXRpZnkgdGhlIGRhdGEgYnkgc29tZSAKdmFyaWFibGUgYW5kIG1ha2UgdGhlIHNhbWUgcGxvdCBmb3IgZWFjaCBzdHJhdGEuIAoKRm9yIGV4YW1wbGUsIGlmIHdlIHdhbnRlZCB0byBfZmFjZXRfIGJ5IHRoZSAKYHR5cGVgIHZhcmlhYmxlLCB3ZSB3aWxsIGFkZCBhIGxheWVyIHRvIG91ciAKYGdncGxvdCgpYCBvYmplY3QgdXNpbmcgdGhlIGBmYWNldF9ncmlkKClgIG9yIApgZmFjZXRfd3JhcCgpYCBmdW5jdGlvbnMuIFRoZSBmdW5jdGlvbiBleHBlY3RzCnRoZSByb3cgYW5kIGNvbHVtbiB2YXJpYWJsZXMgdG8gYmUgc2VwYXJhdGVkIApieSBhIGB+YC4gCgpgYGB7ciwgZmlnLndpZHRoPTEyLCBmaWcuaGVpZ2h0PTh9CmhjICU+JQogIGZpbHRlcih5ZWFyID09ICIyMDEzIikgJT4lIAogIGdncGxvdChhZXMoeCA9IHNwZW5kaW5nX2NhcGl0YSwgeSA9IHByb3BfY292ZXJhZ2UsIAogICAgICAgICAgICAgY29sb3IgPSByZWdpb24pKSArIAogIGdlb21fcG9pbnQoKSArIAogIHhsYWIoInNwZW5kaW5nIHBlciBjYXBpdGEiKSArIAogIHlsYWIoImNvdmVyYWdlIHByb3BvcnRpb24iKSArIAogIGdlb21fc21vb3RoKG1ldGhvZCA9ICJsbSIsIGNvbCA9ICJyZWQiKSArIAogIGdlb21fdGV4dF9yZXBlbChhZXMobGFiZWw9YWJiKSkgKyAKICBmYWNldF93cmFwKH50eXBlKQpgYGAKCldlIHNlZSB0aGF0IHRoZSBwcm9wb3J0aW9uIG9mIHBlb3BsZSBjb3ZlcmVkIApoYXZlIGRpZmZlcmVudCBzY2FsZXMgaW4gdGhlIHktYXhpcy4gTGV0J3MgCnJlYWQgdGhlIGhlbHAgZmlsZSB0byBzZWUgaWYgdGhlcmUgaXMgc29tZSB3YXkgCnRvIG5vdCByZXN0cmljdCB0aGUgeS1heGlzIHRvIGJlIHRoZSBzYW1lLiAKYGBge3J9Cj9nZ3Bsb3QyOjpmYWNldF9ncmlkCmBgYAoKWWVzLCB3ZSBzZWUgdGhlcmUgaXMgYW4gYXJndW1lbnQgY2FsbGVkIApgc2NhbGVzYCB0aGF0IGNhbiBiZSBgZnJlZV95YCwgKGZyZWUgY29sdW1ucyksCmBmcmVlX3hgIChmcmVlIHJvd3MpLCBhbmQgYGZyZWVgIChib3RoKS4gCkxldCdzIHRyeSBgZnJlZV95YCBhbmQgbG9vayBhdCBhIGRpZmZlcmVudAp5ZWFyIChgeWVhcj09IjIwMTQiYCk6IAoKYGBge3IsIGZpZy53aWR0aD0xMiwgZmlnLmhlaWdodD02fQpoYyAlPiUKICBmaWx0ZXIoeWVhciA9PSAiMjAxNCIpICU+JSAKICBnZ3Bsb3QoYWVzKHggPSBzcGVuZGluZ19jYXBpdGEsIHkgPSBwcm9wX2NvdmVyYWdlLCAKICAgICAgICAgICAgIGNvbG9yID0gcmVnaW9uKSkgKyAKICBnZW9tX3BvaW50KCkgKyAKICB4bGFiKCJzcGVuZGluZyBwZXIgY2FwaXRhIikgKyAKICB5bGFiKCJjb3ZlcmFnZSBwcm9wb3J0aW9uIikgKyAKICBnZW9tX3Ntb290aChtZXRob2QgPSAibG0iLCBjb2wgPSAicmVkIikgKyAKICBnZW9tX3RleHRfcmVwZWwoYWVzKGxhYmVsPWFiYikpICsgCiAgZmFjZXRfd3JhcCh+dHlwZSwgc2NhbGVzPSJmcmVlX3kiKQpgYGAKCkdpdmVuIHdlIGtub3cgYE90aGVyIFB1YmxpY2AgcmVmZXJzIHRvIHRoZSAKbWlsaXRhcnkgb3IgVmV0ZXJhbnMgQWRtaW5pc3RyYXRpb24sIHdlIGNhbiBzZWUgCnN0YXRlcyBsaWtlIEhJLCBWQSwgTlYgaGF2ZSBhIGxhcmdlciAKcHJvcG9ydGlvbiBvZiBtaWxpdGFyeSBvciBWQSBgT3RoZXIgUHVibGljYCAKdHlwZSBjb3ZlcmFnZS4gV2hpbGUgYSBzdGF0ZSBsaWtlIEFLIGhhcyBhIApzaW1pbGFyIHByb3BvcnRpb24gb2YgYE90aGVyIFB1YmxpY2AgY292ZXJhZ2UsIAppdCBoYXMgYSBtdWNoIGxhcmdlciBzcGVuZGluZyBwZXIgY2FwaXRhLiAKCldlIGFsc28gc2VlIGEgbmVnYXRpdmUgcmVsYXRpb25zaGlwIHdpdGggdGhlIApgVW5pbnN1cmVkYCB0eXBlLiBUaGUgbW9yZSBzdGF0ZXMgc3BlbmQsIHRoZQpsZXNzIHVuaW5zdXJlZCBwZW9wbGUgaW4gdGhlIHN0YXRlLiAKCiMjIyA1LiBDcmVhdGUgYm94cGxvdHMgdXNpbmcgYGdlb21fYm94cGxvdCgpYAoKTmV4dCwgbGV0J3MgcmV2aXNpdCB0aGUgc2Vjb25kIHF1ZXN0aW9uLiAKCj4gMi4gV2hpY2ggVVMgc3RhdGVzIHNwZW5kIHRoZSBtb3N0IGFuZCB3aGljaCBzcGVuZCB0aGUgbGVhc3Qgb24gaGVhbHRoY2FyZT8gSG93IGRvZXMgdGhlIHNwZW5kaW5nIGRpc3RyaWJ1dGlvbiBjaGFuZ2UgYWNyb3NzIGdlb2dyYXBoaWMgcmVnaW9ucyBpbiB0aGUgVW5pdGVkIFN0YXRlcz8KCkxldCdzIHRyeSBtYWtpbmcgYSBib3hwbG90IHdpdGggYGdncGxvdDJgLiAKSWYgeW91IHJlY2FsbCwgdGhlIHdheSB0byBkbyB0aGlzIGluIGJhc2UgUiB3YXM6IAoKYGBge3J9CmJveHBsb3QoaGMkc3BlbmRpbmdfY2FwaXRhIH4gaGMkcmVnaW9uKQpgYGAKCk5vdywgd2UgaW50cm9kdWNlIHRoZSBgZ2VvbV9ib3hwbG90KClgIApmdW5jdGlvbi4gTm90ZSwgd2UgbmVlZGVkIHRvIHRlbGwgYGdncGxvdDJgCndoYXQgbmVlZHMgdG8gYmUgYWxvbmcgdGhlIHggYW5kIHkgYXhpcyBpbgpgYWVzKClgLiAKCmBgYHtyfQpoYyAlPiUgCiAgZ2dwbG90KGFlcyh4ID0gcmVnaW9uLCB5ID0gc3BlbmRpbmdfY2FwaXRhKSkgKyAKICBnZW9tX2JveHBsb3QoKQpgYGAKCiMjIyA2LiBGYWNldCBieSB0d28gdmFyaWFibGVzIHVzaW5nIGBmYWNldF9ncmlkYAoKPiAzLiBEb2VzIHRoZSByZWxhdGlvbnNoaXAgYmV0d2VlbiBoZWFsdGhjYXJlIGNvdmVyYWdlIGFuZCBoZWFsdGhjYXJlIHNwZW5kaW5nIGluIHRoZSBVbml0ZWQgU3RhdGVzIGNoYW5nZSBmcm9tIDIwMTMgdG8gMjAxND8gICAKCkxldCdzIHRyeSBmYWNldGluZyBieSBib3RoIGB5ZWFyYCBhbmQgYHR5cGVgLiAKTm90ZSB0aGF0IHdlIGNhbiBmYWNldCBieSByb3dzIHB1dHRpbmcgYSAKY29sdW1uIG5hbWUgYmVmb3JlIHRoZSBgfmAgYW5kIGZhY2V0IGJ5IApjb2x1bW5zIHB1dHRpbmcgYSBjb2x1bW4gbmFtZSBhZnRlciB0aGUgYH5gLiAKV2UgYXJlIGFsc28gdXNpbmcgYGZhY2V0X2dyaWQoKWAgaW5zdGVhZCBvZiAKYGZhY2V0X3dyYXAoKWAuCgpgYGB7ciwgZmlnLndpZHRoPTEyLCBmaWcuaGVpZ2h0PTh9CnAgPC0gaGMgJT4lCiAgZ2dwbG90KGFlcyh4ID0gc3BlbmRpbmdfY2FwaXRhLCB5ID0gcHJvcF9jb3ZlcmFnZSwgCiAgICAgICAgICAgICBjb2xvciA9IHJlZ2lvbikpICsgCiAgZ2VvbV9wb2ludCgpICsgCiAgeGxhYigic3BlbmRpbmcgcGVyIGNhcGl0YSIpICsgCiAgeWxhYigiY292ZXJhZ2UgcHJvcG9ydGlvbiIpICsgCiAgZ2VvbV9zbW9vdGgobWV0aG9kID0gImxtIiwgY29sID0gInJlZCIpICsgCiAgZ2VvbV90ZXh0X3JlcGVsKGFlcyhsYWJlbD1hYmIpKSAKCnAgKyBmYWNldF9ncmlkKHllYXJ+dHlwZSwgc2NhbGVzPSJmcmVlIikKcCArIGZhY2V0X2dyaWQoeWVhcn50eXBlKQpgYGAKCgojIFN1bW1hcnkgICAKClRoZSB0b3RhbCBoZWFsdGhjYXJlIGV4cGVuZGl0dXJlIGlzIGFzc29jaWF0ZWQgd2l0aCAKdGhlIHBvcHVsYXRpb24uIFRvIG1ha2UgYSBmYWlyIGNvbXBhcmlzb24sIAp3ZSBjcmVhdGUgImhlYWx0aGNhcmUgZXhwZW5kaXR1cmUgcGVyIGNhcGl0YS4iIApGdXJ0aGVyLCB0aGUgZXhwbG9yYXRvcnkgYW5hbHlzaXMgdmlhIGRhdGEgdmlzdWFsaXphdGlvbiBzaG93ZWQgCmhpZ2hlciBzcGVuZGluZyBpbiBoZWFsdGhjYXJlIHBlciBjYXBpdGEgCmlzIHBvc2l0aXZlbHkgYXNzb2NpYXRlZCB3aXRoIGhpZ2hlciAKZW1wbG95ZXIgY292ZXJhZ2UgcHJvcG9ydGlvbiBhbmQgaXMgCm5lZ2F0aXZlbHkgYXNzb2NpYXRlZCB3aXRoIHRoZSBwcm9wb3J0aW9uIApvZiB1bmluc3VyZWQgcG9wdWxhdGlvbiBhY3Jvc3MgdGhlIFN0YXRlcy4gCgoKCgoK