1 Basics

1.1 Install derfinderPlot

R is an open-source statistical environment which can be easily modified to enhance its functionality via packages. derfinderPlot is a R package available via the Bioconductor repository for packages. R can be installed on any operating system from CRAN after which you can install derfinderPlot by using the following commands in your R session:

install.packages("BiocManager")
BiocManager::install("derfinderPlot")

## Check that you have a valid Bioconductor installation
BiocManager::valid()

1.2 Required knowledge

derfinderPlot is based on many other packages and in particular in those that have implemented the infrastructure needed for dealing with RNA-seq data. A derfinderPlot user is not expected to deal with those packages directly but will need to be familiar with derfinder and for some plots with ggbio.

If you are asking yourself the question “Where do I start using Bioconductor?” you might be interested in this blog post.

1.3 Asking for help

As package developers, we try to explain clearly how to use our packages and in which order to use the functions. But R and Bioconductor have a steep learning curve so it is critical to learn where to ask for help. The blog post quoted above mentions some but we would like to highlight the Bioconductor support site as the main resource for getting help: remember to use the derfinder or derfinderPlot tags and check the older posts. Other alternatives are available such as creating GitHub issues and tweeting. However, please note that if you want to receive help you should adhere to the posting guidelines. It is particularly critical that you provide a small reproducible example and your session information so package developers can track down the source of the error.

1.4 Citing derfinderPlot

We hope that derfinderPlot will be useful for your research. Please use the following information to cite the package and the overall approach. Thank you!

## Citation info
citation('derfinderPlot')
## 
## Collado-Torres L, Jaffe AE, Leek JT (2017). _derfinderPlot: Plotting
## functions for derfinder_. doi: 10.18129/B9.bioc.derfinderPlot (URL:
## http://doi.org/10.18129/B9.bioc.derfinderPlot),
## https://github.com/leekgroup/derfinderPlot - R package version
## 1.16.1, <URL: http://www.bioconductor.org/packages/derfinderPlot>.
## 
## Collado-Torres L, Nellore A, Frazee AC, Wilks C, Love MI, Langmead
## B, Irizarry RA, Leek JT, Jaffe AE (2017). "Flexible expressed region
## analysis for RNA-seq with derfinder." _Nucl. Acids Res._. doi:
## 10.1093/nar/gkw852 (URL: http://doi.org/10.1093/nar/gkw852), <URL:
## http://nar.oxfordjournals.org/content/early/2016/09/29/nar.gkw852>.
## 
## To see these entries in BibTeX format, use 'print(<citation>,
## bibtex=TRUE)', 'toBibtex(.)', or set
## 'options(citation.bibtex.max=999)'.

2 Introduction to derfinderPlot

derfinderPlot (Collado-Torres, Jaffe, and Leek, 2017) is an addon package for derfinder (Collado-Torres, Nellore, Frazee, Wilks, et al., 2017) with functions that allow you to visualize the results.

While the functions in derfinderPlot assume you generated the data with derfinder, they can be used with other GRanges objects properly formatted.

The functions in derfinderPlot are:

  • plotCluster() is a tailored ggbio (Yin, Cook, and Lawrence, 2012) plot that shows all the regions in a cluster (defined by distance). It shows the base-level coverage for each sample as well as the mean for each group. If these regions overlap any known gene, the gene and the transcript annotation is displayed.
  • plotOverview() is another tailored ggbio (Yin, Cook, and Lawrence, 2012) plot showing an overview of the whole genome. This plot can be useful to observe if the regions are clustered in a subset of a chromosome. It can also be used to check whether the regions match predominantly one part of the gene structure (for example, 3’ overlaps).
  • plotRegionCoverage() is a fast plotting function using R base graphics that shows the base-level coverage for each sample inside a specific region of the genome. If the region overlaps any known gene or intron, the information is displayed. Optionally, it can display the known transcripts. This function is most likely the easiest to use with GRanges objects from other packages.

3 Example

As an example, we will analyze a small subset of the samples from the BrainSpan Atlas of the Human Brain (BrainSpan, 2011) publicly available data.

We first load the required packages.

## Load libraries
suppressPackageStartupMessages(library('derfinder'))
library('derfinderData')
library('derfinderPlot')

3.1 Analyze data

For this example, we created a small table with the relevant phenotype data for 12 samples: 6 from fetal samples and 6 from adult samples. We chose at random a brain region, in this case the primary auditory cortex (core) and for the example we will only look at data from chromosome 21. Other variables include the age in years and the gender. The data is shown below.

library('knitr')
## Get pheno table
pheno <- subset(brainspanPheno, structure_acronym == 'A1C')

## Display the main information
p <- pheno[, -which(colnames(pheno) %in% c('structure_acronym',
    'structure_name', 'file'))]
rownames(p) <- NULL
kable(p, format = 'html', row.names = TRUE)
gender lab Age group
1 M HSB114.A1C -0.5192308 fetal
2 M HSB103.A1C -0.5192308 fetal
3 M HSB178.A1C -0.4615385 fetal
4 M HSB154.A1C -0.4615385 fetal
5 F HSB150.A1C -0.5384615 fetal
6 F HSB149.A1C -0.5192308 fetal
7 F HSB130.A1C 21.0000000 adult
8 M HSB136.A1C 23.0000000 adult
9 F HSB126.A1C 30.0000000 adult
10 M HSB145.A1C 36.0000000 adult
11 M HSB123.A1C 37.0000000 adult
12 F HSB135.A1C 40.0000000 adult

We can load the data from derfinderData (Collado-Torres, Jaffe, and Leek, 2018) by first identifying the paths to the BigWig files with derfinder::rawFiles() and then loading the data with derfinder::fullCoverage().

## Determine the files to use and fix the names
files <- rawFiles(system.file('extdata', 'A1C', package = 'derfinderData'),
    samplepatt = 'bw', fileterm = NULL)
names(files) <- gsub('.bw', '', names(files))

## Load the data from disk
system.time(fullCov <- fullCoverage(files = files, chrs = 'chr21'))

Alternatively, since the BigWig files are publicly available from BrainSpan (see here), we can extract the relevant coverage data using derfinder::fullCoverage(). Note that as of rtracklayer 1.25.16 BigWig files are not supported on Windows: you can find the fullCov object inside derfinderData to follow the examples.

## Determine the files to use and fix the names
files <- pheno$file
names(files) <- gsub('.A1C', '', pheno$lab)

## Load the data from the web
system.time(fullCov <- fullCoverage(files = files, chrs = 'chr21'))

Once we have the base-level coverage data for all 12 samples, we can construct the models. In this case, we want to find differences between fetal and adult samples while adjusting for gender and a proxy of the library size.

## Get some idea of the library sizes
sampleDepths <- sampleDepth(collapseFullCoverage(fullCov), 1)
## 2018-12-03 22:15:20 sampleDepth: Calculating sample quantiles
## 2018-12-03 22:15:20 sampleDepth: Calculating sample adjustments
## Define models
models <- makeModels(sampleDepths, testvars = pheno$group,
    adjustvars = pheno[, c('gender')])

Next, we can find candidate differentially expressed regions (DERs) using as input the segments of the genome where at least one sample has coverage greater than 3. In this particular example, we chose a low theoretical F-statistic cutoff and used 20 permutations.

## Filter coverage
filteredCov <- lapply(fullCov, filterData, cutoff = 3)
## 2018-12-03 22:15:21 filterData: originally there were 48129895 rows, now there are 90023 rows. Meaning that 99.81 percent was filtered.
## Perform differential expression analysis
suppressPackageStartupMessages(library('bumphunter'))
system.time(results <- analyzeChr(chr = 'chr21', filteredCov$chr21,
    models, groupInfo = pheno$group, writeOutput = FALSE,
    cutoffFstat = 5e-02, nPermute = 20, seeds = 20140923 + seq_len(20)))
## 2018-12-03 22:15:22 analyzeChr: Pre-processing the coverage data
## 2018-12-03 22:15:25 analyzeChr: Calculating statistics
## 2018-12-03 22:15:25 calculateStats: calculating the F-statistics
## 2018-12-03 22:15:25 analyzeChr: Calculating pvalues
## 2018-12-03 22:15:25 analyzeChr: Using the following theoretical cutoff for the F-statistics 5.31765507157871
## 2018-12-03 22:15:25 calculatePvalues: identifying data segments
## 2018-12-03 22:15:25 findRegions: segmenting information
## 2018-12-03 22:15:25 findRegions: identifying candidate regions
## 2018-12-03 22:15:25 findRegions: identifying region clusters
## 2018-12-03 22:15:25 calculatePvalues: calculating F-statistics for permutation 1 and seed 20140924
## 2018-12-03 22:15:25 findRegions: segmenting information
## 2018-12-03 22:15:26 findRegions: identifying candidate regions
## 2018-12-03 22:15:26 calculatePvalues: calculating F-statistics for permutation 2 and seed 20140925
## 2018-12-03 22:15:26 findRegions: segmenting information
## 2018-12-03 22:15:27 findRegions: identifying candidate regions
## 2018-12-03 22:15:27 calculatePvalues: calculating F-statistics for permutation 3 and seed 20140926
## 2018-12-03 22:15:27 findRegions: segmenting information
## 2018-12-03 22:15:27 findRegions: identifying candidate regions
## 2018-12-03 22:15:27 calculatePvalues: calculating F-statistics for permutation 4 and seed 20140927
## 2018-12-03 22:15:27 findRegions: segmenting information
## 2018-12-03 22:15:27 findRegions: identifying candidate regions
## 2018-12-03 22:15:27 calculatePvalues: calculating F-statistics for permutation 5 and seed 20140928
## 2018-12-03 22:15:27 findRegions: segmenting information
## 2018-12-03 22:15:27 findRegions: identifying candidate regions
## 2018-12-03 22:15:27 calculatePvalues: calculating F-statistics for permutation 6 and seed 20140929
## 2018-12-03 22:15:27 findRegions: segmenting information
## 2018-12-03 22:15:27 findRegions: identifying candidate regions
## 2018-12-03 22:15:28 calculatePvalues: calculating F-statistics for permutation 7 and seed 20140930
## 2018-12-03 22:15:28 findRegions: segmenting information
## 2018-12-03 22:15:28 findRegions: identifying candidate regions
## 2018-12-03 22:15:28 calculatePvalues: calculating F-statistics for permutation 8 and seed 20140931
## 2018-12-03 22:15:28 findRegions: segmenting information
## 2018-12-03 22:15:28 findRegions: identifying candidate regions
## 2018-12-03 22:15:28 calculatePvalues: calculating F-statistics for permutation 9 and seed 20140932
## 2018-12-03 22:15:28 findRegions: segmenting information
## 2018-12-03 22:15:28 findRegions: identifying candidate regions
## 2018-12-03 22:15:28 calculatePvalues: calculating F-statistics for permutation 10 and seed 20140933
## 2018-12-03 22:15:28 findRegions: segmenting information
## 2018-12-03 22:15:28 findRegions: identifying candidate regions
## 2018-12-03 22:15:28 calculatePvalues: calculating F-statistics for permutation 11 and seed 20140934
## 2018-12-03 22:15:29 findRegions: segmenting information
## 2018-12-03 22:15:29 findRegions: identifying candidate regions
## 2018-12-03 22:15:29 calculatePvalues: calculating F-statistics for permutation 12 and seed 20140935
## 2018-12-03 22:15:29 findRegions: segmenting information
## 2018-12-03 22:15:29 findRegions: identifying candidate regions
## 2018-12-03 22:15:29 calculatePvalues: calculating F-statistics for permutation 13 and seed 20140936
## 2018-12-03 22:15:29 findRegions: segmenting information
## 2018-12-03 22:15:29 findRegions: identifying candidate regions
## 2018-12-03 22:15:29 calculatePvalues: calculating F-statistics for permutation 14 and seed 20140937
## 2018-12-03 22:15:29 findRegions: segmenting information
## 2018-12-03 22:15:29 findRegions: identifying candidate regions
## 2018-12-03 22:15:29 calculatePvalues: calculating F-statistics for permutation 15 and seed 20140938
## 2018-12-03 22:15:29 findRegions: segmenting information
## 2018-12-03 22:15:30 findRegions: identifying candidate regions
## 2018-12-03 22:15:30 calculatePvalues: calculating F-statistics for permutation 16 and seed 20140939
## 2018-12-03 22:15:30 findRegions: segmenting information
## 2018-12-03 22:15:30 findRegions: identifying candidate regions
## 2018-12-03 22:15:30 calculatePvalues: calculating F-statistics for permutation 17 and seed 20140940
## 2018-12-03 22:15:30 findRegions: segmenting information
## 2018-12-03 22:15:30 findRegions: identifying candidate regions
## 2018-12-03 22:15:30 calculatePvalues: calculating F-statistics for permutation 18 and seed 20140941
## 2018-12-03 22:15:30 findRegions: segmenting information
## 2018-12-03 22:15:30 findRegions: identifying candidate regions
## 2018-12-03 22:15:30 calculatePvalues: calculating F-statistics for permutation 19 and seed 20140942
## 2018-12-03 22:15:30 findRegions: segmenting information
## 2018-12-03 22:15:30 findRegions: identifying candidate regions
## 2018-12-03 22:15:30 calculatePvalues: calculating F-statistics for permutation 20 and seed 20140943
## 2018-12-03 22:15:31 findRegions: segmenting information
## 2018-12-03 22:15:31 findRegions: identifying candidate regions
## 2018-12-03 22:15:32 calculatePvalues: calculating the p-values
## 2018-12-03 22:15:32 analyzeChr: Annotating regions
## No annotationPackage supplied. Trying org.Hs.eg.db.
## Loading required package: org.Hs.eg.db
## Loading required package: AnnotationDbi
## Loading required package: Biobase
## Welcome to Bioconductor
## 
##     Vignettes contain introductory material; view with
##     'browseVignettes()'. To cite Bioconductor, see
##     'citation("Biobase")', and for packages 'citation("pkgname")'.
## 
## Getting TSS and TSE.
## Getting CSS and CSE.
## Getting exons.
## Annotating genes.
## .............
##    user  system elapsed 
##  114.97    1.11  116.08
## Quick access to the results
regions <- results$regions$regions

## Annotation database to use
suppressPackageStartupMessages(library('TxDb.Hsapiens.UCSC.hg19.knownGene'))
txdb <- TxDb.Hsapiens.UCSC.hg19.knownGene

3.2 plotOverview()

Now that we have obtained the main results using derfinder, we can proceed to visualizing the results using derfinderPlot. The easiest to use of all the functions is plotOverview() which takes a set of regions and annotation information produced by bumphunter::matchGenes().

Figure 1 shows the candidate DERs colored by whether their q-value was less than 0.10 or not.

## Q-values overview
plotOverview(regions = regions, annotation = results$annotation, type = 'qval')
## 2018-12-03 22:17:19 plotOverview: assigning chromosome lengths from hg19!!!
## Scale for 'x' is already present. Adding another scale for 'x', which will
## replace the existing scale.
## Scale for 'x' is already present. Adding another scale for 'x', which will
## replace the existing scale.
Location of the DERs in the genome. This plot is was designed for many chromosomes but only one is shown here for simplicity.

Figure 1: Location of the DERs in the genome
This plot is was designed for many chromosomes but only one is shown here for simplicity.

Figure 2 shows the candidate DERs colored by the type of gene feature they are nearest too.

## Annotation overview
plotOverview(regions = regions, annotation = results$annotation,
    type = 'annotation')
## 2018-12-03 22:17:20 plotOverview: assigning chromosome lengths from hg19!!!
## Scale for 'x' is already present. Adding another scale for 'x', which will
## replace the existing scale.
Location of the DERs in the genome and colored by annotation class. This plot is was designed for many chromosomes but only one is shown here for simplicity.

Figure 2: Location of the DERs in the genome and colored by annotation class
This plot is was designed for many chromosomes but only one is shown here for simplicity.

In this particular example, because we are only using data from one chromosome the above plot is not as informative as in a real case scenario. However, with this plot we can quickly observe that nearly all of the candidate DERs are inside an exon.

3.3 plotRegionCoverage()

The complete opposite of visualizing the candidate DERs at the genome-level is to visualize them one region at a time. plotRegionCoverage() allows us to do this quickly for a large number of regions.

Before using this function, we need to process more detailed information using two derfinder functions: annotateRegions() and getRegionCoverage() as shown below.

## Get required information for the plots
annoRegs <- annotateRegions(regions, genomicState$fullGenome)
## 2018-12-03 22:17:21 annotateRegions: counting
## 2018-12-03 22:17:21 annotateRegions: annotating
regionCov <- getRegionCoverage(fullCov, regions)
## 2018-12-03 22:17:21 getRegionCoverage: processing chr21
## 2018-12-03 22:17:22 getRegionCoverage: done processing chr21

Once we have the relevant information we can proceed to plotting the first 10 regions. In this case, we will supply plotRegionCoverage() with the information it needs to plot transcripts overlapping these 10 regions (Figures ??, ??, ??, ??, ??, ??, ??, ??, ??, ??).

## Plot top 10 regions
plotRegionCoverage(regions = regions, regionCoverage = regionCov, 
    groupInfo = pheno$group, nearestAnnotation = results$annotation, 
    annotatedRegions = annoRegs, whichRegions=1:10, txdb = txdb, scalefac = 1,
    ask = FALSE, verbose = FALSE)
## Warning in matrix(c(-pad, -pad, pad, pad), nrow = nrow(d), ncol = 4, byrow =
## TRUE): data length exceeds size of matrix
Base-pair resolution plot of differentially expressed region 1.

Figure 3: Base-pair resolution plot of differentially expressed region 1

Base-pair resolution plot of differentially expressed region 2.

Figure 3: Base-pair resolution plot of differentially expressed region 2

Base-pair resolution plot of differentially expressed region 3.

Figure 3: Base-pair resolution plot of differentially expressed region 3

Base-pair resolution plot of differentially expressed region 4.

Figure 3: Base-pair resolution plot of differentially expressed region 4

Base-pair resolution plot of differentially expressed region 5.

Figure 3: Base-pair resolution plot of differentially expressed region 5

Base-pair resolution plot of differentially expressed region 6.

Figure 3: Base-pair resolution plot of differentially expressed region 6

Base-pair resolution plot of differentially expressed region 7.

Figure 3: Base-pair resolution plot of differentially expressed region 7

Base-pair resolution plot of differentially expressed region 8.

Figure 3: Base-pair resolution plot of differentially expressed region 8

Base-pair resolution plot of differentially expressed region 9.

Figure 3: Base-pair resolution plot of differentially expressed region 9

Base-pair resolution plot of differentially expressed region 10.

Figure 3: Base-pair resolution plot of differentially expressed region 10

The base-level coverage is shown in a log2 scale with any overlapping exons shown in dark blue and known introns in light blue.

3.4 plotCluster()

In this example, we noticed with the plotRegionCoverage() plots that most of the candidate DERs are contained in known exons. Sometimes, the signal might be low or we might have used very stringent cutoffs in the derfinder analysis. One way we can observe this is by plotting clusters of regions where a cluster is defined as regions within 300 bp (default option) of each other.

To visualize the clusters, we can use plotCluster() which takes similar input to plotOverview() with the notable addition of the coverage information as well as the idx argument. This argument specifies which region to focus on: it will be plotted with a red bar and will determine the cluster to display.

In Figure 4 we observe one large candidate DER with other nearby ones that do not have a q-value less than 0.10. In a real analysis, we would probably discard this region as the coverage is fairly low.

## First cluster
plotCluster(idx = 1, regions = regions, annotation = results$annotation,
    coverageInfo = fullCov$chr21, txdb = txdb, groupInfo = pheno$group,
    titleUse = 'pval')
## Parsing transcripts...
## Parsing exons...
## Parsing cds...
## Parsing utrs...
## ------exons...
## ------cdss...
## ------introns...
## ------utr...
## aggregating...
## Done
## Constructing graphics...
## Coordinate system already present. Adding new coordinate system, which will replace the existing one.
## Coordinate system already present. Adding new coordinate system, which will replace the existing one.
## Coordinate system already present. Adding new coordinate system, which will replace the existing one.
## Coordinate system already present. Adding new coordinate system, which will replace the existing one.
Cluster plot for cluster 1 using ggbio.

Figure 4: Cluster plot for cluster 1 using ggbio

The second cluster (Figure 5) shows a larger number of potential DERs (again without q-values less than 0.10) in a segment of the genome where the coverage data is highly variable. This is a common occurrence with RNA-seq data.

## Second cluster
plotCluster(idx = 2, regions = regions, annotation = results$annotation,
    coverageInfo = fullCov$chr21, txdb = txdb, groupInfo = pheno$group,
    titleUse = 'pval')
## Warning in getIdeoGR(data): geom(ideogram) need valid seqlengths information for accurate mapping,
##                  now use reduced information as ideogram...
## Warning: `panel.margin` is deprecated. Please use `panel.spacing` property
## instead

## Warning: `panel.margin` is deprecated. Please use `panel.spacing` property
## instead
## Parsing transcripts...
## Parsing exons...
## Parsing cds...
## Parsing utrs...
## ------exons...
## ------cdss...
## ------introns...
## ------utr...
## aggregating...
## Done
## Constructing graphics...
## Warning: `panel.margin` is deprecated. Please use `panel.spacing` property
## instead

## Warning: `panel.margin` is deprecated. Please use `panel.spacing` property
## instead

## Warning: `panel.margin` is deprecated. Please use `panel.spacing` property
## instead

## Warning: `panel.margin` is deprecated. Please use `panel.spacing` property
## instead

## Warning: `panel.margin` is deprecated. Please use `panel.spacing` property
## instead

## Warning: `panel.margin` is deprecated. Please use `panel.spacing` property
## instead

## Warning: `panel.margin` is deprecated. Please use `panel.spacing` property
## instead

## Warning: `panel.margin` is deprecated. Please use `panel.spacing` property
## instead

## Warning: `panel.margin` is deprecated. Please use `panel.spacing` property
## instead
## Coordinate system already present. Adding new coordinate system, which will replace the existing one.
## Coordinate system already present. Adding new coordinate system, which will replace the existing one.
## Coordinate system already present. Adding new coordinate system, which will replace the existing one.
## Coordinate system already present. Adding new coordinate system, which will replace the existing one.
## Warning: Transformation introduced infinite values in continuous y-axis
## Warning: Transformation introduced infinite values in continuous y-axis
Cluster plot for cluster 2 using ggbio.

Figure 5: Cluster plot for cluster 2 using ggbio

These plots show an ideogram which helps quickly identify which region of the genome we are focusing on. Then, the base-level coverage information for each sample is displayed in log2. Next, the coverage group means are shown in the log2 scale. The plot is completed with the potential and candidate DERs as well as any known transcripts.

3.5 vennRegions

derfinder has functions for annotating regions given their genomic state. A typical visualization is to then view how many regions overlap known exons, introns, intergenic regions, none of them or several of these groups in a venn diagram. The function vennRegions() makes this plot using the output from derfinder::annotateRegions() as shown in Figure 6.

## Make venn diagram
venn <- vennRegions(annoRegs)
Venn diagram of regions by annotation class.

Figure 6: Venn diagram of regions by annotation class

## It returns the actual venn counts information
venn
##   exon intergenic intron Counts
## 1    0          0      0      0
## 2    0          0      1     11
## 3    0          1      0     13
## 4    0          1      1      0
## 5    1          0      0   1175
## 6    1          0      1    113
## 7    1          1      0      0
## 8    1          1      1      0
## attr(,"class")
## [1] "VennCounts"

4 Reproducibility

This package was made possible thanks to:

Code for creating the vignette

## Create the vignette
library('rmarkdown')
system.time(render('derfinderPlot.Rmd', 'BiocStyle::html_document'))

## Extract the R code
library('knitr')
knit('derfinderPlot.Rmd', tangle = TRUE)
## Clean up
unlink('chr21', recursive = TRUE)
file.remove('derfinderPlotRef.bib')
## [1] TRUE

Date the vignette was generated.

## [1] "2018-12-03 22:18:00 EST"

Wallclock time spent generating the vignette.

## Time difference of 2.931 mins

R session information.

## - Session info -------------------------------------------------------------------------------------------------------
##  setting  value                                      
##  version  R version 3.5.1 Patched (2018-07-24 r75008)
##  os       Windows Server 2012 R2 x64                 
##  system   x86_64, mingw32                            
##  ui       RTerm                                      
##  language (EN)                                       
##  collate  C                                          
##  ctype    English_United States.1252                 
##  tz       America/New_York                           
##  date     2018-12-03                                 
## 
## - Packages -----------------------------------------------------------------------------------------------------------
##  package                           * version   date       lib source        
##  acepack                             1.4.1     2016-10-29 [2] CRAN (R 3.5.1)
##  AnnotationDbi                     * 1.44.0    2018-12-03 [2] Bioconductor  
##  AnnotationFilter                    1.6.0     2018-12-04 [2] Bioconductor  
##  assertthat                          0.2.0     2017-04-11 [2] CRAN (R 3.5.1)
##  backports                           1.1.2     2017-12-13 [2] CRAN (R 3.5.0)
##  base64enc                           0.1-3     2015-07-28 [2] CRAN (R 3.5.0)
##  bibtex                              0.4.2     2017-06-30 [2] CRAN (R 3.5.1)
##  bindr                               0.1.1     2018-03-13 [2] CRAN (R 3.5.1)
##  bindrcpp                            0.2.2     2018-03-29 [2] CRAN (R 3.5.1)
##  Biobase                           * 2.42.0    2018-12-03 [2] Bioconductor  
##  BiocGenerics                      * 0.28.0    2018-12-03 [2] Bioconductor  
##  BiocManager                         1.30.4    2018-11-13 [2] CRAN (R 3.5.1)
##  BiocParallel                        1.16.2    2018-12-03 [2] Bioconductor  
##  BiocStyle                         * 2.10.0    2018-12-04 [2] Bioconductor  
##  biomaRt                             2.38.0    2018-12-04 [2] Bioconductor  
##  Biostrings                          2.50.1    2018-12-04 [2] Bioconductor  
##  biovizBase                          1.30.0    2018-12-04 [2] Bioconductor  
##  bit                                 1.1-14    2018-05-29 [2] CRAN (R 3.5.1)
##  bit64                               0.9-7     2017-05-08 [2] CRAN (R 3.5.1)
##  bitops                              1.0-6     2013-08-17 [2] CRAN (R 3.5.1)
##  blob                                1.1.1     2018-03-25 [2] CRAN (R 3.5.1)
##  bookdown                            0.8       2018-12-03 [2] CRAN (R 3.5.1)
##  BSgenome                            1.50.0    2018-12-04 [2] Bioconductor  
##  bumphunter                        * 1.24.5    2018-12-04 [2] Bioconductor  
##  checkmate                           1.8.5     2017-10-24 [2] CRAN (R 3.5.1)
##  cli                                 1.0.1     2018-09-25 [2] CRAN (R 3.5.1)
##  cluster                             2.0.7-1   2018-04-13 [2] CRAN (R 3.5.1)
##  codetools                           0.2-15    2016-10-05 [2] CRAN (R 3.5.1)
##  colorspace                          1.3-2     2016-12-14 [2] CRAN (R 3.5.1)
##  crayon                              1.3.4     2017-09-16 [2] CRAN (R 3.5.1)
##  curl                                3.2       2018-03-28 [2] CRAN (R 3.5.1)
##  data.table                          1.11.8    2018-09-30 [2] CRAN (R 3.5.1)
##  DBI                                 1.0.0     2018-05-02 [2] CRAN (R 3.5.1)
##  DelayedArray                        0.8.0     2018-12-04 [2] Bioconductor  
##  derfinder                         * 1.16.1    2018-12-04 [2] Bioconductor  
##  derfinderData                     * 2.0.0     2018-11-01 [2] Bioconductor  
##  derfinderHelper                     1.16.1    2018-12-03 [2] Bioconductor  
##  derfinderPlot                     * 1.16.1    2018-12-03 [1] Bioconductor  
##  dichromat                           2.0-0     2013-01-24 [2] CRAN (R 3.5.0)
##  digest                              0.6.18    2018-10-10 [2] CRAN (R 3.5.1)
##  doRNG                               1.7.1     2018-06-22 [2] CRAN (R 3.5.1)
##  dplyr                               0.7.8     2018-11-10 [2] CRAN (R 3.5.1)
##  ensembldb                           2.6.3     2018-12-04 [2] Bioconductor  
##  evaluate                            0.12      2018-10-09 [2] CRAN (R 3.5.1)
##  foreach                           * 1.4.4     2017-12-12 [2] CRAN (R 3.5.1)
##  foreign                             0.8-71    2018-07-20 [2] CRAN (R 3.5.1)
##  Formula                             1.2-3     2018-05-03 [2] CRAN (R 3.5.0)
##  GenomeInfoDb                      * 1.18.1    2018-12-04 [2] Bioconductor  
##  GenomeInfoDbData                    1.2.0     2018-10-06 [2] Bioconductor  
##  GenomicAlignments                   1.18.0    2018-12-04 [2] Bioconductor  
##  GenomicFeatures                   * 1.34.1    2018-12-04 [2] Bioconductor  
##  GenomicFiles                        1.18.0    2018-12-04 [2] Bioconductor  
##  GenomicRanges                     * 1.34.0    2018-12-04 [2] Bioconductor  
##  GGally                              1.4.0     2018-05-17 [2] CRAN (R 3.5.1)
##  ggbio                               1.30.0    2018-12-04 [2] Bioconductor  
##  ggplot2                             3.1.0     2018-10-25 [2] CRAN (R 3.5.1)
##  glue                                1.3.0     2018-07-17 [2] CRAN (R 3.5.1)
##  graph                               1.60.0    2018-12-03 [2] Bioconductor  
##  gridExtra                           2.3       2017-09-09 [2] CRAN (R 3.5.1)
##  gtable                              0.2.0     2016-02-26 [2] CRAN (R 3.5.1)
##  highr                               0.7       2018-06-09 [2] CRAN (R 3.5.1)
##  Hmisc                               4.1-1     2018-01-03 [2] CRAN (R 3.5.1)
##  hms                                 0.4.2     2018-03-10 [2] CRAN (R 3.5.1)
##  htmlTable                           1.12      2018-05-26 [2] CRAN (R 3.5.1)
##  htmltools                           0.3.6     2017-04-28 [2] CRAN (R 3.5.1)
##  htmlwidgets                         1.3       2018-09-30 [2] CRAN (R 3.5.1)
##  httr                                1.3.1     2017-08-20 [2] CRAN (R 3.5.1)
##  IRanges                           * 2.16.0    2018-12-03 [2] Bioconductor  
##  iterators                         * 1.0.10    2018-07-13 [2] CRAN (R 3.5.1)
##  jsonlite                            1.5       2017-06-01 [2] CRAN (R 3.5.1)
##  knitcitations                     * 1.0.8     2017-07-04 [2] CRAN (R 3.5.1)
##  knitr                             * 1.20      2018-02-20 [2] CRAN (R 3.5.1)
##  labeling                            0.3       2014-08-23 [2] CRAN (R 3.5.0)
##  lattice                             0.20-38   2018-11-04 [2] CRAN (R 3.5.1)
##  latticeExtra                        0.6-28    2016-02-09 [2] CRAN (R 3.5.1)
##  lazyeval                            0.2.1     2017-10-29 [2] CRAN (R 3.5.1)
##  limma                               3.38.3    2018-12-03 [2] Bioconductor  
##  locfit                            * 1.5-9.1   2013-04-20 [2] CRAN (R 3.5.1)
##  lubridate                           1.7.4     2018-04-11 [2] CRAN (R 3.5.1)
##  magrittr                            1.5       2014-11-22 [2] CRAN (R 3.5.1)
##  Matrix                              1.2-15    2018-11-01 [2] CRAN (R 3.5.1)
##  matrixStats                         0.54.0    2018-07-23 [2] CRAN (R 3.5.1)
##  memoise                             1.1.0     2017-04-21 [2] CRAN (R 3.5.1)
##  munsell                             0.5.0     2018-06-12 [2] CRAN (R 3.5.1)
##  nnet                                7.3-12    2016-02-02 [2] CRAN (R 3.5.1)
##  org.Hs.eg.db                      * 3.7.0     2018-12-03 [2] Bioconductor  
##  OrganismDbi                         1.24.0    2018-12-04 [2] Bioconductor  
##  pillar                              1.3.0     2018-07-14 [2] CRAN (R 3.5.1)
##  pkgconfig                           2.0.2     2018-08-16 [2] CRAN (R 3.5.1)
##  pkgmaker                            0.27      2018-05-25 [2] CRAN (R 3.5.1)
##  plyr                                1.8.4     2016-06-08 [2] CRAN (R 3.5.1)
##  prettyunits                         1.0.2     2015-07-13 [2] CRAN (R 3.5.1)
##  progress                            1.2.0     2018-06-14 [2] CRAN (R 3.5.1)
##  ProtGenerics                        1.14.0    2018-12-03 [2] Bioconductor  
##  purrr                               0.2.5     2018-05-29 [2] CRAN (R 3.5.1)
##  qvalue                              2.14.0    2018-12-03 [2] Bioconductor  
##  R6                                  2.3.0     2018-10-04 [2] CRAN (R 3.5.1)
##  RBGL                                1.58.1    2018-12-03 [2] Bioconductor  
##  RColorBrewer                        1.1-2     2014-12-07 [2] CRAN (R 3.5.0)
##  Rcpp                                1.0.0     2018-11-07 [2] CRAN (R 3.5.1)
##  RCurl                               1.95-4.11 2018-07-15 [2] CRAN (R 3.5.1)
##  RefManageR                          1.2.0     2018-04-25 [2] CRAN (R 3.5.1)
##  registry                            0.5       2017-12-03 [2] CRAN (R 3.5.0)
##  reshape                             0.8.8     2018-10-23 [2] CRAN (R 3.5.1)
##  reshape2                            1.4.3     2017-12-11 [2] CRAN (R 3.5.1)
##  rlang                               0.3.0.1   2018-10-25 [2] CRAN (R 3.5.1)
##  rmarkdown                           1.10      2018-06-11 [2] CRAN (R 3.5.1)
##  rngtools                            1.3.1     2018-05-15 [2] CRAN (R 3.5.1)
##  rpart                               4.1-13    2018-02-23 [2] CRAN (R 3.5.1)
##  rprojroot                           1.3-2     2018-01-03 [2] CRAN (R 3.5.1)
##  Rsamtools                           1.34.0    2018-12-04 [2] Bioconductor  
##  RSQLite                             2.1.1     2018-05-06 [2] CRAN (R 3.5.1)
##  rstudioapi                          0.8       2018-10-02 [2] CRAN (R 3.5.1)
##  rtracklayer                         1.42.1    2018-12-04 [2] Bioconductor  
##  S4Vectors                         * 0.20.1    2018-12-03 [2] Bioconductor  
##  scales                              1.0.0     2018-08-09 [2] CRAN (R 3.5.1)
##  sessioninfo                       * 1.1.1     2018-11-05 [2] CRAN (R 3.5.1)
##  stringi                             1.2.4     2018-07-20 [2] CRAN (R 3.5.1)
##  stringr                             1.3.1     2018-05-10 [2] CRAN (R 3.5.1)
##  SummarizedExperiment                1.12.0    2018-12-04 [2] Bioconductor  
##  survival                            2.43-3    2018-11-26 [2] CRAN (R 3.5.1)
##  tibble                              1.4.2     2018-01-22 [2] CRAN (R 3.5.1)
##  tidyselect                          0.2.5     2018-10-11 [2] CRAN (R 3.5.1)
##  TxDb.Hsapiens.UCSC.hg19.knownGene * 3.2.2     2018-07-30 [2] Bioconductor  
##  VariantAnnotation                   1.28.3    2018-12-04 [2] Bioconductor  
##  withr                               2.1.2     2018-03-15 [2] CRAN (R 3.5.1)
##  xfun                                0.4       2018-10-23 [2] CRAN (R 3.5.1)
##  XML                                 3.98-1.16 2018-08-19 [2] CRAN (R 3.5.1)
##  xml2                                1.2.0     2018-01-24 [2] CRAN (R 3.5.1)
##  xtable                              1.8-3     2018-08-29 [2] CRAN (R 3.5.1)
##  XVector                             0.22.0    2018-12-04 [2] Bioconductor  
##  yaml                                2.2.0     2018-07-25 [2] CRAN (R 3.5.1)
##  zlibbioc                            1.28.0    2018-12-04 [2] Bioconductor  
## 
## [1] C:/Users/biocbuild/bbs-3.8-bioc/tmpdir/Rtmpycu5Li/Rinst256c180e34a1
## [2] C:/Users/biocbuild/bbs-3.8-bioc/R/library

5 Bibliography

This vignette was generated using BiocStyle (Oles, Morgan, and Huber, 2018) with knitr (Xie, 2014) and rmarkdown (Allaire, Xie, McPherson, Luraschi, et al., 2018) running behind the scenes.

Citations made with knitcitations (Boettiger, 2017).

[1] J. Allaire, Y. Xie, J. McPherson, J. Luraschi, et al. rmarkdown: Dynamic Documents for R. R package version 1.10. 2018. URL: https://CRAN.R-project.org/package=rmarkdown.

[1] S. Arora, M. Morgan, M. Carlson and H. Pagès. GenomeInfoDb: Utilities for manipulating chromosome and other ‘seqname’ identifiers. 2017. DOI: 10.18129/B9.bioc.GenomeInfoDb.

[1] C. Boettiger. knitcitations: Citations for ‘Knitr’ Markdown Files. R package version 1.0.8. 2017. URL: https://CRAN.R-project.org/package=knitcitations.

[1] BrainSpan. “Atlas of the Developing Human Brain [Internet]. Funded by ARRA Awards 1RC2MH089921-01, 1RC2MH090047-01, and 1RC2MH089929-01.” 2011. URL: http://www.brainspan.org/.

[1] M. Carlson and B. P. Maintainer. TxDb.Hsapiens.UCSC.hg19.knownGene: Annotation package for TxDb object(s). R package version 3.2.2. 2015.

[1] L. Collado-Torres, A. E. Jaffe and J. T. Leek. derfinderPlot: Plotting functions for derfinder. https://github.com/leekgroup/derfinderPlot - R package version 1.16.1. 2017. DOI: 10.18129/B9.bioc.derfinderPlot. URL: http://www.bioconductor.org/packages/derfinderPlot.

[1] L. Collado-Torres, A. Jaffe and J. Leek. derfinderData: Processed BigWigs from BrainSpan for examples. R package version 2.0.0. 2018. URL: https://github.com/leekgroup/derfinderData.

[1] G. Csárdi, R. core, H. Wickham, W. Chang, et al. sessioninfo: R Session Information. R package version 1.1.1. 2018. URL: https://CRAN.R-project.org/package=sessioninfo.

[1] A. E. Jaffe, P. Murakami, H. Lee, J. T. Leek, et al. “Bump hunting to identify differentially methylated regions in epigenetic epidemiology studies”. In: International Journal of Epidemiology (2012).

[1] E. Neuwirth. RColorBrewer: ColorBrewer Palettes. R package version 1.1-2. 2014. URL: https://CRAN.R-project.org/package=RColorBrewer.

[1] A. Oles, M. Morgan and W. Huber. BiocStyle: Standard styles for vignettes and other Bioconductor documents. R package version 2.10.0. 2018. URL: https://github.com/Bioconductor/BiocStyle.

[1] R Core Team. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing. Vienna, Austria, 2018. URL: https://www.R-project.org/.

[1] H. Wickham. “Reshaping Data with the reshape Package”. In: Journal of Statistical Software 21.12 (2007), pp. 1–20. URL: http://www.jstatsoft.org/v21/i12/.

[1] H. Wickham. “The Split-Apply-Combine Strategy for Data Analysis”. In: Journal of Statistical Software 40.1 (2011), pp. 1–29. URL: http://www.jstatsoft.org/v40/i01/.

[1] H. Wickham. ggplot2: Elegant Graphics for Data Analysis. Springer-Verlag New York, 2016. ISBN: 978-3-319-24277-4. URL: http://ggplot2.org.

[1] H. Wickham. scales: Scale Functions for Visualization. R package version 1.0.0. 2018. URL: https://CRAN.R-project.org/package=scales.

[1] H. Wickham. “testthat: Get Started with Testing”. In: The R Journal 3 (2011), pp. 5–10. URL: https://journal.r-project.org/archive/2011-1/RJournal_2011-1_Wickham.pdf.

[1] Y. Xie. “knitr: A Comprehensive Tool for Reproducible Research in R”. In: Implementing Reproducible Computational Research. Ed. by V. Stodden, F. Leisch and R. D. Peng. ISBN 978-1466561595. Chapman and Hall/CRC, 2014. URL: http://www.crcpress.com/product/isbn/9781466561595.

[1] T. Yin, D. Cook and M. Lawrence. “ggbio: an R package for extending the grammar of graphics for genomic data”. In: Genome Biology 13.8 (2012), p. R77.

[1] T. Yin, M. Lawrence and D. Cook. biovizBase: Basic graphic utilities for visualization of genomic data. R package version 1.30.0. 2018.