Predicting expression: the complementary power of histone modification and transcription factor binding data
Epigenetics & Chromatin volume 7, Article number: 36 (2014)
Transcription factors (TFs) and histone modifications (HMs) play critical roles in gene expression by regulating mRNA transcription. Modelling frameworks have been developed to integrate high-throughput omics data, with the aim of elucidating the regulatory logic that results from the interactions of DNA, TFs and HMs. These models have yielded an unexpected and poorly understood result: that TFs and HMs are statistically redundant in explaining mRNA transcript abundance at a genome-wide level.
We constructed predictive models of gene expression by integrating RNA-sequencing, TF and HM chromatin immunoprecipitation sequencing and DNase I hypersensitivity data for two mammalian cell types. All models identified genome-wide statistical redundancy both within and between TFs and HMs, as previously reported. To investigate potential explanations, groups of genes were constructed for ontology-classified biological processes. Predictive models were constructed for each process to explore the distribution of statistical redundancy. We found significant variation in the predictive capacity of TFs and HMs across these processes and demonstrated the predictive power of HMs to be inversely proportional to process enrichment for housekeeping genes.
It is well established that the roles played by TFs and HMs are not functionally redundant. Instead, we attribute the statistical redundancy reported in this and previous genome-wide modelling studies to the heterogeneous distribution of HMs across chromatin domains. Furthermore, we conclude that statistical redundancy between individual TFs can be readily explained by nucleosome-mediated cooperative binding. This could possibly help the cell confer regulatory robustness by rejecting signalling noise and allowing control via multiple pathways.
A critical challenge in molecular biology is understanding the biological mechanisms underlying precise spatiotemporal regulation of gene expression in mammals. Significant regulation is known to occur at the level of transcriptional initiation and elongation , through the combinatorial interactions of transcription factors (TFs) [2, 3] and histone modifications (HMs) [4, 5]. By binding to specific DNA motifs, activator or repressor TFs regulate the recruitment and behaviour of RNA polymerase II (RNAP-II). Direct interactions between TFs and the transcription pre-initiation complex require genomic proximity to the transcription start site (TSS) or higher-order chromatin looping , corresponding with TF-binding motifs in the promoter or enhancer/silencer regions respectively [2, 7]. Post-translational modifications of the amino-termini of nucleosomal histones are also known to regulate transcription [8, 9] by either modulating the local chromatin structure to control TF accessibility  or directly recruiting chromatin remodellers and other related enzymes . Altered gene expression caused by abnormalities in TF or HM patterns has been directly associated with hundreds of human diseases , including leukaemia , prostate cancer  and various developmental, autoimmune, neurological, inflammatory and neoplastic disorders .
The complex relationship between TFs and HMs is still largely unexplored. Statistical models have recently been developed to integrate high-throughput omics data with the aim of understanding the regulatory logic that follows from these interactions (recently reviewed in ). These models demonstrated that TFs and HMs are accurate predictors of mRNA transcript abundance in several organisms and cell types. However, the utility of this data-driven framework is not the ability to predict gene expression, but rather the insights that can be gained from investigating the putative regulatory interactions captured by an accurate model. A recent study showed that models constructed from position weight matrix-predicted TF binding, when combined with a tissue-specific H3K4me3 prior, yield similar prediction accuracy to models constructed from actual chromatin immunoprecipitation sequencing (ChIP-seq) data . Furthermore, a principal component analysis of these models was able to extract correctly the established regulatory roles (i.e., activator or repressor) of 20 TFs and HMs in mouse embryonic stem cells (mESCs) .
In addition to providing a powerful explorative framework, predictive modelling of gene expression has yielded an unexpected and previously unexplained result: that TFs and HMs are statistically redundant in explaining mRNA transcript abundance at a genome-wide level. Moreover, redundancy has been identified both within and between TFs and HMs in mESCs , to the extent that a single TF (E2f1) is almost as informative as a panel of 20 TFs and HMs with well-established regulatory roles . Here, statistical redundancy equates to two variables providing equivalent information (e.g., due to being strongly correlated), and it is important to appreciate that this does not necessarily imply functional redundancy (i.e., removing either element does not affect gene expression). Assuming the existence of functional redundancy between TFs and HMs outwardly contradicts our understanding of transcriptional regulation, in which TFs and HMs play complementary yet distinct roles in RNAP-II recruitment and elongation.
In this study, we investigate the fundamental cause of the statistical redundancy within and between TFs and HMs. First, we validate the robustness of previous findings by constructing genome-wide predictive models for different mammalian cell types and modelling algorithms. We confirm that TFs and HMs are both predictive of gene expression (measured by mRNA transcript abundance) and statistically redundant at a genome-wide level. Our analysis was extended by constructing individual models for thousands of ontology-classified biological processes. By diverging from previous genome-wide analyses, we identify significant variance in the distribution of statistical redundancy across these processes, which we attribute to regions of open nucleosome-sparse chromatin maintained by the activity of boundary proteins and enriched for housekeeping genes. Finally, we discuss several implications of our findings and how they contribute to the overall understanding of regulatory logic in mammalian systems.
Results and discussion
Transcription factors and histone modifications are predictive of mRNA transcript abundance
As TFs and HMs are known to play critical roles in regulating transcription, accurate predictive models of mRNA transcript abundance have been constructed from corresponding ChIP-seq binding data for various organisms, cell types and modelling techniques [14, 17–19]. To validate the robustness of these findings, we constructed both log-linear and support vector regression (SVR) models for two mammalian cell types: mESCs and human lymphoblastoids (GM12878).
Table 1 presents the prediction accuracy of log-linear and SVR models constructed from three sets of data: TF binding (TF), HM and DNase-I hypersensitivity (HM+DNase; both proxies for chromatin accessibility) and the concatenation of both (TF+HM+DNase). The proportion of transcript abundance variation explained by each model (adjusted R2) was calculated using a tenfold cross-validation , with the presented adjusted R2 values capturing the mean and standard deviation of these folds. The relationship between measured and predicted mRNA transcript abundance is visualised in Additional file 1: Figure S1 and Additional file 2: Figure S2 for mESCs and GM12878 cells, respectively.
It is evident that small sets of TFs, HMs and DNase are predictive of genome-wide mRNA transcript abundance in mESCs, as reported in previous studies . We have further demonstrated that these results extend to different mammalian cell types and are robust against algorithm selection. As support vector regression (SVR) yields minimal improvement despite a two-order-of-magnitude increase in required CPU time, only log-linear regression is applied throughout the remainder of this study.
Transcription factors and histone modifications are less predictive of mRNA transcript abundance in differentiated cells
Our results reveal that models of transcriptional regulation in GM12878 cells are less accurate than those constructed for mESCs. To ensure that this does not simply reflect the different proportion of zero-expression genes in the GM12878 and mESC data, we constructed log-linear regression models considering only genes with R/FPKM(fragments per kilobase per million)-normalised transcript abundance >0. These models yielded an average reduction in adjusted R2 prediction accuracy of 58% and 7% for GM12878 and mESC, respectively (not shown), excluding a high proportion of zero-expression genes in the differentiated GM12878 cell line as the underlying cause of the observed performance gap. The removal of these genes also adversely affected subsequent analysis (not shown), as much of the information used to elucidate the silencing roles of some regulatory elements (e.g., H3K9me3 and H3K27me3) is lost.
One explanation for the performance gap between mESC and GM12878 models may be the selection of individual TFs, which vary between cell types. The 12 TFs selected for mESCs (see Table 2) are known to play important regulatory roles specific to embryonic stem cell biology; i.e., as self-renewal regulators and pluripotency reprogramming factors [21, 22]. Initial differentiation of embryonic stem cells involves silencing of these TFs and activation of developmental regulators [23, 24], necessitating the selection of alternate TFs for GM12878 modelling. Although the 11 GM12878 TFs chosen are known to play key roles (see Table 2) in regulating various cellular, metabolic and development processes , it is possible that they represent a smaller fraction of the key regulators than the 12 considered for mESCs (in which regulatory logic is better characterised).
A more likely explanation for the performance gap between predictive models for embryonic stem versus differentiated cells is the increasing heterogeneity in regulatory mechanisms following differentiation. In embryonic stem cells, the majority of gene promoters containing CpG (dinucleotide) islands are characterised by H3K4me3-bearing nucleosomes. Many of these genes are maintained in a bivalent state with the inherently antagonistic H3K27me3 repressive mark; these genes are expressed only at low levels, but are poised for rapid transition to active or silenced states in response to differentiation signals or other extracellular stimuli . Accordingly, the genome-wide correlation between H3K4me3 and H3K27me3 in mESCs is very high (Pearson’s r = 0.78 versus -0.20 in GM12878, not shown).
Lineage-specific gene expression programs exhibit far less regulatory homogeneity; e.g., many genes are silenced by H3K27me3/polycomb-mediated facultative heterochromatinisation, whereas others are silenced by H3K9me3/HP1-mediated constitutive heterochromatinisation and subsequent DNA methylation. Synergistic and conditional relationships become more widespread (e.g., H3K4me3 is positively associated with expression only in the absence of H3K27me3), limiting the effectiveness of regression models only able to capture additive and simple-multiplicative relationships.
Future predictive modelling studies of differentiated cells could integrate information for the H2A.Z histone variant (not assayed), which is critical for maintaining metastable equilibrium between antagonistic H3K4me3 and H3K27me3 [37, 38], and could therefore be used to classify genes subject to different regulatory logic.
Individual transcription factors are statistically redundant for predicting mRNA transcript abundance
Functional redundancy between individual TFs has previously been observed in Saccharomyces cerevisiae and Drosophila melanogaster and proposed as an important mechanism in eukaryotes . To investigate the existence of similar redundancy within mammalian TFs and HMs, log-linear regression models of genome-wide mRNA transcript abundance were constructed for all combinations of n TFs and m HMs and DNase considered in this study. Figure 1(a,b) demonstrates the adjusted R2 distributions for these 4,095 mESC TF models and 255 mESC HM+DNase models respectively, with the minimum and maximum prediction accuracies for each n and m connected by the blue and red curves. The corresponding results for GM12878 models are presented in Figure 1(c,d).
Although models constructed from greater numbers of regulatory elements generally yielded improved prediction accuracy, this improvement diminished considerably for values of n or m greater than 4. This is particularly evident for mESC TF models; despite all 12 TFs being known to play key roles in mESC biology , a model constructed from E2f1 data alone yielded equivalent mRNA transcript abundance prediction accuracy (adjusted R2 = 0.57) as a model integrating all 12 (adjusted R2 = 0.59). The most predictive TFs (E2f1, c-Myc, n-Myc and Zfx) were those known to localise preferentially to promoter regions (e.g., E2f1 was found to bind to more than 60% of mESC promoters), whereas the least predictive TFs (Smad1 and Stat3) bind further from the TSS (e.g., Smad1 was found to bind to less than 3% of mESC promoters).
Previous studies have demonstrated that many TFs (including E2f1 and Oct4) do not require the presence of a consensus motif to bind in vivo, but rather may be recruited to the promoter with the assistance of other bound TFs [39, 40]. These results may partially explain the observed statistical redundancy between mammalian TFs; i.e., if one TF is necessary for the recruitment of another, these TFs will provide similar predictive information regarding the regulatory state despite their distinct functional roles. It should be noted that this is distinct from functional redundancy; i.e., it does not imply the removal of any individual TF would not affect gene expression. It has previously been proposed that the parallel deployment of cooperatively bound TFs confers robustness to gene expression, both allowing the regulatory state of a gene to reject signalling noise and providing control through activation or inhibition of multiple signalling pathways .
Transcription factors and histone modifications provide equivalent information regarding genome-wide transcriptional regulation
In Table 1, we present the prediction accuracy of log-linear and SVR models constructed from three sets of data: TF binding (TF), HM and DNase-I hypersensitivity (HM+DNase) and the concatenation of both (TF+HM+DNase). In addition to the findings described earlier, it is apparent that the TF+HM+DNase models perform only marginally better than those constructed from TF or HM+DNase data alone, irrespective of algorithm or cell type. Although TFs and HMs independently provide significant information regarding transcriptional regulation, it appears that they provide the same information and are therefore statistically redundant. To quantify this phenomenon, we performed a partial correlation analysis by calculating the correlation between genome-wide transcript abundance prediction residuals for TF and HM+DNase models . The residuals were found to be highly correlated (Pearson’s r > 0.8 for both mESCs and GM12878 cells, not shown), indicating a significant degree of association between the TF and HM+DNase data. These results (previously identified for mESCs [15, 16]) outwardly contradict our understanding of transcriptional regulation, in which TFs and HMs play complementary yet distinct roles in RNAP-II recruitment and elongation.
Prediction of transcript abundance for genes grouped by biological process suggests a more heterogeneous role for transcription factors and histone modifications
To investigate the source of statistical redundancy between TFs and HMs, we constructed individual predictive models for thousands of ontology-classified biological processes. Insight can be gained into the nature of this redundancy by investigating its distribution across the smaller groups of genes contributing to each process.
The mESC and GM12878 genes were grouped by ontology-classified biological process. Two regression models were constructed for each set of genes: one considering only TF-binding data and the other considering only HM and DNase data. The ratio of adjusted R2 values for the TF and HM+DNase models was calculated to capture their relative performance.
Of the 1,880 mESC processes considered, 25 were found to exhibit a significant TF-to-HM+DNase adjusted R2 ratio (i.e., demonstrating that TF binding is more predictive of mESC mRNA transcript abundance than HMs and DNase for the markers considered in this study, Benjamini–Hochberg-corrected P < 0.05 ). A full list of these processes and their respective ratios is provided in Additional file 3: Table S1. Furthermore, 523 processes were found to exhibit a significant HM+DNase-to-TF adjusted R2 ratio (i.e., demonstrating that HMs and DNase are more predictive of mRNA transcript abundance than TF binding). These processes and their respective ratios are listed in Additional file 4: Table S2. The specific TF and HM+DNase adjusted R2 values used to calculate the ratios for each of the 1,880 processes are provided in Additional file 5: Table S3.
The distributions of adjusted R2 values for models constructed from mESC TF and HM+DNase data (visualised in Figure 2) demonstrate that their relative predictive power is heterogeneous across different biological processes. A similar distribution of adjusted R2 values is evident for GM12878 data (not shown), although statistically significant outliers were not confidently identified due to an overall lower prediction accuracy of GM12878 models (described earlier). It is important to note that this lack of outliers does not adversely affect subsequent analysis, which focuses on statistically significant trends across high- and low-scoring biological processes rather than the individual processes themselves.
Our results suggest that the genome-wide redundancy reported in previous studies [15, 16] is not indicative of functional redundancy, but rather arises from averaging over heterogeneous groups of genes subject to different regulatory logic. Moreover, the observation that HM and DNase data were significantly more accurate in predicting the mRNA transcript abundance of mESC genes contributing to 28% of biological processes, suggests the existence of a small number of genes for which TF binding is considerably more informative. If under-represented in the processes examined, these genes would introduce negative bias into the null distribution (and therefore increase the number of statistically significant outliers) when randomly sampled during bootstrapped significance testing. This is also consistent with the order-of-magnitude fewer processes (1.3%) for which contributing mRNA transcript abundance was more accurately predicted by TF-binding data.
Redundancy in transcriptional regulation is dependent upon enrichment for housekeeping genes
The set of genes for which TF binding is considerably more predictive of gene expression than HM and DNase data was comparatively small (Figure 2). Inspecting the biological processes with high TF-to-HM+DNase and HM+DNase-to-TF adjusted R2 ratios for their constituent genes, it is apparent that the former are enriched for housekeeping tasks (e.g., ncRNA processing and RNA splicing) and the latter for tissue and context-specific processes (e.g., signal transduction and regulation of cell differentiation). To investigate whether these two groups of genes can be characterised accordingly, the top 100 processes from each list were tested for enrichment of housekeeping genes.
Figure 3 presents the housekeeping-gene enrichment of biological processes with the top 100 TF-to-HM+DNase and HM+DNase-to-TF adjusted R2 ratios for both (a) mESCs and (b) GM12878 cells. In both cases, the proportion of housekeeping genes contributing to biological processes is significantly larger for the top 100 TF-to-HM+DNase group (Welch’s t-test (a) P < 2.2 × 10-16 and (b) P < 2.6 × 10-6). These results suggest TF binding provides more information regarding the transcriptional regulatory state of mammalian biological processes enriched for housekeeping genes.
Our findings can be explained by considering the spatial chromatin structure, as housekeeping genes are known to maintain constant ubiquitous expression by co-location in regions of actively transcribed open chromatin (e.g., at the boundaries of euchromatin and heterochromatin, topologically associating domains and larger A and B compartments [6, 45, 46]). These regions are maintained primarily by the activity of boundary proteins (e.g., CTCF ) rather than histone acetylation and methyl-recognising co-factors . They are also significantly depleted for histone H1 (responsible for solenoidal chromatin packing ) and exhibit overall nucleosomal sparsity to provide unrestricted TF accessibility . As HM ChIP-seq data was not normalised to nucleosome density (not assayed), this combination of nucleosome sparsity and TF-modulated chromatin structure presumably explains why HMs provide comparatively little information regarding the regulatory state of housekeeping genes. As TF–DNA complexes in open regions are capable of remaining stable throughout multiple rounds of transcription [51, 52], it is also unsurprising that a snapshot of local TF binding would provide more information regarding housekeeping mRNA transcript abundance than in the case of dynamically modulated chromatin.
Predictive modelling frameworks (recently reviewed in ) have the potential to fill an important gap between thermodynamically driven models of individual transcription regulatory events [53, 54] and association-driven network models of indirect gene regulation (e.g., those represented in the DREAM challenges ). Rather than modelling the regulation of specific genes, they can lead to more general conclusions regarding the roles and interactions of TFs, HMs and other key regulators of gene expression. Furthermore, they avoid the common issue of an underdetermined system by treating individual genes as observations of transcriptional regulatory logic in action, rather than variables in an association-driven analysis .
Recent predictive modelling studies have identified statistical redundancy between the regulatory roles of TFs and HMs [15, 16]. These findings outwardly contradict our understanding of transcriptional regulation, in which TFs and HMs play complementary yet distinct roles in RNAP-II recruitment and elongation. Moreover, there have previously been minimal attempts to resolve this contradiction (or even to distinguish between statistical and functional redundancy), potentially leading readers to perceive this modelling framework as one prone to capturing invalid biology. For the above reasons and to enhance our understanding of transcriptional regulatory logic, we believe that it is important to identify the underlying cause of this recurring statistical redundancy.
In this study, we validated the robustness of previous findings across multiple mammalian cell types and using different modelling algorithms. We extend this analysis by constructing individual models for thousands of ontology-classified biological processes, identifying significant variation in the relative predictive power of TFs and HMs across processes (i.e., the redundancy observed at the genome-wide level breaks down at this resolution). Importantly, this resolves the paradox between the distinct regulatory roles of TFs and HMs and the statistical redundancy within and between these elements.
Our investigation has highlighted several examples of simple predictive models yielding complex results that are consistent with our current understanding of fundamental molecular biology. With the hindsight provided by recent surveys of spatial genomic domains based on chromatin conformation capture , we can identify the signature of housekeeping genes localised to nucleosome-sparse domain boundaries by our inability to predict their expression using HM ChIP-seq data. Similarly, the statistical redundancy between TFs corresponds with the recently established notion of a transcription factor hierarchy, whereby the binding of a pioneer TF initiates a sequence of cooperative binding events that results in chromatin remodelling and/or RNAP-II recruitment . The well-characterised crosstalk between TFs and HMs in regulating transcriptional initiation and elongation is also reflected in the statistical redundancy between TFs and HMs, and importantly our results have demonstrated that such correlation is unlikely to imply functionally redundant regulatory roles. These outcomes highlight the potential of predictive modelling as a powerful explorative framework for integrating heterogeneous genome-wide datasets to elucidate novel biology, and we encourage other researchers to incorporate such models in their own analysis pipelines.
Data availability and implementation
Calculation of transcription factor–gene association strength
where g k is the height (mapped tags) of the k th TF-binding peak, d k is the distance (in base pairs) separating the k th peak from the TSS of gene i, and d0 is the empirical decay rate derived from the approximate average widths of ChIP-seq peaks (d0 = 5,000 for all TFs except E2f1 (d0 = 500) ). Binding sites further than 30,000 bp from the TSS were not considered as their weighted contribution is negligible. The TFAS matrix A was log-transformed and quantile-normalised .
An alternative formulation of the TFAS involves simply summing the number of mapped ChIP-seq tags either side of the TSS [16, 17] (e.g., -4 to approximately 4 kbp). The exponentially decaying formulation was chosen as it corresponds with the observed sharpness of ChIP-seq TF-binding peaks about the TSS and yields more accurate predictions of mRNA transcript abundance .
Calculation of histone and DNase scores
where g k is the number of ChIP/DNase-seq reads for j mapped to position k relative to the TSS of i. A region 2,000 bp either side of the TSS was chosen for consistency with previous studies [15–17, 19]. An equivalent method was applied to DNase-seq tags to produce a DNase score. The concatenated histone and DNase score matrix B was log-transformed and quantile-normalised as per the TFAS matrix A. Unlike TFs, HMs do not exhibit sharp, well-defined ChIP-seq peaks about the TSS. This prevents the formulation of histone and DNase scores equivalent to Equation 1 .
Regression models for predicting mRNA transcript abundance
Predictive models of mRNA transcript abundance were constructed using two regression techniques: log-linear regression and SVR , as illustrated in Figure 4(a). Both techniques have been previously applied to modelling transcript abundance as a function of transcriptional regulatory elements and demonstrated to yield comparable predictive performance [15–19]. However, as log-linear regression and nonlinear SVR have previously been applied either to independent datasets or with different TFAS/histone score formulations, it remains unclear which is more appropriate for transcript abundance modelling.
The log-linear regression model describing mRNA transcript abundance as a function of TF binding, HMs and DNase was formulated as:
where y i is the mRNA transcript abundance of gene i, μ is the basal transcript abundance and ε i is the gene-specific error term [14, 15, 18]. For a gene i and TF j, a ij is the TFAS defined in Equation 1 and β j is the fitted coefficient. Similarly, b ik is the histone (or DNase) score for a gene i and HM (or DNase) k defined in Equation 2 and γ k is the fitted coefficient. The constant σ is fitted from a 20% held-aside dataset to avoid evaluation of log(0). A model considering only the TFAS or HM+DNase score data can be constructed by excluding the HM+DNase or TF-binding components from Equation 3, respectively. The linear regression implementation from the stats R package was used.
Support vector regression
The SVR model describing mRNA transcript abundance of a gene i, y i , as a nonlinear function of a TFAS and/or HM+DNase score matrix, X, can be formulated as:
where K (·) is the kernel function and α represents the difference between the Lagrange multipliers fitted using a constrained quadratic optimisation process (described in Additional file 6). The ε-SVR with radial basis kernel function implementation from the e1071 R package was used with default parameters.
Identifying heterogeneity in predictive power
Previous models of mRNA transcript abundance have focused on modelling mRNA transcript abundance genome-wide [15–19]. To investigate whether the relative performance of TF-binding and HM+DNase-based models varies across smaller sets of process-related genes, the Gene Ontology biological process annotations for the available set of 17,517 mESC and 38,041 GM12878 genes were considered . For each process, a set containing all genes annotated with that term or any descendant term was constructed. Sets containing fewer than 50 or greater than 10,000 genes were discarded, yielding 1,880 and 1,965 sets of genes (for mESC and GM12878 respectively) for analysis.
Two regression models were constructed for each set of genes: one considering only TF-binding data and the other considering only HM and DNase data. The performance of the fitted models was evaluated as an adjusted R2 score, which captures the proportion of variation in measured mRNA transcript abundance for those genes explained by the model. Unlike the R2 score (i.e., the coefficient of determination, equivalent to the square of the Pearson correlation coefficient and previously used to evaluate models of mRNA transcript abundance [16, 17]), the adjusted R2 prevents spurious inflation due to the introduction of additional explanatory variables . The ratio of adjusted R2 values for the TF and HM+DNase models was calculated to capture their relative performance.
A bootstrapped non-parametric test was conducted to identify sets of genes exhibiting a significant adjusted R2 ratio, as illustrated in Figure 4(b). Specifically, for each biological process annotating n genes, 5,000 sets of n genes were randomly sampled from the available 17,517/38,041 (mESC/GM12878) to generate a corresponding distribution of adjusted R2 ratios under the null hypothesis. From this distribution, a non-parametric P value was calculated using an empirical cumulative distribution function approximation . Statistically significant P values were identified by applying a Benjamini–Hochberg correction with a false discovery rate of 0.05 .
Identifying enrichment of housekeeping genes
If the gene-specific residual, , for a gene, i, is sufficiently large, it follows that the relationship between mRNA transcript abundance and the transcriptional regulatory elements described by the corresponding regression model does not hold for i. These poorly fitted genes were removed to identify enrichment of housekeeping annotation amongst sets of genes sharing common regulatory profiles. For each of the biological processes subsequently found to exhibit a statistically significant adjusted R2 ratio for the TF and HM+DNase models, genes exhibiting a studentised residual magnitude were therefore discarded . The remaining genes were tested for significant enrichment of housekeeping annotation using the bootstrapped non-parametric test methodology described above.
mouse embryonic stem cell
RNA polymerase II
support vector regression
transcription factor association strength
transcription start site.
Maston GA, Evans SK, Green MR:Transcriptional regulatory elements in the human genome. Annu Rev Genomics Hum Genet. 2006, 7: 29-59.
Farnham PJ:Insights from genomic profiling of transcription factors. Nat Rev Genet. 2009, 10 (9): 605-616.
Vaquerizas JM, Kummerfeld SK, Teichmann SA, Luscombe NM:A census of human transcription factors: function, expression and evolution. Nat Rev Genet. 2009, 10 (4): 252-263.
Berger SL:The complex language of chromatin regulation during transcription. Nature. 2007, 447 (7143): 407-412.
Kurdistani SK, Tavazoie S, Grunstein M:Mapping global histone acetylation patterns to gene expression. Cell. 2004, 117 (6): 721-733.
Dekker J, Marti-Renom MA, Mirny LA:Exploring the three-dimensional organization of genomes: interpreting chromatin interaction data. Nat Rev Genet. 2013, 14 (6): 390-403.
Li B, Carey M, Workman JL:The role of chromatin during transcription. Cell. 2007, 128 (4): 707-719.
Bernstein BE, Meissner A, Lander ES:The mammalian epigenome. Cell. 2007, 128 (4): 669-681.
Pekowska A, Benoukraf T, Ferrier P, Spicuglia S:A unique H3K4me2 profile marks tissue-specific gene regulation. Genome Res. 2010, 20 (11): 1493-1502.
Kouzarides T:Chromatin modifications and their function. Cell. 2007, 128 (4): 693-705.
Krivtsov AV, Feng Z, Lemieux ME, Faber J, Vempati S, Sinha AU, Xia X, Jesneck J, Bracken AP, Silverman LB, Kutok JL, Kung AL, Armstrong SA:H3K79 methylation profiles define murine and human MLL-AF4 leukemias. Cancer Cell. 2008, 14 (5): 355-368.
Shi Y:Histone lysine demethylases: emerging roles in development, physiology and disease. Nat Rev Genet. 2007, 8 (11): 829-833.
Portela A, Esteller M:Epigenetic modifications and human disease. Nat Biotechnol. 2010, 28 (10): 1057-1068.
Budden DM, Hurley DG, Crampin EJ:Predictive modelling of gene expression from transcriptional regulatory elements. Brief Bioinform. 2014, bbu034: doi:10.1093/bib/bbu034.
McLeay RC, Lesluyes T, Partida GC, Bailey TL:Genome-wide in silico prediction of gene expression. Bioinformatics. 2012, 28 (21): 2789-2796.
Cheng C, Gerstein M:Modeling the relative relationship of transcription factor binding and histone modifications to gene expression levels in mouse embryonic stem cells. Nucleic Acids Res. 2012, 40 (2): 553-568.
Cheng C, Yan K-K, Yip KY, Rozowsky J, Alexander R, Shou C, Gerstein M:A statistical framework for modeling gene expression using chromatin features and application to modENCODE datasets. Genome Biol. 2011, 12 (2): 15.
Ouyang Z, Zhou Q, Wong WH:ChIP-Seq of transcription factors predicts absolute and differential gene expression in embryonic stem cells. Proc Natl Acad Sci. 2009, 106 (51): 21521-21526.
Karlić R, Chung H-R, Lasserre J, Vlahoviček K, Vingron M:Histone modification levels are predictive for gene expression. Proc Natl Acad Sci. 2010, 107 (7): 2926-2931.
Arlot S, Celisse A:A survey of cross-validation procedures for model selection. Stat Surv. 2010, 4: 40-79.
Chen X, Xu H, Yuan P, Fang F, Huss M, Vega VB, Wong E, Orlov Y. L, Zhang W, Jiang J, Loh Y-H, Yeo HC, Yeo ZX, Narang V, Govindarajan KR, Leong B, Shahab A, Ruan Y, Bourque G, Sung W-K, Clarke ND, Wei C-L, Ng H-H:Integration of external signaling pathways with the core transcriptional network in embryonic stem cells. Cell. 2008, 133 (6): 1106-1117.
Meissner A:Epigenetic modifications in pluripotent and differentiated cells. Nat Biotechnol. 2010, 28 (10): 1079-1088.
Epsztejn-Litman S, Feldman N, Abu-Remaileh M, Shufaro Y, Gerson A, Ueda J, Deplus R, Fuks F, Shinkai Y, Cedar H, Bergman Y:De novo DNA methylation promoted by G9a prevents reprogramming of embryonically silenced genes. Nat Struct Mol Biol. 2008, 15 (11): 1176-1183.
Feldman N, Gerson A, Fang J, Li E, Zhang Y, Shinkai Y, Cedar H, Bergman Y:G9a-mediated irreversible epigenetic inactivation of Oct-3/4 during early embryogenesis. Nat Cell Biol. 2006, 8 (2): 188-194.
Cloonan N, Forrest AR, Kolle G, Gardiner BB, Faulkner GJ, Brown MK, Taylor DF, Steptoe AL, Wani S, Bethel G, Robertson AJ, Perkins AC, Bruce SJ, Lee CC, Ranade SS, Peckham HE, Manning JM, McKernan KJ, Grimmond SM:Stem cell transcriptome profiling via massive-scale mRNA sequencing. Nat Methods. 2008, 5 (7): 613-619.
Mortazavi A, Williams BA, McCue K, Schaeffer L, Wold B:Mapping and quantifying mammalian transcriptomes by RNA-Seq. Nat Methods. 2008, 5 (7): 621-628.
Flicek P, Amode MR, Barrell D, Beal K, Billis K, Brent S, Carvalho-Silva D, Clapham P, Coates G, Fitzgerald S, Gil L, Gironi CG, Gordon L, Hourlier T, Hunt S, Johnson N, Juettemann T, Kahari AK, Keenan S, Kulesha E, Martin FJ, Maurel T, McLaren WM, Murphy DN, Nag R, Overduin B, Pignatelli M, Pritchard B, Pritchard E, Riat HS:Ensembl 2014. Nucleic Acids Res. 2014, 42 (D1): 749-755.
Mapping of transcription factor binding sites in mouse embryonic stem cells. [http://www.ncbi.nlm.nih.gov/geo/query/acc.cgi?acc=GSE11431].
MIT CHiP-seq data. [ftp://ftp.broad.mit.edu/pub/papers/chipseq/].
Mikkelsen TS, Ku M, Jaffe DB, Issac B, Lieberman E, Giannoukos G, Alvarez P, Brockman W, Kim T-K, Koche RP, Lee W, Mendenhall E, O’Donovan A, Presser A, Russ C, Xie X, Meissner A, Wernig M, Jaenisch R, Nusbaum C, Lander ES, Bernstein BE:Genome-wide maps of chromatin state in pluripotent and lineage-committed cells. Nature. 2007, 448 (7153): 553-560.
Meissner A, Mikkelsen TS, Gu H, Wernig M, Hanna J, Sivachenko A, Zhang X, Bernstein BE, Nusbaum C, Jaffe DB, Gnirke A, Jaenisch R, Lander ES:Genome-scale DNA methylation maps of pluripotent and differentiated cells. Nature. 2008, 454 (7205): 766-770.
Genome-wide in silico prediction of gene expression. [http://research.imb.uq.edu.au/t.bailey/supplementary_data/McLeay2011a/].
Gene Ontology Consortium download annotations. [http://www.geneontology.org/GO.downloads.annotations.shtml].
Ashburner M, Ball CA, Blake JA, Botstein D, Butler H, Cherry JM, Davis AP, Dolinski K, Dwight SS, Eppig JT, Harris MA, Hill DP, Issel-Tarver L, Kasarskis A, Lewis S, Matese JC, Richardson JE, Ringwald M, Rubin GM, Sherlock G:Gene ontology: tool for the unification of biology. Nat Genet. 2000, 25 (1): 25-29.
Mouse Genome Informatics. [http://www.informatics.jax.org/homology.shtml].
Voigt P, Tee W-W, Reinberg D:A double take on bivalent promoters. Genes Dev. 2013, 27 (12): 1318-1338.
Hu G, Cui K, Northrup D, Liu C, Wang C, Tang Q, Ge K, Levens D, Crane-Robinson C, Zhao K:H2A.Z facilitates access of active and repressive complexes to chromatin in embryonic stem cell self-renewal and differentiation. Cell Stem Cell. 2013, 12 (2): 180-192.
Ku M, Jaffe JD, Koche RP, Rheinbay E, Endoh M, Koseki H, Carr SA, Bernstein BE:H2A.Z landscapes and dual modifications in pluripotent and multipotent stem cells underlie complex genome regulatory functions. Genome Biol. 2012, 13 (10): 1-13.
Jin VX, O’Geen H, Iyengar S:Identification of an OCT4 and SRY regulatory module using integrated computational and experimental genomics approaches. Genome Res. 2007, 17 (6): 807-817.
Xu X, Bieda M, Jin VX, Rabinovich A, Oberley MJ, Green R, Farnham PJ:A comprehensive ChIP–chip analysis of E2F1, E2F4, and E2F6 in normal and tumor cells reveals interchangeable roles of E2F family members. Genome Res. 2007, 17 (11): 1550-1561.
Schreiber SL, Bernstein BE:Signaling network model of chromatin. Cell. 2002, 111 (6): 771-778.
Baba K, Shibata R, Sibuya M:Partial correlation and conditional correlation as measures of conditional independence. Aust N Z J Stat. 2004, 46 (4): 657-664.
Benjamini Y, Hochberg Y:Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Series B (Methodological). 1995, 57: 289-300.
Welch BL:The generalization of Student’s problem when several different population variances are involved. Biometrika. 1947, 34: 28-35.
Dixon JR, Selvaraj S, Yue F, Kim A, Li Y, Shen Y, Hu M, Liu JS, Ren B:Topological domains in mammalian genomes identified by analysis of chromatin interactions. Nature. 2012, 485 (7398): 376-380.
Zhou G-L, Xin L, Song W, Di L-J, Liu G, Wu X-S, Liu D-P, Liang C-C:Active chromatin hub of the mouseα-globin locus forms in a transcription factory of clustered housekeeping genes. Mol Cell Biol. 2006, 26 (13): 5096-5105.
Phillips JE, Corces VG:CTCF: Master weaver of the genome. Cell. 2009, 137 (7): 1194-1211.
Gaszner M, Felsenfeld G:Insulators: exploiting transcriptional and epigenetic mechanisms. Nat Rev Genet. 2006, 7 (9): 703-713.
Thoma F, Koller T, Klug A:Involvement of histone H1 in the organization of the nucleosome and of the salt-dependent superstructures of chromatin. J Cell Biol. 1979, 83 (2): 403-427.
Tazi J, Bird A:Alternative chromatin structure at CpG islands. Cell. 1990, 60 (6): 909-920.
Cloutier TE, Librizzi MD, Mollah A, Brenowitz M, Willis IM:Kinetic trapping of DNA by transcription factor IIIB. Proc Natl Acad Sci. 2001, 98 (17): 9581-9586.
Nikolov D, Burley S:RNA polymerase II transcription initiation: a structural view. Proc Natl Acad Sci. 1997, 94 (1): 15-22.
He X, Samee MAH, Blatti C, Sinha S:Thermodynamics-based models of transcriptional regulation by enhancers: the roles of synergistic activation, cooperative binding and short-range repression. PLoS Comput Biol. 2010, 6 (9): 1000935.
Mariani L, Löhning M, Radbruch A, Höfer T:Transcriptional control networks of cell differentiation: insights from helper T lymphocytes. Progress Biophys Mol Biol. 2004, 86 (1): 45-76.
Marbach D, Costello JC, Küffner R, Vega NM, Prill RJ, Camacho DM, Allison KR, Kellis M, Collins JJ, Stolovitzky G:Wisdom of crowds for robust gene network inference. Nat Methods. 2012, 9 (8): 796-804.
Maetschke SR, Madhamshettiwar PB, Davis MJ, Ragan MA:Supervised, semi-supervised and unsupervised inference of gene regulatory networks. Brief Bioinform. 2014, 15 (2): 195-211.
Sherwood RI, Hashimoto T, O’Donnell CW, Lewis S, Barkal AA, van Hoff JP, Karun V, Jaakkola T, Gifford DK:Discovery of directional and nondirectional pioneer transcription factors by modeling DNase profile magnitude and shape. Nat Biotechnol. 2014, 32 (2): 171-178.
Scripts and supplementary data. [http://sourceforge.net/projects/budden2014exploring/].
The ENCODE Project Consortium:An integrated encyclopedia of DNA elements in the human genome. Nature. 2012, 489 (7414): 57-74.
Trapnell C, Williams BA, Pertea G, Mortazavi A, Kwan G, van Baren MJ, Salzberg SL, Wold BJ, Pachter L:Transcript assembly and quantification by RNA-Seq reveals unannotated transcripts and isoform switching during cell differentiation. Nat Biotechnol. 2010, 28 (5): 511-515.
List of housekeeping genes. [http://www.tau.ac.il/elieis/HKG/].
Eisenberg E, Levanon EY:Human housekeeping genes, revisited. Trends Genet. 2013, 29 (10): 569-574.
Bolstad BM, Irizarry RA, Åstrand M, Speed TP:A comparison of normalization methods for high density oligonucleotide array data based on variance and bias. Bioinformatics. 2003, 19 (2): 185-193.
Basak D, Pal S, Patranabis DC:Support vector regression. Neural Inf Processing Letters Rev. 2007, 11 (10): 203-224.
Harel O:The estimation ofR2and adjustedR2in incomplete data sets using multiple imputation. J Appl Stat. 2009, 36 (10): 1109-1118.
Knijnenburg TA, Wessels LF, Reinders MJ, Shmulevich I:Fewer permutations, more accuratep-values. Bioinformatics. 2009, 25 (12): 161-168.
Wang C, Tian R, Zhao Q, Xu H, Meyer CA, Li C, Zhang Y, Liu XS:Computational inference of mRNA stability from histone modification and transcriptome profiles. Nucleic Acids Res. 2012, 40 (14): 6414-6423.
This work was supported by an Australian Postgraduate Award (DMB); the National Breast Cancer Foundation (MJD); the Australian Federal and Victoria State Governments and the Australian Research Council through the ICT Centre of Excellence program, National ICT Australia (NICTA) (DMB, EJC); and the Australian Research Council Centre of Excellence in Convergent Bio-Nano Science and Technology (project number CE140100036) (EJC). The views expressed herein are those of the authors and are not necessarily those of the National Breast Cancer Foundation, NICTA or the Australian Research Council.
The authors declare that they have no competing interests.
DMB, DGH, JC, JFM, MJD and EJC analysed and interpreted the data, and were responsible for the study design and concept. DMB developed the software, processed the data and drafted the paper. All authors read and approved the final manuscript.
Electronic supplementary material
Additional file 1: Figure S1: Relationship between actual genome-wide mESC mRNA transcript abundance (RPKM-normalised RNA-sequencing) versus transcript abundance predicted from ChIP-seq (TF binding and HM) and DNase data. Two regression algorithms were considered: log-linear regression, for (a) TF, (b) HM+DNase and (c) TF+HM+DNase; and support vector regression, for (d) TF, (e) HM+DNase and (f) TF+HM+DNase. ChIP-seq, chromatin immunoprecipitation sequencing; HM, histone modification; mESC, mouse embryonic stem cell; TF, transcription factor. (ZIP 11 MB)
Additional file 2: Figure S2: Relationship between actual genome-wide GM12878 mRNA transcript abundance (FPKM-normalised RNA-sequencing) versus transcript abundance predicted from ChIP-seq (TF binding and HM) and DNase data. Two regression algorithms were considered: log-linear regression, for (a) TF, (b) HM+DNase and (c) TF+HM+DNase; and support vector regression, for (d) TF, (e) HM+DNase and (f) TF+HM+DNase. ChIP-seq, chromatin immunoprecipitation sequencing; HM, histone modification; TF, transcription factor. (ZIP 19 MB)
Additional file 3: Table S1: List of 25 mESC biological processes found to exhibit a statistically significant TF-to-HM+DNase adjusted R2 ratio (demonstrating that TF binding is more predictive of mESC mRNA transcript abundance than HMs and DNase for the markers considered in this study, Benjamini–Hochberg-corrected P < 0.05 ). (CSV 1 KB)
Additional file 4: Table S2: List of 523 mESC biological processes found to exhibit a statistically significant HM+DNase-to-TF adjusted R2 ratio (i.e., demonstrating that HMs and DNase are more predictive of mESC mRNA transcript abundance than TF binding for the markers considered in this study, Benjamini–Hochberg-corrected P < 0.05 ). (CSV 30 KB)
Additional file 5: Table S3: TF and HM+DNase model performance for each of the 1,880 mESC biological processes considered. (CSV 125 KB)
Additional file 6: The ε -support vector regression model describing mRNA transcript abundance as a nonlinear function of a TFAS or HM+DNase score matrix. (PDF 37 KB)
About this article
Cite this article
Budden, D.M., Hurley, D.G., Cursons, J. et al. Predicting expression: the complementary power of histone modification and transcription factor binding data. Epigenetics & Chromatin 7, 36 (2014). https://doi.org/10.1186/1756-8935-7-36
- Gene expression
- Transcriptional regulation
- Transcription factors
- Histone modifications
- Predictive modelling