Across eukaryotes, gene regulation is manifested via chromatin states roughly distinguished as heterochromatin and euchromatin. The establishment, maintenance, and modulation of the chromatin states is mediated using several factors including chromatin modifiers. However, factors that avoid the intrusion of silencing signals into protein-coding genes are poorly understood. Here we show that a plant specific paralog of RNA polymerase (Pol) II, named Pol IV, is involved in avoidance of facultative heterochromatic marks in protein-coding genes, in addition to its well-established functions in silencing repeats and transposons. In its absence, H3K27 trimethylation (me3) mark intruded the protein-coding genes, more profoundly in genes embedded with repeats. In a subset of genes, spurious transcriptional activity resulted in small(s) RNA production, leading to post-transcriptional gene silencing. We show that such effects are significantly pronounced in rice, a plant with a larger genome with distributed heterochromatin compared with Our results indicate the division of labor among plant-specific polymerases, not just in establishing effective silencing via sRNAs and DNA methylation but also in influencing chromatin boundaries.