Memory CD8+ T cells are characterized by more rapid and robust effector function upon infection compared with naive T cells, but factors governing effector gene responsiveness are incompletely understood. We sought to understand transcriptional control of the effector genes IFN-γ (Ifng), granzyme B (Gzmb), and perforin 1 (Prf1) in murine memory CD8+ T cells by characterizing their transcriptional profiles and chromatin states during lymphocytic choriomeningitis virus infection. Each effector gene has a distinct transcriptional profile in resting memory cells and following restimulation. Primary infection leads to reduced nucleosomal density near the transcription start sites and reduced H3K27 methylation throughout the Ifng and Gzmb loci, and these chromatin changes persist in the memory phase. Despite similarities in chromatin at the memory stage, PolII recruitment and continuous transcription occur at the Ifng locus but not the Gzmb locus. We propose that these chromatin changes poise effector genes for rapid upregulation, but are insufficient for PolII recruitment and transcription.