Exploiting core working sets to filter the L1 cache with random sampling

Yoav Etsion*, Dror G. Feitelson

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

7 Scopus citations

Abstract

Locality is often characterized by working sets, defined by Denning as the set of distinct addresses referenced within a certain window of time. This definition ignores the fact that dramatic differences exist between the usage patterns of frequently used data and transient data. We therefore propose to extend Denning's definition with that of core working sets, which identify blocks that are used most frequently and for the longest time. The concept of a core motivates the design of dual-cache structures that provide special treatment for the core. In particular, we present a probabilistic locality predictor for L1 caches that leverages the skewed popularity of blocks to distinguish transient cache insertions from more persistent ones. We further present a dual L1 design that inserts only frequently used blocks into a low-latency, low-power, direct-mapped main cache, while serving others from a small fully associative filter. To reduce the prohibitive cost of such a filter, we present a content addressable memory design that eliminates most of the costly lookups using a small auxiliary lookup table. The proposed design enables a 16K direct-mapped L1 cache, augmented with a small 2K filter, to outperform a 32K 4-way cache, while at the same time consumes 70-80 percent less dynamic power and 40 percent less static power.

Original languageAmerican English
Article number6035687
Pages (from-to)1535-1550
Number of pages16
JournalIEEE Transactions on Computers
Volume61
Issue number11
DOIs
StatePublished - 2012

Keywords

  • Benchmark testing
  • Core working sets
  • Educational institutions
  • Histograms
  • L1 cache
  • Measurement
  • Power demand
  • Probabilistic logic
  • System performance
  • cache filtering
  • cache insertion policy
  • dual-cache design
  • mass-count disparity
  • random insertion policy

Fingerprint

Dive into the research topics of 'Exploiting core working sets to filter the L1 cache with random sampling'. Together they form a unique fingerprint.

Cite this