I/O Speculation for the Microsecond Era

Michael Yung Chung Wei, Matias Bjørling, Philippe Bonnet, Steven Swanson

    Research output: Conference Article in Proceeding or Book/Report chapterArticle in proceedingsResearchpeer-review

    Abstract

    Microsecond latencies and access times will soon dominate most datacenter I/O workloads, thanks to improvements in both storage and networking technologies. Current techniques for dealing with I/O latency are targeted
    for either very fast (nanosecond) or slow (millisecond) devices. These techniques are suboptimal for microsecond devices - they either block the processor for tens of microseconds or yield the processor only to be ready again microseconds later. Speculation is an alternative technique that resolves the issues of yielding and blocking by enabling an application to continue running until the application produces an externally visible side effect. State-of-the-art techniques for speculating on I/O requests involve checkpointing, which can take up to a
    millisecond, squandering any of the performance bene-fits microsecond scale devices have t o offer. In this paper, we survey how speculation can address the challenges that microsecond scale devices will bring. We measure applications for the potential benefit to be gained from speculation and examine several classes of speculation techniques. In addition, we propose two new techniques,
    hardware checkpoint and checkpoint-free speculation. Our exploration suggests that speculation will enable systems to extract the maximum performance of
    I/O devices in the microsecond era.
    Original languageEnglish
    Title of host publication2014 USENIX Annual Technical Conference, USENIX ATC '14, Philadelphia, PA, USA, June 19-20, 2014.
    Number of pages7
    PublisherUSENIX - The Advanced Computing Systems Association
    Publication date2014
    Pages475-481
    ISBN (Print)978-1-931971-10-2
    DOIs
    Publication statusPublished - 2014

    Keywords

    • Microsecond latency
    • Datacenter I/O workloads
    • Storage technologies
    • Networking technologies
    • Speculation techniques

    Fingerprint

    Dive into the research topics of 'I/O Speculation for the Microsecond Era'. Together they form a unique fingerprint.

    Cite this