Couchbase Server

performance hit when compaction hits

Details

  • Type: Bug Bug
  • Status: Resolved Resolved
  • Priority: Blocker Blocker
  • Resolution: Duplicate
  • Affects Version/s: recent-builds-2.0
  • Fix Version/s: None
  • Component/s: couchbase-bucket
  • Security Level: Public
  • Labels:
    None

Description

Under key-value tests, when compaction kicks in, it clobbers I/O resources; leading to slower drain-rates, which lead to longer queues and more memory consumption; then, there's evictions, and then more bg-fetches (which compete more for I/O). So, there's a corresponding hit to ops/sec.

Activity

Ascending order - Click to sort in descending order
Hide
Permalink
Peter Wansch added a comment -
Chiyoung and Damien are working on a prototype to move the compactor into ep_engine and sequentialize it with the flusher to avoid the performance hits in this report. The plan is to make a toy build available and re-test. Only side-effect should be that the peak disk size may be slightly higher.
Show
Peter Wansch added a comment - Chiyoung and Damien are working on a prototype to move the compactor into ep_engine and sequentialize it with the flusher to avoid the performance hits in this report. The plan is to make a toy build available and re-test. Only side-effect should be that the peak disk size may be slightly higher.
Hide
Permalink
Peter Wansch added a comment -
Chiyoung, since you are prototyping this change, I'll assign this one to you. Thank you.
Show
Peter Wansch added a comment - Chiyoung, since you are prototyping this change, I'll assign this one to you. Thank you.
Hide
Permalink
Chiyoung Seo added a comment -
We decided to move the ep-engine side compaction to post 2.0
Show
Chiyoung Seo added a comment - We decided to move the ep-engine side compaction to post 2.0
Hide
Permalink
Mike Wiederhold added a comment -
Duplicate of CBD-485.
Show
Mike Wiederhold added a comment - Duplicate of CBD-485.

People

  • Assignee:
    Chiyoung Seo
    Reporter:
    Steve Yen
Vote (0)
Watch (3)

Dates

  • Created:
    Updated:
    Resolved: