Next, we can see the active counters that moxi tracks on a per-bucket basis. First, we can see that nothing's happened to the frontcache counters (unsurprisingly, as the frontcache feature has been configured off):
STAT 11211:default:stats:listening 2 STAT 11211:default:stats:listening_failed 0 STAT 11211:default:frontcache:max 0 STAT 11211:default:frontcache:oldest_live 0 STAT 11211:default:frontcache:tot_get_hits 0 STAT 11211:default:frontcache:tot_get_expires 0 STAT 11211:default:frontcache:tot_get_misses 0 STAT 11211:default:frontcache:tot_get_bytes 0 STAT 11211:default:frontcache:tot_adds 0 STAT 11211:default:frontcache:tot_add_skips 0 STAT 11211:default:frontcache:tot_add_fails 0 STAT 11211:default:frontcache:tot_add_bytes 0 STAT 11211:default:frontcache:tot_deletes 0 STAT 11211:default:frontcache:tot_evictions 0
Then, we can see more interesting and useful per-bucket statistics.
In general, counters named num_xxx are active counters (they increase and decrease). And, tot_xxx are counters that only increase (until there's a "stats proxy reset" command).
Below, "upstream" refers to client-side statistics (from your application). And "downstream" refers to Couchbase server-side statistics.
Of note, moxi acquires downstream connections from a connection pool, assigns them to upstream clients, and releases the downstream connections back into the connection when the upstream client has finished a request/response, if there were no errors (in which case moxi might close the downstream connection rather than releasing it back into the connection pool). Because of this, you'll see that "tot_downstream_conn_acquired" will often grow (hopefully, only slightly) faster than "tot_downstream_conn_released".
STAT 11211:default:pstd_stats:num_upstream 1 STAT 11211:default:pstd_stats:tot_upstream 1 STAT 11211:default:pstd_stats:num_downstream_conn 0 STAT 11211:default:pstd_stats:tot_downstream_conn 0 STAT 11211:default:pstd_stats:tot_downstream_conn_acquired 0 STAT 11211:default:pstd_stats:tot_downstream_conn_released 0 STAT 11211:default:pstd_stats:tot_downstream_released 0 STAT 11211:default:pstd_stats:tot_downstream_reserved 0 STAT 11211:default:pstd_stats:tot_downstream_reserved_time 0 STAT 11211:default:pstd_stats:max_downstream_reserved_time 0 STAT 11211:default:pstd_stats:tot_downstream_freed 0 STAT 11211:default:pstd_stats:tot_downstream_quit_server 0 STAT 11211:default:pstd_stats:tot_downstream_max_reached 0 STAT 11211:default:pstd_stats:tot_downstream_create_failed 0 STAT 11211:default:pstd_stats:tot_downstream_connect 0 STAT 11211:default:pstd_stats:tot_downstream_connect_failed 0 STAT 11211:default:pstd_stats:tot_downstream_connect_timeout 0 STAT 11211:default:pstd_stats:tot_downstream_connect_interval 0 STAT 11211:default:pstd_stats:tot_downstream_connect_max_reached 0 STAT 11211:default:pstd_stats:tot_downstream_waiting_errors 0 STAT 11211:default:pstd_stats:tot_downstream_auth 0 STAT 11211:default:pstd_stats:tot_downstream_auth_failed 0 STAT 11211:default:pstd_stats:tot_downstream_bucket 0 STAT 11211:default:pstd_stats:tot_downstream_bucket_failed 0 STAT 11211:default:pstd_stats:tot_downstream_propagate_failed 0 STAT 11211:default:pstd_stats:tot_downstream_close_on_upstream_close 0 STAT 11211:default:pstd_stats:tot_downstream_timeout 0 STAT 11211:default:pstd_stats:tot_wait_queue_timeout 0 STAT 11211:default:pstd_stats:tot_assign_downstream 0 STAT 11211:default:pstd_stats:tot_assign_upstream 0 STAT 11211:default:pstd_stats:tot_assign_recursion 0 STAT 11211:default:pstd_stats:tot_reset_upstream_avail 0 STAT 11211:default:pstd_stats:tot_multiget_keys 0 STAT 11211:default:pstd_stats:tot_multiget_keys_dedupe 0 STAT 11211:default:pstd_stats:tot_multiget_bytes_dedupe 0 STAT 11211:default:pstd_stats:tot_optimize_sets 0 STAT 11211:default:pstd_stats:tot_optimize_self 0 STAT 11211:default:pstd_stats:tot_retry 0 STAT 11211:default:pstd_stats:tot_retry_time 0 STAT 11211:default:pstd_stats:max_retry_time 0 STAT 11211:default:pstd_stats:tot_retry_vbucket 0 STAT 11211:default:pstd_stats:tot_upstream_paused 0 STAT 11211:default:pstd_stats:tot_upstream_unpaused 0 STAT 11211:default:pstd_stats:err_oom 0 STAT 11211:default:pstd_stats:err_upstream_write_prep 0 STAT 11211:default:pstd_stats:err_downstream_write_prep 0
Of note in the previous section, if "tot_upstream_paused" grows much greater than "tot_upstream_unpaused", that means that client connections are stuck in a "paused" state, awaiting some event that wakes them up (such as moxi receiving a response from a Couchbase server or a reserved/assigned downstream connection getting closed).