Couchbase

[MB-8341] Per node stats for Replication progress i.e. "Percent complete" shows "?".

Wed, 22 May 2013 21:19:15 -0500

Per server stats for Replication progress shows "?".
- Looks like they are not calculated per Server? Attached Screenshot

Steps to repro
1. Setup a 4 node cluster.
2, Load 1M data
3, Setup replication from cluster1 to cluster2.
4. View Outbound XDCR stats " Percentage Complete" for XDC Replicaiton cluster-wide, and then per-node

Results
- Aggregated stats show correct value ~ 30 percent,
- View per node, shows "?" for each node.

[MB-8340] [system test][windows] erlang crash due to memory overflow

Wed, 22 May 2013 20:29:38 -0500

Environment:
7 windows server 2008 r2 64bit with SSD and 8GB RAM

1:10.3.121.173
2:10.3.121.169
3:10.3.121.171
4:10.3.3.214
5:10.3.121.47
6:10.3.3.180
7:10.3.3.181

Cluster setup:
7 nodes cluster
1 default bucket (3GB with replica index enable)
1 sasl bucket (3GB with replica index disable)

Load item to both buckets until active resident ratio down to 70%
Run access phase more than one day with
default bucket: set 5% get 80% expired 5%
sasl bucket: set 5% get 5% delete 20% and expired 80%
After more than one day running, one node in cluster (10.3.121.171) become unstable with erlang crashed
See memory use is used over 3GB over mem quota for couchbase server as show in capture

Link to manifest file of this build http://builds.hq.northscale.net/latestbuilds/couchbase-server-enterprise_x86_64_2.0.2-807-rel.setup.exe.manifest.xml

Link to collect info of 6 nodes https://s3.amazonaws.com/packages.couchbase/collect_info/2_0_2/2013_05/7nodes_202-807_nodeDown_erlCrash_20130522-174845.tgz
Due to node 171 is down, I could not get the collect info file
erlang crash dump also attached

Cluster is in failed state now

Impact of this bug. Node 10.3.121.171 is in unstable state. One solution is failover that node, add another node in and rebalance out failed node.

.

[MB-8328] High latency variation and regression in query throughput

Wed, 22 May 2013 20:10:19 -0500

Build vs. query throughput
-----------------
| 170 | 1357 |
-----------------
| 740 | 1210 |
| 745 | 1338 |
| 755 | 1363 |
-----------------
| 758 | 579 |
| 759 | 571 |
| 760 | 583 |
| 765 | 531 |
| 770 | 597 |
| 790 | 530 |
| 799 | 561 |
| 803 | 587 |
| 807 | 573 |
| 809 | 576 |
---------------

80th and 90th percentiles (that we usually track) are not affected but 99th and 99.9th percentiles are much worse.
Obviously average throughput regressed (>2x).

Diags, stats, atop:
2.0.1-170 - http://172.23.96.10:8080/view/views/job/vesta-views/45/artifact/
2.0.2-755 - http://172.23.96.10:8080/view/views/job/vesta-views/62/artifact/
2.0.2-758 - http://172.23.96.10:8080/view/views/job/vesta-views/60/artifact/
2.0.2-809 - http://172.23.96.10:8080/view/views/job/vesta-views/63/artifact/

Manifests:
http://builds.hq.northscale.net/latestbuilds/couchbase-server-enterprise_x86_2.0.2-755-rel.rpm.manifest.xml
http://builds.hq.northscale.net/latestbuilds/couchbase-server-enterprise_x86_2.0.2-758-rel.rpm.manifest.xml

Changes in bucket_engine:
2a797a8 ~~MB-6144~~: fixed typo
0992a55 ~~MB-6144~~: Some packages used incorrect offsets

Changes in ns_server:
301435b MB-100: fixed build error due to bad .PHONY and rule interaction
414e304 MB-100: provide api for testrunner for messing with memcached
759135b ~~MB-7398~~: added CHANGES entry for hostname management feature
4ac8e1b CBD-220: run memcached and ns_server from babysitting VM
ec84aad CBD-220: [ale] allow syncing all log messages to all sinks
717902e CBD-220: switched ns_server_sup to supervisor2
68c1e9f MB-100: added typespec to ns_pubsub:subscribe_link
f1032ac ~~MB-7398~~: don't allow hostnames without dot
337c98e MB-100: moved samples_loader_tasks earlier in ns_server_sup list
89661aa MB-5307 Handle failure to save address after rename.
1dd0e9e ~~MB-7398~~ Rename added node to what was specified as its address.
c2b0108 ~~MB-7398~~ Ability to specify server hostname in wizard.
3fc9d9d ~~MB-7398~~ REST call to rename a node.
e6aa76a ~~MB-7398~~ Handle ip_start file in dist_manager.
e3b488a ~~MB-7398~~ Move is_good_address to misc.
531d168 MB-5307 Try to stop net_kernel on dist_manager start.
400c20a MB-5307 Remove references to non-existent path-box class.

[MB-8046] [RN 2.0.2] config.dat and other potentially security sensitive files are world readable in world readable directories

Wed, 22 May 2013 20:09:32 -0500

[RN 2.0.2] config.dat and other potentially security sensitive files are world readable in world readable directories

[MB-8336] Updated/New Front Matter

Wed, 22 May 2013 20:05:02 -0500

Front matter, introduction for 2.0.2 in need of overhaul check of features.

[MB-8339] Binary Protocol on Metadata

Wed, 22 May 2013 19:14:34 -0500

http://www.couchbase.com/issues/browse/MB-8217

[MB-8017] [Internal Only Doc] cbrecovery tool to recovery data for missing partitions

Wed, 22 May 2013 18:11:51 -0500

Attached is FINAL draft content for review on cbrecovery for missing data partitions:

"Data Recovery from Remote Clusters" on pages 114 – 118.

Mandatory Reviewers: Bin Cui, Abhinav

Optional Reviewers: PerryK, JamesM

Bug tracking doc update: http://www.couchbase.com/issues/browse/MB-8017

Review timeframe: *Please provide your review input by EOD Wednesday, May 22 of next week.

*Please add comments directly to the PDF or to the bug link above.
==================================

Provide a tool to help with data recovery when nodes (beyond the number of replicas) fail. Currently if a rebalance operation is performed without restoring data, it causes loss of data. To help restore data, we need to develop a tool that manages the following:

- check with partitions are missing all-together
- Block service for those partitions
- Recover the missing partitions from the backup cluster
- Start service on those partitions

This will require data to be backed up using XDCR on a separate cluster. The first version of the tool will be available in the early April time frame. It will be productized in the 2.1 release.

Addition details here:

Engineering spec: http://hub.internal.couchbase.com/confluence/display/~farshid/cbrecovery+tool.
PM requirements: http://hub.internal.couchbase.com/confluence/display/PM/CBRecovery+Tool

Ticket: http://www.couchbase.com/issues/browse/CBSE-301
Ticket: http://www.couchbase.com/issues/browse/MB-8017

Test-Plan: http://hub.internal.couchbase.com/confluence/display/QA/Cbrecovery+test+plan
Bin, design: https://github.com/couchbase/couchbase-cli/blob/2.0.2/docs/cbrecovery-design_spec.md

Need to build by 2.0.2 / April

Customer request

[MB-8333] [DOC 2.0.2] [windows] unable to add a 1.8.0 node to 2.0.2 cluster

Wed, 22 May 2013 16:53:33 -0500

2 nodes cluster (2.0.2), trying to add a 1.8.0 node

2013-05-22 00:40:06.346 ns_cluster:5:info:message(ns_1@172.23.105.74) - Failed to add node 172.23.105.72:8091 to cluster. This node cannot add another node ('ns_1@172.23.105.72') because of cluster version compatibility mismatch. Cluster works in [2, 0] mode and node only supports [1, 8]

[MB-8061] [Doc'd]: Host name and IP address management in Couchbase

Wed, 22 May 2013 16:29:22 -0500

Attached is new draft content for review on hostname and IP address management for 2.0.2 and updates/fixes to 2.0.1

Using Hostnames with Couchbase Server – Page 29-32
Handling Changes in IP Addresses (Cloud) – Page 59
Mandatory Reviewers: Bin Cui, AliaskeyA, Ketaki/or Delegate

Optional Reviewers: JamesM, PerryK

Bug tracking doc update: http://www.couchbase.com/issues/browse/MB-8061

Review timeframe: *Please provide your review input by EOD Wednesday, May 22 of next week.

*Please add comments directly to the PDF or to the bug link above.
--------------

http://www.couchbase.com/issues/browse/MB-7398

Need to update: http://www.couchbase.com/docs/couchbase-manual-2.0/couchbase-bestpractice-cloud-ip.html

AND

http://www.couchbase.com/docs/couchbase-manual-2.0/couchbase-getting-started-hostnames.html

[MB-8314] rebalance exited ns_vbucket_mover failed to initiate_indexing

Wed, 22 May 2013 16:21:42 -0500

Have a 5 node cluster that was upgraded from 181 -> 202 (build 805).
After upgrade attempted to swap out orchestrator(10.3.121.69) and add in a new 202 node (10.3.3.131)

Rebalance fails with ns_vbucket_mover000 on orchestrator reporting:
<0.11037.1> exited with {noproc,
{gen_server,call,
[{'janitor_agent-saslbucket',
'ns_1@10.3.3.131'},
{if_rebalance,<0.1.1>,initiate_indexing},
infinity]}}

On new node 202, couchdb went down and erlang crash dump was generated(attached).

Saw these errors from mccouch which may be why vbuckets couldn't be moved to this node:
Fri May 17 07:27:36.981472 PDT 3: (saslbucket) Trying to connect to mccouch: "127.0.0.1:11213"
Fri May 17 07:27:36.981615 PDT 3: (saslbucket) Connected to mccouch: "127.0.0.1:11213"
Fri May 17 07:27:37.019496 PDT 3: (saslbucket) Connection closed by mccouch
Fri May 17 07:27:37.019527 PDT 3: (saslbucket) Resetting connection to mccouch, lastReceivedCommand = notify_vbucket_update lastSentCommand = notify_vbucket_update currentCommand =unknown
Fri May 17 07:27:37.019595 PDT 3: (saslbucket) Trying to connect to mccouch: "127.0.0.1:11213"
Fri May 17 07:27:37.019730 PDT 3: (saslbucket) Connected to mccouch: "127.0.0.1:11213"
Fri May 17 07:27:37.021763 PDT 3: (saslbucket) Connection closed by mccouch
Fri May 17 07:27:37.021788 PDT 3: (saslbucket) Resetting connection to mccouch, lastReceivedCommand = select_bucket lastSentCommand = notify_vbucket_update currentCommand =unknown

=========================CRASH REPORT=========================
  crasher:
    initial call: mc_connection:init/1
    pid: <0.965.0>
    registered_name: []
    exception error: no case clause matching {error,system_limit}
      in function mc_connection:do_notify_vbucket_update/3
      in call from mc_connection:handle_message/9
      in call from mc_connection:read_full_message/2
      in call from mc_connection:run_loop/2
    ancestors: [mc_conn_sup,mc_sup,ns_server_sup,ns_server_cluster_sup,
                  <0.59.0>]
    messages: []
    links: [<0.641.0>,#Port<0.6784>]
    dictionary: []
    trap_exit: false
    status: running
    heap_size: 1597
    stack_size: 24
    reductions: 1094838
  neighbours:

[error_logger:error,2013-05-17T7:27:36.622,ns_1@10.3.3.131:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
     Supervisor: {local,mc_conn_sup}
     Context: child_terminated
     Reason: {case_clause,{error,system_limit}}
     Offender: [{pid,<0.965.0>},
                  {name,mc_connection},
                  {mfargs,{mc_connection,start_link,undefined}},
                  {restart_type,temporary},
                  {shutdown,brutal_kill},
                  {child_type,worker}]

=========================CRASH REPORT=========================
  crasher:
    initial call: couch_file:spawn_reader/2
    pid: <0.652.0>
    registered_name: []
    exception exit: {problem_reopening_file,
                        {error,system_limit},
                        {set_close_after,infinity,<0.650.0>},
                        <0.652.0>,
                        "/opt/couchbase/var/lib/couchbase/data/_replicator.couch.1",
                        10}
      in function couch_file:reader_loop/3
    ancestors: [<0.650.0>,couch_server,couch_primary_services,
                  couch_server_sup,cb_couch_sup,ns_server_cluster_sup,
                  <0.59.0>]
    messages: []
    links: [<0.650.0>]
    dictionary: []
    trap_exit: true
    status: running
    heap_size: 377
    stack_size: 24
    reductions: 504
  neighbours:

[MB-7856] better to prevent running two instances of couchbase Install Shield wizards

Wed, 22 May 2013 16:20:08 -0500

build 170

can run 2 installer instances at the same time

result:
---------------------------
Couchbase Server - InstallShield Wizard
---------------------------
Cannot open source file for reading.
---------------------------
OK
---------------------------

[Window Title]
Setup Launcher

[Main Instruction]
Setup Launcher has stopped working

[Content]
Windows can check online for a solution to the problem.

[V] View problem details [Check online for a solution and close the program] [Close the program]

[MB-8221] [Doc'd] Upgrade, Prerequisites, Initial Install for 2.0.2

Wed, 22 May 2013 16:17:45 -0500

Attached is draft content for review for 2.0.2 prerequisites, install, initial setup and upgrade:

"Preparation" on pages 17-19.
"Installing" on pages 20-23.
"Initial Server Setup: on pages 23-29
"Upgrading to Couchbase Server 2.0.x" on pages 30-38

Mandatory Reviewers: BinC, Tony/Thuan, Chisheng

Optional Reviewers: PerryK, AnilK

Bug tracking doc update:http://www.couchbase.com/issues/browse/MB-8221

Review timeframe: *Please provide your review input by EOD Friday, May 24 of this week.

==============
Review session on 2.0.2 upgrade process: see what overhaul required to existing chapter.

[MB-8338] [windows] moxi crashed when create bucket with error: bad json configuration

Wed, 22 May 2013 16:08:28 -0500

Install couchbase server 2.0.2-811 on one node windows 2012 64-bit

Create default bucket, see moxi crash right after bucket created with error bad json configuration

Port server moxi on node 'babysitter_of_ns_1@127.0.0.1' exited with status 0. Restarting. Messages: WARNING: curl error: transfer closed with outstanding read data remaining from: http://127.0.0.1:8091/pools/default/saslBucketsStreaming
2013-05-22 13:11:46: (agent_config.c.705) ERROR: bad JSON configuration from http://127.0.0.1:8091/pools/default/saslBucketsStreaming: Number of vBuckets must be a power of two > 0 and <= 65536 ({
"name": "default",
"nodeLocator": "vbucket",
"saslPassword": "",
"nodes": [{
"hostname": "127.0.0.1:8091",
"ports": {
"direct": 11210,
"proxy": 11211
}
}],
"vBucketServerMap": {
"hashAlgorithm": "CRC",
"numReplicas": 1,
"serverList": ["127.0.0.1:11210"],
"vBucketMap": []
}
})
EOL on stdin. Exiting ns_log000 ns_1@127.0.0.1 13:11:26 - Wed May 22, 2013
Bucket "default" loaded on node 'ns_1@127.0.0.1' in 0 seconds. ns_memcached001 ns_1@127.0.0.1 13:11:16 - Wed May 22, 2013
Created bucket "default" of type: membase
[{num_replicas,1},
{replica_index,false},
{ram_quota,2571108352},
{auth_type,sasl},
{flush_enabled,false}] menelaus_web012 ns_1@127.0.0.1 13:11:16 - Wed May 22, 2013

after moxi restarts, I could use cbworkloadgen.exe to load and read items from bucket

Link to manifest file for this build http://builds.hq.northscale.net/latestbuilds/couchbase-server-enterprise_x86_64_2.0.2-811-rel.setup.exe.manifest.xml

[MB-8313] Table 7.4. Administration — Standard couchbase Tool Options should be updated with new options

Wed, 22 May 2013 15:35:32 -0500

http://www.couchbase.com/docs/couchbase-manual-2.0.pdf

Table 7.4. Administration — Standard couchbase Tool Options doesn't contains the full list of available options.

Actual info we can get from from './couchbase-cli -h":

CLUSTER:
  --cluster=HOST[:PORT] or -c HOST[:PORT]

OPTIONS:
  -u USERNAME, --user=USERNAME admin username of the cluster
  -p PASSWORD, --password=PASSWORD admin password of the cluster
  -o KIND, --output=KIND KIND is json or standard
  -d, --debug

server-add OPTIONS:
  --server-add=HOST[:PORT] server to be added
  --server-add-username=USERNAME admin username for the
                                    server to be added
  --server-add-password=PASSWORD admin password for the
                                    server to be added

server-readd OPTIONS:
  --server-add=HOST[:PORT] server to be added
  --server-add-username=USERNAME admin username for the
                                    server to be added
  --server-add-password=PASSWORD admin password for the
                                    server to be added

rebalance OPTIONS:
  --server-add* see server-add OPTIONS
  --server-remove=HOST[:PORT] the server to be removed

failover OPTIONS:
  --server-failover=HOST[:PORT] server to failover

cluster-* OPTIONS:
  --cluster-username=USER new admin username
  --cluster-password=PASSWORD new admin password
  --cluster-port=PORT new cluster REST/http port
  --cluster-ramsize=RAMSIZEMB per node ram quota in MB

node-init OPTIONS:
  --node-init-data-path=PATH per node path to store data
  --node-init-index-path=PATH per node path to store index

bucket-* OPTIONS:
  --bucket=BUCKETNAME bucket to act on
  --bucket-type=TYPE memcached or couchbase
  --bucket-port=PORT supports ASCII protocol and is auth-less
  --bucket-password=PASSWORD standard port, exclusive with bucket-port
  --bucket-ramsize=RAMSIZEMB ram quota in MB
  --bucket-replica=COUNT replication count
  --enable-flush=[0|1] enable/disable flush
  --enable-index-replica=[0|1] enable/disable index replicas
  --wait wait for bucket create to be complete before returning
  --force force to execute command without asking for confirmation
  --data-only compact datbase data only
  --view-only compact view data only

setting-compacttion OPTIONS:
  --compaction-db-percentage=PERCENTAGE at which point database compaction is triggered
  --compaction-db-size=SIZE[MB] at which point database compaction is triggered
  --compaction-view-percentage=PERCENTAGE at which point view compaction is triggered
  --compaction-view-size=SIZE[MB] at which point view compaction is triggered
  --compaction-period-from=HH:MM allow compaction time period from
  --compaction-period-to=HH:MM allow compaction time period to
  --enable-compaction-abort=[0|1] allow compaction abort when time expires
  --enable-compaction-parallel=[0|1] allow parallel compaction for database and view

setting-notification OPTIONS:
  --enable-notification=[0|1] allow notification

setting-alert OPTIONS:
  --enable-email-alert=[0|1] allow email alert
  --email-recipients=RECIPIENT email recipents, separate addresses with , or ;
  --email-sender=SENDER sender email address
  --email-user=USER email server username
  --email-password=PWD email server password
  --email-host=HOST email server host
  --email-port=PORT email server port
  --enable-email-encrypt=[0|1] email encrypt
  --alert-auto-failover-node node was auto failover
  --alert-auto-failover-max-reached maximum number of auto failover nodes was reached
  --alert-auto-failover-node-down node wasn't auto failover as other nodes are down at the same time
  --alert-auto-failover-cluster-small node wasn't auto fail over as cluster was too small
  --alert-ip-changed node ip address has changed unexpectedly
  --alert-disk-space disk space used for persistent storgage has reached at least 90% capacity
  --alert-meta-overhead metadata overhead is more than 50%
  --alert-meta-oom bucket memory on a node is entirely used for metadata
  --alert-write-failed writing data to disk for a specific bucket has failed

setting-autofailover OPTIONS:
  --enable-auto-failover=[0|1] allow auto failover
  --auto-failover-timeout=TIMEOUT (>=30) specify timeout that expires to trigger auto failover

setting-xdcr OPTIONS:
  --max-concurrent-reps=[32] maximum concurrent replications per bucket, 8 to 256.
  --checkpoint-interval=[1800] intervals between checkpoints, 60 to 14400 seconds.
  --worker-batch-size=[500] doc batch size, 500 to 10000.
  --doc-batch-size=[2048]KB document batching size, 10 to 100000 KB
  --failure-restart-interval=[30] interval for restarting failed xdcr, 1 to 300 seconds
  --optimistic-replication-threshold=[256] document body size threshold (bytes) to trigger optimistic replication

xdcr-setup OPTIONS:
  --create create a new xdcr configuration
  --edit modify existed xdcr configuration
  --delete delete existed xdcr configuration
  --xdcr-cluster-name=CLUSTERNAME cluster name
  --xdcr-hostname=HOSTNAME remote host name to connect to
  --xdcr-username=USERNAME remote cluster admin username
  --xdcr-password=PASSWORD remtoe cluster admin password

xdcr-replicate OPTIONS:
  --create create and start a new replication
  --delete stop and cancel a replication
  --xdcr-from-bucket=BUCKET local bucket name to replicate from
  --xdcr-clucter-name=CLUSTERNAME remote cluster to replicate to
  --xdcr-to-bucket=BUCKETNAME remote bucket to replicate to

[MB-8311] Table 7.3. Administration — couchbase Tool Commands should be updated with new features

Wed, 22 May 2013 15:35:00 -0500

according to http://www.couchbase.com/docs/couchbase-manual-2.0.pdf

Table 7.3. Administration — couchbase Tool Commands
Command Description
server-list List all servers in a cluster
server-info Show details on one server
server-add Add one or more servers to the cluster
server-readd Re-add a server that was failed over to the cluster
rebalance Start a cluster rebalancingCommand-line Interface for Administration
169
Command Description
rebalance-stop Stop current cluster rebalancing
rebalance-status Show status of current cluster rebalancing
failover Failover one or more servers
cluster-init Set the username, password and port of the cluster
node-init Set node specific parameters
bucket-list List all buckets in a cluster
bucket-create Add a new bucket to the cluster
bucket-edit Modify an existing bucket
bucket-delete Delete an existing bucket
bucket-flush Flush a given bucket
help Show longer usage/help and examples

but the full list should be for 2.0.2 as:

./couchbase-cli
usage: couchbase-cli COMMAND CLUSTER [OPTIONS]

CLUSTER is --cluster=HOST[:PORT] or -c HOST[:PORT]

COMMANDs include
  server-list list all servers in a cluster
  server-info show details on one server
  server-add add one or more servers to the cluster
  server-readd readd a server that was failed over
  rebalance start a cluster rebalancing
  rebalance-stop stop current cluster rebalancing
  rebalance-status show status of current cluster rebalancing
  failover failover one or more servers
  cluster-init set the username,password and port of the cluster
  cluster-edit modify cluster settings
  node-init set node specific parameters
  bucket-list list all buckets in a cluster
  bucket-create add a new bucket to the cluster
  bucket-edit modify an existing bucket
  bucket-delete delete an existing bucket
  bucket-flush flush all data from disk for a given bucket
  bucket-compact compact database and index data
  setting-compaction set auto compaction settings
  setting-notification set notification settings
  setting-alert set email alert settings
  setting-autofailover set auto failover settings
  setting-xdcr set xdcr related settings
  xdcr-setup set up XDCR connection
  xdcr-replicate xdcr operations
  help show longer usage/help and examples

[MB-8065] [Doc'd]: CLI tool: All new settings

Wed, 22 May 2013 15:34:19 -0500

~~MB-7851~~ : CLI tool: Support cluster settings

[MB-8337] UI fails to retrieve 181 node information during online upgrade

Wed, 22 May 2013 15:27:38 -0500

While Performing rolling upgrade of nodes from 181 -> 202 I am unable to view the server info of the 181 nodes from a node running the 202 UI. Instead the UI shows "loading" string.

Error from logs:

Client-side error-report for user "Administrator" on node 'ns_1@10.3.2.92':

User-Agent:Mozilla/5.0 (X11; Linux i686) AppleWebKit/535.7 (KHTML, like Gecko) Chrome/16.0.912.75 Safari/535.7
Got unhandled error: Uncaught TypeError: Cannot read property 'length' of undefined
At: http://10.3.2.92:8091/js/cells.js:64
Backtrace:
Function: collectBacktraceViaCaller
Args:

---------
Function: appOnError
Args:
"Uncaught TypeError: Cannot read property 'length' of undefined"
"http://10.3.2.92:8091/js/cells.js"
64
---------

[MB-8302] [Doc'd] READMEs Win, Linux, Mac

Wed, 22 May 2013 14:45:26 -0500

Attached are three README's 1) updated Mac for 2.0.2, 2) new 2.0.2 Linux for Centos and Ubuntu, and 3) new 2.0.2 for Windows.

They include the front-matter from Release Notes 2.0.2, fixes from Jira and any important notes before starting the server.

Here is the ticket where they are also attached: http://www.couchbase.com/issues/browse/MB-8302

per bug triage, we need couchbase installation readme.txt for Windows and Linux OS.

[MB-8062] [RN 2.0.2 + Doc]: Implement detailed rebalance progress report

Wed, 22 May 2013 14:44:32 -0500

~~MB-8013~~ : Implement detailed rebalance progress report

[MB-7959] [Doc'd]: New 2.0.2 XDCR Contin. Optimistic, new XDCR stats, and more XDCR background

Wed, 22 May 2013 14:43:55 -0500

Attached is FINAL draft content for review on XDCR Optimistic Replication, new XDCR stats, updated replication discussion and configuration

Configuring Replication: pages 104-108
Conflict Resolution: page 109
'Optimistic Replication': pages 110-111
Monitoring Outgoing XDCR in Web Console: pages 144-147
Getting XDCR Stats via REST: pages 227-228
Setting 'optimistic replication' via REST: page 227
Mandatory Reviewers: Junyi, Ketaki

Optional Reviewers: PerryK

Bug tracking doc update:http://www.couchbase.com/issues/browse/MB-7959

Review timeframe: *Please provide your review input by EOD Wednesday, May 22 of next week.

*Please add comments directly to the PDF or to the bug link above.

==============

Provide information to document on new parameter for 2.0.2, then assign to Karen to add.

[MB-7300] [Doc'd] cbtansfer/cbbackup/cbrestore - option to just transfer design-docs only

Wed, 22 May 2013 14:43:03 -0500

"Backing Up Design Documents Only" on pages 178-179.
"Using cbrestore for Design Documents Only" on page 180.
"Tranfering Design Documents Only" on page 183

Mandatory Reviewers: Bin Cui, Chisheng

Optional Reviewers: PerryK

Bug tracking doc update:http://www.couchbase.com/issues/browse/MB-7300

Review timeframe: *Please provide your review input by EOD Friday, May 24 of next week.

*Please add comments directly to the PDF or to the bug link above.

cbtansfer/cbbackup/cbrestore should optionally allow just transferring design-docs only, without any transfering of data items.

[MB-8277] [Doc'd ]Release Notes 2.0.2

Wed, 22 May 2013 14:38:31 -0500

Attached is first draft content for 2.0.2 Release Notes, pages 334-346.

Mandatory Reviewers: Dipti, Anil

Please provide feedback and updates to me by Monday, May 20 by end of day.

--------------------------

As we did for 2.0.1, I need the intro/front-matter for release notes. Currently:

Couchbase Server 2.0.2 is second maintenance release for
Couchbase Server 2.0. This release contains a number of enhancements
including:

[MB-8321] [RN 2.0.2] windows32: Rebalance exited with reason {mover_failed,{badmatch,{error,eaddrinuse}}}

Wed, 22 May 2013 14:30:58 -0500

http://qa.hq.northscale.net/job/windows32_rebalance-kv/11/consoleFull

./testrunner -i /tmp/4-w-32.ini get-cbcollect-info=True -t rebalancetests.IncrementalRebalanceOut.test_load,replica=1,do-stop=True

2013-05-19 06:24:15,085] - [rest_client:925] INFO - rebalance params : password=password&ejectedNodes=&user=Administrator&knownNodes=ns_1%4010.3.2.179%2Cns_1%4010.3.2.185%2Cns_1%4010.3.2.178%2Cns_1%4010.3.2.183
[2013-05-19 06:24:15,296] - [rest_client:929] INFO - rebalance operation started
[2013-05-19 06:24:15,334] - [rest_client:1031] INFO - rebalance percentage : 0 %
[2013-05-19 06:24:17,376] - [rest_client:1031] INFO - rebalance percentage : 0.0 %
[2013-05-19 06:24:19,438] - [rest_client:1031] INFO - rebalance percentage : 0.703125 %
[2013-05-19 06:24:21,473] - [rest_client:1031] INFO - rebalance percentage : 1.640625 %
[2013-05-19 06:24:23,499] - [rest_client:1031] INFO - rebalance percentage : 2.6953125 %
[2013-05-19 06:24:25,523] - [rest_client:1031] INFO - rebalance percentage : 3.6328125 %
[2013-05-19 06:24:26,544] - [rest_client:1031] INFO - rebalance percentage : 4.21875 %
[2013-05-19 06:24:27,572] - [rest_client:1031] INFO - rebalance percentage : 4.8046875 %
[2013-05-19 06:24:28,601] - [rest_client:1031] INFO - rebalance percentage : 5.5078125 %
[2013-05-19 06:24:30,639] - [rest_client:1031] INFO - rebalance percentage : 6.4453125 %
[2013-05-19 06:24:31,663] - [rest_client:1014] ERROR - {u'status': u'none', u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try rebalance again.'} - rebalance failed
[2013-05-19 06:24:31,663] - [rest_client:1015] INFO - Latest logs from UI:
[2013-05-19 06:24:31,764] - [rest_client:1016] ERROR - {u'node': u'ns_1@10.3.2.179', u'code': 1, u'text': u'Bucket "bucket-0" loaded on node \'ns_1@10.3.2.179\' in 0 seconds.', u'shortText': u'message', u'module': u'ns_memcached', u'tstamp': 1368969856238, u'type': u'info'}
[2013-05-19 06:24:31,764] - [rest_client:1016] ERROR - {u'node': u'ns_1@10.3.2.179', u'code': 4, u'text': u"Node 'ns_1@10.3.2.179' saw that node 'ns_1@10.3.2.185' came up. Tags: []", u'shortText': u'node up', u'module': u'ns_node_disco', u'tstamp': 1368969855691, u'type': u'info'}
[2013-05-19 06:24:31,765] - [rest_client:1016] ERROR - {u'node': u'ns_1@10.3.2.179', u'code': 3, u'text': u'Node ns_1@10.3.2.179 joined cluster', u'shortText': u'message', u'module': u'ns_cluster', u'tstamp': 1368969854738, u'type': u'info'}
[2013-05-19 06:24:31,765] - [rest_client:1016] ERROR - {u'node': u'ns_1@10.3.2.179', u'code': 4, u'text': u"Node 'ns_1@10.3.2.179' saw that node 'ns_1@10.3.2.183' came up. Tags: []", u'shortText': u'node up', u'module': u'ns_node_disco', u'tstamp': 1368969854738, u'type': u'info'}
[2013-05-19 06:24:31,765] - [rest_client:1016] ERROR - {u'node': u'ns_1@10.3.2.179', u'code': 0, u'text': u"Port server moxi on node 'babysitter_of_ns_1@127.0.0.1' exited with status 0. Restarting. Messages: WARNING: curl error: transfer closed with outstanding read data remaining from: http://127.0.0.1:8091/pools/default/saslBucketsStreaming\nEOL on stdin. Exiting", u'shortText': u'message', u'module': u'ns_log', u'tstamp': 1368969854628, u'type': u'info'}
[2013-05-19 06:24:31,765] - [rest_client:1016] ERROR - {u'node': u'ns_1@10.3.2.179', u'code': 1, u'text': u"Couchbase Server has started on web port 8091 on node 'ns_1@10.3.2.179'.", u'shortText': u'web start ok', u'module': u'menelaus_sup', u'tstamp': 1368969854597, u'type': u'info'}
[2013-05-19 06:24:31,766] - [rest_client:1016] ERROR - {u'node': u'ns_1@10.3.2.178', u'code': 2, u'text': u'Rebalance exited with reason {mover_failed,{badmatch,{error,eaddrinuse}}}\n', u'shortText': u'message', u'module': u'ns_orchestrator', u'tstamp': 1368969854354, u'type': u'info'}
[2013-05-19 06:24:31,766] - [rest_client:1016] ERROR - {u'node': u'ns_1@10.3.2.178', u'code': 0, u'text': u'<0.26161.33> exited with {mover_failed,{badmatch,{error,eaddrinuse}}}', u'shortText': u'message', u'module': u'ns_vbucket_mover', u'tstamp': 1368969854339, u'type': u'critical'}
[2013-05-19 06:24:31,767] - [rest_client:1016] ERROR - {u'node': u'ns_1@10.3.2.185', u'code': 1, u'text': u'Bucket "bucket-0" loaded on node \'ns_1@10.3.2.185\' in 0 seconds.', u'shortText': u'message', u'module': u'ns_memcached', u'tstamp': 1368969850886, u'type': u'info'}
[2013-05-19 06:24:31,767] - [rest_client:1016] ERROR - {u'node': u'ns_1@10.3.2.185', u'code': 3, u'text': u'Node ns_1@10.3.2.185 joined cluster', u'shortText': u'message', u'module': u'ns_cluster', u'tstamp': 1368969850479, u'type': u'info'}

[MB-8232] [Doc'd] Multi-reader/writer

Wed, 22 May 2013 14:30:21 -0500

[Doc'd] Multi-reader/writer

[MB-8335] Move RAM stuff to RAM chapter from Disk Storage

Wed, 22 May 2013 14:11:59 -0500

As a separate task, I think we need to take a look at how we are describing what goes on with RAM and disk. The "Disk Storage" section covers a lot of the RAM stuff...

[MB-8308] Rebalance time regression in large scale DGM vperf tests

Relates to — Wed, 22 May 2013 14:06:58 -0500

Timings (builds vs. rebalance time in sec):
--------------------
| 170 | 19763 |
--------------------
| 740 | 28559 |
| 761 | 26748 |
| 799 | 37526 |
| 803 | 34903 |
| 807 | 26430 |
| 809 | 26430 |
--------------------

diags, master events, atop:
2.0.1-170 - http://172.23.96.10:8080/view/views/job/apollo-views/105/artifact/
2.0.2-740 - http://172.23.96.10:8080/view/views/job/apollo-views/118/artifact/
2.0.2-809 - http://172.23.96.10:8080/view/views/job/apollo-views/121/artifact/

[MB-8330] Documentation for reduce (specially rereduce) function is missleading

Wed, 22 May 2013 13:54:08 -0500

The documentation for reduce-functions is very missleading.

If you just read the first examples, you get the impression, that this function can be called by having a collection of reduced and non-reduced data.

I got informed via IRC by someone, working with CouchDB, that this isn't the case. You have either a collection of reduced or a collection of non-reduced data you get as arguments for this function.

The documentation there also talks about using the build-in function typeof ... I can hardly see that you've made use of that function ...

[MB-7852] [Doc'd] Complete productization of Replica Read API

Wed, 22 May 2013 13:43:10 -0500

Replica Read API implementation is ready but testing and related documentation have not completed up to the product-feature ready state.

[MB-8334] [windows] unable to get back to previous step in installer

Wed, 22 May 2013 13:09:47 -0500

On the final step of installation wizard(see screenshot) try to click Back btn.
there is no any reaction on clicking it

[MB-8329] ui doesn't show document content

Wed, 22 May 2013 12:53:26 -0500

earlier documents page shown id and content, now content is omitted

[MB-8066] Observed rebalance regression from 2.0.1 to 2.0.2

Relates to — Wed, 22 May 2013 12:50:03 -0500

Noticed that Rebalance consistently taking longer time in 2.0.2-755 than 2.0.1-170.

Consider the last or last 2 results from each rebalance job on:
http://dashboard.hq.couchbase.com/litmus/dashboard/?env=thor

Also consider the graphs of rebalance jobs attached in http://www.couchbase.com/issues/browse/CBD-914, to note the increase in rebalance times.

Logs and graphs from reb-out-large-2 attached.

[MB-8332] moxi crashed when delete non default bucket

Wed, 22 May 2013 12:48:16 -0500

Test on build 2.0.2-809 on windows 8 64bit
Create default bucket,
Delete default bucket ==> no moxi crashed

Create sasl bucket
Delete sasl bucket ==> moxi crashed as show in log

Deleted bucket "saslbucket"
menelaus_web011 ns_1@127.0.0.1 18:43:37 - Tue May 21, 2013
Port server moxi on node 'babysitter_of_ns_1@127.0.0.1' exited with status 0. Restarting. Messages: 2013-05-21 18:40:02: (cproxy_config.c.317) env: MOXI_SASL_PLAIN_USR (13)
2013-05-21 18:40:02: (cproxy_config.c.326) env: MOXI_SASL_PLAIN_PWD (8)
2013-05-21 18:40:36: (agent_config.c.705) ERROR: bad JSON configuration from http://127.0.0.1:8091/pools/default/saslBucketsStreaming: Number of vBuckets must be a power of two > 0 and <= 65536 ({
"name": "default",
"nodeLocator": "vbucket",
"saslPassword": "",
"nodes": [{
"hostname": "127.0.0.1:8091",
"ports": {
"direct": 11210,
"proxy": 11211
}
}],
"vBucketServerMap": {
"hashAlgorithm": "CRC",
"numReplicas": 1,
"serverList": ["127.0.0.1:11210"],
"vBucketMap": []
}
})
2013-05-21 18:43:11: (agent_config.c.705) ERROR: bad JSON configuration from http://127.0.0.1:8091/pools/default/saslBucketsStreaming: Number of vBuckets must be a power of two > 0 and <= 65536 ({
"name": "saslbucket",
"nodeLocator": "vbucket",
"saslPassword": "",
"nodes": [{
"hostname": "127.0.0.1:8091",
"ports": {
"direct": 11210,
"proxy": 11211
}
}],
"vBucketServerMap": {
"hashAlgorithm": "CRC",
"numReplicas": 1,
"serverList": ["127.0.0.1:11210"],
"vBucketMap": []
}
})
EOL on stdin. Exiting ns_log000 ns_1@127.0.0.1 18:43:37 - Tue May 21, 2013
Shutting down bucket "saslbucket" on 'ns_1@127.0.0.1' for deletion ns_memcached002 ns_1@127.0.0.1 18:43:33 - Tue May 21, 2013
Bucket "saslbucket" loaded on node 'ns_1@127.0.0.1' in 0 seconds. ns_memcached001 ns_1@127.0.0.1 18:43:09 - Tue May 21, 2013
Created bucket "saslbucket" of type: membase
[{num_replicas,1},
{replica_index,false},
{ram_quota,2515533824},
{auth_type,sasl},
{autocompaction,false},
{flush_enabled,false}] menelaus_web012 ns_1@127.0.0.1 18:43:09 - Tue May 21, 2013
Shutting down bucket "default" on 'ns_1@127.0.0.1' for deletion ns_memcached002 ns_1@127.0.0.1 18:41:59 - Tue May 21, 2013
Bucket "default" loaded on node 'ns_1@127.0.0.1' in 0 seconds. ns_memcached001 ns_1@127.0.0.1 18:40:34 - Tue May 21, 2013
Created bucket "default" of type: membase
[{num_replicas,1},
{replica_index,false},
{ram_quota,2515533824},
{auth_type,sasl},
{autocompaction,false},
{flush_enabled,false}] menelaus_web012 ns_1@127.0.0.1 18:40:34 - Tue May 21, 2013
Deleted bucket "new-bucket-97c90481-0efb-4ad3-84ed-8a0bc00799ad"
(repeated 1 times) menelaus_web011 ns_1@127.0.0.1 18:40:27 - Tue May 21, 2013
Client-side error-report for user "Administrator" on node 'ns_1@127.0.0.1':
User-Agent:Python-httplib2/$Rev: 259 $
2013-05-21 18:39:58.017545 : test_non_default_moxi finished
menelaus_web102 ns_1@127.0.0.1 18:40:02 - Tue May 21, 2013
Port server moxi on node 'babysitter_of_ns_1@127.0.0.1' exited with status 0. Restarting. Messages: 2013-05-21 18:39:43: (cproxy_config.c.317) env: MOXI_SASL_PLAIN_USR (13)
2013-05-21 18:39:43: (cproxy_config.c.326) env: MOXI_SASL_PLAIN_PWD (8)
EOL on stdin. Exiting ns_log000 ns_1@127.0.0.1 18:40:02 - Tue May 21, 2013
Shutting down bucket "new-bucket-97c90481-0efb-4ad3-84ed-8a0bc00799ad" on 'ns_1@127.0.0.1' for deletion

Link to manifest file of this build http://builds.hq.northscale.net/latestbuilds/couchbase-server-enterprise_x86_64_2.0.2-809-rel.setup.exe.manifest.xml

[MB-8306] Number of document mutations pending XDC replication is rapidly growing

Wed, 22 May 2013 11:29:32 -0500

Also time spent waiting for checkpointing is much higher.

Diags (internal IP address):
http://172.23.96.10:8080/view/xdcr/job/xperf-lnx-bi/25/artifact/

[MB-8010] Couchbase Logo update on Windows Installer

Wed, 22 May 2013 11:01:59 -0500

Couchbase Logo update on Windows Installer

[MB-8215] [windows] firewalled node is seen as healthy

Wed, 22 May 2013 07:24:34 -0500

.29 node was firewalled
Domain Profile Settings:
----------------------------------------------------------------------
State ON
Firewall Policy BlockInbound,AllowOutbound
LocalFirewallRules N/A (GPO-store only)
LocalConSecRules N/A (GPO-store only)
InboundUserNotification Disable
RemoteManagement Disable
UnicastResponseToMulticast Enable

Logging:
LogAllowedConnections Disable
LogDroppedConnections Disable
FileName %systemroot%\system32\LogFiles\Firewall\pfirewall.log
MaxFileSize 4096

Private Profile Settings:
----------------------------------------------------------------------
State ON
Firewall Policy BlockInbound,AllowOutbound
LocalFirewallRules N/A (GPO-store only)
LocalConSecRules N/A (GPO-store only)
InboundUserNotification Disable
RemoteManagement Disable
UnicastResponseToMulticast Enable

Logging:
LogAllowedConnections Disable
LogDroppedConnections Disable
FileName %systemroot%\system32\LogFiles\Firewall\pfirewall.log
MaxFileSize 4096

Public Profile Settings:
----------------------------------------------------------------------
State ON
Firewall Policy BlockInbound,AllowOutbound
LocalFirewallRules N/A (GPO-store only)
LocalConSecRules N/A (GPO-store only)
InboundUserNotification Disable
RemoteManagement Disable
UnicastResponseToMulticast Enable

Logging:
LogAllowedConnections Disable
LogDroppedConnections Disable
FileName %systemroot%\system32\LogFiles\Firewall\pfirewall.log
MaxFileSize 4096

Ok.

[MB-8294] Destination node with XDCR (heavy DGM) goes into pending.

Wed, 22 May 2013 07:24:28 -0500

Destination node with XDCR (heavy DGM) goes into pending.

Setup Information:

- Cluster Config : 4 nodes, OS: Centos 6.3, CPU : 6 Core, RAM : 16G, Disk : 500G
- XDCR Topology : Unidirectional ( Master(3) -> Slave(1))
- 4 buckets AbRegNums(2GB), MsgsCalls(2GB), RevAB(3GB), UserInfo(2GB)
- Data Loaded using Viber Workload with 6.7M(RR ~45%), 0.1M(RR 100%), 11M(RR 100%), 12M(RR ~30%) data on the 4 buckets
- Unidirectional XDCR setup to 1 node(master -> slave) for 3 buckets AbRegNums, RevAB, UserInfo

Destination node goes into pending state(screenshot attached). Both beam.smp and memcached are running on the node.

There are lot of crash reports like below but there are no views/design docs in the system.

[error_logger:error,2013-05-16T1:40:30.265,ns_1@127.0.0.1:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
  crasher:
    initial call: set_view_update_daemon:init/1
    pid: <0.9511.707>
    registered_name: set_view_update_daemon
    exception exit: {noproc,
                        {gen_server,call,
                            ['capi_set_view_manager-UserInfo',
                             {foreach_doc,
                                 #Fun<capi_ddoc_replication_srv.2.102018441>},
                             infinity]}}
      in function gen_server:terminate/6
    ancestors: [ns_server_sup,ns_server_cluster_sup,<0.58.0>]
    messages: []
    links: [<0.298.0>,<0.9512.707>]
    dictionary: []
    trap_exit: false
    status: running
    heap_size: 121393
    stack_size: 24
    reductions: 7537
  neighbours:

=========================CRASH REPORT=========================
  crasher:
    initial call: compaction_daemon:-spawn_bucket_compactor/3-fun-2-/0
    pid: <0.9508.707>
    registered_name: []
    exception exit: {noproc,
                        {gen_server,call,
                            ['capi_set_view_manager-RevAB',
                             {foreach_doc,
                                 #Fun<capi_ddoc_replication_srv.1.36030090>},
                             infinity]}}
      in function gen_server:call/3
      in call from capi_ddoc_replication_srv:foreach_live_ddoc_id/2
      in call from capi_ddoc_replication_srv:fetch_ddoc_ids/1
      in call from compaction_daemon:'-spawn_bucket_compactor/3-fun-2-'/4
    ancestors: [compaction_daemon,ns_server_sup,ns_server_cluster_sup,
                  <0.58.0>]
    messages: []
    links: [<0.412.0>]
    dictionary: []
    trap_exit: false
    status: running
    heap_size: 28657
    stack_size: 24
    reductions: 30607
  neighbours:

The pending node is in the same state and can be used for investigation:
coconut-h20804.hq.couchbase.com

[MB-8159] Performance / efficiency improvements for view compaction retry phase

Wed, 22 May 2013 06:37:01 -0500

In the same vein as MB-8029, move much of the IO/CPU intensive work from Erlang to C for the view compaction retry phase

[MB-8295] Dev views uses bsuperstar, but single vbucket

Wed, 22 May 2013 06:37:01 -0500

Dev views uses bsuperstar, but single vbucket

[MB-7269] cbtransfer/cbrestore throws BadStatusLine exception when using wrong port number

Wed, 22 May 2013 04:59:30 -0500

Thanks to Tony Fonager....

When cbtransfer is invoked incorrectly against the wrong port (11211 rather than 8091), the tool should give a more polite, useful error message rather than an ugly stack trace.

[root@cbnode05 bin]# ./cbtransfer /root/Backup/cbtransfer http://192.168.0.75:11211 -b quizmo -B quizmo -u username -p password
Traceback (most recent call last):
  File "/opt/couchbase/lib/python/cbtransfer", line 33, in <module>
    pump_transfer.exit_handler(pump_transfer.Transfer().main(sys.argv))
  File "/opt/couchbase/lib/python/pump_transfer.py", line 85, in main
    sink_class, sink).run()
  File "/opt/couchbase/lib/python/pump.py", line 100, in run
    rv, source_map, sink_map = self.check_endpoints()
  File "/opt/couchbase/lib/python/pump.py", line 150, in check_endpoints
    rv, sink_map = self.sink_class.check(self.opts, self.sink_spec, source_map)
  File "/opt/couchbase/lib/python/pump_cb.py", line 71, in check
    rv, sink_map = pump.rest_couchbase(opts, spec)
  File "/opt/couchbase/lib/python/pump.py", line 879, in rest_couchbase
    rest_request_json(host, int(port), user, pswd, path)
  File "/opt/couchbase/lib/python/pump.py", line 856, in rest_request_json
    reason=reason)
  File "/opt/couchbase/lib/python/pump.py", line 829, in rest_request
    resp = conn.getresponse()
  File "/usr/lib64/python2.6/httplib.py", line 990, in getresponse
    response.begin()
  File "/usr/lib64/python2.6/httplib.py", line 391, in begin
    version, status, reason = self._read_status()
  File "/usr/lib64/python2.6/httplib.py", line 355, in _read_status
    raise BadStatusLine(line)
httplib.BadStatusLine

[MB-6231] 405 Method text response to POST /default/_design/doc includes POST as a valid method

Wed, 22 May 2013 04:36:58 -0500

405 Method text response to POST /default/_design/doc includes POST as a valid method

[MB-8239] cbcollect_info only collects couchbase.log and misses other logs

Wed, 22 May 2013 01:44:08 -0500

Chishengs-MacBook-Pro:bin chisheng$ ./cbcollect_info
info.zipuname (uname -a) - OK
Directory structure membase - previous versions (ls -lR /opt/membase /var/membase /var/opt/membase /etc/opt/membase) - Exit code 1
sysctl settings (sysctl -a) - OK
Process list snapshot (top -l 1) - OK
Disk activity (iostat 1 10) - OK
Process list (ps -Aww -o user,pid,lwp,ppid,nlwp,pcpu,pri,nice,vsize,rss,tty,stat,wchan:12,start,bsdtime,command) - Exit code 1
Network configuration (ifconfig -a) - OK
Taking sample 2 after 10.000000 seconds -
OK
Network status (netstat -an) - OK
Network routing table (netstat -rn) - OK
Arp cache (arp -na) - OK
Filesystem (df -ha) - OK
System activity reporter (sar 1 10) - OK
System paging activity (vmstat 1 10) - Exit code 127
System uptime (uptime) - OK
couchbase user definition (getent passwd couchbase) - Exit code 127
couchbase user limits (su couchbase -c "ulimit -a") - skipped (needs root privs)
membase user definition (getent passwd membase) - Exit code 127
couchbase user limits (su couchbase -c "ulimit -a") - skipped (needs root privs)
membase user limits (su membase -c "ulimit -a") - skipped (needs root privs)
Interrupt status (intrstat 1 10) - Exit code 127
Processor status (mpstat 1 10) - Exit code 127
System log (cat /var/adm/messages) - Exit code 1
Kernel log buffer (dmesg) - Exit code 1
Checking for server guts in /Applications/Couchbase Server.app/Contents/Resources/couchbase-core/var/lib/couchbase/initargs...
./erl: line 28: /lib/erlang/erts-5.8.*/bin/erlexec: No such file or directory
./erl: line 28: exec: /lib/erlang/erts-5.8.*/bin/erlexec: cannot execute: No such file or directory
Checking for server guts in /opt/couchbase/var/lib/couchbase/initargs...
./erl: line 28: /lib/erlang/erts-5.8.*/bin/erlexec: No such file or directory
./erl: line 28: exec: /lib/erlang/erts-5.8.*/bin/erlexec: cannot execute: No such file or directory
Checking for server guts in /Users/chisheng/Library/Application Support/Couchbase/var/lib/couchbase/initargs...
./erl: line 28: /lib/erlang/erts-5.8.*/bin/erlexec: No such file or directory
./erl: line 28: exec: /lib/erlang/erts-5.8.*/bin/erlexec: cannot execute: No such file or directory

[MB-8023] Port server moxi on node 'ns_1@10.3.121.97' exited with status 1.

Tue, 21 May 2013 20:54:52 -0500

I reboot one vms install couchbase server 2.0.2-746.
After the vm is up and couchbase server started, I saw error "Port server moxi on node 'ns_1@10.3.121.97' exited with status 1." in log page

Port server moxi on node 'ns_1@10.3.121.97' exited with status 1. Restarting. Messages: 2013-04-02 15:48:43: (cproxy_config.c.317) env: MOXI_SASL_PLAIN_USR (13)
2013-04-02 15:48:43: (cproxy_config.c.326) env: MOXI_SASL_PLAIN_PWD (8)
2013-04-02 15:48:45: (cproxy.c.330) ERROR: could not listen on port 11211. Please use -Z port_listen=PORT_NUM to specify a different port number. ns_port_server000 ns_1@10.3.121.97 15:48:43 - Tue Apr 2, 2013
Port server moxi on node 'ns_1@10.3.121.97' exited with status 1. Restarting. Messages: 2013-04-02 15:48:38: (cproxy_config.c.317) env: MOXI_SASL_PLAIN_USR (13)
2013-04-02 15:48:38: (cproxy_config.c.326) env: MOXI_SASL_PLAIN_PWD (8)
2013-04-02 15:48:40: (cproxy.c.330) ERROR: could not listen on port 11211. Please use -Z port_listen=PORT_NUM to specify a different port number. ns_port_server000 ns_1@10.3.121.97 15:48:38 - Tue Apr 2, 2013
Service moxi exited on node 'ns_1@10.3.121.97' in 0.01s
supervisor_cushion001 ns_1@10.3.121.97 15:48:33 - Tue Apr 2, 2013
Port server moxi on node 'ns_1@10.3.121.97' exited with status 1. Restarting. Messages: 2013-04-02 15:48:33: (cproxy_config.c.317) env: MOXI_SASL_PLAIN_USR (13)
2013-04-02 15:48:33: (cproxy_config.c.326) env: MOXI_SASL_PLAIN_PWD (8)
2013-04-02 15:48:35: (cproxy.c.330) ERROR: could not listen on port 11211. Please use -Z port_listen=PORT_NUM to specify a different port number. ns_port_server000 ns_1@10.3.121.97 15:48:33 - Tue Apr 2, 2013
Port server moxi on node 'ns_1@10.3.121.97' exited with status 1. Restarting. Messages: 2013-04-02 15:48:28: (cproxy_config.c.317) env: MOXI_SASL_PLAIN_USR (13)
2013-04-02 15:48:28: (cproxy_config.c.326) env: MOXI_SASL_PLAIN_PWD (8)
2013-04-02 15:48:30: (cproxy.c.330) ERROR: could not listen on port 11211. Please use -Z port_listen=PORT_NUM to specify a different port number. ns_port_server000 ns_1@10.3.121.97 15:48:28 - Tue Apr 2, 2013

I will attach collect info file soon

[MB-8325] ns_server should collect various stats about supervised processes

Tue, 21 May 2013 19:22:05 -0500

ns_server should collect various stats about supervised processes

[MB-7621] [Mac README]No way to install CLI tools as per readme.tx instructions

Tue, 21 May 2013 18:27:13 -0500

From the readme.txt in the Mac download:
  * After installing the command-line tools (via the item in the menu),
    moving the app will break the symbolic links that were created in
    /usr/local/bin (or wherever you installed the tools into.)

There is no "item in the menu" with which to install the tools. How does one do so?

We also need docs on the Mac installation in general.

[MB-8319] [DOC? 2.0.2] View compaction is triggered during rebalance when auto-compaction is disabled

Tue, 21 May 2013 18:20:45 -0500

Steps:
1. Set fragmentation threshold to 100% (both data and index)
2. Start workload, view fragmentation is high, >90%.
3. Rebalance cluster

As result view compaction kicks in. Bucket compaction doesn't kick in.

Not sure if it's a bug but behavior is very confusing. At least I didn't find documentation that explains it.

Diags for 2.0.2, just in case:
http://172.23.96.10:8080/view/views/job/apollo-views/116/artifact/

Basically I just want to run a test with no view compaction.

[MB-6972] [Doc when ready] distribute couchbase-server through yum and debian package repositories

Dependency — Tue, 21 May 2013 18:19:24 -0500

this helps us in handling dependencies that are needed for couchbase server
sdk team has already implemented this for various sdk packages.

we might have to make some changes to our packaging metadata to work with this schema

[MB-8240] memslap vbucketkeygen vbuckettool is not working with MAC for latest build

Tue, 21 May 2013 17:42:33 -0500

Chishengs-MacBook-Pro:tools chisheng$ ./memslap -h
dyld: Library not loaded: /opt/couchbase/lib/libmemcached.6.dylib
  Referenced from: /Applications/Couchbase Server.app/Contents/Resources/couchbase-core/bin/tools/./memslap
  Reason: image not found
Trace/BPT trap: 5

Chishengs-MacBook-Pro:tools chisheng$ ./vbuckettool -h
dyld: Library not loaded: /opt/couchbase/lib/libvbucket.1.dylib
  Referenced from: /Applications/Couchbase Server.app/Contents/Resources/couchbase-core/bin/tools/./vbuckettool
  Reason: image not found
Trace/BPT trap: 5

Chishengs-MacBook-Pro:tools chisheng$ ./vbucketkeygen -h
dyld: Library not loaded: /opt/couchbase/lib/libvbucket.1.dylib
  Referenced from: /Applications/Couchbase Server.app/Contents/Resources/couchbase-core/bin/tools/./vbucketkeygen
  Reason: image not found
Trace/BPT trap: 5

[MB-8274] items not draining seems... ep-engine is deadlocked

Tue, 21 May 2013 16:36:16 -0500

during xdcr longevity test memcached kept restarting on a node
ui reports: Control connection to memcached on 'ns_1@172.23.105.57' disconnected: {badmatch,
{error,
couldnt_connect_to_memcached}}

(guinep-s1050.sc.couchbase.com)

everytime I do a gdb backtrace I see threads 16,17,18 in the lock() method.

Thread 18 (Thread 0x7f1212849700 (LWP 21113)):
#0 0x00007f121a5b4054 in __lll_lock_wait () from /lib64/libpthread.so.0
#1 0x00007f121a5af388 in _L_lock_854 () from /lib64/libpthread.so.0
#2 0x00007f121a5af257 in pthread_mutex_lock () from /lib64/libpthread.so.0
#3 0x00007f1214436f7a in Mutex::acquire (this=0x641e0f0) at src/mutex.cc:79
#4 0x00007f121447d566 in lock (this=0x641e000) at ./src/locks.hh:48
#5 LockHolder (this=0x641e000) at ./src/locks.hh:26
#6 CouchNotifier::selectBucket (this=0x641e000) at src/couch-kvstore/couch-notifier.cc:723
#7 0x00007f121447dbcf in CouchNotifier::processInput (this=0x641e000) at src/couch-kvstore/couch-notifier.cc:606
#8 0x00007f121447e475 in waitOnce (this=0x641e000, vbs=..., file_version=1, header_offset=212992, cb=...) at src/couch-kvstore/couch-notifier.cc:675
#9 CouchNotifier::notify_update (this=0x641e000, vbs=..., file_version=1, header_offset=212992, cb=...) at src/couch-kvstore/couch-notifier.cc:755
#10 0x00007f1214475cb8 in notify_headerpos_update (this=0x643fb00, vbid=760, rev=1, docs=0x323bd880, docinfos=0x323bda40, docCount=56) at ./src/couch-kvstore/couch-notifier.hh:144
#11 CouchKVStore::saveDocs (this=0x643fb00, vbid=760, rev=1, docs=0x323bd880, docinfos=0x323bda40, docCount=56) at src/couch-kvstore/couch-kvstore.cc:1498
#12 0x00007f121447628b in CouchKVStore::commit2couchstore (this=0x643fb00) at src/couch-kvstore/couch-kvstore.cc:1410
#13 0x00007f121447647a in CouchKVStore::commit (this=<value optimized out>) at src/couch-kvstore/couch-kvstore.cc:806
#14 0x00007f1214401f56 in EventuallyPersistentStore::flushVBucket (this=0x6395c00, vbid=760) at src/ep.cc:1919
#15 0x00007f121442aeb9 in doFlush (this=0x520b7a0, tid=1098) at src/flusher.cc:222
#16 Flusher::step (this=0x520b7a0, tid=1098) at src/flusher.cc:152
#17 0x00007f121443ac10 in ExecutorThread::run (this=0x52bfba0) at src/scheduler.cc:148
#18 0x00007f121443b32d in launch_executor_thread (arg=0x52bfba0) at src/scheduler.cc:34
#19 0x00007f121a5ad851 in start_thread () from /lib64/libpthread.so.0
#20 0x00007f121a2fb90d in clone () from /lib64/libc.so.6

Thread 17 (Thread 0x7f1211e48700 (LWP 21114)):
#0 0x00007f121a5b4054 in __lll_lock_wait () from /lib64/libpthread.so.0
#1 0x00007f121a5af388 in _L_lock_854 () from /lib64/libpthread.so.0
#2 0x00007f121a5af257 in pthread_mutex_lock () from /lib64/libpthread.so.0
#3 0x00007f1214436f7a in Mutex::acquire (this=0x641e0f0) at src/mutex.cc:79
#4 0x00007f121447e2c3 in lock (this=0x641e000, vbs=..., file_version=1, header_offset=217088, cb=...) at ./src/locks.hh:48
#5 LockHolder (this=0x641e000, vbs=..., file_version=1, header_offset=217088, cb=...) at ./src/locks.hh:26
#6 CouchNotifier::notify_update (this=0x641e000, vbs=..., file_version=1, header_offset=217088, cb=...) at src/couch-kvstore/couch-notifier.cc:753
#7 0x00007f1214475cb8 in notify_headerpos_update (this=0x64d4c00, vbid=693, rev=1, docs=0x93f4480, docinfos=0x94186c0, docCount=72) at ./src/couch-kvstore/couch-notifier.hh:144
#8 CouchKVStore::saveDocs (this=0x64d4c00, vbid=693, rev=1, docs=0x93f4480, docinfos=0x94186c0, docCount=72) at src/couch-kvstore/couch-kvstore.cc:1498
#9 0x00007f121447628b in CouchKVStore::commit2couchstore (this=0x64d4c00) at src/couch-kvstore/couch-kvstore.cc:1410
#10 0x00007f121447647a in CouchKVStore::commit (this=<value optimized out>) at src/couch-kvstore/couch-kvstore.cc:806
#11 0x00007f1214401f56 in EventuallyPersistentStore::flushVBucket (this=0x6395c00, vbid=693) at src/ep.cc:1919
#12 0x00007f121442aeb9 in doFlush (this=0x520b680, tid=1095) at src/flusher.cc:222
#13 Flusher::step (this=0x520b680, tid=1095) at src/flusher.cc:152
#14 0x00007f121443ac10 in ExecutorThread::run (this=0x52bfa00) at src/scheduler.cc:148
#15 0x00007f121443b32d in launch_executor_thread (arg=0x52bfa00) at src/scheduler.cc:34
#16 0x00007f121a5ad851 in start_thread () from /lib64/libpthread.so.0
#17 0x00007f121a2fb90d in clone () from /lib64/libc.so.6

Thread 16 (Thread 0x7f1211447700 (LWP 21115)):
#0 0x00007f121a5b4054 in __lll_lock_wait () from /lib64/libpthread.so.0
#1 0x00007f121a5af388 in _L_lock_854 () from /lib64/libpthread.so.0
#2 0x00007f121a5af257 in pthread_mutex_lock () from /lib64/libpthread.so.0
#3 0x00007f1214436f7a in Mutex::acquire (this=0x641e0f0) at src/mutex.cc:79
#4 0x00007f121447e2c3 in lock (this=0x641e000, vbs=..., file_version=1, header_offset=212992, cb=...) at ./src/locks.hh:48
#5 LockHolder (this=0x641e000, vbs=..., file_version=1, header_offset=212992, cb=...) at ./src/locks.hh:26
#6 CouchNotifier::notify_update (this=0x641e000, vbs=..., file_version=1, header_offset=212992, cb=...) at src/couch-kvstore/couch-notifier.cc:753
#7 0x00007f1214475cb8 in notify_headerpos_update (this=0x64d4600, vbid=750, rev=1, docs=0x321a4480, docinfos=0x321a4fc0, docCount=65) at ./src/couch-kvstore/couch-notifier.hh:144
#8 CouchKVStore::saveDocs (this=0x64d4600, vbid=750, rev=1, docs=0x321a4480, docinfos=0x321a4fc0, docCount=65) at src/couch-kvstore/couch-kvstore.cc:1498
#9 0x00007f121447628b in CouchKVStore::commit2couchstore (this=0x64d4600) at src/couch-kvstore/couch-kvstore.cc:1410
#10 0x00007f121447647a in CouchKVStore::commit (this=<value optimized out>) at src/couch-kvstore/couch-kvstore.cc:806
#11 0x00007f1214401f56 in EventuallyPersistentStore::flushVBucket (this=0x6395c00, vbid=750) at src/ep.cc:1919
#12 0x00007f121442aeb9 in doFlush (this=0x520b560, tid=1096) at src/flusher.cc:222
#13 Flusher::step (this=0x520b560, tid=1096) at src/flusher.cc:152
#14 0x00007f121443ac10 in ExecutorThread::run (this=0x52bf860) at src/scheduler.cc:148
#15 0x00007f121443b32d in launch_executor_thread (arg=0x52bf860) at src/scheduler.cc:34
#16 0x00007f121a5ad851 in start_thread () from /lib64/libpthread.so.0
#17 0x00007f121a2fb90d in clone () from /lib64/libc.so.6

Thread 15 (Thread 0x7f1210a46700 (LWP 21116)):
#0 0x00007f121a5b4054 in __lll_lock_wait () from /lib64/libpthread.so.0
#1 0x00007f121a5af388 in _L_lock_854 () from /lib64/libpthread.so.0
#2 0x00007f121a5af257 in pthread_mutex_lock () from /lib64/libpthread.so.0
#3 0x00007f1214436f7a in Mutex::acquire (this=0x528f0f0) at src/mutex.cc:79
#4 0x00007f121447d566 in lock (this=0x528f000) at ./src/locks.hh:48
#5 LockHolder (this=0x528f000) at ./src/locks.hh:26
#6 CouchNotifier::selectBucket (this=0x528f000) at src/couch-kvstore/couch-notifier.cc:723
#7 0x00007f121447dbcf in CouchNotifier::processInput (this=0x528f000) at src/couch-kvstore/couch-notifier.cc:606
#8 0x00007f121447e475 in waitOnce (this=0x528f000, vbs=..., file_version=2, header_offset=1798144, cb=...) at src/couch-kvstore/couch-notifier.cc:675
#9 CouchNotifier::notify_update (this=0x528f000, vbs=..., file_version=2, header_offset=1798144, cb=...) at src/couch-kvstore/couch-notifier.cc:755
#10 0x00007f1214475cb8 in notify_headerpos_update (this=0x5295b00, vbid=1023, rev=2, docs=0x1a897c00, docinfos=0x1a896a80, docCount=107) at ./src/couch-kvstore/couch-notifier.hh:144
#11 CouchKVStore::saveDocs (this=0x5295b00, vbid=1023, rev=2, docs=0x1a897c00, docinfos=0x1a896a80, docCount=107) at src/couch-kvstore/couch-kvstore.cc:1498
#12 0x00007f121447628b in CouchKVStore::commit2couchstore (this=0x5295b00) at src/couch-kvstore/couch-kvstore.cc:1410
#13 0x00007f121447647a in CouchKVStore::commit (this=<value optimized out>) at src/couch-kvstore/couch-kvstore.cc:806
#14 0x00007f1214401f56 in EventuallyPersistentStore::flushVBucket (this=0x527e000, vbid=1023) at src/ep.cc:1919
#15 0x00007f121442aeb9 in doFlush (this=0x520a360, tid=12) at src/flusher.cc:222
#16 Flusher::step (this=0x520a360, tid=12) at src/flusher.cc:152
#17 0x00007f121443ac10 in ExecutorThread::run (this=0x52e6ea0) at src/scheduler.cc:148
#18 0x00007f121443b32d in launch_executor_thread (arg=0x52e6ea0) at src/scheduler.cc:34
#19 0x00007f121a5ad851 in start_thread () from /lib64/libpthread.so.0
#20 0x00007f121a2fb90d in clone () from /lib64/libc.so.6

there are also errors in memcached.logs about "Too many connections"

I have full backtrace attached and machine is currently live.

[MB-8324] some nodes have 0 active items after offline upgrade

Tue, 21 May 2013 16:13:53 -0500

1) Loaded data into a 9 node cluster at 181.
2) Stopped load, waited for disk-write-queue = 0.
3) shutdown all nodes simultaneously via /etc/init.d/couchbase-server stop
4) upgrade to 2.0.2-807.

Nodes come back up but with less items than before upgrade. 2 nodes have 0 active items.

Impact: apparent data loss
Cluster live ( 10.3.2.89:8091)

all node diags attached.
shutdown occured at timestamp: [2013-05-20 14:37...]
followed by upgrade.

[MB-8210] Update the incorrect information on the Automated Index Updates

Tue, 21 May 2013 14:47:03 -0500

We need to fix this page http://www.couchbase.com/docs/couchbase-manual-2.0/couchbase-views-operation-autoupdate.html ?

Relevant information about how it actually works.

"Every updateInterval milliseconds it checks if index file is more than updateMinChanges behind .couch files (which is itself behind in-memory source of truth, potentially for tens of seconds). And true, it triggers view update."

[MB-7887] [Doc'd] Appends can cause large amounts of memory fragmentation in tcmalloc

Duplicate — Tue, 21 May 2013 14:42:07 -0500

[Doc'd] Appends can cause large amounts of memory fragmentation in tcmalloc

[MB-7902] [windows] Rebalance exited with reason {detected_nodes_change, {ns_node_disco_events,

Dependency — Tue, 21 May 2013 14:17:34 -0500

The below test is failing while doing rebalance:
./testrunner -i win-aws.ini -t rebalancetests.IncrementalRebalanceInTests.test_load,replica=2,delete-ratio=0.6,expiry-ratio=0.2,do-stop=True

Logs show below error message:

<0.6654.65>:ns_orchestrator:handle_info:319]Rebalance exited with reason {detected_nodes_change,
                                 {ns_node_disco_events,
                                     ['ns_1@10.130.71.207',
                                      'ns_1@10.131.33.89',
                                      'ns_1@10.131.35.139',
                                      'ns_1@10.142.174.97'],

The run log of testrunner is attached. Will be attaching cbcollect_info shortly.

[MB-8331] Need to move to 5.8.5.cb1

Dependency — Tue, 21 May 2013 14:15:58 -0500

We need to move to our patched Erlang version 5.8.5.cb1 as we decided not to move to newer version of Erlang that has Filipe's changes upstream.

[MB-7862] Building from source: couchbase version is not correct

Tue, 21 May 2013 13:54:52 -0500

built from source using command
PRODUCT_VERSION=2.0.1 PATH=/opt/couchbase/bin:$PATH LD_RUN_PATH=/opt/couchbase/lib make PREFIX=/opt/couchbase AUTO_RECONFIG=1 'couchdb_EXTRA_OPTIONS=--with-erlang=/opt/couchbase/lib/erlang/usr/include --with-btree-implementation=native --with-v8-include=~/icu4c/source/v8/include --with-v8-lib=~/icu4c/source/v8' 'couchdb_EXTRA_MAKE_OPTIONS=' ' libmemcached_EXTRA_OPTIONS=--disable-sasl' 'memcached_EXTRA_OPTIONS=--with-libevent=/opt/couchbase LDFLAGS=-L/opt/couchbase/lib LIBS=-ltcmalloc_minimal' 'ep-engine_EXTRA_OPTIONS=--with-libevent-prefix=/opt/couchbase' 'moxi_EXTRA_MAKE_OPTIONS=LTLIBEVENT=~/Downloads/libevent-2.0.19-stable/.libs/libevent.a' all

On initializing screen build version is not correct (see screenshot): 0.0.0 DEV
For 2.0.0 appropriate version is indicated

[MB-7177] lack of fsyncs in view engine may lead to silent index corruption

Tue, 21 May 2013 13:51:20 -0500

SUBJ. Found out about this in discussion with Filipe about how views work.

If I understood correctly it doesn't fsync at all silently assuming that if there's valid header, then preceding data is valid as well. Which is clearly not true.

IMHO that's a massive blocker that needs to be fixed sooner rather than later.

[MB-8323] Crash caused by task running while a bucket is shutting down

Tue, 21 May 2013 13:44:23 -0500

Crash caused by task running while a bucket is shutting down

[MB-8214] bgfetcher performance regression

Tue, 21 May 2013 13:40:08 -0500

* bgfetcher condition variable for woken task is not getting correctly (hasWokenTask).
* also need to immediately move any woken task to readyQueue instead of re-pushing to futureQueue

[MB-7772] [windows performance] Slow Rebalance with 1 bucket and views

Dependency — Tue, 21 May 2013 13:34:48 -0500

The below test takes 2 hours to run with 2.0.0-1976-rel while it took 47 hours to finish with 2.0.1-156-rel build in automation run.

viewquerytests.ViewQueryTests.test_employee_dataset_startkey_endkey_queries_rebalance_in,max-dupe-result-count=10,num_nodes_to_add=3,skip_rebalance=true

The test loads 200k json docs on default bucket on single node. Creates 6 ddocs(1 view each). And then run view queries and start rebalance 1->4.

I have started the test again on the below cluster for 2.0.1. Rebalance is 19% complete in 20 hours and is running very slowly.
For 2.0, the test completed in 2 hours.

Both the clusters are live and can be used for investigation.

2.0.1 cluster (build 2.0.1-156-rel)

10.3.2.23
10.3.2.25
10.3.2.24
10.3.2.73

2.0 cluster (build 2.0.0-1976-rel)

10.3.2.135
10.3.3.40
10.3.2.133
10.3.3.166

[MB-7149] cbbackup loops infinitely

Tue, 21 May 2013 13:05:52 -0500

I'm trying to backup my cluster via cbbackup. I start the backup via
/opt/couchbase/bin/cbbackup couchbase://Administrator:password@mymachine:8091 /backups/couchbase_backup_test
The backup appears to work fine and a progress bar appears, but then exceeds 100% progress and never stops! Example:
^Cinterrupted.###############################] 210.8% (26141950/12403784 msgs)
(I ctrl-C'd to kill it after 200% because it seems that this can't possibly work. Note that both the percent and the number of messages are off). I only have ~12 million items in the bucket, but it went right past that limit when backing up.
Help?

[MB-8263] [system test] Erlang crash during data access phase with Mike's toy build

Tue, 21 May 2013 13:01:04 -0500

cluster ip is 10.5.2.30

1.3 node cluster, create 2 buckets, default 2.5G quota and saslbucket 1.3G
2.load items into buckets to make it dgm. Around 80% resident ratio
3.After initial loading, do a lot of "gets", around 80%. 20% cache miss maximum. Total ops per sec is 3k ops/sec
During data access phase, nodes went down in "Pend" state. bucket is not accessible from UI.

Find erlang_crash.dump on 10.5.2.31 under /opt/couchbase/var/lib/couchbase.

Link to the core_dump file: https://s3.amazonaws.com/bugdb/jira/MB-8263/erl_crash.dump.05-10-2013-19:05:36.7640

[MB-5673] Make a way to install Couchbase if you don't have root access

Duplicate — Tue, 21 May 2013 12:34:49 -0500

If this is already done then we need to document it somewhere.

http://www.couchbase.com/forums/thread/installing-non-root-user

[MB-8252] Docs: How to work with data across different client languages

Tue, 21 May 2013 11:37:31 -0500

There are a few cases where the customer wants to use the same data from different languages and it would be helpful to provide some documentation on how to do this. There are certain things like serialization, etc to take into account.

[MB-8318] memcached crashed in CouchKVStore::setVBucketState

Tue, 21 May 2013 10:53:38 -0500

http://qa.hq.northscale.net/job/cen-ubu-64-2.0-new-rebalance-mixed-cluster-P1/9/consoleFull

1.8.1 & 2.0.2-807 ( mixed cluster)
1_8_1:
10.5.2.11
10.6.2.81
10.6.2.82

2.0.2-807-rel:
10.3.121.119
10.3.121.121
10.3.121.122
10.3.121.123

on 10.3.121.121( root/couchbase):

[root@localhost tmp]# ls -la
total 1345100
drwxrwxrwt 10 root root 4096 May 20 01:09 .
drwxr-xr-x 24 root root 4096 May 18 09:40 ..
drwx------ 2 root root 4096 May 20 00:00 atop.d
drwxr-xr-x 2 root root 4096 May 18 03:24 backup
-rw------- 1 couchbase couchbase 698519552 May 19 17:13 core.memcached.14586
-rw------- 1 couchbase couchbase 947982336 May 19 13:57 core.memcached.3876
-rw-r--r-- 1 root root 129834728 May 18 00:32 couchbase-server-enterprise_x86_64_2.0.2-807-rel.rpm
drwxrwxrwt 2 root root 4096 May 18 09:40 .font-unix
-rw------- 1 root root 66 May 18 00:33 .gdm6DAMUW
srw-rw-rw- 1 root root 0 May 18 09:40 .gdm_socket
drwxrwxrwt 2 root root 4096 May 18 09:40 .ICE-unix
drwx------ 2 root root 4096 Apr 2 12:32 keyring-iUmHcT
drwx------ 2 couchbase couchbase 4096 Apr 11 2012 keyring-JYEPdw
drwx------ 2 root root 4096 May 18 09:40 vmware-root
-r--r--r-- 1 root root 11 May 18 09:40 .X0-lock
drwxrwxrwt 2 root root 4096 May 18 09:40 .X11-unix
[root@localhost tmp]# gdb /opt/couchbase/bin/memcached core.memcached.14586
GNU gdb (GDB) CentOS (7.0.1-45.el5.centos)
Copyright (C) 2009 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>...
Reading symbols from /opt/couchbase/bin/memcached...done.
[New Thread 15231]
[New Thread 20939]
[New Thread 20938]
[New Thread 20937]
[New Thread 15236]
[New Thread 15235]
[New Thread 15234]
[New Thread 15233]
[New Thread 15232]
[New Thread 15230]
[New Thread 14593]
[New Thread 14592]
[New Thread 14591]
[New Thread 14590]
[New Thread 14589]
[New Thread 14588]
[New Thread 14587]
[New Thread 14586]

warning: .dynamic section for "/usr/lib64/libstdc++.so.6" is not at the expected address

warning: difference appears to be caused by prelink, adjusting expectations

warning: .dynamic section for "/lib64/libgcc_s.so.1" is not at the expected address

warning: difference appears to be caused by prelink, adjusting expectations
Reading symbols from /opt/couchbase/lib/memcached/libmemcached_utilities.so.0...done.
Loaded symbols for /opt/couchbase/lib/memcached/libmemcached_utilities.so.0
Reading symbols from /opt/couchbase/lib/libevent-2.0.so.5...done.
Loaded symbols for /opt/couchbase/lib/libevent-2.0.so.5
Reading symbols from /lib64/libdl.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libdl.so.2
Reading symbols from /lib64/libm.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib64/libm.so.6
Reading symbols from /lib64/librt.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/librt.so.1
Reading symbols from /opt/couchbase/lib/libtcmalloc_minimal.so.4...done.
Loaded symbols for /opt/couchbase/lib/libtcmalloc_minimal.so.4
Reading symbols from /lib64/libpthread.so.0...(no debugging symbols found)...done.
[Thread debugging using libthread_db enabled]
Loaded symbols for /lib64/libpthread.so.0
Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib64/libc.so.6
Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/ld-linux-x86-64.so.2
Reading symbols from /usr/lib64/libstdc++.so.6...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/libstdc++.so.6
Reading symbols from /lib64/libgcc_s.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libgcc_s.so.1
Reading symbols from /opt/couchbase/lib/memcached/stdin_term_handler.so...done.
Loaded symbols for /opt/couchbase/lib/memcached/stdin_term_handler.so
Reading symbols from /opt/couchbase/lib/memcached/file_logger.so...done.
Loaded symbols for /opt/couchbase/lib/memcached/file_logger.so
Reading symbols from /opt/couchbase/lib/memcached/bucket_engine.so...done.
Loaded symbols for /opt/couchbase/lib/memcached/bucket_engine.so
Reading symbols from /opt/couchbase/lib/memcached/ep.so...done.
Loaded symbols for /opt/couchbase/lib/memcached/ep.so
Reading symbols from /opt/couchbase/lib/libcouchstore.so.1...done.
Loaded symbols for /opt/couchbase/lib/libcouchstore.so.1
Reading symbols from /opt/couchbase/lib/libsnappy.so.1...done.
Loaded symbols for /opt/couchbase/lib/libsnappy.so.1
Reading symbols from /opt/couchbase/lib/libicuuc.so.44...done.
Loaded symbols for /opt/couchbase/lib/libicuuc.so.44
Reading symbols from /opt/couchbase/lib/libicudata.so.44...(no debugging symbols found)...done.
Loaded symbols for /opt/couchbase/lib/libicudata.so.44
Reading symbols from /opt/couchbase/lib/libicui18n.so.44...done.
Loaded symbols for /opt/couchbase/lib/libicui18n.so.44

warning: no loadable sections found in added symbol-file system-supplied DSO at 0x7fff41d5f000
Core was generated by `/opt/couchbase/bin/memcached -X /opt/couchbase/lib/memcached/stdin_term_handler'.
Program terminated with signal 6, Aborted.
#0 0x0000003018630265 in raise () from /lib64/libc.so.6
(gdb) t a a bt

Thread 18 (Thread 0x2b6944d5f220 (LWP 14586)):
#0 0x00000030186d48a8 in epoll_wait () from /lib64/libc.so.6
#1 0x00002b69448ef576 in epoll_dispatch (base=0x13772000, tv=<value optimized out>) at epoll.c:404
#2 0x00002b69448dae44 in event_base_loop (base=0x13772000, flags=<value optimized out>) at event.c:1558
#3 0x00000000004097d6 in main (argc=<value optimized out>, argv=<value optimized out>) at daemon/memcached.c:7926

Thread 17 (Thread 14587):
#0 0x00000030186c678b in read () from /lib64/libc.so.6
#1 0x000000301866cd57 in _IO_new_file_underflow () from /lib64/libc.so.6
#2 0x000000301866d71e in _IO_default_uflow_internal () from /lib64/libc.so.6
#3 0x0000003018662804 in _IO_getline_info_internal () from /lib64/libc.so.6
#4 0x00000030186616a9 in fgets () from /lib64/libc.so.6
#5 0x00002b6944d60939 in check_stdin_thread (arg=<value optimized out>) at extensions/daemon/stdin_check.c:37
#6 0x000000301920673d in start_thread () from /lib64/libpthread.so.0
#7 0x00000030186d44bd in clone () from /lib64/libc.so.6

Thread 16 (Thread 14588):
#0 0x000000301920b150 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00002aaaaaaae4d6 in logger_thead_main (arg=0xef0a040) at extensions/loggers/file_logger.c:368
#2 0x000000301920673d in start_thread () from /lib64/libpthread.so.0
#3 0x00000030186d44bd in clone () from /lib64/libc.so.6

Thread 15 (Thread 14589):
#0 0x00000030186d48a8 in epoll_wait () from /lib64/libc.so.6
#1 0x00002b69448ef576 in epoll_dispatch (base=0x13772500, tv=<value optimized out>) at epoll.c:404
#2 0x00002b69448dae44 in event_base_loop (base=0x13772500, flags=<value optimized out>) at event.c:1558
#3 0x0000000000414604 in worker_libevent (arg=0xef0d900) at daemon/thread.c:301
#4 0x000000301920673d in start_thread () from /lib64/libpthread.so.0
#5 0x00000030186d44bd in clone () from /lib64/libc.so.6

Thread 14 (Thread 14590):
#0 0x00000030186d48a8 in epoll_wait () from /lib64/libc.so.6
#1 0x00002b69448ef576 in epoll_dispatch (base=0x13772280, tv=<value optimized out>) at epoll.c:404
#2 0x00002b69448dae44 in event_base_loop (base=0x13772280, flags=<value optimized out>) at event.c:1558
#3 0x0000000000414604 in worker_libevent (arg=0xef0d9f8) at daemon/thread.c:301
#4 0x000000301920673d in start_thread () from /lib64/libpthread.so.0
#5 0x00000030186d44bd in clone () from /lib64/libc.so.6

Thread 13 (Thread 14591):
#0 0x00000030186d48a8 in epoll_wait () from /lib64/libc.so.6
#1 0x00002b69448ef576 in epoll_dispatch (base=0x13772c80, tv=<value optimized out>) at epoll.c:404
#2 0x00002b69448dae44 in event_base_loop (base=0x13772c80, flags=<value optimized out>) at event.c:1558
#3 0x0000000000414604 in worker_libevent (arg=0xef0daf0) at daemon/thread.c:301
#4 0x000000301920673d in start_thread () from /lib64/libpthread.so.0
#5 0x00000030186d44bd in clone () from /lib64/libc.so.6

Thread 12 (Thread 14592):
#0 0x00000030186d48a8 in epoll_wait () from /lib64/libc.so.6
#1 0x00002b69448ef576 in epoll_dispatch (base=0x13772a00, tv=<value optimized out>) at epoll.c:404
#2 0x00002b69448dae44 in event_base_loop (base=0x13772a00, flags=<value optimized out>) at event.c:1558
#3 0x0000000000414604 in worker_libevent (arg=0xef0dbe8) at daemon/thread.c:301
#4 0x000000301920673d in start_thread () from /lib64/libpthread.so.0
#5 0x00000030186d44bd in clone () from /lib64/libc.so.6

---Type <return> to continue, or q <return> to quit---
Thread 11 (Thread 14593):
#0 0x00000030186d48a8 in epoll_wait () from /lib64/libc.so.6
#1 0x00002b69448ef576 in epoll_dispatch (base=0x13772780, tv=<value optimized out>) at epoll.c:404
#2 0x00002b69448dae44 in event_base_loop (base=0x13772780, flags=<value optimized out>) at event.c:1558
#3 0x0000000000414604 in worker_libevent (arg=0xef0dce0) at daemon/thread.c:301
#4 0x000000301920673d in start_thread () from /lib64/libpthread.so.0
#5 0x00000030186d44bd in clone () from /lib64/libc.so.6

Thread 10 (Thread 15230):
#0 0x000000301869a541 in nanosleep () from /lib64/libc.so.6
#1 0x00000030186cded4 in usleep () from /lib64/libc.so.6
#2 0x00002aaaaaf32805 in updateStatsThread (arg=0xef0a4c0) at src/memory_tracker.cc:31
#3 0x000000301920673d in start_thread () from /lib64/libpthread.so.0
#4 0x00000030186d44bd in clone () from /lib64/libc.so.6

Thread 9 (Thread 15232):

#0 0x000000301920d524 in __lll_lock_wait () from /lib64/libpthread.so.0
#1 0x0000003019208e1a in _L_lock_1034 () from /lib64/libpthread.so.0
#2 0x0000003019208cdc in pthread_mutex_lock () from /lib64/libpthread.so.0
#3 0x00002aaaaaf336fa in Mutex::acquire (this=0x137ed110) at src/mutex.cc:79
#4 0x00002aaaaaf79dc3 in lock (this=0x137ed000, vbs=..., file_version=1, header_offset=4096, cb=...) at ./src/locks.hh:48
#5 LockHolder (this=0x137ed000, vbs=..., file_version=1, header_offset=4096, cb=...) at ./src/locks.hh:26
#6 CouchNotifier::notify_update (this=0x137ed000, vbs=..., file_version=1, header_offset=4096, cb=...) at src/couch-kvstore/couch-notifier.cc:753
#7 0x00002aaaaaf70163 in CouchKVStore::setVBucketState (this=0x195f6300, vbucketId=1, vbstate=..., vb_change_type=1, newfile=96, notify=true) at src/couch-kvstore/couch-kvstore.cc:745
#8 0x00002aaaaaf71069 in CouchKVStore::snapshotVBuckets (this=0x195f6300, vbstates=Traceback (most recent call last):
  File "/usr/share/gdb/python/libstdcxx/v6/printers.py", line 288, in children
    nodetype = gdb.lookup_type('std::_Rb_tree_node< std::pair< %s, %s > >' % (keytype, valuetype))
RuntimeError: No type named std::_Rb_tree_node< std::pair< const unsigned short, vbucket_state > >.
std::map with 1 elements) at src/couch-kvstore/couch-kvstore.cc:596
#9 0x00002aaaaaf021f3 in EventuallyPersistentStore::snapshotVBuckets (this=0x2ca5b800, priority=..., shardId=<value optimized out>) at src/ep.cc:760
#10 0x00002aaaaaf51cff in VBSnapshotTask::run (this=<value optimized out>) at src/tasks.cc:78
#11 0x00002aaaaaf371c1 in ExecutorThread::run (this=0x1381da00) at src/scheduler.cc:153
#12 0x00002aaaaaf378dd in launch_executor_thread (arg=<value optimized out>) at src/scheduler.cc:34
#13 0x000000301920673d in start_thread () from /lib64/libpthread.so.0
#14 0x00000030186d44bd in clone () from /lib64/libc.so.6

Thread 8 (Thread 15233):
#0 0x000000301920b150 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00002aaaaaf37051 in wait (this=0x1381d860) at src/syncobject.hh:57
#2 ExecutorThread::run (this=0x1381d860) at src/scheduler.cc:139
#3 0x00002aaaaaf378dd in launch_executor_thread (arg=<value optimized out>) at src/scheduler.cc:34
#4 0x000000301920673d in start_thread () from /lib64/libpthread.so.0
#5 0x00000030186d44bd in clone () from /lib64/libc.so.6

Thread 7 (Thread 15234):
#0 0x000000301920b150 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00002aaaaaf37051 in wait (this=0x13844ea0) at src/syncobject.hh:57
#2 ExecutorThread::run (this=0x13844ea0) at src/scheduler.cc:139
#3 0x00002aaaaaf378dd in launch_executor_thread (arg=<value optimized out>) at src/scheduler.cc:34
#4 0x000000301920673d in start_thread () from /lib64/libpthread.so.0
#5 0x00000030186d44bd in clone () from /lib64/libc.so.6

Thread 6 (Thread 15235):
#0 0x000000301920b150 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00002aaaaaf37051 in wait (this=0x13844d00) at src/syncobject.hh:57
---Type <return> to continue, or q <return> to quit---
#2 ExecutorThread::run (this=0x13844d00) at src/scheduler.cc:139
#3 0x00002aaaaaf378dd in launch_executor_thread (arg=<value optimized out>) at src/scheduler.cc:34
#4 0x000000301920673d in start_thread () from /lib64/libpthread.so.0
#5 0x00000030186d44bd in clone () from /lib64/libc.so.6

Thread 5 (Thread 15236):
#0 0x000000301920b150 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00002aaaaaf37051 in wait (this=0x13844b60) at src/syncobject.hh:57
#2 ExecutorThread::run (this=0x13844b60) at src/scheduler.cc:139
#3 0x00002aaaaaf378dd in launch_executor_thread (arg=<value optimized out>) at src/scheduler.cc:34
#4 0x000000301920673d in start_thread () from /lib64/libpthread.so.0
#5 0x00000030186d44bd in clone () from /lib64/libc.so.6

Thread 4 (Thread 20937):
#0 0x000000301920b150 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00002aaaaaf0ebdf in wait (this=0x13770400) at src/syncobject.hh:57
#2 wait (this=0x13770400) at src/syncobject.hh:73
#3 wait (this=0x13770400) at src/tapconnmap.hh:169
#4 EventuallyPersistentEngine::notifyPendingConnections (this=0x13770400) at src/ep_engine.cc:3377
#5 0x00002aaaaaf0ecc3 in EvpNotifyPendingConns (arg=0x13770400) at src/ep_engine.cc:1153
#6 0x000000301920673d in start_thread () from /lib64/libpthread.so.0
#7 0x00000030186d44bd in clone () from /lib64/libc.so.6

Thread 3 (Thread 20938):
#0 0x000000301920b150 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00002aaaaaef31c8 in wait (this=0x1428d440, d=...) at src/syncobject.hh:57
#2 IdleTask::run (this=0x1428d440, d=...) at src/dispatcher.cc:342
#3 0x00002aaaaaef5d2a in Dispatcher::run (this=0x137b2a80) at src/dispatcher.cc:184
#4 0x00002aaaaaef64ed in launch_dispatcher_thread (arg=<value optimized out>) at src/dispatcher.cc:28
#5 0x000000301920673d in start_thread () from /lib64/libpthread.so.0
#6 0x00000030186d44bd in clone () from /lib64/libc.so.6

Thread 2 (Thread 20939):
#0 0x000000301920b150 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00002aaaaaef31c8 in wait (this=0x1428ccf0, d=...) at src/syncobject.hh:57
#2 IdleTask::run (this=0x1428ccf0, d=...) at src/dispatcher.cc:342
#3 0x00002aaaaaef5d2a in Dispatcher::run (this=0x137b2fc0) at src/dispatcher.cc:184
#4 0x00002aaaaaef64ed in launch_dispatcher_thread (arg=<value optimized out>) at src/dispatcher.cc:28
#5 0x000000301920673d in start_thread () from /lib64/libpthread.so.0
#6 0x00000030186d44bd in clone () from /lib64/libc.so.6

Thread 1 (Thread 0x4651e940 (LWP 15231)):
#0 0x0000003018630265 in raise () from /lib64/libc.so.6
#1 0x0000003018631d10 in abort () from /lib64/libc.so.6
#2 0x00002aaaaaf7a779 in BinaryPacketHandler::implicitResponse (this=0x38fa) at src/couch-kvstore/couch-notifier.cc:41
#3 0x00002aaaaaf77009 in CouchNotifier::handleResponse (this=0x137ed000, res=0x137fc000) at src/couch-kvstore/couch-notifier.cc:216
#4 0x00002aaaaaf794eb in CouchNotifier::processInput (this=0x137ed000) at src/couch-kvstore/couch-notifier.cc:571
#5 0x00002aaaaaf79185 in waitOnce (this=0x137ed000) at src/couch-kvstore/couch-notifier.cc:677
#6 CouchNotifier::selectBucket (this=0x137ed000) at src/couch-kvstore/couch-notifier.cc:725
#7 0x00002aaaaaf7966f in CouchNotifier::processInput (this=0x137ed000) at src/couch-kvstore/couch-notifier.cc:608
#8 0x00002aaaaaf79f75 in waitOnce (this=0x137ed000, vbs=..., file_version=1, header_offset=4096, cb=...) at src/couch-kvstore/couch-notifier.cc:677
#9 CouchNotifier::notify_update (this=0x137ed000, vbs=..., file_version=1, header_offset=4096, cb=...) at src/couch-kvstore/couch-notifier.cc:755
#10 0x00002aaaaaf70163 in CouchKVStore::setVBucketState (this=0x195f6000, vbucketId=0, vbstate=..., vb_change_type=1, newfile=96, notify=true) at src/couch-kvstore/couch-kvstore.cc:745
#11 0x00002aaaaaf71069 in CouchKVStore::snapshotVBuckets (this=0x195f6000, vbstates=Traceback (most recent call last):
  File "/usr/share/gdb/python/libstdcxx/v6/printers.py", line 288, in children
---Type <return> to continue, or q <return> to quit---
    nodetype = gdb.lookup_type('std::_Rb_tree_node< std::pair< %s, %s > >' % (keytype, valuetype))
RuntimeError: No type named std::_Rb_tree_node< std::pair< const unsigned short, vbucket_state > >.
std::map with 1 elements) at src/couch-kvstore/couch-kvstore.cc:596
#12 0x00002aaaaaf021f3 in EventuallyPersistentStore::snapshotVBuckets (this=0x2ca5b800, priority=..., shardId=<value optimized out>) at src/ep.cc:760
#13 0x00002aaaaaf51cff in VBSnapshotTask::run (this=<value optimized out>) at src/tasks.cc:78
#14 0x00002aaaaaf371c1 in ExecutorThread::run (this=0x1381dba0) at src/scheduler.cc:153
#15 0x00002aaaaaf378dd in launch_executor_thread (arg=<value optimized out>) at src/scheduler.cc:34
#16 0x000000301920673d in start_thread () from /lib64/libpthread.so.0
#17 0x00000030186d44bd in clone () from /lib64/libc.so.6
(gdb) quit

[MB-8241] Refactor set_view code

Tue, 21 May 2013 09:02:04 -0500

Refactor the MapReduce specific code into its own module. The goal is to have major code sharing between the MapReduce and that Spatial Views.

[MB-8322] Use couch_set_view module for index deletion

Tue, 21 May 2013 09:02:03 -0500

At the moment ns_server implements it's own code to cleanup index files. The couch_set_view module implements a similar logic. ns_server should just call the logic from couch_set_view.