Couchbase Server

docloader messes up international characters in beers database

Details

  • Type: Bug Bug
  • Status: Resolved Resolved
  • Priority: Critical Critical
  • Resolution: Fixed
  • Affects Version/s: None
  • Fix Version/s: None
  • Component/s: None
  • Security Level: Public
  • Labels:
    None

Description

See http://i.imgur.com/bXbv3.png

NOTE: I couldn't find 'proper' component and project for this.

Activity

Ascending order - Click to sort in descending order
Hide
Permalink
Aleksey Kondratenko added a comment -
Hm. It's even worse. See this http://i.imgur.com/zUuwz.png

and this:http://i.imgur.com/VOz7y.png

Apparently brewerydb data is already quite massively broken. But, well, I don't think anybody cares why our data sucks. It sucks and IMHO that's all that matters
Show
Aleksey Kondratenko added a comment - Hm. It's even worse. See this http://i.imgur.com/zUuwz.png and this: http://i.imgur.com/VOz7y.png Apparently brewerydb data is already quite massively broken. But, well, I don't think anybody cares why our data sucks. It sucks and IMHO that's all that matters
Hide
Permalink
Aleksey Kondratenko added a comment -
Forget about my last comment. Somebody fixed umlauts in our data. But not in docloader.
Show
Aleksey Kondratenko added a comment - Forget about my last comment. Somebody fixed umlauts in our data. But not in docloader.
Hide
Permalink
Matt Ingenthron added a comment -
Benjamin did fix up some of the data at one point. I'm unclear on where the bug is now. From an email from Bin, he seemed to be saying it's the console.

If the data has some incorrect characters, we should fix that too, but that's different than handling valid, but perhaps undesirable characters.

So, is the bug here:
a) somewhere between the database and the web console or,
b) somewhere between the docloader and the database?
Show
Matt Ingenthron added a comment - Benjamin did fix up some of the data at one point. I'm unclear on where the bug is now. From an email from Bin, he seemed to be saying it's the console. If the data has some incorrect characters, we should fix that too, but that's different than handling valid, but perhaps undesirable characters. So, is the bug here: a) somewhere between the database and the web console or, b) somewhere between the docloader and the database?
Hide
Permalink
Aleksey Kondratenko added a comment -
Data seems valid.

I can double-check later if as-returned-by-memcached stuff is correct. It's not impossible that there's some issues in CAPI or UI, a bit unlikely.

Would be happy if somebody can validate that by using GET via moxi.
Show
Aleksey Kondratenko added a comment - Data seems valid. I can double-check later if as-returned-by-memcached stuff is correct. It's not impossible that there's some issues in CAPI or UI, a bit unlikely. Would be happy if somebody can validate that by using GET via moxi.
Hide
Permalink
Bin Cui added a comment -
The problem is caused by wrong encoding in beer database.

It is supposed to be \u00E4 instead of \u00c3\u00a4 for ä.

docloader, python sdk and couchbase server handle those international characters correctly.
Show
Bin Cui added a comment - The problem is caused by wrong encoding in beer database. It is supposed to be \u00E4 instead of \u00c3\u00a4 for ä. docloader, python sdk and couchbase server handle those international characters correctly.

People

  • Assignee:
    Bin Cui
    Reporter:
    Aleksey Kondratenko
Vote (0)
Watch (1)

Dates

  • Created:
    Updated:
    Resolved: