I need some guidance on the following problem.
I need to replicate a number of documents, 10 to 100 documents(depends), 500K each document. Sync gateway sits behind nginx acting as reverse proxy. The error I get from nginx is Entity too large when I try to bulk upload all document.
Now the obvious solution is to modify nginx configuration to allow for such request size. But I would like to avoid that seeing it as a potential vulnerability allowing someone to make such big requests.
Another solution could be to replicate the single document when it is created but in case the user is offline for sometime i am back to the original problem having to replicate multiple documents at once.
I though to find a way to force the replication not to use bulk post but instead replicate each document one by one.
Is this a good idea in general? How would it affect performance?
Is at all possible to force such behaviour on the replication? Prevent bulk post and replicate one by one? I haven’t found anything related to that. Should I avoid the sync gateway and go directly to couchbase and post my documents one by one? How would that work?
Thank you for your time