-
Notifications
You must be signed in to change notification settings - Fork 77
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Unable to do a full import from file (ES 1.3.4) #93
Comments
I forgot to upload 1.3.4.1 in October. Now it's there. Can you try 1.3.4.1 to check if the problems persist? Thanks. http://xbib.org/repository/org/xbib/elasticsearch/plugin/elasticsearch-knapsack/1.3.4.1/ |
Hi, So i've did a lot of testing, but found the solution. The mapping was not transfered (or not correctly transfered) to the new server if you move the data via a file. If i inject the mapping before the _import that it seems to work fine (the export is a bulk.gz of one index). |
Yes. The bulk archive is not able to transport mappings. The ES bulk format has no mechanism for creating mappings, only for document indexing. |
ok, than stil the issue of 'non' bulk exports only begin 2GB is still 2016-01-19 15:06 GMT+01:00 Jörg Prante [email protected]:
|
Yes, I checked. The fix was not backported. If you can build form source, here is a quick fix: Set to |
so it is only a problem with tar files? Then could just use .zip which is fine be me. (i can't test at the moment, since the testing server is runnig a different job)/. |
Yes, it's a tar format peculiarity, the original tar is limited to 2GB, while POSIX TAR or GNU TAR is not. |
Ok, then i'll try the zip method tomorrow. I'll report back on that 2016-01-19 15:50 GMT+01:00 Jörg Prante [email protected]:
|
Hi,
I'm trying to export the from my es server (about 22GB, 100K documents, 1 index) to a file. The following situations happen.
I would like to have all the data in a file, since it is portable.
Command to export:
curl -XPOST 'localhost:9200/_export?path=/data/elasticsearch_export/nda_export.bulk.gz'
The are two clusters. cluster A containg 1 node, and cluster B containing 3 nodes. I'm trying to move data from A to B.
download link of plugin is
http://xbib.org/repository/org/xbib/elasticsearch/plugin/elasticsearch-knapsack/${es_version}.0/elasticsearch-knapsack-${es_version}.0-plugin.zip
where $es_version is 1.3.4The text was updated successfully, but these errors were encountered: