Skip to content

timeout during dumping keys in large bucket #12

@pallinger

Description

@pallinger

I'm trying to dump data from a bucket for migration:
java -jar riak-data-migrator-0.2.6.jar -d -r ./ -b BUCKET -h IP -p 8087 -H 8098

The above operation exits with an exception:

Dumping bucket BUCKET
Exception in thread "main" java.lang.RuntimeException: com.basho.riak.pbc.RiakError: timeout
    at com.basho.riak.pbc.RiakStreamClient$1.hasNext(RiakStreamClient.java:100)
    at com.basho.riak.client.raw.pbc.PBClientAdapter$1.hasNext(PBClientAdapter.java:284)
    at com.basho.proserv.datamigrator.io.AbstractKeyJournal.populate(AbstractKeyJournal.java:56)
    at com.basho.proserv.datamigrator.BucketDumper.dumpBucket(BucketDumper.java:157)
    at com.basho.proserv.datamigrator.BucketDumper.dumpBuckets(BucketDumper.java:99)
    at com.basho.proserv.datamigrator.Main.runDumper(Main.java:470)
    at com.basho.proserv.datamigrator.Main.main(Main.java:116)
Caused by: com.basho.riak.pbc.RiakError: timeout
    at com.basho.riak.pbc.RiakConnection.receive(RiakConnection.java:125)
    at com.basho.riak.pbc.KeySource.get_next_response(KeySource.java:80)
    at com.basho.riak.pbc.KeySource.hasNext(KeySource.java:46)
    at com.basho.riak.pbc.RiakStreamClient$1.hasNext(RiakStreamClient.java:98)
    ... 6 more

During the above operation, it dumps a significant amount of keys in BUCKET/bucketkeys.keys (about 1.3M of 2.2M keys).

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions