Hazelcast: Aggregations using SupplierConsumingMapper for the Mapper stage are inefficient

Created on 12 Aug 2016  路  4Comments  路  Source: hazelcast/hazelcast

Most helpful comment

@noctarius, glad to hear that, mapreduce in hazelcast seems a better solution but not popular as its cache use cases, hope it could be improved as expected. we're looking forward some simple solution replacement to hadoop mapreduce.

All 4 comments

@magiccrafter, so any update with such issue and how could you improve map-reduce in hazelcast for countaggregation ?

Engineering is working on a better solution. The utilized chunking approach in the mapreduce framework didn't perform to expectations (and yeah I wronte it but I admit it failed :-))

@noctarius, glad to hear that, mapreduce in hazelcast seems a better solution but not popular as its cache use cases, hope it could be improved as expected. we're looking forward some simple solution replacement to hadoop mapreduce.

we have changed design of aggregation in 3.8 for efficiency. please retry with 3.8 early access and reopen if needed.

Was this page helpful?
0 / 5 - 0 ratings