Hazelcast Jet uses a combination of a directed acyclic graph (DAG) computation model, in-memory processing and storage, data locality, partition mapping affinity, single-producer/single-consumer queues, and green threads to achieve very high performance. These key design decisions are explained below.
Word Count is the classic Big Data application used to compare performance between systems. Jet 0.4 is faster than all other frameworks. See complete benchmark.
Streaming Word Count involves windowing and out-of-order data processing. The latency of Jet remains flat even under higher load. Flink and Spark were unable to keep up for the 10-second window sliding by 100 milliseconds. See complete benchmark.