Hacker News new | past | comments | ask | show | jobs | submit login
Announcing Hazelcast Jet 0.6 – The 3rd Generation Big Data Processing Engine (hazelcast.com)
23 points by Darren1968 on April 12, 2018 | hide | past | favorite | 2 comments



This is done using the Jet API programmatically from your Java application. Jet is meant to be used operationally with developed and deployed applications.

We can use HDFS as a source or a sink. See https://github.com/hazelcast/hazelcast-jet-code-samples/blob... for a HDFS Wordcount example.

Jet jobs run in an isolated class loader, which is distributed to the cluster when the Job is started. You do this by adding classes/jars to JobConfig. See http://docs.hazelcast.org/docs/jet/0.6/manual/#practical- considerations for details.


If I already have a Hadoop cluster, which can run a spark job in a jar file on HDFS with spark-submit, how can I install Hazelcast Jet so that I can do the same as with Spark?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: