Big Data for Small Dollars

The defining attribute of Big Data is size. It's big data, and that means it's going to cost money to store it for processing. Hardware isn't free.

So instead what we're going to look at here is running big data analytics in-memory prior to storage.

Using an in-memory streaming engine we can process the data as it comes in, derive the insights that help us, and only pay to store those insights. Effectively we store the output of the processing not the input. Naturally we'll store this in-memory too, in an in-memory data grid. And as a nice side benefit since we process the data as it arrives, the insights derived are available immediately, so we can act upon them real-time for competitive advantage.

The talk will be accompanied by a demo that you can download from Github after.