Amazon has a new data streaming analytics platform, called Kinesis and it is now in public beta. The service allows developers to build real-time applications without managing the complexity of multiple clusters. But though it has been regarded as a new type of real-time app platform, it also has a few drawbacks that have emerged since its AWS Re:Invent launch.
AWS Kinesis is capable of streaming thousands of data streams on a per-second basis. It allows developers to yank any amount of data, from any number of sources, scaling up and down as needed.
Amazon CTO Werner Vogels at AWS Re:Invent said, “The power of the platform comes with its capability to process data in a world where sensors are transmitting information in any number of ways.” Vogels made the point that there will be an increasing use of sensors to record data. With Kinesis, builders could look at the data and determine the best time to pour the concrete in the foundation.
The Kinesis system works across multiple availability zones, which is also replicated for high availability. The service splits the data into streams, with each handling 1,000 write transactions and up to 20 read transactions.
AWS is positioning Kinesis as an alternative to Hadoop, which has traditionally used batch processing of data to complete analysis. Hadoop has a diverse network behind the scenes, with new pieces such as Yarn, which provides real-time processing capabilities and sets the stage for building real-time apps.
Kinesis marks a new era in the analytics world with its data streaming capability, though. But AWS is not the first in the picture and on no account is the market leader. There are a growing list of options from the open-source community that are viable alternatives to AWS and its exclusive infrastructure.
[Image via gigaom]