Introduction to Amazon Kinesis

 

Amazon Kinesis:

• Cloud service provided by Amazon Web Services (AWS) for real-time data processing and streaming
• Serverless Streaming Data Service
• Enables you to collect, process, and analyze large streams of data in real-time

Amazon Kinesis has 4 Service types:

• Amazon Kinesis Video Streams - to securely stream video from connected devices to AWS for analytics, machine learning (ML), playback, and other processing. Designed for processing video streams in real time, often used for IoT, security cameras, and machine learning applications related to video and audio data.
• Amazon Kinesis Data Streams - to easily stream data at any scale. Allows you to capture, process, and store data streams. This is useful for applications that require continuous, high-throughput data ingestion, such as real-time analytics, log and event data, or IoT device data. See Introduction to Amazon Kinesis Data Streams.
• Amazon Data Firehose - to reliably loads real-time streams into data lakes, warehouses, and analytics services. An easy way to load streaming data into AWS services like Amazon S3, Amazon Redshift, or Amazon Elasticsearch Service. It can also transform and process the data on the fly, before delivering it to the destination.
• Amazon Managed Service for Apache Flink - to transform and analyze streaming data in real time. Kinesis Data Analytics: Allows you to process and analyze streaming data using standard SQL queries. You can transform data in real-time, detect anomalies, and build sophisticated real-time applications without needing to write complex code.

Kinesis is highly scalable and can handle large volumes of streaming data in real time, making it popular for use cases like real-time monitoring, real-time analytics, log processing, or real-time machine learning model inference.