Kinesis & Streaming
| Owner | |
|---|---|
| Verification | |
| Tags | |
| Last edited time |
Managed data streaming service (Logs, IOT, clicks) in real time
data is replicated across 3 AZ’s
Kinesis Data Streams
Real time low latency streaming using a producer library agent , data is divided into Shards of 1-2mb to scale: add shards. data retention 1-365 days
Data can be reprocessed by multiple applications with real time processing
Data cannot be removed after loading
Capacity: On-demand (auto) / Provisioned ,(resize number or shards)
- Classic: 2mb per shard , 5 API call per sec per shard
- Enhanced Fan Out: 2mb at read per shard
Kinesis Data Analytics
real time analysis on streams using SQL reference table to output data to dashboards
Kinesis Firehose
fully managed auto scale , Near real time (60sec or 1mb - batch) load streams to DataDog, SPLUNK.
can set buffer size and time to control flush
Kinesis Video Streams
One video stream per device , data to S3
