Fajri Abdillah
Solutions Architect, Serverless Indonesia, PT. Myedisi Interaktif Media
fajri@serverless.id
Pipe
A process that moves data from a source to a destination and has the possibilities to transform the data along the way.
A system that responsible to generate data and send it to pipeline
A system that responsible to retrieve data from pipeline and process it
Amazon Simple Queue Service (Amazon SQS) offers a secure, durable, and available hosted queue that lets you integrate and decouple distributed software systems and components.
Price per 1 Million Requests after Free Tier (Monthly) | |
---|---|
Standard Queue | $0.40 ($0.00000040 per request) |
FIFO Queue | $0.50 ($0.00000050 per request) |
Amazon Kinesis Data Streams enables you to build custom applications that process or analyze streaming data for specialized needs.
number_of_shards = max(incoming_write_bandwidth_in_KiB/1024, outgoing_read_bandwidth_in_KiB/2048)
Pricing (Singapore) | |
---|---|
Shard Hour (1MB/second ingress, 2MB/second egress) | $0.0184 / hour |
PUT Payload Units, per 1,000,000 units | $0.0195 |
Pricing (Singapore) | |
---|---|
Extended Data Retention (Up to 7 days), per Shard Hour | $0.025 |
Enhanced fan-out data retrievals, per GB | $0.0159 |
Enhanced fan-out, per consumer-shard hour | $0.0184 |
Do you need multiple consumer or just one?
Do you need ordered message with high throughput?
Do you need to replay your data in consumer?
Do you need to tracks the ack/fail for individual message?
Do you need to delay your message individually?
Do you need a dynamically increasing concurrency/throughput at read time?
Join our Facebook Group : Serverless Indonesia
Our Medium Publications : Serverless Indonesia
Our u(n)pdated Blog : blog.serverless.id