Ends in
00
days
00
hrs
00
mins
00
secs
SHOP NOW

$2 OFF ALL AWS, Azure, Google Cloud & Kubernetes Practice Exams!

Find answers, ask questions, and connect with our
community around the world.

Home Forums AWS AWS Certified Data Analytics – Specialty KDF + Opensearch + Kibana VS KDF + Redshift + Quicksight

  • KDF + Opensearch + Kibana VS KDF + Redshift + Quicksight

  • novicewhistler

    Member
    February 10, 2022 at 6:48 pm

    Hi!

    I had a question about the use of these technologies to create near-real-time visualisations. One of the questions asked in the visualisation review section asks for a solution that provides near-real-time and time-sensitive visualisations (Screenshot of the question attached). Having loaded the data from Kinesis Data Firehose, wouldn’t Redshift Spectrum + Quicksight be more performant (Faster) than Opensearch + Kibana?

    Also, in what situations would we prefer Kibana visualisations over Quicksight visualisations?

  • novicewhistler

    Member
    February 10, 2022 at 8:41 pm

    This has now been answered in the slack channel. In case anyone is still curious, here’s a copy-paste of the answer.

    While it’s true that ingestion of data from Firehose to Redshift is supported, it’s not actually going to be in near-real-time because of how Firehose shepherds data to Redshift. Under the hood, Firehose has to load streaming data to Amazon S3 first, then from there, it issues a COPY command to move the data to Redshift. This method introduces latencies in the order of minutes as mentioned in this blog
    https://aws.amazon.com/blogs/big-data/integrate-etleap-with-amazon-redshift-streaming-ingestion-preview-to-make-data-available-in-seconds/

    The new way of streaming data to Redshift appears to be to leverage its streaming ingestion feature in conjunction with Kinesis Data Stream, which substantially lowers latency.

Viewing 1 - 2 of 2 replies

The forum ‘AWS Certified Data Analytics – Specialty’ is closed to new discussions and replies.

Original Post
0 of 0 posts June 2018
Now