Saturday, July 20, 2024

Zero-ETL integration With Amazon Aurora MySQL and Amazon Redshift

Swami Sivasubramanian, Vice President of Database, Analytics, and Machine Learning at Amazon Web Services, has said that “data is at the center of every application, process, and business decision,” and I couldn’t agree with him more. Customers frequently follow a pattern that involves constructing data pipelines in order to migrate data from Amazon Aurora to Amazon Redshift in today’s world. They are able to increase their sales, lower their costs, and otherwise improve their enterprises with the assistance of these solutions.

At AWS re:Invent 2022, AWS made the Amazon Aurora zero-ETL connection with Amazon Redshift announcement. This integration will be available in public preview for the Amazon Aurora MySQL-Compatible Edition in June 2023. Its purpose is to assist you in concentrating more on extracting value from data as opposed to preparing data for analysis.

Now available to the wider public: Amazon Redshift interaction with the Amazon Aurora MySQL zero-ETL system

AWS are pleased to announce today that the general availability of the Amazon Aurora MySQL zero-ETL integration with Amazon Redshift is now available. Because this solution is fully managed, there is no need for you to construct and maintain complicated data pipelines in order to draw time-sensitive insights from your transactional data in order to make important business decisions.

This zero-ETL interface between Amazon Aurora and Amazon Redshift enables you to execute near real-time analytics and machine learning (ML) on petabytes of transactional data stored in Amazon Redshift, which opens up new potential for you. As soon as this information is written into Aurora, it will promptly become accessible through Amazon Redshift.

You may also execute consolidated analytics from numerous Aurora MySQL database clusters in Amazon Redshift, which will allow you to obtain holistic insights across a large number of apps or partitions. The Amazon Aurora MySQL zero-ETL integration with Amazon Redshift processes more than 1 million transactions per minute (which is equivalent to 17.5 million insert/update/delete row operations per minute) from multiple Aurora databases and then makes those transactions available in Amazon Redshift in less than 15 seconds (p50 latency lag).

In addition, you are able to make use of Amazon Redshift’s analytics and built-in machine learning capabilities, such as materialized views, cross-Region data sharing, and federated access to different data stores and data lakes.

Things to consider

Availability: US East (Ohio), US East (N. Virginia), US West (Oregon), Asia Pacific (Singapore), Asia Pacific (Sydney), Asia Pacific (Tokyo), Europe (Frankfurt), Europe (Ireland), and Europe (Stockholm) may all use Amazon Aurora zero-ETL integration with Amazon Redshift.

Supported Database Engines: MySQL-compatible versions of Amazon Aurora are presently supported by the Amazon Aurora zero-ETL Integration with Amazon Redshift. There is currently no support for Amazon Aurora PostgreSQL-Compatible Edition.

Pricing: There is no extra charge for the Amazon Aurora zero-ETL integration with Amazon Redshift. The change data generated as part of a zero-ETL integration is created and processed using current Amazon Redshift and Aurora resources, which you pay for.

They are getting closer to assisting you in concentrating more on generating value from data rather than getting it ready for analysis.

Agarapu Ramesh was founder of the Govindhtech and Computer Hardware enthusiast. He interested in writing Technews articles. Working as an Editor of Govindhtech for one Year and previously working as a Computer Assembling Technician in G Traders from 2018 in India. His Education Qualification MSc.


Recent Posts

Popular Post Would you like to receive notifications on latest updates? No Yes