Data Integration

 View Only

IBM Data Replication and SingleStoreDB enabling near real-time applications

By Jonathan Rosen posted Wed August 02, 2023 03:51 PM

  

Imagine using a database focused on speed and scalability for maximum performance of OLTP and OLAP workloads; a database that’s fully-multi cloud to help you avoid vendor lock-in; a database that uses familiar SQL Tooling, is API Driven and supports multiple data types such as JSON, time-series and geospatial data.  What if this database was built with enterprise security protocols in mind, compliant, supportive of a data fabric architecture, and capable of staying in sync in real-time, eliminating latency issues.

SingleStoreDB and IBM are working together to deliver this vision.  SingleStoreDB is a distributed, relational database with optimized speed and scalability to support data-intensive and real-time applications.  Keep your SingleStoreDB in sync in near real time with IBM’s Data Replication technology.

What is SingleStore?

SingleStoreDB's distributed architecture and high-performance processing capabilities can ensure that data is replicated and processed quickly. This helps organization reason on the data that lands in SingleStore and take real time decisions on the most recent data. SingleStoreDB can also provide high availability and scalability for customer’s data, ensuring that the data is always accessible and can be used for analytics and reporting. Learn about setting up your SingleStore instance in cloud.

What is IBM Data Replication CDC?

IBM InfoSphere Data Replication is a replication solution that captures database changes as they happen and delivers them to the target databases, message queues or an ETL solution that is based on table mappings and configured within the IBM Data Replication Management Console GUI application.

Change Data Capture (CDC) provides low impact capture and fast delivery of data changes for key information management initiatives including dynamic data warehousing, master data management, application consolidations or migrations, operational BI, and enabling SOA projects. CDC also helps reduce processing overheads and network traffic by only sending the data that has changed. Replication can be carried out continuously or periodically. When data is transferred from a source server, it can be remapped or transformed in the target environment.

You can also learn more here.

How does the integration work?

Let us take an example of moving data from MySQL database (the most popular open-source database) into SingleStore using the IBM Data Replication CDC tool.

How to Replicate to SingleStore

Start with Single Store Database and table.

Step1 - Set up Subscription

Click the 'Configuration' tab in the Management Console.  Right click within the subscription box and a window will pop up.  Name your subscription.

Select your source datastore, which is connected to your source database.

Select your SingleStoreDB datastore as the target and press 'OK.'                      

 

Step 2 - Map a Table

You will receive a prompt to Map Tables once the subscription has been created successfully.  Click 'Yes.'

Choose a standard mapping.

Select your source table and check the box in the 'Replicate' column.

Select your target table.

Step 3- Replicate

Select the 'Mirror' option

Review the mapping and press 'finish.'

Completed View of Subscription

 

Step 4- Insert a Row

Using your favorite database client, insert a row into your source table and commit the transaction.

Right-click the subscription. Click 'Start Mirroring' at the bottom of the popup.

 

Go to the SingleStore Portal, click 'Run CTRL' and check to see if the replication has occurred.

Conclusion

IBM Data Replication CDC and SingleStore provide a powerful capability to support customer use cases of moving data from the supported sources directly into SingleStore for building real time analytical solutions. With a highly secure and real time data movement to SingleStore, organizations can build the next game changing real-time analytical application to help drive business growth.

Next Steps
You can learn more about IBM Data Replication CDC on singlestore.com
Learn more about IBM Data Replication products.
Book a meeting with us.

#DataIntegration #DataReplication #datafabric#Database #Real-time#singlestore

0 comments
21 views

Permalink