App Connect

Using IBM App Connect to interact with Amazon DynamoDB

By Shahmini Arumugam posted Tue December 15, 2020 07:34 AM

  

Amazon DynamoDB is a fully managed key-value and document database. It is a NoSQL database that provides fast and predictable performance with seamless scalability. It is a multi-master, multi-region database that restores data and provides backup. It encrypts data by using your encryption keys. It enables you to run high-performance applications and can handle more than 10 trillion requests per day.

Using Amazon DynamoDB with IBM App Connect

You can use App Connect to perform actions on the following objects:

  • Tables
  • Items
  • Backups
  • Tags

To use App Connect to integrate Amazon DynamoDB with your other applications, you need to connect App Connect to your Amazon DynamoDB account by providing the following information:

  • Secret Access Key: The secret access key to access Amazon DynamoDB programmatically or through the AWS. The secret access key for your Amazon DynamoDB account is generated in the Security Credentials page in the AWS Management Console.
  • Access Key ID: The Access key ID to access Amazon DynamoDB programmatically or through the AWS. The access key ID for your Amazon DynamoDB account is generated in the Security Credentials page in the AWS Management Console.
  • Region: The region of your Amazon DynamoDB account.

 

Scenario: Synchronize data between Amazon DynamoDB and Google Big Query


As an example, consider this scenario where you use App Connect to create a flow for an API that, when called, retrieves employee records from Amazon DynamoDB and synchronizes that data with Google Cloud BigQuery.

In this scenario, the Request node retrieves items from Amazon DynamoDB through the Retrieve items action.

 

You can retrieve employee data based on the following parameters:

  • Employee ID
  • Company
  • City
  • Department
  • Designation
  • Employee status
  • First name
  • Last name
  • Mobile number

You need to use a For each node from the Toolbox to process each record so that you can configure the flow to retrieve items.

The retrieved items are validated with the records in Google Cloud BigQuery based on selected parameters. If the record does not match, it generates a 204 status code, and an employee record is inserted into Google Cloud BigQuery through the Insert records action with the following details:

  • Employee ID
  • Company
  • City
  • Department
  • Designation
  • Employee status
  • First name
  • Last name
  • Mobile number

If the item from the Amazon DynamoDB matches the record in Google Cloud BigQuery, then a message “record already exists” is displayed in Slack.

The Response node contains an example of the output mapping of the employee records.

Figure 1: Flow for an API to synchronize the data between Amazon DynamoDB and Google Big Query.
For more information about other supported connectors, see Connectors.





#AppConnect
#Amazon-DynamoDB
1 comment
17 views

Permalink

Comments

Wed March 03, 2021 02:45 PM

Very good article, It is possible to have a good idea of how to work with Amazon DynamoDB with Big Query

Empresa de TI - OneIT