Data Integration

Data Integration

Connect with experts and peers to elevate technical expertise, solve problems and share insights.

 View Only

Now Generally Available: watsonx.data integration 0.0.1 (Beta) SDK for Python

By John Wen posted 5 hours ago

  

We’re excited to announce the general availability of the watsonx.data integration 0.0.1 (Beta) SDK for Python. This brand new Python SDK that gives developers streamlined access to key features for building and managing Streaming pipelines in watsonx.data integration.

What’s included in the 0.0.1 Beta release?

  • Projects - full CRUD support for managing projects, a collaborative workspace in watsonx.data integration where users can organize assets such as jobs, flows, environments and more.

  • Flows - Build and manage data pipelines made of connected stages. Create, update, duplicate, and delete flows are all available as a part of this release.

    • Stages - Define the logic of each pipeline step with individual processing stages that transform and route data.

  • Jobs - Create reusable jobs, launch job runs with custom parameters, cancel executions, and retrieve logs.

  • Environments - Configure runtime settings like engine version, libraries, CPU, and memory. Generate launch commands to start environments easily.

    • Engines - Run flows with customizable compute settings for performance and resource optimization.

  • Administration - Programmatically manage platform access and user roles with support for managing Accounts, Users, and Access Groups.

To get started with our SDK install the ibm-watsonx-data-integration via pip today

pip3 install ibm-watsonx-data-integration

To see more details and view code examples, visit our documentation here

Try out watsonx.data integration for free today!

0 comments
15 views

Permalink