Cloud Pak for Data

 View Only

Data Fabric Orchestrator and Data Location Rules Experimental Release

  • 1.  Data Fabric Orchestrator and Data Location Rules Experimental Release

    Posted Wed May 04, 2022 11:17 AM
    Edited by Alexander Jones Wed May 04, 2022 01:25 PM
    We are pleased to make available new, experimental functionality on cloud within Cloud Pak for Data as a Service which enables users to set the physical and sovereign location of data assets, define rules governing their access.  Once defined, these and other data protection policies can be enforced  within Watson Studio notebooks through the Data Fabric Orchestrator.

    Data location rules provide attributes-based access control of data assets based on their location. The rules ensure that data privacy and location-aware regulations are enforced when you move data from one physical or sovereign location to another, ensuring compliance with organizational  policies and various national regulations.

    The IBM Data Fabric Orchestrator (DFO) provides a front door for governed data access scenarios.  DFO brings together the components of the IBM Cloud platform required to enforce access policies on data assets that are cataloged in IBM Watson Knowledge Catalog, by applying the data protection rules and data location rules configured for user's account.  DFO uses Apache Arrow Flight connectors for fast data access to various data source types such as databases and cloud object stores, and supports file formats such as CSV, JSON, Avro, Parquet and database tables.  For this experimental release, Watson Studio Notebook clients can access the DFO APIs using the Data Fabric Orchestrator SDK.

    Please note, this release of Data Fabric Orchestrator is designated "experimental" which means it is being delivered by IBM for evaluation purposes. Do not use this code in production, or to process PII or other sensitive data. APIs may change without notice or backwards compatibility. 

    To learn more about this and try this out for yourself, please contact me by replying to this post, privately if you prefer, and we will provide a tutorial project demonstrating the functionality and details about the DFO API.

    ------------------------------
    Alexander Jones
    Senior Product Manager
    IBM Data Fabric
    ------------------------------