IBM watsonx.data uses a modern lakehouse architecture to separate computing and storage. Data is stored in object storage services, such as public cloud AWS S3, Azure ADLS, GCP and IBM COS, or private cloud IBM Fusion HCI, Redhat Ceph, etc. Enterprise-level object storage services have natural...
Join us for a dynamic in-person community meetup hosted in collaboration between IBM and Cloudera , focused on how organization's are accelerating real-time AI outcomes with modern data strategies. This in-person meetup brings together data and AI professionals, engineers, and tech...
Sat July 19, 2025 | 09:00 AM - 01:00 PM IST Bengaluru KA
What is Apache Spark? Apache Spark is a lightning-fast unified analytics engine designed for big data processing and machine learning applications. Originally developed at UC Berkeley in 2009, Spark has evolved into one of the largest open-source projects for data processing, offering...
Build RAG with Visual Grounding with IBM watsonx.ai, Docling and watsonx.data Milvus Introduction In the era of ever-expanding digital documents, extracting precise, context-rich answers from large PDF files is a growing challenge...
In this blog post we will look at the details of how Unity Catalog API and Iceberg REST Catalog API are supported in IBM watsonx.data. Unity Catalog API is Databrick’s data governance solution for access control, auditing, lineage tracking, and data discovery. Databricks’ move to open-source...
This month IBM is radically simplifying the enterprise data stack, introducing software that unifies, governs, and activates the unstructured enterprise data necessary to power AI agents and other advanced AI applications. The two new products include IBM watsonx.data integration and IBM...
Currently, an API gateway is required as a proxy to connect to the Iceberg REST Catalog in watsonx.data, as it is only accessible within the data plane. The Iceberg REST Catalog endpoint is exposed via a nodeport, running on port 32671 instead of the standard port 443. Since Snowflake restricts...
In this blog, we will see how to connect to Snowflake Open Catalog from watsonx.data using Spark. For detailed instructions on setting up Snowflake Open Catalog, see https://other-docs.snowflake.com/en/opencatalog/overview Snowflake Open Catalog offers an implementation of the Iceberg REST...
Scaling your Analytics with WatsonX.data and Netezza: A Hybrid Cloud Solution Modernising your data warehouse while preserving your investments Handling big data efficiently can be a tedious task and as someone who's worked with enterprise data systems for quite some time, I've...