Cloud Pak for Data Group

 View Only

What's new in Streams application development with Microsoft Visual Studio Code

By NATASHA D'SILVA posted Thu February 18, 2021 06:44 PM


The Streams extension for Microsoft Visual Studio Code (VS Code) allows you to develop and build Streams applications that run on IBM Cloud Pak for Data. It contains features for developing Streams applications without having to install Streams.  
Features include editor support for Streams Processing Language (SPL), including syntax highlighting, code completion and code folding.  You can also use it to deploy and monitor Streams applications.

The two most recent releases add a variety of functions to make developing and managing Streams applications easier.

Summary of new features:

Application development:

  • Support for toolkit and primitive operator development: You can create toolkits and primitive operators in Java or C++.   These operators and toolkits can then be built for use in a Streams application.

Application monitoring:

  • A new Active Runs panel showing all active runs for jobs in an instance or Cloud Pak for Data project.
  • Support for Streams jobs with REST endpoints.  Streams in Cloud Pak for Data 3.5 allows you to send and receive streaming data via REST services. We've added tooling in the VS Code extension to make it easy to use this feature.   For example, you can:

    • Use the new  Application Services panel to list all running Streams jobs that have at least one REST endpoint

      The Application Services pane showing a job with REST endpoints. The list of endpoints is displayed under Data access endpoints, and you can click Receive data on a GET endpoint or Send data on a POST endpoint to retreive or send data.

      endpoint displayed in app services pane
    • Retreive and save data from a running application that uses the EndpointSink operator. In the screenshot below you can see a table that displays the data retreived from the application. This is different from a view because it provides access to all the tuples on the Stream, as opposed to a sample of the tuples. Similar function to send data to the EndpointSource operator has also been added.

      recevied data table
    • See REST source and sink operators are displayed in the Job Graph:


See a demo of the Streams job graph in this video.

Try it

Visit the extension's page to learn more of how to install it.

  •  If you are familiar with Streams but new to VS Code, you can learn how to develop SPL applications using the Streams extension for VS Code by following the Quick Start in the documentation.
  • If you are new to Streams and SPL you can follow the Streams Quick Start, which will cover the basics of Streams applications using VS Code.