Data Integration

View Only

This online community is intended for DataStage and Data Integration users (including Information Server, QualityStage, FastTrack, and Information Services Director) to get advice from their industry peers, communicate with IBM experts on best practices, and stay up to date with IBM regarding product enhancements, user group meetings, webinars, how-to blogs and new helpful materials. Join the conversation!

The first post of all new members requires admin approval - we check regularly, so if you don't see your comment or question at first, we'll get to it as soon as we can 🙂

New to IBM Communities? Set up or link your IBM ID by logging in, and joining the groups that spark your interest!

Interested specifically in Data Replication? Join the group here!

Additional resources:

If you have questions or need support on IBM Data Integration products, check out our Support page where you can Chat with Support, open a case, or search all technical documentation from one convenient location.
Developers can ask technical questions on https://stackoverflow.com using tag "ibm-datastage".
IBM Cloud Pak for Data badges help DataStage users validate their cloud and data transformation expertise on IBM's Data and AI platform that modernizes how businesses collect, organize and analyze data to infuse AI throughout their organizations. From data management, DataOps, governance, business analytics, and automated AI, IBM Cloud Pak for Data helps eliminate the need for costly, and often competing, point solutions while providing the information architecture you need to implement AI successfully. Check out IBM Cloud Pak for Data V3.0.x Essentials and IBM Cloud Pak for Data V3.0.x Data Access and Transformation.

Latest Discussions

RE: Output ASCII Complex Flat File Differing formats ...

By: Ralf Martin , 12 days ago

I have not spoted that Jackson used the stage to output data, I have always used the CFF stage to read (mostly EBCDIC) files. I agree with Jesse, that it is likely the best way to split the data, if needed use the Column Export stage (or do this in the ...
RE: Output ASCII Complex Flat File Differing formats ...

By: Jesse Hensarling , 13 days ago

It was my understanding that the complex flat file stage only handled input files. When we need to write a file with multiple record types, we use the column export stage to consolidate the fields of each record into a single "record" field. We have ...
RE: Output ASCII Complex Flat File Differing formats ...

By: Ralf Martin , 13 days ago

Hi Jackson, I have yet not used the CFF Stage for more than one Record, but if you go to the Stage/Records tab, then in the bottom left, there is a "Single record" checkbox, if you uncheck this, then you can add a an additional Record. I hope this helps. ...

Populate data lakehouses easier than ever with DataStage support for Iceberg and Delta Lake table formats

By: Caroline Garay 25 days ago

It should come as no surprise that business leaders will risk compromising their competitive edge if they do not proactively implement Generative AI (GenAI). The technology is predicted to significantly impact our economy , with Goldman Sachs ...

1 person likes this.
Real life data quality and observability experiences

By: Jonathan Rosen one month ago

Well… about that return flight - I didn’t get to change it. However, my experience on that trip provided my first real appreciation for data quality and data observability… or lack thereof. Data quality is kind of obvious: your data still accurate, ...

2 people like this.
Flexibility through Kafka and Data Replication

By: Jonathan Rosen one month ago

Traveling can be fun and exciting. Realizing that you booked the wrong return flight after you already left? Maybe not as much fun. If you are fortunate enough to have a flexible budget, then maybe it’s not as bad as a situation as it could have ...

2 people like this.
The Power of Data Replication

By: Jonathan Rosen one month ago

Getting sick is a fact of life. If you live in the United States, paying for your doctor’s bill is normally your responsibility. Unless you decide to send a check via snail mail, you are probably going to pay off your bill with an online transaction ...

1 person likes this.
IBM Address Verification Interface Enhances Data Quality Within a Data Fabric Architecture

By: KATIE LE one month ago

As organizations steer their business strategies to become wholly data-driven, data and analytics are more crucial than ever before. Insights from data improve business outcomes, but managing data quality amidst the explosion of data growth is a tremendous ...

3 people like this.