The truth is that the JDBC/ODBC Connector for MongoDB is VERY limited. Also you will require another process running on the DS Engine server to map your objects/arrays. Using the hierarchical stage to "unwind" your arrays into flat records is a nightmare (in my opinion the worst stage available)...
We ended up creating our own connector by using the Java Connector Stage with the MongoDB Java driver. We are streaming huge the JSON files with the Jackson API and loading them in bulk in MongoDB. Streaming huge files with the hierarchical stage is the last thing you want to do.
Don't get me wrong DS is a great ETL tool but when it comes to JSON and a Document store like MongoDB it is very painful and inefficient to use.
------------------------------
Emmanuel Côté
------------------------------
Original Message:
Sent: Thu May 20, 2021 08:26 PM
From: VICTOR JIMENEZ SANCHEZ
Subject: How to insert objects into MONGODB with DataStage
A customer wants to use the ODBC/JDBC connector to LOAD objects into MONGODB with DataStage 11.7, Does anyone has a guide of the capabilities inserting objects into MONGODB is it possible
Te image shows and ID inserted as a String (Second tree) with DataStage, but they need to insert an object like the first ID Tree inserted.
Any ideas??? any documentation or guide?
------------------------------
VICTOR JIMENEZ SANCHEZ
DataStage Consultant
IBM
------------------------------
#DataIntegration