Data Integration

Data Integration

Connect with experts and peers to elevate technical expertise, solve problems and share insights.

 View Only
  • 1.  DataStage 1.7.1.1.6 parquet file integration

    Posted Fri June 13, 2025 10:01 AM

    Hello,

    I'm trying to read a local Parquet file with File Connector. It works overall, but for some files, including a very important one, I get the error "IllegalArgumentException INT96 not implemented yet." Does anyone know if it's possible to read this format? The official documentation doesn't say much about it.

    Thank you in advance



    ------------------------------
    Jerzy Konarski
    ------------------------------


  • 2.  RE: DataStage 1.7.1.1.6 parquet file integration

    Posted 22 hours ago

    The choice of jar file versions is very important. You must replace org.mortbay.jetty.util.jar with jetty-util-6.1.26.jar. Remove unnecessary jars from CLASSPATH - especially parquetxxx.jar. The CLASSPATH and HADOOP_HOME environment variables must be specified in the job and not in the Windows environment variables - I didn't understand that.



    ------------------------------
    Jerzy Konarski
    ------------------------------