watsonx.data

 View Only

  • 1.  How do you import dates or convert a text field to a date?

    Posted Thu September 14, 2023 04:00 PM
    Edited by NICK PLOWDEN Fri September 15, 2023 02:30 PM

    I am importing from a parquet file, and have not been able to change the text date into a date.
    Also, how does iceberg deal with nil dates?

    Watsonx.data dev edition


    #watsonx.data
    #PrestoEngine
    #HiveMetastore

    ------------------------------
    John Kevlin
    ------------------------------



  • 2.  RE: How do you import dates or convert a text field to a date?

    Posted Mon September 25, 2023 08:47 AM

    Hi John,

    My apologies for the long delay in responding, I missed your question. Were you able to get a response from one of your colleagues?

    Thanks,

    Nick



    ------------------------------
    NICKOLUS PLOWDEN
    ------------------------------

    Original Message


  • 3.  RE: How do you import dates or convert a text field to a date?

    Posted Tue September 26, 2023 06:00 AM

    Nickolus, I got a response, they said the parquet ingester needed some work. I does not handle dates correctly.



    ------------------------------
    John Kevlin
    ------------------------------

    Original Message


  • 4.  RE: How do you import dates or convert a text field to a date?

    Posted Tue September 26, 2023 09:07 AM

    Thanks for the update John, I appreciate it. The intention of this new community is for members to ask questions about using watsonx for their applications. 



    ------------------------------
    NICKOLUS PLOWDEN
    ------------------------------

    Original Message


  • 5.  RE: How do you import dates or convert a text field to a date?

    Posted Mon November 27, 2023 08:44 AM

    To import a date from a splice file and convert it to a date format, you need to first determine the location and format of the date in the splice file.
    If there is a zero date, you can handle it by adding a condition. For example, replace a zero date with a specific date



    ------------------------------
    jqx123 金桥鑫
    ------------------------------

    Original Message