Hi Anuj,
Have done this on Windows OS and would like to share that experience so as to give you a frame of reference.
For SSO (i.e.: IS = Mode 5) you will have to enable the SAML 2.0 protocol where Identity Provider will be Customer (i.e.: Your Org) and Service Provider will be IBM. This will involve some .xml exchange between IBM & Customer that needs to be added to respective IT libraries.
You may raise a ticket with IBM as their reps (Nigel in particular) are pretty helpful around this to delve into specifics.
Kind Regards,
- Roscoe
------------------------------
Roscoe Lobo
Leader - Data Science & AI
Veracitiz
India
------------------------------