AIX

 View Only
Expand all | Collapse all

First boot issue with new 9009-41G AIX standalone w/out HMC. (SMS asking for admin password)

  • 1.  First boot issue with new 9009-41G AIX standalone w/out HMC. (SMS asking for admin password)

    Posted Wed March 16, 2022 05:03 PM
    This is our 2nd customer where new AIX server does not fully boot AIX and if you try to enter SMS there is a service processor admin password prompt.  Tryed "admin", "password", "abc123", blank, all fail.   With the other customer IBM resolved the issue and we were not informed what they did.

    During boot process the server displays IBM logo with Menu options like this; (Example Using SMS To Choose Boot Device) with "1. SMS", stored bootlist, etc.  System appears to boot AIX, allowed pressing "1" to use this display as the console then nothing happens.  No output to display.  Being we were able to define console means AIX was recognized on boot drive and should have been entering into Configuration Assistant but doesn't.

    When we select 1 for SMS menu it's prompting for POWERPC Firmware admin password.  This is new server, 1st boot so we never set the password and I'm the remote application vendor.  

    Does anyone know default admin password or suggestions on booting into AIX.  For years these servers were a bit fussy recognizing the console but once you have valid console with keyboard/mouse in blue USB ports these servers would boot into AIX configuration assistant fine.  Supposedly AIX was pre-installed.

    ------------------------------
    Ron Arms
    ------------------------------


  • 2.  RE: First boot issue with new 9009-41G AIX standalone w/out HMC. (SMS asking for admin password)

    Posted Wed March 16, 2022 05:10 PM
    Can you share details regarding the model, firmware, and server
    configuration (ie: local disk)? New or refurbished?

    Was this server previously connected to an HMC?

    Finally, "abc1234" and "abc12345"?

    On Wed, Mar 16, 2022 at 09:03:05PM +0000, Ron Arms via IBM Community wrote:
    > This is our 2nd customer where new AIX server does not fully boot
    > AIX and if you try to enter SMS there is a service processor admin
    > password prompt. Tryed "admin", "password", "abc123", blank, all
    > fail. With the other customer IBM resolved the issue and we were
    > not informed what they did.
    >
    > During boot process the server displays IBM logo with Menu options
    > like this; (Example Using SMS To Choose Boot Device
    > <https: www.ibm.com/support/pages/example-using-sms-choose-boot-device="">)
    > with "1. SMS", stored bootlist, etc. System appears to boot AIX,
    > allowed pressing "1" to use this display as the console then nothing
    > happens. No output to display. Being we were able to define
    > console means AIX was recognized on boot drive and should have been
    > entering into Configuration Assistant but doesn't.
    >
    > When we select 1 for SMS menu it's prompting for POWERPC Firmware
    > admin password. This is new server, 1st boot so we never set the
    > password and I'm the remote application vendor.
    >
    > Does anyone know default admin password or suggestions on booting
    > into AIX. For years these servers were a bit fussy recognizing the
    > console but once you have valid console with keyboard/mouse in blue
    > USB ports these servers would boot into AIX configuration assistant
    > fine. Supposedly AIX was pre-installed.

    ------------------------------------------------------------------
    Russell Adams Russell.Adams@AdamsSystems.nl
    Principal Consultant Adams Systems Consultancy
    http://adamssystems.nl/


    Original Message


  • 3.  RE: First boot issue with new 9009-41G AIX standalone w/out HMC. (SMS asking for admin password)

    Posted Wed March 16, 2022 05:41 PM
    Is the system micropartitioned or is there just a single partition?

    You could try resetting the BMC back to factory defaults through ASMI, but that will blow away whatever partitions you have set up on there. If there is only a single partition on the system that might not be so bad.

    ------------------------------
    Anthony Cascianelli
    ------------------------------

    Original Message


  • 4.  RE: First boot issue with new 9009-41G AIX standalone w/out HMC. (SMS asking for admin password)

    Posted Thu March 17, 2022 09:10 AM
    Thanks for the prompt responses;

    Server is brand new 9009-41G from IBM purchased through reseller, ordered mid Dec 2021, arrived Jan 2022
    Server is standalone, not partitioned never been used/booted and no HMC  
          Never connected to HMC and nothing has been connected to HMC ports.
    Console is 5748 graphics card with DVI monitor, USB keyboard and mouse connected to the "blue" USB 3.0 ports  (our standard for past decade)
    Firmware was definitely 9.50.xx, pretty sure latest 9.50.92, could be 1 level back VL9.50.87  (trying to verify with consultant)
         (note: I'm remote app software vendor working with out of state consultant installing for our customer so any onsite work has to be scheduled w/consultant.)


    Here are the feature codes of order, note it should have shipped with AIX 7.2 pre-installed:
    5313-HPO IBM Power Software HIPO 000000000 1 N/C
    0643 9009-41G Routing Code 1 N/C
    0967 Base OS 1 N/C
    1072 OS Specify code for AIX 7.2 1 N/C
    5000 Preload 1 N/C
    5924 English Preinstall PII Language 1 N/C

    Due to IBM parts constraint server was ordered with (3) 800GB SSD NVMe drives (4-bay backplane) where normally we'd use the 12 or 18 bay backplane with conventional 2.5" SSD or spinning drives.  Customer is non-technical, consultant not real familiar with IBM Power so laptop connected to HMC port for ASMI access will be challenging.  Done this stuff for 28 years, never recall seeing SMS password or booting issue like this, now 2 in a row so seems like something has changed with IBM pre-install setup...

    They are placing call to IBM this morning, will keep you posted.
    Thanks!



    ------------------------------
    Ron Arms
    ------------------------------

    Original Message


  • 5.  RE: First boot issue with new 9009-41G AIX standalone w/out HMC. (SMS asking for admin password)

    Posted Thu March 17, 2022 10:41 AM
    On Thu, Mar 17, 2022 at 01:09:52PM +0000, Ron Arms via IBM Community wrote:
    > Server is brand new 9009-41G from IBM purchased through reseller, ordered mid Dec 2021, arrived Jan 2022
    > Server is standalone, not partitioned never been used/booted and no HMC
    > Never connected to HMC and nothing has been connected to HMC ports.
    > Console is 5748 graphics card with DVI monitor, USB keyboard and mouse connected to the "blue" USB 3.0 ports (our standard for past decade)
    > Firmware was definitely 9.50.xx, pretty sure latest 9.50.92, could be 1 level back VL9.50.87 (trying to verify with consultant)
    > (note: I'm remote app software vendor working with out of state consultant installing for our customer so any onsite work has to be scheduled w/consultant.)

    Great info, but nothing unusual there.

    > Customer is non-technical, consultant not real familiar with IBM
    > Power so laptop connected to HMC port for ASMI access will be
    > challenging.

    Remote support is fun! ;]

    > Done this stuff for 28 years, never recall seeing SMS
    > password or booting issue like this, now 2 in a row so seems like
    > something has changed with IBM pre-install setup...

    There shouldn't be any "Default" password on SMS, which is why I was
    curious if it was refurbished and this was missed. If this is straight
    from the factory, I'm just as confused as you are.

    I'll be curious to know what your solution is.

    ------------------------------------------------------------------
    Russell Adams Russell.Adams@AdamsSystems.nl
    Principal Consultant Adams Systems Consultancy
    http://adamssystems.nl/


    Original Message


  • 6.  RE: First boot issue with new 9009-41G AIX standalone w/out HMC. (SMS asking for admin password)

    Posted Fri March 18, 2022 01:15 PM
    I would suggest to read documentation,  I have seen server at native console asking for ADMIN Access password security feature since several POWER generations:  You should plan for a remote IPMI terminal connection rather than local S1 RS232 distance limited access.
    Suggested starting point in planning and installing documentation:
    https://www.ibm.com/docs/en/power9/9009-42G?topic=configuration-selecting-console-type
    Here are other thoughts / recomendations from my recent experiences with 9009-22G  server types with no graphic pci card.
    You should connect an ASCII TERMINAL and boot AIX in Single user mode and setup  the attributes of TTY0  for login  and for runtime  adding  ",clocal" at the end. (I normally do this with smitty chtty ) this is a very old AIX flavour).
    in order to setup the admin ASMI password you should connect an ascii terminal to S1 port with a serial RS232 cable, or an ethernet cable to HMC1 or HMC2 port. and access via http WEB, (but don't do both at the same time).
    My experience with other 9009-22A or 22G servers and AIX preload is that IBM 1st level of support is not very agile, but second level will guide you exactly in that situation if you open a priority or severity 1 case. Be prepared to send pictures and setup a remote connection through an accesible  laptop connected to S1 port RS232-PUTTY or HMC1-2 port ethernet crossover cable and http or IPMI sol console.your laptop. I would suggest also - If recently they solved same situation with another server/customer-  try to gather and inform of the case number so it will go faster to the root cause and fastest solution. 
    To access and configure and operate server ASMI remotely you should use the following manuals: 
    Read the login restrictions (which are really frustrating if you keep trying passwords and the ASMI has not been setup the way it should.
    Also the problem you describe reminds me of the old  well known  AIX tty0 ascii line driver config feature that gets solved just append in smitty chtty
    the ",clocal" attribute to   STTY run time and login Attributes  .   (this was also typical problem symptom with IVM (VIOS installations on first boot on entry servers with no HMCs).
    Hope that helps.



    ------------------------------
    Ivan Montesino Martinez del Cerro
    ------------------------------

    Original Message


  • 7.  RE: First boot issue with new 9009-41G AIX standalone w/out HMC. (SMS asking for admin password)

    Posted Fri March 18, 2022 01:15 PM
    You should connect an ASCII TERMINAL and boot AIX in Single user mode and setup  the attributes of TTY0  for login  and for runtime  adding  ",clocal" at the end. (I normally do this with smitty chtty ) this is a very old AIX flavour).
    in order to setup the admin ASMI password you should connect an ascii terminal to S1 port with a serial RS232 cable, or an ethernet cable to HMC1 or HMC2 port. and access via http WEB, (but don't do both at the same time).
    My experience with other 9009-22A or 22G servers and AIX preload is that IBM 1st level of support is not very agile, but second level will guide you exactly in that situation if you open a priority or severity 1 case. Be prepared to send pictures and setup a remote connection through an accesible  laptop connected to S1 port RS232-PUTTY or HMC1-2 port ethernet crossover cable and http or IPMI sol console.your laptop. I would suggest also - If recently they solved same situation with another server/customer-  try to gather and inform of the case number so it will go faster to the root cause and fastest solution. 
    To access and configure and operate server ASMI remotely you should use the following manuals: 
    Read the login restrictions (which are really frustrating if you keep trying passwords and the ASMI has not been setup the way it should.
    Hope that helps.

    Iván Montesino Martinez del Cerro

    Tel: +34 91 398 54 00 
    Mobile: +34 609 013 469
    #CadaDIAMasCerca



    Este correo electrónico y todos los ficheros adjuntos son confidenciales y destinados exclusivamente al uso de la persona a la cual han sido remitidos. Si Usted no es el destinatario del mensaje, agradecemos advierta al remitente y elimine el mensaje y sus adjuntos de su sistema. La publicación, distribución, impresión o copia no autorizada de este mensaje y de sus adjuntos queda estrictamente prohibida.

    This e-mail and any attachment are confidential and intended solely for the use of the individual to whom it is addressed. If you are not the intended recipient, please telephone or email the sender and delete this message and any attachment from your system. Unauthorized publication, use, dissemination, forwarding, printing or copying of this e-mail and its associated attachments is strictly prohibited.



    Original Message


  • 8.  RE: First boot issue with new 9009-41G AIX standalone w/out HMC. (SMS asking for admin password)

    Posted Fri March 18, 2022 01:15 PM
    This is what I would or try  do if in your situation:
    read and follow official doc: 
    For example: https://www.ibm.com/docs/en/power9/9009-42G?topic=configuration-selecting-console-type

    You should connect an ASCII TERMINAL and boot AIX in Single user mode and setup  the attributes of TTY0  for login  and for runtime  adding  ",clocal" at the end. (I normally do this with smitty chtty ) this is a very old AIX flavour).
    in order to setup the admin ASMI password you should connect an ascii terminal to S1 port with a serial RS232 cable, or an ethernet cable to HMC1 or HMC2 port. and access via http WEB, (but don't do both at the same time).
    My experience with other 9009-22A or 22G servers and AIX preload is that IBM 1st level of support is not very agile, but second level will guide you exactly in that situation if you open a priority or severity 1 case. Be prepared to send pictures and setup a remote connection through an accesible  laptop connected to S1 port RS232-PUTTY or HMC1-2 port ethernet crossover cable and http or IPMI sol console.your laptop. I would suggest also - If recently they solved same situation with another server/customer-  try to gather and inform of the case number so it will go faster to the root cause and fastest solution. 
    To access and configure and operate server ASMI remotely you should use the following manuals: 
    Read the login restrictions (which are really frustrating if you keep trying passwords and the ASMI has not been setup the way it should.
    Hope that helps.


    ------------------------------
    Ivan Montesino
    ------------------------------

    Original Message


  • 9.  RE: First boot issue with new 9009-41G AIX standalone w/out HMC. (SMS asking for admin password)

    Posted Fri March 18, 2022 03:47 PM
    Issue resolved although not 100% sure of root cause other than server shipped with admin password in reset mode.

    Resolution: Reset admin password via ASMI w/laptop (https://www.ibm.com/docs/en/power9?topic=notebook-accessing-asmi-using-pc-web-browser)
    Remotely assisted local IT consultant connecting laptop to HMC1 port, using web browser to reset the the service process "admin" pasword which was in reset mode.  Once we did this we were able to enter into SMS, select normal boot and server came up fully to AIX configuration assistant (it's in inittab on new servers), 

    TTY access:
    Regarding tty serial access that ship sailed 10-20 years ago.  Expecting customer or trying to find rj45-db9 or various cables if not ordered with the server is next to impossible.  Also laptops do not ship with serial ports and it's hard to find 3151's or vt420's kicking around anymore so this just isn't a viable option in the field.

    I've probably remotely installed over 500-1000 standalone POWER servers since the early 90's starting with RT's  before the RS6000 was out, somewhere around the P5 era is when the native serial ports did not support a console for period of time so we transitioned to graphics card for console display.  Keep in mind these are standalone  low-end standalone servers at client offices, not enterprise datacenters, no HMC, no SAN, not micro-partitioned and we try to keep it simple.  HMC or vHMC add's significant cost and complexities.

    So it seems these last 2 new servers shipped with admin password in "reset" mode or perhaps it's due to adding graphics card after the build since they are no longer marketed as of Dec 14th 2021.  Slight chance it's the NVMe drives being used as boot drives but doubt that.  As mentioned being remote and not seeing the screens in person it seemed odd seeing service processor password requirement on 1st boot and the system doesn't tell you it's in reset mode, just invalide password when you type the default admin password and 3 strikes you're out and have to reboot again.

    Thanks for all the input!

    ------------------------------
    Ron Arms
    ------------------------------

    Original Message