To work around these problems, do the following in emergency mode of the VM:

This makes it possible for the cloned or restored VM to boot up correctly.

To work around these problems, do the following in emergency mode of the VM:

This makes it possible for the cloned or restored VM to boot up correctly.

I'm not sure if the commands would work for this.  The system crashes to emergency mode before cloud-init runs. 

Redhat is aware of the issue but I haven't seen anything on a fix for it yet, but I haven't looked recently either.   If I find out any more info on this I will update this discussion.

To work around these problems, do the following in emergency mode of the VM:

This makes it possible for the cloned or restored VM to boot up correctly.

Thanks Tom,

Yeps, I tested it some time back and it won't work, like U said..

Thanks for any info if U hear something regarding this.

Br,

tommi

I'm not sure if the commands would work for this.  The system crashes to emergency mode before cloud-init runs. 

Redhat is aware of the issue but I haven't seen anything on a fix for it yet, but I haven't looked recently either.   If I find out any more info on this I will update this discussion.

To work around these problems, do the following in emergency mode of the VM:

This makes it possible for the cloned or restored VM to boot up correctly.

It's a long shot, but can you try adding persistent_policy="by-uuid" to /etc/dracut.conf.d/policy.conf and regenerate the initramfs?

It helped with a similar problem on SLES in the past.

Regards,

Levente

Thanks Tom,

Yeps, I tested it some time back and it won't work, like U said..

Thanks for any info if U hear something regarding this.

Br,

tommi

I'm not sure if the commands would work for this.  The system crashes to emergency mode before cloud-init runs. 

Redhat is aware of the issue but I haven't seen anything on a fix for it yet, but I haven't looked recently either.   If I find out any more info on this I will update this discussion.

To work around these problems, do the following in emergency mode of the VM:

This makes it possible for the cloned or restored VM to boot up correctly.

Thanks Levente, I will give a try on this if no official fix comes from Redhat soon; 

Br,

tommi

It's a long shot, but can you try adding persistent_policy="by-uuid" to /etc/dracut.conf.d/policy.conf and regenerate the initramfs?

It helped with a similar problem on SLES in the past.

Regards,

Levente

Thanks Tom,

Yeps, I tested it some time back and it won't work, like U said..

Thanks for any info if U hear something regarding this.

Br,

tommi

I'm not sure if the commands would work for this.  The system crashes to emergency mode before cloud-init runs. 

Redhat is aware of the issue but I haven't seen anything on a fix for it yet, but I haven't looked recently either.   If I find out any more info on this I will update this discussion.

To work around these problems, do the following in emergency mode of the VM:

This makes it possible for the cloned or restored VM to boot up correctly.

Looks like Redhat has a workaround for this.   This is from the Redhat 9.1 release notes.

Alternatively, to prevent the issue from occurring, do the following before cloning a VM or creating a VM snapshot:

Thanks Levente, I will give a try on this if no official fix comes from Redhat soon; 

Br,

tommi

It's a long shot, but can you try adding persistent_policy="by-uuid" to /etc/dracut.conf.d/policy.conf and regenerate the initramfs?

It helped with a similar problem on SLES in the past.

Regards,

Levente

Thanks Tom,

Yeps, I tested it some time back and it won't work, like U said..

Thanks for any info if U hear something regarding this.

Br,

tommi

I'm not sure if the commands would work for this.  The system crashes to emergency mode before cloud-init runs. 

Redhat is aware of the issue but I haven't seen anything on a fix for it yet, but I haven't looked recently either.   If I find out any more info on this I will update this discussion.

To work around these problems, do the following in emergency mode of the VM:

This makes it possible for the cloned or restored VM to boot up correctly.

Hi,

I tested it now....and it works! :)

At least VM Clone worked OK on PowerVC 2.1 after this change, so I assume also normal Capture / Deploy image will work as well.

Many Thanks Tom for digging this info & helping in this ! 

Br,

tommi

------------------------------
Tommi Sihvo, Lead Service Architect
Tietoevry, Compute Services
email tommi.sihvo@tietoevry.com mobile +358 (0)40 5180 Finland
------------------------------


Original Message:
Sent: Tue February 28, 2023 10:17 AM
From: Tom Komadowski
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Looks like Redhat has a workaround for this.   This is from the Redhat 9.1 release notes.

Alternatively, to prevent the issue from occurring, do the following before cloning a VM or creating a VM snapshot:

------------------------------
Tom Komadowski
Principal DevOps Engineer
Fortra, LLC.
Eden Prairie MN


Original Message:
Sent: Tue February 28, 2023 03:22 AM
From: Tommi Sihvo
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Thanks Levente, I will give a try on this if no official fix comes from Redhat soon; 

Br,

tommi

------------------------------
Tommi Sihvo, Lead Service Architect
Tietoevry, Compute Services
email tommi.sihvo@tietoevry.com mobile +358 (0)40 5180 Finland


Original Message:
Sent: Tue February 28, 2023 03:07 AM
From: Levente Szente
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

It's a long shot, but can you try adding persistent_policy="by-uuid" to /etc/dracut.conf.d/policy.conf and regenerate the initramfs?

It helped with a similar problem on SLES in the past.

Regards,

Levente

------------------------------
Levente Szente


Original Message:
Sent: Mon February 27, 2023 01:17 AM
From: Tommi Sihvo
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Thanks Tom,

Yeps, I tested it some time back and it won't work, like U said..

Thanks for any info if U hear something regarding this.

Br,

tommi

------------------------------
Tommi Sihvo, Lead Service Architect
Tietoevry, Compute Services
email tommi.sihvo@tietoevry.com mobile +358 (0)40 5180 Finland


Original Message:
Sent: Fri February 24, 2023 09:58 AM
From: Tom Komadowski
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

I'm not sure if the commands would work for this.  The system crashes to emergency mode before cloud-init runs. 

Redhat is aware of the issue but I haven't seen anything on a fix for it yet, but I haven't looked recently either.   If I find out any more info on this I will update this discussion.

------------------------------
Tom Komadowski
Principal DevOps Engineer
Fortra, LLC.
Eden Prairie MN


Original Message:
Sent: Thu January 19, 2023 02:52 AM
From: Tommi Sihvo
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Hi Tom!

Many Thanks for the help on this! Can easily say that I would NEVER would have figured this out myself. :D 

But like you said it works! 

Have you tried to put those commands on cloud-init config or somewhere, to avoid the need manually push the guy up from the maintenance mode after deploy?  ...or maybe cloud-init is not run yet on that phase..so most probably it won't help..?  So should we wait for some fix from Redhat ..?  Any clue if there is any case open there already?

Br,
tommi

------------------------------
Tommi Sihvo, Lead Service Architect
Tietoevry, Compute Services
email tommi.sihvo@tietoevry.com mobile +358 (0)40 5180 Finland


Original Message:
Sent: Tue January 17, 2023 09:36 AM
From: Tom Komadowski
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

I was able to get it working.  You are correct there is a bug in the RHEL 9 install.  I found an obscure reference in the RedHat forums about it after much searching.

The reference page is here:  Chapter 8. Known issues Red Hat Enterprise Linux 9 | Red Hat Customer Portal

the section is about cloning with Nutanix but it applies for PowerVC as well.  This is the section.

To work around these problems, do the following in emergency mode of the VM:

This makes it possible for the cloned or restored VM to boot up correctly.

------------------------------
Tom Komadowski

Coming late to this discussion, but setting  use_devicesfile = 0 in  /etc/lvm/lvm.conf is what I'm using in our PowerVC landscape and it works just fine for capture and deploy.

Unfortunately, there is still this bug to deal with:

RHEL8/9: LPAR is not booting up after inactive LPM - Red Hat Customer Portal

That applies to PowerVC deploy operations too. A fix for this problem has already been build, but depending on which release you are using, it's not available the official repositories yet.

The described workaround to use a compute template with dedicated processors instead of shared processors works for PowerVC deploy operations too.

------------------------------
Walter Orb

IBM
------------------------------


Original Message:
Sent: Wed March 01, 2023 01:54 AM
From: Tommi Sihvo
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Hi,

I tested it now....and it works! :)

At least VM Clone worked OK on PowerVC 2.1 after this change, so I assume also normal Capture / Deploy image will work as well.

Many Thanks Tom for digging this info & helping in this ! 

Br,

tommi

------------------------------
Tommi Sihvo, Lead Service Architect
Tietoevry, Compute Services
email tommi.sihvo@tietoevry.com mobile +358 (0)40 5180 Finland


Original Message:
Sent: Tue February 28, 2023 10:17 AM
From: Tom Komadowski
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Looks like Redhat has a workaround for this.   This is from the Redhat 9.1 release notes.

Alternatively, to prevent the issue from occurring, do the following before cloning a VM or creating a VM snapshot:

------------------------------
Tom Komadowski
Principal DevOps Engineer
Fortra, LLC.
Eden Prairie MN


Original Message:
Sent: Tue February 28, 2023 03:22 AM
From: Tommi Sihvo
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Thanks Levente, I will give a try on this if no official fix comes from Redhat soon; 

Br,

tommi

------------------------------
Tommi Sihvo, Lead Service Architect
Tietoevry, Compute Services
email tommi.sihvo@tietoevry.com mobile +358 (0)40 5180 Finland


Original Message:
Sent: Tue February 28, 2023 03:07 AM
From: Levente Szente
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

It's a long shot, but can you try adding persistent_policy="by-uuid" to /etc/dracut.conf.d/policy.conf and regenerate the initramfs?

It helped with a similar problem on SLES in the past.

Regards,

Levente

------------------------------
Levente Szente


Original Message:
Sent: Mon February 27, 2023 01:17 AM
From: Tommi Sihvo
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Thanks Tom,

Yeps, I tested it some time back and it won't work, like U said..

Thanks for any info if U hear something regarding this.

Br,

tommi

------------------------------
Tommi Sihvo, Lead Service Architect
Tietoevry, Compute Services
email tommi.sihvo@tietoevry.com mobile +358 (0)40 5180 Finland


Original Message:
Sent: Fri February 24, 2023 09:58 AM
From: Tom Komadowski
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

I'm not sure if the commands would work for this.  The system crashes to emergency mode before cloud-init runs. 

Redhat is aware of the issue but I haven't seen anything on a fix for it yet, but I haven't looked recently either.   If I find out any more info on this I will update this discussion.

------------------------------
Tom Komadowski
Principal DevOps Engineer
Fortra, LLC.
Eden Prairie MN


Original Message:
Sent: Thu January 19, 2023 02:52 AM
From: Tommi Sihvo
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Hi Tom!

Many Thanks for the help on this! Can easily say that I would NEVER would have figured this out myself. :D 

But like you said it works! 

Have you tried to put those commands on cloud-init config or somewhere, to avoid the need manually push the guy up from the maintenance mode after deploy?  ...or maybe cloud-init is not run yet on that phase..so most probably it won't help..?  So should we wait for some fix from Redhat ..?  Any clue if there is any case open there already?

Br,
tommi

------------------------------
Tommi Sihvo, Lead Service Architect
Tietoevry, Compute Services
email tommi.sihvo@tietoevry.com mobile +358 (0)40 5180 Finland


Original Message:
Sent: Tue January 17, 2023 09:36 AM
From: Tom Komadowski
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

I was able to get it working.  You are correct there is a bug in the RHEL 9 install.  I found an obscure reference in the RedHat forums about it after much searching.

The reference page is here:  Chapter 8. Known issues Red Hat Enterprise Linux 9 | Red Hat Customer Portal

the section is about cloning with Nutanix but it applies for PowerVC as well.  This is the section.

To work around these problems, do the following in emergency mode of the VM:

This makes it possible for the cloned or restored VM to boot up correctly.

------------------------------
Tom Komadowski

Thanks Walter,

Yes. the use_devicesfile = 0 setting works, I tested it too yesterday.

And Thanks for the info regarding the LPM bug; that was news to me!

Any details which version (PowerVC / RHEL 8.x) are affected now? 

And where can we find info regarding the official fix availability?

Br,

tommi

Coming late to this discussion, but setting  use_devicesfile = 0 in  /etc/lvm/lvm.conf is what I'm using in our PowerVC landscape and it works just fine for capture and deploy.

Unfortunately, there is still this bug to deal with:

RHEL8/9: LPAR is not booting up after inactive LPM - Red Hat Customer Portal

That applies to PowerVC deploy operations too. A fix for this problem has already been build, but depending on which release you are using, it's not available the official repositories yet.

The described workaround to use a compute template with dedicated processors instead of shared processors works for PowerVC deploy operations too.

------------------------------
Walter Orb

IBM


Original Message:
Sent: Wed March 01, 2023 01:54 AM
From: Tommi Sihvo
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Hi,

I tested it now....and it works! :)

At least VM Clone worked OK on PowerVC 2.1 after this change, so I assume also normal Capture / Deploy image will work as well.

Many Thanks Tom for digging this info & helping in this ! 

Br,

tommi

------------------------------
Tommi Sihvo, Lead Service Architect
Tietoevry, Compute Services
email tommi.sihvo@tietoevry.com mobile +358 (0)40 5180 Finland


Original Message:
Sent: Tue February 28, 2023 10:17 AM
From: Tom Komadowski
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Looks like Redhat has a workaround for this.   This is from the Redhat 9.1 release notes.

Alternatively, to prevent the issue from occurring, do the following before cloning a VM or creating a VM snapshot:

------------------------------
Tom Komadowski
Principal DevOps Engineer
Fortra, LLC.
Eden Prairie MN


Original Message:
Sent: Tue February 28, 2023 03:22 AM
From: Tommi Sihvo
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Thanks Levente, I will give a try on this if no official fix comes from Redhat soon; 

Br,

tommi

------------------------------
Tommi Sihvo, Lead Service Architect
Tietoevry, Compute Services
email tommi.sihvo@tietoevry.com mobile +358 (0)40 5180 Finland


Original Message:
Sent: Tue February 28, 2023 03:07 AM
From: Levente Szente
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

It's a long shot, but can you try adding persistent_policy="by-uuid" to /etc/dracut.conf.d/policy.conf and regenerate the initramfs?

It helped with a similar problem on SLES in the past.

Regards,

Levente

------------------------------
Levente Szente


Original Message:
Sent: Mon February 27, 2023 01:17 AM
From: Tommi Sihvo
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Thanks Tom,

Yeps, I tested it some time back and it won't work, like U said..

Thanks for any info if U hear something regarding this.

Br,

tommi

------------------------------
Tommi Sihvo, Lead Service Architect
Tietoevry, Compute Services
email tommi.sihvo@tietoevry.com mobile +358 (0)40 5180 Finland


Original Message:
Sent: Fri February 24, 2023 09:58 AM
From: Tom Komadowski
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

I'm not sure if the commands would work for this.  The system crashes to emergency mode before cloud-init runs. 

Redhat is aware of the issue but I haven't seen anything on a fix for it yet, but I haven't looked recently either.   If I find out any more info on this I will update this discussion.

------------------------------
Tom Komadowski
Principal DevOps Engineer
Fortra, LLC.
Eden Prairie MN


Original Message:
Sent: Thu January 19, 2023 02:52 AM
From: Tommi Sihvo
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Hi Tom!

Many Thanks for the help on this! Can easily say that I would NEVER would have figured this out myself. :D 

But like you said it works! 

Have you tried to put those commands on cloud-init config or somewhere, to avoid the need manually push the guy up from the maintenance mode after deploy?  ...or maybe cloud-init is not run yet on that phase..so most probably it won't help..?  So should we wait for some fix from Redhat ..?  Any clue if there is any case open there already?

Br,
tommi

------------------------------
Tommi Sihvo, Lead Service Architect
Tietoevry, Compute Services
email tommi.sihvo@tietoevry.com mobile +358 (0)40 5180 Finland


Original Message:
Sent: Tue January 17, 2023 09:36 AM
From: Tom Komadowski
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

I was able to get it working.  You are correct there is a bug in the RHEL 9 install.  I found an obscure reference in the RedHat forums about it after much searching.

The reference page is here:  Chapter 8. Known issues Red Hat Enterprise Linux 9 | Red Hat Customer Portal

the section is about cloning with Nutanix but it applies for PowerVC as well.  This is the section.

To work around these problems, do the following in emergency mode of the VM:

This makes it possible for the cloned or restored VM to boot up correctly.

------------------------------
Tom Komadowski

Hi Tommi, 

I'm on PowerVC version 2.1 already, but the problem is an issue with grub and it shouldn't matter which PowerVC version you are using.

I think it affects RHEL 8.6 and higher and all RHEL 9 releases. The bugzilla items do not talk about planned release dates, I think you'd have to open a support case with Red Hat if you need this info. 

Thanks Walter,

Yes. the use_devicesfile = 0 setting works, I tested it too yesterday.

And Thanks for the info regarding the LPM bug; that was news to me!

Any details which version (PowerVC / RHEL 8.x) are affected now? 

And where can we find info regarding the official fix availability?

Br,

tommi

Coming late to this discussion, but setting  use_devicesfile = 0 in  /etc/lvm/lvm.conf is what I'm using in our PowerVC landscape and it works just fine for capture and deploy.

Unfortunately, there is still this bug to deal with:

RHEL8/9: LPAR is not booting up after inactive LPM - Red Hat Customer Portal

That applies to PowerVC deploy operations too. A fix for this problem has already been build, but depending on which release you are using, it's not available the official repositories yet.

The described workaround to use a compute template with dedicated processors instead of shared processors works for PowerVC deploy operations too.

------------------------------
Walter Orb

IBM


Original Message:
Sent: Wed March 01, 2023 01:54 AM
From: Tommi Sihvo
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Hi,

I tested it now....and it works! :)

At least VM Clone worked OK on PowerVC 2.1 after this change, so I assume also normal Capture / Deploy image will work as well.

Many Thanks Tom for digging this info & helping in this ! 

Br,

tommi

------------------------------
Tommi Sihvo, Lead Service Architect
Tietoevry, Compute Services
email tommi.sihvo@tietoevry.com mobile +358 (0)40 5180 Finland


Original Message:
Sent: Tue February 28, 2023 10:17 AM
From: Tom Komadowski
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Looks like Redhat has a workaround for this.   This is from the Redhat 9.1 release notes.

Alternatively, to prevent the issue from occurring, do the following before cloning a VM or creating a VM snapshot:

------------------------------
Tom Komadowski
Principal DevOps Engineer
Fortra, LLC.
Eden Prairie MN


Original Message:
Sent: Tue February 28, 2023 03:22 AM
From: Tommi Sihvo
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Thanks Levente, I will give a try on this if no official fix comes from Redhat soon; 

Br,

tommi

------------------------------
Tommi Sihvo, Lead Service Architect
Tietoevry, Compute Services
email tommi.sihvo@tietoevry.com mobile +358 (0)40 5180 Finland


Original Message:
Sent: Tue February 28, 2023 03:07 AM
From: Levente Szente
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

It's a long shot, but can you try adding persistent_policy="by-uuid" to /etc/dracut.conf.d/policy.conf and regenerate the initramfs?

It helped with a similar problem on SLES in the past.

Regards,

Levente

------------------------------
Levente Szente


Original Message:
Sent: Mon February 27, 2023 01:17 AM
From: Tommi Sihvo
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Thanks Tom,

Yeps, I tested it some time back and it won't work, like U said..

Thanks for any info if U hear something regarding this.

Br,

tommi

------------------------------
Tommi Sihvo, Lead Service Architect
Tietoevry, Compute Services
email tommi.sihvo@tietoevry.com mobile +358 (0)40 5180 Finland


Original Message:
Sent: Fri February 24, 2023 09:58 AM
From: Tom Komadowski
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

I'm not sure if the commands would work for this.  The system crashes to emergency mode before cloud-init runs. 

Redhat is aware of the issue but I haven't seen anything on a fix for it yet, but I haven't looked recently either.   If I find out any more info on this I will update this discussion.

------------------------------
Tom Komadowski
Principal DevOps Engineer
Fortra, LLC.
Eden Prairie MN


Original Message:
Sent: Thu January 19, 2023 02:52 AM
From: Tommi Sihvo
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Hi Tom!

Many Thanks for the help on this! Can easily say that I would NEVER would have figured this out myself. :D 

But like you said it works! 

Have you tried to put those commands on cloud-init config or somewhere, to avoid the need manually push the guy up from the maintenance mode after deploy?  ...or maybe cloud-init is not run yet on that phase..so most probably it won't help..?  So should we wait for some fix from Redhat ..?  Any clue if there is any case open there already?

Br,
tommi

------------------------------
Tommi Sihvo, Lead Service Architect
Tietoevry, Compute Services
email tommi.sihvo@tietoevry.com mobile +358 (0)40 5180 Finland


Original Message:
Sent: Tue January 17, 2023 09:36 AM
From: Tom Komadowski
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

I was able to get it working.  You are correct there is a bug in the RHEL 9 install.  I found an obscure reference in the RedHat forums about it after much searching.

The reference page is here:  Chapter 8. Known issues Red Hat Enterprise Linux 9 | Red Hat Customer Portal

the section is about cloning with Nutanix but it applies for PowerVC as well.  This is the section.

To work around these problems, do the following in emergency mode of the VM:

This makes it possible for the cloned or restored VM to boot up correctly.

------------------------------
Tom Komadowski

Hi Tommi, 

I'm on PowerVC version 2.1 already, but the problem is an issue with grub and it shouldn't matter which PowerVC version you are using.

I think it affects RHEL 8.6 and higher and all RHEL 9 releases. The bugzilla items do not talk about planned release dates, I think you'd have to open a support case with Red Hat if you need this info. 

Thanks Walter,

Yes. the use_devicesfile = 0 setting works, I tested it too yesterday.

And Thanks for the info regarding the LPM bug; that was news to me!

Any details which version (PowerVC / RHEL 8.x) are affected now? 

And where can we find info regarding the official fix availability?

Br,

tommi

Coming late to this discussion, but setting  use_devicesfile = 0 in  /etc/lvm/lvm.conf is what I'm using in our PowerVC landscape and it works just fine for capture and deploy.

Unfortunately, there is still this bug to deal with:

RHEL8/9: LPAR is not booting up after inactive LPM - Red Hat Customer Portal

That applies to PowerVC deploy operations too. A fix for this problem has already been build, but depending on which release you are using, it's not available the official repositories yet.

The described workaround to use a compute template with dedicated processors instead of shared processors works for PowerVC deploy operations too.

------------------------------
Walter Orb

IBM


Original Message:
Sent: Wed March 01, 2023 01:54 AM
From: Tommi Sihvo
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Hi,

I tested it now....and it works! :)

At least VM Clone worked OK on PowerVC 2.1 after this change, so I assume also normal Capture / Deploy image will work as well.

Many Thanks Tom for digging this info & helping in this ! 

Br,

tommi

------------------------------
Tommi Sihvo, Lead Service Architect
Tietoevry, Compute Services
email tommi.sihvo@tietoevry.com mobile +358 (0)40 5180 Finland


Original Message:
Sent: Tue February 28, 2023 10:17 AM
From: Tom Komadowski
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Looks like Redhat has a workaround for this.   This is from the Redhat 9.1 release notes.

Alternatively, to prevent the issue from occurring, do the following before cloning a VM or creating a VM snapshot:

------------------------------
Tom Komadowski
Principal DevOps Engineer
Fortra, LLC.
Eden Prairie MN


Original Message:
Sent: Tue February 28, 2023 03:22 AM
From: Tommi Sihvo
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Thanks Levente, I will give a try on this if no official fix comes from Redhat soon; 

Br,

tommi

------------------------------
Tommi Sihvo, Lead Service Architect
Tietoevry, Compute Services
email tommi.sihvo@tietoevry.com mobile +358 (0)40 5180 Finland


Original Message:
Sent: Tue February 28, 2023 03:07 AM
From: Levente Szente
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

It's a long shot, but can you try adding persistent_policy="by-uuid" to /etc/dracut.conf.d/policy.conf and regenerate the initramfs?

It helped with a similar problem on SLES in the past.

Regards,

Levente

------------------------------
Levente Szente


Original Message:
Sent: Mon February 27, 2023 01:17 AM
From: Tommi Sihvo
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Thanks Tom,

Yeps, I tested it some time back and it won't work, like U said..

Thanks for any info if U hear something regarding this.

Br,

tommi

------------------------------
Tommi Sihvo, Lead Service Architect
Tietoevry, Compute Services
email tommi.sihvo@tietoevry.com mobile +358 (0)40 5180 Finland


Original Message:
Sent: Fri February 24, 2023 09:58 AM
From: Tom Komadowski
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

I'm not sure if the commands would work for this.  The system crashes to emergency mode before cloud-init runs. 

Redhat is aware of the issue but I haven't seen anything on a fix for it yet, but I haven't looked recently either.   If I find out any more info on this I will update this discussion.

------------------------------
Tom Komadowski
Principal DevOps Engineer
Fortra, LLC.
Eden Prairie MN


Original Message:
Sent: Thu January 19, 2023 02:52 AM
From: Tommi Sihvo
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Hi Tom!

Many Thanks for the help on this! Can easily say that I would NEVER would have figured this out myself. :D 

But like you said it works! 

Have you tried to put those commands on cloud-init config or somewhere, to avoid the need manually push the guy up from the maintenance mode after deploy?  ...or maybe cloud-init is not run yet on that phase..so most probably it won't help..?  So should we wait for some fix from Redhat ..?  Any clue if there is any case open there already?

Br,
tommi

------------------------------
Tommi Sihvo, Lead Service Architect
Tietoevry, Compute Services
email tommi.sihvo@tietoevry.com mobile +358 (0)40 5180 Finland


Original Message:
Sent: Tue January 17, 2023 09:36 AM
From: Tom Komadowski
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

I was able to get it working.  You are correct there is a bug in the RHEL 9 install.  I found an obscure reference in the RedHat forums about it after much searching.

The reference page is here:  Chapter 8. Known issues Red Hat Enterprise Linux 9 | Red Hat Customer Portal

the section is about cloning with Nutanix but it applies for PowerVC as well.  This is the section.

To work around these problems, do the following in emergency mode of the VM:

This makes it possible for the cloned or restored VM to boot up correctly.

------------------------------
Tom Komadowski

Hi,

Case #03452076 opened.

Hi Tommi, 

I'm on PowerVC version 2.1 already, but the problem is an issue with grub and it shouldn't matter which PowerVC version you are using.

I think it affects RHEL 8.6 and higher and all RHEL 9 releases. The bugzilla items do not talk about planned release dates, I think you'd have to open a support case with Red Hat if you need this info. 

Thanks Walter,

Yes. the use_devicesfile = 0 setting works, I tested it too yesterday.

And Thanks for the info regarding the LPM bug; that was news to me!

Any details which version (PowerVC / RHEL 8.x) are affected now? 

And where can we find info regarding the official fix availability?

Br,

tommi

Coming late to this discussion, but setting  use_devicesfile = 0 in  /etc/lvm/lvm.conf is what I'm using in our PowerVC landscape and it works just fine for capture and deploy.

Unfortunately, there is still this bug to deal with:

RHEL8/9: LPAR is not booting up after inactive LPM - Red Hat Customer Portal

That applies to PowerVC deploy operations too. A fix for this problem has already been build, but depending on which release you are using, it's not available the official repositories yet.

The described workaround to use a compute template with dedicated processors instead of shared processors works for PowerVC deploy operations too.

------------------------------
Walter Orb

IBM


Original Message:
Sent: Wed March 01, 2023 01:54 AM
From: Tommi Sihvo
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Hi,

I tested it now....and it works! :)

At least VM Clone worked OK on PowerVC 2.1 after this change, so I assume also normal Capture / Deploy image will work as well.

Many Thanks Tom for digging this info & helping in this ! 

Br,

tommi

------------------------------
Tommi Sihvo, Lead Service Architect
Tietoevry, Compute Services
email tommi.sihvo@tietoevry.com mobile +358 (0)40 5180 Finland


Original Message:
Sent: Tue February 28, 2023 10:17 AM
From: Tom Komadowski
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Looks like Redhat has a workaround for this.   This is from the Redhat 9.1 release notes.

Alternatively, to prevent the issue from occurring, do the following before cloning a VM or creating a VM snapshot:

------------------------------
Tom Komadowski
Principal DevOps Engineer
Fortra, LLC.
Eden Prairie MN


Original Message:
Sent: Tue February 28, 2023 03:22 AM
From: Tommi Sihvo
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Thanks Levente, I will give a try on this if no official fix comes from Redhat soon; 

Br,

tommi

------------------------------
Tommi Sihvo, Lead Service Architect
Tietoevry, Compute Services
email tommi.sihvo@tietoevry.com mobile +358 (0)40 5180 Finland


Original Message:
Sent: Tue February 28, 2023 03:07 AM
From: Levente Szente
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

It's a long shot, but can you try adding persistent_policy="by-uuid" to /etc/dracut.conf.d/policy.conf and regenerate the initramfs?

It helped with a similar problem on SLES in the past.

Regards,

Levente

------------------------------
Levente Szente


Original Message:
Sent: Mon February 27, 2023 01:17 AM
From: Tommi Sihvo
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Thanks Tom,

Yeps, I tested it some time back and it won't work, like U said..

Thanks for any info if U hear something regarding this.

Br,

tommi

------------------------------
Tommi Sihvo, Lead Service Architect
Tietoevry, Compute Services
email tommi.sihvo@tietoevry.com mobile +358 (0)40 5180 Finland


Original Message:
Sent: Fri February 24, 2023 09:58 AM
From: Tom Komadowski
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

I'm not sure if the commands would work for this.  The system crashes to emergency mode before cloud-init runs. 

Redhat is aware of the issue but I haven't seen anything on a fix for it yet, but I haven't looked recently either.   If I find out any more info on this I will update this discussion.

------------------------------
Tom Komadowski
Principal DevOps Engineer
Fortra, LLC.
Eden Prairie MN


Original Message:
Sent: Thu January 19, 2023 02:52 AM
From: Tommi Sihvo
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

Hi Tom!

Many Thanks for the help on this! Can easily say that I would NEVER would have figured this out myself. :D 

But like you said it works! 

Have you tried to put those commands on cloud-init config or somewhere, to avoid the need manually push the guy up from the maintenance mode after deploy?  ...or maybe cloud-init is not run yet on that phase..so most probably it won't help..?  So should we wait for some fix from Redhat ..?  Any clue if there is any case open there already?

Br,
tommi

------------------------------
Tommi Sihvo, Lead Service Architect
Tietoevry, Compute Services
email tommi.sihvo@tietoevry.com mobile +358 (0)40 5180 Finland


Original Message:
Sent: Tue January 17, 2023 09:36 AM
From: Tom Komadowski
Subject: PowerVC 2.0.3 / RHEL9 Guest VM

I was able to get it working.  You are correct there is a bug in the RHEL 9 install.  I found an obscure reference in the RedHat forums about it after much searching.

The reference page is here:  Chapter 8. Known issues Red Hat Enterprise Linux 9 | Red Hat Customer Portal

the section is about cloning with Nutanix but it applies for PowerVC as well.  This is the section.

To work around these problems, do the following in emergency mode of the VM:

This makes it possible for the cloned or restored VM to boot up correctly.

------------------------------
Tom Komadowski