Informix

Hello All,

Today i added couple of  chunks to informix instance using onspace command. But i failed to add them in first run as i am getting below error. I ran the same command again for 2-3 times and then successfully added to instance in the last run.
I could not get clear information on this error in message log file or in command prompt. So I want to understand what could be the possible reason for failure of this command on first run.

Please share your thoughts if you have any idea on this.

$onspaces -a data1bs -p /home4/DATA/sales12/data1dbs_4 -o 0 -s 10485760
Verifying physical disk space, please wait ...
DR: Couldn't send add dbspace/chunk request to RSS secondary (sales12r_rep)


------------------------------
Cherry
------------------------------

#Informix

Original Message------

Hello All,

Today i added couple of  chunks to informix instance using onspace command. But i failed to add them in first run as i am getting below error. I ran the same command again for 2-3 times and then successfully added to instance in the last run.
I could not get clear information on this error in message log file or in command prompt. So I want to understand what could be the possible reason for failure of this command on first run.

Please share your thoughts if you have any idea on this.

$onspaces -a data1bs -p /home4/DATA/sales12/data1dbs_4 -o 0 -s 10485760
Verifying physical disk space, please wait ...
DR: Couldn't send add dbspace/chunk request to RSS secondary (sales12r_rep)


------------------------------
Cherry
------------------------------

#Informix

Yes Art, Chunks are created with correct privileges on both primary and RSS server before I trigger the command. I did nothing in between onspace command runs...


------------------------------
Cherry
------------------------------

Original Message:
Sent: Mon April 27, 2020 02:29 PM
From: Art Kagel
Subject: failed to add chunks

Had the chunk file been created on the RSS secondary prior to running this onspaces? Were its permissions correct? Was the RSS online at the time? Try looking in the message log in the RSS server for around that time.

Art S. Kagel, President and Principal Consultant

ASK Database Management

www.askdbmgt.com

Blog: http://informix-myview.blogspot.com/

Disclaimer: Please keep in mind that my own opinions are my own opinions and do not reflect on the IIUG, nor any other organization with which I am associated either explicitly, implicitly, or by inference.  Neither do those opinions reflect those of other individuals affiliated with any entity with which I am affiliated nor those of the entities themselves.

Original Message------

Hello All,

Today i added couple of  chunks to informix instance using onspace command. But i failed to add them in first run as i am getting below error. I ran the same command again for 2-3 times and then successfully added to instance in the last run.
I could not get clear information on this error in message log file or in command prompt. So I want to understand what could be the possible reason for failure of this command on first run.

Please share your thoughts if you have any idea on this.

$onspaces -a data1bs -p /home4/DATA/sales12/data1dbs_4 -o 0 -s 10485760
Verifying physical disk space, please wait ...
DR: Couldn't send add dbspace/chunk request to RSS secondary (sales12r_rep)


------------------------------
Cherry
------------------------------

#Informix

Original Message------

Yes Art, Chunks are created with correct privileges on both primary and RSS server before I trigger the command. I did nothing in between onspace command runs...


------------------------------
Cherry
------------------------------

#Informix

Cherry:

I agree 100% with Art.  I have run into this issue from time to time.  Typically adding a chunk in the primary server directly will create the chunk on the secondary without issue but occasionally I will have to create the file for the chunk on the secondary server prior to running the ONSPACES command on the primary.  With the target file for the chunk on the secondary I have never seen the ONSPACES command fail.  

------------------------------
Best regards,
Martin Graney
Queues Enforth Development, Inc.
Stoneham, MA 02148
------------------------------

Original Message:
Sent: Mon April 27, 2020 02:24 PM
From: Cherry
Subject: failed to add chunks

Hello All,

Today i added couple of  chunks to informix instance using onspace command. But i failed to add them in first run as i am getting below error. I ran the same command again for 2-3 times and then successfully added to instance in the last run.
I could not get clear information on this error in message log file or in command prompt. So I want to understand what could be the possible reason for failure of this command on first run.

Please share your thoughts if you have any idea on this.

$onspaces -a data1bs -p /home4/DATA/sales12/data1dbs_4 -o 0 -s 10485760
Verifying physical disk space, please wait ...
DR: Couldn't send add dbspace/chunk request to RSS secondary (sales12r_rep)


------------------------------
Cherry
------------------------------

#Informix

Adding a chunk on an HDR/RSS replicated server requires the new device being present and meeting all size and permission requirements not only on primary, but on all secondaries too.  For every secondary currently connected, this requirement is being enforced by sending a verification request, via SMX, to each of them and checking its return value  (for secondaries not currently connected, you only can trust the circumstances will be right when it comes to replicating the chunk addition).

The error you're citing would indicate something went wrong with sending that verification request to or receiving back a reply from one of the connected secondaries.  So all might be good wrt. new chunk devices/files, but somehow that information couldn't be exchanged.

------------------------------
Andreas Legner
------------------------------

Original Message:
Sent: Mon April 27, 2020 02:24 PM
From: Cherry
Subject: failed to add chunks

Hello All,

Today i added couple of  chunks to informix instance using onspace command. But i failed to add them in first run as i am getting below error. I ran the same command again for 2-3 times and then successfully added to instance in the last run.
I could not get clear information on this error in message log file or in command prompt. So I want to understand what could be the possible reason for failure of this command on first run.

Please share your thoughts if you have any idea on this.

$onspaces -a data1bs -p /home4/DATA/sales12/data1dbs_4 -o 0 -s 10485760
Verifying physical disk space, please wait ...
DR: Couldn't send add dbspace/chunk request to RSS secondary (sales12r_rep)


------------------------------
Cherry
------------------------------

#Informix

Yeah.. I doubt any network issues like packet drop/communcation failure at the moment, may be reason for that error

------------------------------
Cherry
------------------------------

Original Message:
Sent: Tue April 28, 2020 06:53 AM
From: Andreas Legner
Subject: failed to add chunks

Adding a chunk on an HDR/RSS replicated server requires the new device being present and meeting all size and permission requirements not only on primary, but on all secondaries too.  For every secondary currently connected, this requirement is being enforced by sending a verification request, via SMX, to each of them and checking its return value  (for secondaries not currently connected, you only can trust the circumstances will be right when it comes to replicating the chunk addition).

The error you're citing would indicate something went wrong with sending that verification request to or receiving back a reply from one of the connected secondaries.  So all might be good wrt. new chunk devices/files, but somehow that information couldn't be exchanged.

------------------------------
Andreas Legner

Original Message:
Sent: Mon April 27, 2020 02:24 PM
From: Cherry
Subject: failed to add chunks

Hello All,

Today i added couple of  chunks to informix instance using onspace command. But i failed to add them in first run as i am getting below error. I ran the same command again for 2-3 times and then successfully added to instance in the last run.
I could not get clear information on this error in message log file or in command prompt. So I want to understand what could be the possible reason for failure of this command on first run.

Please share your thoughts if you have any idea on this.

$onspaces -a data1bs -p /home4/DATA/sales12/data1dbs_4 -o 0 -s 10485760
Verifying physical disk space, please wait ...
DR: Couldn't send add dbspace/chunk request to RSS secondary (sales12r_rep)


------------------------------
Cherry
------------------------------

#Informix

Check the online.log on the primary and on the RSS node.

Run onstat -g cluster on the primary to check the state of log transfer and apply.

Regards,

David.

------------------------------
David Williams
------------------------------

Original Message:
Sent: Tue April 28, 2020 02:34 PM
From: Cherry
Subject: failed to add chunks

Yeah.. I doubt any network issues like packet drop/communcation failure at the moment, may be reason for that error

------------------------------
Cherry

Original Message:
Sent: Tue April 28, 2020 06:53 AM
From: Andreas Legner
Subject: failed to add chunks

Adding a chunk on an HDR/RSS replicated server requires the new device being present and meeting all size and permission requirements not only on primary, but on all secondaries too.  For every secondary currently connected, this requirement is being enforced by sending a verification request, via SMX, to each of them and checking its return value  (for secondaries not currently connected, you only can trust the circumstances will be right when it comes to replicating the chunk addition).

The error you're citing would indicate something went wrong with sending that verification request to or receiving back a reply from one of the connected secondaries.  So all might be good wrt. new chunk devices/files, but somehow that information couldn't be exchanged.

------------------------------
Andreas Legner

Original Message:
Sent: Mon April 27, 2020 02:24 PM
From: Cherry
Subject: failed to add chunks

Hello All,

Today i added couple of  chunks to informix instance using onspace command. But i failed to add them in first run as i am getting below error. I ran the same command again for 2-3 times and then successfully added to instance in the last run.
I could not get clear information on this error in message log file or in command prompt. So I want to understand what could be the possible reason for failure of this command on first run.

Please share your thoughts if you have any idea on this.

$onspaces -a data1bs -p /home4/DATA/sales12/data1dbs_4 -o 0 -s 10485760
Verifying physical disk space, please wait ...
DR: Couldn't send add dbspace/chunk request to RSS secondary (sales12r_rep)


------------------------------
Cherry
------------------------------

#Informix

Hi Cherry

Do you have the RSS node defined in the SQLHOSTS file of your Primary node? Replication will appear to work seamlessly without the RSS node included in the SQLHOSTS file; but come the time to add a chunk the error message that you have encountered is indeed manifested.

Failing this, I can point you to the following APAR which was allegedly fixed in 12.10.xC5... 

IT05500: ONSPACES ADDING CHUNKS TO DBSPACES WHEN MACH RSS SECONDARY IS PRESENT SOMETIMES GETS DR: COULDN'T SEND ADD DBSPACE/CHUNK REQUEST


------------------------------
Kirit Rana
------------------------------

Original Message:
Sent: Mon April 27, 2020 02:24 PM
From: Cherry
Subject: failed to add chunks

Hello All,

Today i added couple of  chunks to informix instance using onspace command. But i failed to add them in first run as i am getting below error. I ran the same command again for 2-3 times and then successfully added to instance in the last run.
I could not get clear information on this error in message log file or in command prompt. So I want to understand what could be the possible reason for failure of this command on first run.

Please share your thoughts if you have any idea on this.

$onspaces -a data1bs -p /home4/DATA/sales12/data1dbs_4 -o 0 -s 10485760
Verifying physical disk space, please wait ...
DR: Couldn't send add dbspace/chunk request to RSS secondary (sales12r_rep)


------------------------------
Cherry
------------------------------

#Informix

Hello Rana,

Issue was intermittent. I was able to add chunk on later run. issue may be related to network drop or RSS acknowledgement failure.



------------------------------
Cherry
------------------------------

Original Message:
Sent: Mon June 22, 2020 09:19 AM
From: Kirit Rana
Subject: failed to add chunks

Hi Cherry

Do you have the RSS node defined in the SQLHOSTS file of your Primary node? Replication will appear to work seamlessly without the RSS node included in the SQLHOSTS file; but come the time to add a chunk the error message that you have encountered is indeed manifested.

Failing this, I can point you to the following APAR which was allegedly fixed in 12.10.xC5... 

IT05500: ONSPACES ADDING CHUNKS TO DBSPACES WHEN MACH RSS SECONDARY IS PRESENT SOMETIMES GETS DR: COULDN'T SEND ADD DBSPACE/CHUNK REQUEST


------------------------------
Kirit Rana

Original Message:
Sent: Mon April 27, 2020 02:24 PM
From: Cherry
Subject: failed to add chunks

Hello All,

Today i added couple of  chunks to informix instance using onspace command. But i failed to add them in first run as i am getting below error. I ran the same command again for 2-3 times and then successfully added to instance in the last run.
I could not get clear information on this error in message log file or in command prompt. So I want to understand what could be the possible reason for failure of this command on first run.

Please share your thoughts if you have any idea on this.

$onspaces -a data1bs -p /home4/DATA/sales12/data1dbs_4 -o 0 -s 10485760
Verifying physical disk space, please wait ...
DR: Couldn't send add dbspace/chunk request to RSS secondary (sales12r_rep)


------------------------------
Cherry
------------------------------

#Informix

Great !

------------------------------
Kirit Rana
------------------------------

Original Message:
Sent: Mon June 22, 2020 10:10 AM
From: Cherry
Subject: failed to add chunks

Hello Rana,

Issue was intermittent. I was able to add chunk on later run. issue may be related to network drop or RSS acknowledgement failure.



------------------------------
Cherry

Original Message:
Sent: Mon June 22, 2020 09:19 AM
From: Kirit Rana
Subject: failed to add chunks

Hi Cherry

Do you have the RSS node defined in the SQLHOSTS file of your Primary node? Replication will appear to work seamlessly without the RSS node included in the SQLHOSTS file; but come the time to add a chunk the error message that you have encountered is indeed manifested.

Failing this, I can point you to the following APAR which was allegedly fixed in 12.10.xC5... 

IT05500: ONSPACES ADDING CHUNKS TO DBSPACES WHEN MACH RSS SECONDARY IS PRESENT SOMETIMES GETS DR: COULDN'T SEND ADD DBSPACE/CHUNK REQUEST


------------------------------
Kirit Rana

Original Message:
Sent: Mon April 27, 2020 02:24 PM
From: Cherry
Subject: failed to add chunks

Hello All,

Today i added couple of  chunks to informix instance using onspace command. But i failed to add them in first run as i am getting below error. I ran the same command again for 2-3 times and then successfully added to instance in the last run.
I could not get clear information on this error in message log file or in command prompt. So I want to understand what could be the possible reason for failure of this command on first run.

Please share your thoughts if you have any idea on this.

$onspaces -a data1bs -p /home4/DATA/sales12/data1dbs_4 -o 0 -s 10485760
Verifying physical disk space, please wait ...
DR: Couldn't send add dbspace/chunk request to RSS secondary (sales12r_rep)


------------------------------
Cherry
------------------------------

#Informix