Decision Optimization

Hello,

After updating to CPLEX 12.10, I keep getting out-of-memory error when trying to solve a problem. It's weird because sometimes it runs the MIP completely and others it gives out-of-memory error. With CPLEX 12.9 the sucess rate is better, but still get out-of-memory sometimes.

I'm running it in a Windows server 2012 OS with Intel Xeon E5-2670 @ 2.60 GHz and 48 GB RAM.

Tried turning memory emphasis on and using node files for storage, but without success.

Attached is a piscture from a log file before I tried memory emphasis and node file storage.

Any advices about what can I do?

------------------------------
Saulo Silva
------------------------------

#DecisionOptimization

Tried to change the following parameters, but still getting out-of-memory error. I'm running it through python.

optsolver.options['mip_strategy_file'] = 3;
optsolver.options['emphasis_memory'] = 'y';
optsolver.options['workmem'] = 12048;

------------------------------
Saulo Silva
------------------------------

Original Message:
Sent: Thu May 21, 2020 01:26 PM
From: Saulo Silva
Subject: CPLEX Out-of-memory status

Hello,

After updating to CPLEX 12.10, I keep getting out-of-memory error when trying to solve a problem. It's weird because sometimes it runs the MIP completely and others it gives out-of-memory error. With CPLEX 12.9 the sucess rate is better, but still get out-of-memory sometimes.

I'm running it in a Windows server 2012 OS with Intel Xeon E5-2670 @ 2.60 GHz and 48 GB RAM.

Tried turning memory emphasis on and using node files for storage, but without success.

Attached is a piscture from a log file before I tried memory emphasis and node file storage.

Any advices about what can I do?

------------------------------
Saulo Silva
------------------------------

#DecisionOptimization

Hi,

I recommend https://www.ibm.com/support/pages/diagnosing-cplex-error-1001-out-memory#item4


and in particular


If you are taking advantage of the parallel CPLEX optimizers, reducing the number of threads in use typically also reduces memory usage. However, this may adversely impact performance, in which case one should view this as a short term solution.


so you could try

opt.options['threads'] = 1

------------------------------
ALEX FLEISCHER
------------------------------

Original Message:
Sent: Thu May 21, 2020 07:58 PM
From: Saulo Silva
Subject: CPLEX Out-of-memory status

Tried to change the following parameters, but still getting out-of-memory error. I'm running it through python.

optsolver.options['mip_strategy_file'] = 3;
optsolver.options['emphasis_memory'] = 'y';
optsolver.options['workmem'] = 12048;

------------------------------
Saulo Silva

Original Message:
Sent: Thu May 21, 2020 01:26 PM
From: Saulo Silva
Subject: CPLEX Out-of-memory status

Hello,

After updating to CPLEX 12.10, I keep getting out-of-memory error when trying to solve a problem. It's weird because sometimes it runs the MIP completely and others it gives out-of-memory error. With CPLEX 12.9 the sucess rate is better, but still get out-of-memory sometimes.

I'm running it in a Windows server 2012 OS with Intel Xeon E5-2670 @ 2.60 GHz and 48 GB RAM.

Tried turning memory emphasis on and using node files for storage, but without success.

Attached is a piscture from a log file before I tried memory emphasis and node file storage.

Any advices about what can I do?

------------------------------
Saulo Silva
------------------------------
#DecisionOptimization

It's possible to use an intermediate number of threads, so the performance is not very impacted? The log file shows that I have up to 8 threads.

Just tried with the three parameters above and CPLEX 12.9 and the problem was sovled, but with 12.10 I'm still getting the error.

------------------------------
Saulo Silva
------------------------------

Original Message:
Sent: Fri May 22, 2020 02:56 AM
From: ALEX FLEISCHER
Subject: CPLEX Out-of-memory status

Hi,

I recommend https://www.ibm.com/support/pages/diagnosing-cplex-error-1001-out-memory#item4


and in particular


If you are taking advantage of the parallel CPLEX optimizers, reducing the number of threads in use typically also reduces memory usage. However, this may adversely impact performance, in which case one should view this as a short term solution.


so you could try

opt.options['threads'] = 1

------------------------------
ALEX FLEISCHER

Original Message:
Sent: Thu May 21, 2020 07:58 PM
From: Saulo Silva
Subject: CPLEX Out-of-memory status

Tried to change the following parameters, but still getting out-of-memory error. I'm running it through python.

optsolver.options['mip_strategy_file'] = 3;
optsolver.options['emphasis_memory'] = 'y';
optsolver.options['workmem'] = 12048;

------------------------------
Saulo Silva

Original Message:
Sent: Thu May 21, 2020 01:26 PM
From: Saulo Silva
Subject: CPLEX Out-of-memory status

Hello,

After updating to CPLEX 12.10, I keep getting out-of-memory error when trying to solve a problem. It's weird because sometimes it runs the MIP completely and others it gives out-of-memory error. With CPLEX 12.9 the sucess rate is better, but still get out-of-memory sometimes.

I'm running it in a Windows server 2012 OS with Intel Xeon E5-2670 @ 2.60 GHz and 48 GB RAM.

Tried turning memory emphasis on and using node files for storage, but without success.

Attached is a piscture from a log file before I tried memory emphasis and node file storage.

Any advices about what can I do?

------------------------------
Saulo Silva
------------------------------
#DecisionOptimization

Could you share one of the offending problem instances? If you don't want to reduce the global thread count you could try to only reduce the auxiliary threads at the root node. To do this use auxrootthreads parameter.

------------------------------
Daniel Junglas
------------------------------

Original Message:
Sent: Fri May 22, 2020 07:21 AM
From: Saulo Silva
Subject: CPLEX Out-of-memory status

It's possible to use an intermediate number of threads, so the performance is not very impacted? The log file shows that I have up to 8 threads.

Just tried with the three parameters above and CPLEX 12.9 and the problem was sovled, but with 12.10 I'm still getting the error.

------------------------------
Saulo Silva

Original Message:
Sent: Fri May 22, 2020 02:56 AM
From: ALEX FLEISCHER
Subject: CPLEX Out-of-memory status

Hi,

I recommend https://www.ibm.com/support/pages/diagnosing-cplex-error-1001-out-memory#item4


and in particular


If you are taking advantage of the parallel CPLEX optimizers, reducing the number of threads in use typically also reduces memory usage. However, this may adversely impact performance, in which case one should view this as a short term solution.


so you could try

opt.options['threads'] = 1

------------------------------
ALEX FLEISCHER

Original Message:
Sent: Thu May 21, 2020 07:58 PM
From: Saulo Silva
Subject: CPLEX Out-of-memory status

Tried to change the following parameters, but still getting out-of-memory error. I'm running it through python.

optsolver.options['mip_strategy_file'] = 3;
optsolver.options['emphasis_memory'] = 'y';
optsolver.options['workmem'] = 12048;

------------------------------
Saulo Silva

Original Message:
Sent: Thu May 21, 2020 01:26 PM
From: Saulo Silva
Subject: CPLEX Out-of-memory status

Hello,

After updating to CPLEX 12.10, I keep getting out-of-memory error when trying to solve a problem. It's weird because sometimes it runs the MIP completely and others it gives out-of-memory error. With CPLEX 12.9 the sucess rate is better, but still get out-of-memory sometimes.

I'm running it in a Windows server 2012 OS with Intel Xeon E5-2670 @ 2.60 GHz and 48 GB RAM.

Tried turning memory emphasis on and using node files for storage, but without success.

Attached is a piscture from a log file before I tried memory emphasis and node file storage.

Any advices about what can I do?

------------------------------
Saulo Silva
------------------------------
#DecisionOptimization