A workaround is to define a shared resource, then set limit for it on queue, specify rusage on job.
Original Message:
Sent: Thu December 17, 2020 04:32 PM
From: Stephane colas
Subject: CPU-cores max limit per queue
Hi Larry
not sure to understand
if you have a grid environment that host test and prod queues on few machines and people want to limit the test queue cpu usage to 10% of the environment how do you do that ?
------------------------------
Stephane colas
Original Message:
Sent: Thu December 17, 2020 04:17 PM
From: Larry Adams
Subject: CPU-cores max limit per queue
If you use the schedule by slot setting in lsb.params, you can set the per host scheduling slots as large as you want it. I have customers that set it to 1000, and the only thing that controls scheduling is memory reservations. It works perfectly. Now, if you use Affinity "bsub -R 'afinnity[code|thread|socket|numa]', well then there is no good way of oversubscribing the box.
Regards,
Larry Adams
Global Architect Spectrum Computing
Global Spectrum RTM Product Lead
IBM Spectrum Computing
|
Mobile: 586-899-1138
E-mail: adamsla@us.ibm.com
Chat:
Find me on: | 
4224 Bold Meadows
Oakland Township, MI 48306
United States |
Original Message:
Sent: 12/17/2020 3:44:00 PM
From: Stephane colas
Subject: RE: CPU-cores max limit per queue
Oh I see. you link the number of slots to the number of cores ok.
I'm sorry but I disagree because this assumption reduces the number of batch execution or interactive sessions. With a 10 cores machine you can run more than 10 interactive sessions for instance without pending sessions.
MJX is not ! but 150 for each machine. Do you see ?
Is there another proposition ?
------------------------------
Stephane colas
Original Message:
Sent: Thu December 17, 2020 10:11 AM
From: YI SUN
Subject: CPU-cores max limit per queue
Not cpu time limit, as Bernd said it should be SLOT. Here are examples of limits you can set.
Begin Limit
NAME=limit1
SLOTS=10
QUEUES=queue-A
End Limit
Begin Limit
NAME=limit2
SLOTS=22
QUEUES=queue-B
End Limit
To match SLOT exactly to CPU core, in lsb.hosts file set following in host section.
Begin HostHOST_NAME MXJ ... Default ! ...End Host
------------------------------
YI SUN
Original Message:
Sent: Thu December 17, 2020 02:47 AM
From: Stephane colas
Subject: CPU-cores max limit per queue
Yes I think so but cpulimit is a number of minutes.
so which limit recommend you ?
------------------------------
Stephane colas
Original Message:
Sent: Wed December 16, 2020 08:56 PM
From: YI SUN
Subject: CPU-cores max limit per queue
You may consider to use resource limit configuration in lsb.resources file.
https://www.ibm.com/support/knowledgecenter/SSWRJV_10.1.0/lsf_config_ref/lsb.resources.5.html
------------------------------
YI SUN
Original Message:
Sent: Wed December 16, 2020 11:15 AM
From: Stephane colas
Subject: CPU-cores max limit per queue
hi team :)
We're working with IBM Spectrum LSF Standard 10.1.0.6
I'm supposed to split the CPU-cores ressources between two queues.
for instance, my queues are hosted on 2 machines 16 CPU-cores and I would like to limit to 10 cores max on the QUEUE-A and 22 cores max for the QUEUE-B.
Is it possible and how ?
I found PROCLIMIT but this is deprecated in 10.1
https://www.bsc.es/support/LSF/9.1.2/lsf_admin/index.htm?processors_allocated_limiting.html~main
------------------------------
Stephane colas
------------------------------
#SpectrumComputingGroup