Why is my task queue filling up with another project's tasks?

Message boards : Number crunching : Why is my task queue filling up with another project's tasks?

To post messages, you must log in.

AuthorMessage
googloo
Avatar

Send message
Joined: 15 Sep 06
Posts: 133
Credit: 22,715,646
RAC: 3,712
Message 100500 - Posted: 27 Jan 2021, 18:34:08 UTC

I have Rosetta at 90%, World Community Grid at 6%, and Einstein@home at 4%. Yet there are 15 World Community Grid tasks, one Einstein@home task, and *only* one Rosetta@home task "Ready to start." I don't get it. Can anyone explain, please?

Additional information: I have 8 threads, all currently running Rosetta@home tasks, with one Einstein@home task in its middle, "Waiting to run."
ID: 100500 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Bryn Mawr

Send message
Joined: 26 Dec 18
Posts: 393
Credit: 12,110,248
RAC: 4,952
Message 100501 - Posted: 27 Jan 2021, 19:38:47 UTC - in response to Message 100500.  

I have Rosetta at 90%, World Community Grid at 6%, and Einstein@home at 4%. Yet there are 15 World Community Grid tasks, one Einstein@home task, and *only* one Rosetta@home task "Ready to start." I don't get it. Can anyone explain, please?

Additional information: I have 8 threads, all currently running Rosetta@home tasks, with one Einstein@home task in its middle, "Waiting to run."


The weightings are not percentages but that’s as may be, as you have them adding up to 100 you can treat them as such.

But they weightings relate to jobs that are running rather than the cache of jobs ready to start. WCG does tend to download more than other projects but as they’ll be refreshed at the rate they’re used it makes little difference.

Also, the weightings apply to the total throughput over a parametrised number of days rather than controlling what it happening at each instant in time so, if you have just added WCG and Einstein then they’ll be playing catch-up for several days.

Another point is that Rosetta jobs last a lot longer than the other two so you don’t need a large cache of them to ensure that it can carry on running, it’s quite happy running one out, one in.
ID: 100501 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Link
Avatar

Send message
Joined: 4 May 07
Posts: 356
Credit: 382,349
RAC: 0
Message 100503 - Posted: 29 Jan 2021, 10:02:51 UTC

What cache settings do you have?
.
ID: 100503 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
googloo
Avatar

Send message
Joined: 15 Sep 06
Posts: 133
Credit: 22,715,646
RAC: 3,712
Message 100507 - Posted: 30 Jan 2021, 5:12:18 UTC - in response to Message 100503.  

Is this what you mean?
Store at least 0.2 days of work
Store up to an additional 0.2 days of work
ID: 100507 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1681
Credit: 17,854,150
RAC: 20,118
Message 100508 - Posted: 30 Jan 2021, 6:25:25 UTC - in response to Message 100507.  

Is this what you mean?
Store at least 0.2 days of work
Store up to an additional 0.2 days of work
So that will give roughly half a day's work. As Brian posted, when you first join a project it takes a while for it to work out exactly how long it will take to process work. if the project has several different types, then it will take a while to determine how long it takes to process each type.

Having a small cache (eg 0.2 & 0.01, or even no cache) will mean less work will be downloaded initially while the new projects applications figure out how long things will take. Then the number of Tasks being processed at any given time between projects will (mostly) stabilise.
Grant
Darwin NT
ID: 100508 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Link
Avatar

Send message
Joined: 4 May 07
Posts: 356
Credit: 382,349
RAC: 0
Message 100509 - Posted: 30 Jan 2021, 9:45:03 UTC - in response to Message 100507.  

Is this what you mean?
Store at least 0.2 days of work
Store up to an additional 0.2 days of work

Yes, and there I see the issue. Your current setting tells your BOINC client not to ask for work unless you have less than 0.2 days in your cache, BUT to ask for additional up to 0.2 days if your cache is between 0.2 and 0.4 days and this will also happen if the client connects to just to report a task.

Long story short: set it to 0.39 (store at least) and 0.01 (additional).
.
ID: 100509 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
googloo
Avatar

Send message
Joined: 15 Sep 06
Posts: 133
Credit: 22,715,646
RAC: 3,712
Message 100512 - Posted: 30 Jan 2021, 16:36:29 UTC - in response to Message 100509.  
Last modified: 30 Jan 2021, 16:46:30 UTC

Thanks; I'll do that. To all of you who assumed that I have recently added projects, I have not. My signature image doesn't show World Community Grid, even though I have been contributing for months. BOINCstats doesn't include WCG.
ID: 100512 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Link
Avatar

Send message
Joined: 4 May 07
Posts: 356
Credit: 382,349
RAC: 0
Message 100513 - Posted: 30 Jan 2021, 17:29:04 UTC - in response to Message 100512.  

BOINCstats doesn't include WCG.

It does for others. IIRC it's one of the projects, on which you need to enable data export to stats sites in your WCG preferences.
.
ID: 100513 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
googloo
Avatar

Send message
Joined: 15 Sep 06
Posts: 133
Credit: 22,715,646
RAC: 3,712
Message 100514 - Posted: 30 Jan 2021, 17:58:50 UTC - in response to Message 100513.  

BOINCstats doesn't include WCG.

It does for others. IIRC it's one of the projects, on which you need to enable data export to stats sites in your WCG preferences.

Thanks. Updated my WCG preferences.
ID: 100514 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Kissagogo27

Send message
Joined: 31 Mar 20
Posts: 86
Credit: 2,919,932
RAC: 2,317
Message 100515 - Posted: 30 Jan 2021, 18:09:24 UTC

hi, you can also limit the cache size by project Calculation preferences setting

for Rosetta in my settings , i limit the disk size to 3.75GB to have 2 working WU and 2 Spare WU
ID: 100515 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote

Message boards : Number crunching : Why is my task queue filling up with another project's tasks?



©2024 University of Washington
https://www.bakerlab.org