Is the amount of credits I'm getting normal?

Message boards : Number crunching : Is the amount of credits I'm getting normal?

To post messages, you must log in.

1 · 2 · 3 · Next

AuthorMessage
Tomcat雄猫

Send message
Joined: 20 Dec 14
Posts: 180
Credit: 5,386,173
RAC: 0
Message 95031 - Posted: 21 Apr 2020, 6:32:49 UTC
Last modified: 21 Apr 2020, 6:44:22 UTC

I just noticed that my Ryzen 5 3600 seems to be netting quite a bit fewer credits per core per hour than comparable, or even much slower systems.

For example, for Rosetta 4.15/4.16 tasks, my 3600 is netting 200-300 credits per core per 36 hours, whilst my phone from 2016 is getting 200-500 credits per core per 36 hours, and my 2015 13 inch Macbook Pro is getting about 1000 credits per core per 36 hours. I don't get it, my Ryzen system seems to be consistently generating way more "Decoys" per WU than my Macbook Pro, so why are the credits way lower?

Is that just a fluke, since this issue does not seem to be reflected in my RAC for each computer. Or does that indicate a problem with my Ryzen system?

Rosetta mini tasks seem to behave normally, with my Ryzen system consistently netting 1700-2000 credits per core per 36 hours.

Thanks!
ID: 95031 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1679
Credit: 17,801,903
RAC: 22,703
Message 95032 - Posted: 21 Apr 2020, 6:55:20 UTC - in response to Message 95031.  

Is that just a fluke, since this issue does not seem to be reflected in my RAC for each computer. Or does that indicate a problem with my Ryzen system?
It's just the way the Credit mechanism is. Different work mixes on different systems will give a different amount of Credit. Overall, they should end up fairly (sort of, mostly) similar, but there are always ups & down with Credit granted even for WUs that have been around for a while, a mix of new & old WUs & different hardware then the ups & downs tend to be bigger than usual.
Grant
Darwin NT
ID: 95032 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Tomcat雄猫

Send message
Joined: 20 Dec 14
Posts: 180
Credit: 5,386,173
RAC: 0
Message 95033 - Posted: 21 Apr 2020, 7:39:52 UTC - in response to Message 95032.  
Last modified: 21 Apr 2020, 7:41:58 UTC

Is that just a fluke, since this issue does not seem to be reflected in my RAC for each computer. Or does that indicate a problem with my Ryzen system?
It's just the way the Credit mechanism is. Different work mixes on different systems will give a different amount of Credit. Overall, they should end up fairly (sort of, mostly) similar, but there are always ups & down with Credit granted even for WUs that have been around for a while, a mix of new & old WUs & different hardware then the ups & downs tend to be bigger than usual.


Welp, it still feels weird to have your main rig rather consistently beaten by much older ARM an Bulldozer CPUs. I just do not understand how the credit system works.

An example is this:
My phone got 396.06 on this WU (r4k_10886_fold_SAVE_ALL_OUT_920986_87_0)
<core_client_version>7.4.39</core_client_version>
<![CDATA[
<stderr_txt>
command: ../../projects/boinc.bakerlab.org_rosetta/rosetta_4.15_arm-android-linux-gnu -abinitio::fastrelax 1 -ex2aro 1 -frag3 00001.200.3mers.index -in:file:native 00001.pdb -silent_gz 1 -frag9 00001.200.9mers.index -out:file:silent default.out -ex1 1 -abinitio::rsd_wt_loop 0.5 -relax::default_repeats 5 -abinitio::use_filters false -abinitio::increase_cycles 10 -abinitio::rsd_wt_helix 0.5 -beta 1 -abinitio::rg_reweight 0.5 -in:file:boinc_wu_zip r4k_10886_data.zip -out:file:silent default.out -silent_gz -mute all -nstruct 10000 -cpu_run_time 28800 -watchdog -boinc:max_nstruct 5000 -checkpoint_interval 120 -database minirosetta_database -in::file::zip minirosetta_database.zip -boinc::watchdog -run::rng mt19937 -constant_seed -jran 2942914
======================================================
DONE ::     1 starting structures   128071 cpu seconds
This process generated     54 decoys from      54 attempts
======================================================
BOINC :: WS_max 0
 called boinc_finish(0)

</stderr_txt>
]]>


While my main rig got only 271.31 credits on this WU (r4k_16816_fold_SAVE_ALL_OUT_921555_181_0) despite generating 6X the "Decoys"
<core_client_version>7.16.5</core_client_version>
<![CDATA[
<stderr_txt>
command: projects/boinc.bakerlab.org_rosetta/rosetta_4.15_windows_x86_64.exe -abinitio::fastrelax 1 -ex2aro 1 -frag3 00001.200.3mers.index -in:file:native 00001.pdb -silent_gz 1 -frag9 00001.200.9mers.index -out:file:silent default.out -ex1 1 -abinitio::rsd_wt_loop 0.5 -relax::default_repeats 5 -abinitio::use_filters false -abinitio::increase_cycles 10 -abinitio::rsd_wt_helix 0.5 -beta 1 -abinitio::rg_reweight 0.5 -in:file:boinc_wu_zip r4k_16816_data.zip -out:file:silent default.out -silent_gz -mute all -nstruct 10000 -cpu_run_time 28800 -watchdog -boinc:max_nstruct 5000 -checkpoint_interval 120 -database minirosetta_database -in::file::zip minirosetta_database.zip -boinc::watchdog -run::rng mt19937 -constant_seed -jran 2083630
Starting watchdog...
Watchdog active.
Starting watchdog...
Watchdog active.
Starting watchdog...
Watchdog active.
======================================================
DONE ::     1 starting structures   129490 cpu seconds
This process generated    331 decoys from     331 attempts
======================================================
BOINC :: WS_max 4.32751e+08

BOINC :: Watchdog shutting down...
02:36:22 (10952): called boinc_finish(0)

</stderr_txt>
]]>


Furthermore, it appears to me that every other rig I've had a look at seems to only get slightly lower (around 200) credits per task at the default run time of 8 hours than my main rig does per task at 36 hours.
I'm tempted to change my target run-time to the default of 8 hours and see how that affects my RAC.
ID: 95033 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1679
Credit: 17,801,903
RAC: 22,703
Message 95035 - Posted: 21 Apr 2020, 8:23:33 UTC - in response to Message 95033.  
Last modified: 21 Apr 2020, 8:25:10 UTC

Is that just a fluke, since this issue does not seem to be reflected in my RAC for each computer. Or does that indicate a problem with my Ryzen system?
It's just the way the Credit mechanism is. Different work mixes on different systems will give a different amount of Credit. Overall, they should end up fairly (sort of, mostly) similar, but there are always ups & down with Credit granted even for WUs that have been around for a while, a mix of new & old WUs & different hardware then the ups & downs tend to be bigger than usual.
I just do not understand how the credit system works.
To be honest, i don't think anyone does.
Rosetta uses their own system. It was a response to the original BOINC Credit system (which was seriously broken) and developed before Credit New came out (which is also broken beyond in belief, just in different ways to the original system). And apparently under certain circumstances the present Rosetta Credit mechanism reverts back to using the underlying BOINC Credit New system (did i mention that Credit New is extremely broken?). So while the Credit allocated is generally (mostly, sort of) relatively consistent, there are circumstances that result in rather large deviations (up, down & sideways).



I'm tempted to change my target run-time to the default of 8 hours and see how that affects my RAC.
It would be interesting to see what the results are (the biggest problem being the long Runtime of Rosetta Tasks, and the continually changing mix of Tasks, as well as the continually changing types of Tasks makes direct comparisons pretty much near impossible (and with a well working Credit system that wouldn't be the case). But if the changes are significant enough, then some conclusions could reasonably be drawn).
Grant
Darwin NT
ID: 95035 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Tomcat雄猫

Send message
Joined: 20 Dec 14
Posts: 180
Credit: 5,386,173
RAC: 0
Message 95037 - Posted: 21 Apr 2020, 8:42:17 UTC - in response to Message 95035.  
Last modified: 21 Apr 2020, 9:15:17 UTC


And apparently under certain circumstances the present Rosetta Credit mechanism reverts back to using the underlying BOINC Credit New system (did i mention that Credit New is extremely broken?).


That was what I was suspecting. A lot of the time I fail to see much of a difference between the credits per task on my main rig and those of others. And that is with a 28 hour run-time difference and my CPU being the much faster one, in many cases.

I know for sure that my Macbook Pro and my phones seem to be free from this issue (at least for recent tasks). Since I've increase my run-time from 12 hours to 36 hours on my Mac, and it got a 2X-ish increase in credits per task, which is to be expected.

Maybe this issue might be limited to Rosetta for Windows (Rosetta mini seems fine) that have a really long target run-time? I need to try messing with the target run-time on my main rig.

Since big bad proteins are coming to Rosetta, this is gonna be fun...

The worst protein I've seen so far took 36 hours of crunching on my main rig to generate 11 "decoys", it achieved a peak working set size of 2,802.30 MB and a peak swap size of 3,462.16 MB. I cannot imagine what an actual big bad protein would do...
ID: 95037 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Admin
Project administrator

Send message
Joined: 1 Jul 05
Posts: 4805
Credit: 0
RAC: 0
Message 95053 - Posted: 21 Apr 2020, 18:27:57 UTC - in response to Message 95033.  

My apologies since I've been busy with other things to look into this until now. There indeed is an issue that I will soon fix. Your machine is generating more than the maximum allowable credit but this is our fault. I will adjust our server accordingly.
ID: 95053 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Tomcat雄猫

Send message
Joined: 20 Dec 14
Posts: 180
Credit: 5,386,173
RAC: 0
Message 95058 - Posted: 21 Apr 2020, 18:57:15 UTC - in response to Message 95053.  

My apologies since I've been busy with other things to look into this until now. There indeed is an issue that I will soon fix. Your machine is generating more than the maximum allowable credit but this is our fault. I will adjust our server accordingly.



Ah, that explains everything.
Thanks!
ID: 95058 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Admin
Project administrator

Send message
Joined: 1 Jul 05
Posts: 4805
Credit: 0
RAC: 0
Message 95059 - Posted: 21 Apr 2020, 19:03:00 UTC

Done. Let us know if you are still seeing these issues.
ID: 95059 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Tomcat雄猫

Send message
Joined: 20 Dec 14
Posts: 180
Credit: 5,386,173
RAC: 0
Message 95062 - Posted: 21 Apr 2020, 19:07:39 UTC - in response to Message 95059.  
Last modified: 21 Apr 2020, 19:07:55 UTC

Done. Let us know if you are still seeing these issues.


Thanks, it appears to have been fixed.

Just got 2,010.91 credits for a task, now THAT'S more like it.

Time to stand back and watch my RAC explode...
ID: 95062 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Admin
Project administrator

Send message
Joined: 1 Jul 05
Posts: 4805
Credit: 0
RAC: 0
Message 95065 - Posted: 21 Apr 2020, 19:26:21 UTC - in response to Message 95062.  
Last modified: 21 Apr 2020, 19:29:50 UTC

It is odd that you were reporting back such low claimed credit. I'm not sure what is going on with your BOINC client. Typically the claimed credit is somewhat in line with the credit our validator calculates based on the credit/decoy average.

So it wasn't completely a fault of our settings, for some reason your boinc client is reporting very low credit based on the client benchmarks etc.
ID: 95065 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Tomcat雄猫

Send message
Joined: 20 Dec 14
Posts: 180
Credit: 5,386,173
RAC: 0
Message 95066 - Posted: 21 Apr 2020, 19:36:13 UTC - in response to Message 95065.  
Last modified: 21 Apr 2020, 19:42:01 UTC

It is odd that you were reporting back such low claimed credit. I'm not sure what is going on with your BOINC client. Typically the claimed credit is somewhat in line with the credit our validator calculates based on the credit/decoy average.

So it wasn't completely a fault of our settings, for some reason your boinc client is reporting very low credit based on the client benchmarks etc.


I'm running BOINC Manager 7.16.5 (x64) for Windows. Given the fact that my other devices don't have this problem, maybe it's an issue with that particular version?

Maybe my marathon run-times also have something to do with it? I don't know how the "claimed credit" works. I don't even know were to see that stat.

What I do know is that for Rosetta tasks, the estimated computation size is always 80,000 GFLOPs, regardless of target run-time.
ID: 95066 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Admin
Project administrator

Send message
Joined: 1 Jul 05
Posts: 4805
Credit: 0
RAC: 0
Message 95068 - Posted: 21 Apr 2020, 19:49:45 UTC - in response to Message 95066.  

What was happening with your jobs was that there is a check that makes sure that (the credit/model average from our server) * (the number of models your computer generated) is not greater than X*(claimed credit reported back from your BOINC client) where X is a parameter we have set. Since your computer was reporting back relatively low credit (like < 300), and was thus not passing the above criteria, our validator was just giving you the claimed credit.
ID: 95068 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Tomcat雄猫

Send message
Joined: 20 Dec 14
Posts: 180
Credit: 5,386,173
RAC: 0
Message 95069 - Posted: 21 Apr 2020, 19:53:01 UTC - in response to Message 95068.  

What was happening with your jobs was that there is a check that makes sure that (the credit/model average from our server) * (the number of models your computer generated) is not greater than X*(claimed credit reported back from your BOINC client) where X is a parameter we have set. Since your computer was reporting back relatively low credit (like < 300), and was thus not passing the above criteria, our validator was just giving you the claimed credit.


Hmm, is the claimed credits based on estimated computing size? Because the estimated computation size seems to be 80,000 GFLOPs for Rosetta tasks, regardless of target run-time.
ID: 95069 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Admin
Project administrator

Send message
Joined: 1 Jul 05
Posts: 4805
Credit: 0
RAC: 0
Message 95074 - Posted: 21 Apr 2020, 22:41:45 UTC - in response to Message 95069.  

https://boinc.berkeley.edu/trac/wiki/CreditOptions
ID: 95074 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1679
Credit: 17,801,903
RAC: 22,703
Message 95080 - Posted: 21 Apr 2020, 23:14:52 UTC - in response to Message 95074.  
Last modified: 21 Apr 2020, 23:18:08 UTC

Credit options
Made it clickable.
Grant
Darwin NT
ID: 95080 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mod.Sense
Volunteer moderator

Send message
Joined: 22 Aug 06
Posts: 4018
Credit: 0
RAC: 0
Message 95084 - Posted: 21 Apr 2020, 23:39:30 UTC - in response to Message 95069.  

The credit claim is reported by the BOINC Manager, and basically is a measurement of FLOPS used to complete the WU. But the BOINC Manager estimates this based on the machine's benchmarks. Here is what the website presently shows for your two main hosts' benchmarks:

https://boinc.bakerlab.org/rosetta/show_host_detail.php?hostid=3754624
12 CPUs 16GB
Measured floating point speed 5096.8 million ops/sec
Measured integer speed 19562.16 million ops/sec

https://boinc.bakerlab.org/rosetta/show_host_detail.php?hostid=2263735
4 CPUs 8GB
Measured floating point speed 5713.75 million ops/sec
Measured integer speed 13258.92 million ops/sec

So why would your 12 CPU machine report less FLOPS than your 4 CPU machine? There must have been some other major tasks running the last time BOINC Manager ran the benchmarks.
Rosetta Moderator: Mod.Sense
ID: 95084 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1679
Credit: 17,801,903
RAC: 22,703
Message 95086 - Posted: 21 Apr 2020, 23:56:36 UTC - in response to Message 95084.  

So why would your 12 CPU machine report less FLOPS than your 4 CPU machine? There must have been some other major tasks running the last time BOINC Manager ran the benchmarks.
I think the question is why are the reported benchmarks for the i5-5287U CPU so high??? It outperforms my i7-8700Ks at 4.3GHz by a considerable amount.
Overclocked to within an inch of it's life?
Grant
Darwin NT
ID: 95086 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Tomcat雄猫

Send message
Joined: 20 Dec 14
Posts: 180
Credit: 5,386,173
RAC: 0
Message 95087 - Posted: 21 Apr 2020, 23:58:53 UTC - in response to Message 95084.  
Last modified: 22 Apr 2020, 0:25:08 UTC

The credit claim is reported by the BOINC Manager, and basically is a measurement of FLOPS used to complete the WU. But the BOINC Manager estimates this based on the machine's benchmarks. Here is what the website presently shows for your two main hosts' benchmarks:

https://boinc.bakerlab.org/rosetta/show_host_detail.php?hostid=3754624
12 CPUs 16GB
Measured floating point speed 5096.8 million ops/sec
Measured integer speed 19562.16 million ops/sec

https://boinc.bakerlab.org/rosetta/show_host_detail.php?hostid=2263735
4 CPUs 8GB
Measured floating point speed 5713.75 million ops/sec
Measured integer speed 13258.92 million ops/sec

So why would your 12 CPU machine report less FLOPS than your 4 CPU machine? There must have been some other major tasks running the last time BOINC Manager ran the benchmarks.


Wait, isn't that number for single thread, not multi-thread? The numbers I am getting seem to be normal, since the slightly higher clocked 3600X has a floating point speed of 5.27 billion ops/sec according to the statistics on this site. I reran the BOINC benchmark, ensuring that there are as little background processes as there can be and with all tasks suspended, but the benchmark results didn't improve.

Besides, if "1 unit of credit = 1/200 day runtime on a CPU whose Whetstone benchmark is 1 GFLOPS. " according to the BOINC https://boinc.berkeley.edu/trac/wiki/CreditOptions page is true, then my rig should be claiming 1500 credits per task, not under 300.
ID: 95087 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Tomcat雄猫

Send message
Joined: 20 Dec 14
Posts: 180
Credit: 5,386,173
RAC: 0
Message 95089 - Posted: 22 Apr 2020, 0:06:49 UTC - in response to Message 95086.  
Last modified: 22 Apr 2020, 0:26:13 UTC

So why would your 12 CPU machine report less FLOPS than your 4 CPU machine? There must have been some other major tasks running the last time BOINC Manager ran the benchmarks.
I think the question is why are the reported benchmarks for the i5-5287U CPU so high??? It outperforms my i7-8700Ks at 4.3GHz by a considerable amount.
Overclocked to within an inch of it's life?


I have absolutely no idea... The BOINC benchmarks reported a 6.1 GFlops for my piddly i5-5287U stuffed in a glorified lap warmer 13-inch Macbook Pro on a good day... Which is a terrifying amount of GFlops for a machine that can barely run Chrome.

In case you're wondering, 6.1GFlops floating point is i9-9900K territory according to the statistics page.

I think it is safe to say there is something odd going on with BOINC's benchmarks... at least for my laptop. Unless i got miracle class silicon in my laptop boosting to 5 GHz (on regular nitrogen)...
ID: 95089 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1679
Credit: 17,801,903
RAC: 22,703
Message 95100 - Posted: 22 Apr 2020, 1:28:57 UTC - in response to Message 95089.  
Last modified: 22 Apr 2020, 1:36:05 UTC

I think it is safe to say there is something odd going on with BOINC's benchmarks... at least for my laptop. Unless i got miracle class silicon in my laptop boosting to 5 GHz (on regular nitrogen)...
I just noticed, different operating systems.
It shouldn't make any difference at all, but there's a good chance it does.

Edit- and cache sizes between systems, at least what is reported.
I'm thinking different L1 & L2 caches. L1 in particular. Shouldn't be a fact in benchmark results, but undoubtedly is. Even though the desktop systems have a much larger total cache, the L1 & L2 caches per core are probably smaller.
Grant
Darwin NT
ID: 95100 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
1 · 2 · 3 · Next

Message boards : Number crunching : Is the amount of credits I'm getting normal?



©2024 University of Washington
https://www.bakerlab.org