Message boards : Number crunching : Is it worth expanding my spot fleet?
Author | Message |
---|---|
nick Send message Joined: 28 Mar 20 Posts: 7 Credit: 778,267 RAC: 0 |
Hey, Great project, thanks to everyone's efforts. I'm a total newbie here and arrived mostly because of COVID-19. I'd like to spend my earned AWS vouchers in c5.2xlarge machines to crunch away (plus my desktop of course). Raised a couple of instances in a spot fleet and was about to raise more but I see I've run out of tasks. Checking the logs I discovered that this happened early during the morning as well. I was planning on expanding to use 5 instances. But it's going to be worth it only if there's a steady inflow of tasks. Any ideas if this is a temporary issue? |
Mod.Sense Volunteer moderator Send message Joined: 22 Aug 06 Posts: 4018 Credit: 0 RAC: 0 |
Certainly a temporary issue. See post by bcov Rosetta Moderator: Mod.Sense |
nick Send message Joined: 28 Mar 20 Posts: 7 Credit: 778,267 RAC: 0 |
Great, good to know. For what it's worth if anyone wants to use AWS to contribute to this, go for Ubuntu and launch C5 spot instances in the Ohio region. This currently brings you down to almost 1 cent per CPU-hour. |
Mod.Sense Volunteer moderator Send message Joined: 22 Aug 06 Posts: 4018 Credit: 0 RAC: 0 |
Wow! Under 2 bucks a week? How long do you suppose that spot price will hold? Rosetta Moderator: Mod.Sense |
nick Send message Joined: 28 Mar 20 Posts: 7 Credit: 778,267 RAC: 0 |
I haven't the faintest but I'll use this price while it's there. Looking at the three month history of spot prices for C5 instances in Ohio, they've risen from a bit below 1 cent per CPU hour to a tad above 1 cent per CPU hour (or by 9.41% to be exact). 3.13% per month might be significant if you're running thousands of instances but for my intended purposes seems I won't have to worry about a massive pricing change overnight. |
Mod.Sense Volunteer moderator Send message Joined: 22 Aug 06 Posts: 4018 Credit: 0 RAC: 0 |
I guess I should point out that, in addition to those CPU charges, there are also charges for network usage, and disk storage. If you have a number of hosts, you could have one of them fulfill the role of a proxy (in addition to crunching), and avoid getting the same files for each of the host images. Rosetta Moderator: Mod.Sense |
nick Send message Joined: 28 Mar 20 Posts: 7 Credit: 778,267 RAC: 0 |
Yeap, good point. BUT the cost of incoming traffic to AWS is 0, while the cost of outgoing traffic is $0.09 per GB. I assumed that the bulk of the traffic would be incoming to the BOINC client, is that correct? |
Mod.Sense Volunteer moderator Send message Joined: 22 Aug 06 Posts: 4018 Credit: 0 RAC: 0 |
Yep, your only "outgoing" would be scheduler requests and completed out files, which are typically pretty small (100K?) Rosetta Moderator: Mod.Sense |
nick Send message Joined: 28 Mar 20 Posts: 7 Credit: 778,267 RAC: 0 |
After the update all seem great. Now AWS-crunching without issues! |
Message boards :
Number crunching :
Is it worth expanding my spot fleet?
©2024 University of Washington
https://www.bakerlab.org