Please remove Virtualbox as a dependency.

Message boards : Number crunching : Please remove Virtualbox as a dependency.

To post messages, you must log in.

1 · 2 · 3 · Next

AuthorMessage
Technologov

Send message
Joined: 17 Jul 07
Posts: 16
Credit: 415,250,373
RAC: 57,667
Message 105149 - Posted: 23 Feb 2022, 8:47:06 UTC

You can compile Rosetta python apps native with PyInstaller, removing the need for Virtualbox, increase performance . (And allow execution on ARM processors)
ID: 105149 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 1600
Credit: 11,842,216
RAC: 9,161
Message 105169 - Posted: 23 Feb 2022, 14:52:39 UTC - in response to Message 105149.  

+1

I can get Python to work on 1 of my 7 PCs, one of the ones that fails is a 1 year old Ryzen 9 3900XT. Virtual box is a piece of shit unless implemented very well like LHC does.
ID: 105169 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile dcdc

Send message
Joined: 3 Nov 05
Posts: 1832
Credit: 119,658,896
RAC: 10,801
Message 105210 - Posted: 25 Feb 2022, 12:29:47 UTC
Last modified: 25 Feb 2022, 12:29:56 UTC

If it would also allow running as a service again, that would be a huge win too. VirtualBox is way more hard work than any BOINC project should be.
ID: 105210 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5691
Credit: 5,859,226
RAC: 0
Message 105219 - Posted: 25 Feb 2022, 23:35:55 UTC

I'm running a year old ryzen 3700 with Vbox and no problems.
I had problems with QuChemPedia becoming unstable for some reason.
Here Vbox works fine, same with LHC.
It's over my head to know what causes these to become unstable or stall.
ID: 105219 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 1600
Credit: 11,842,216
RAC: 9,161
Message 105220 - Posted: 26 Feb 2022, 6:05:36 UTC - in response to Message 105219.  

I'm running a year old ryzen 3700 with Vbox and no problems.
I had problems with QuChemPedia becoming unstable for some reason.
Here Vbox works fine, same with LHC.
It's over my head to know what causes these to become unstable or stall.
I had a long conversation in LHC because theirs started failing too. Looks like a Windows update has screwed things over randomly. This: https://www.wintips.org/fix-virtualbox-error-vt-x-is-not-available-in-windows-10/ has instructions to fix "Hyper-V" in Windows which can get in the way of VB. You have to turn it on (!), reboot, turn it off, reboot, disable it with the command line, reboot, than you get a 50% chance of it working properly. I have 7 machines, I now have 3 that can do Rosetta Python VB or LHC VB, and 1 that can do LHC VB but not Rosetta, and 3 that refuse to do either. Which is better than before, 6 of them refused both.
ID: 105220 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile [VENETO] boboviz

Send message
Joined: 1 Dec 05
Posts: 1994
Credit: 9,625,551
RAC: 6,845
Message 105222 - Posted: 26 Feb 2022, 7:25:42 UTC - in response to Message 105149.  

You can compile Rosetta python apps native with PyInstaller, removing the need for Virtualbox, increase performance . (And allow execution on ARM processors)


It looks very interesting, which is why we will never see it in the project :-P

PyInstaller reads a Python script written by you. It analyzes your code to discover every other module and library your script needs in order to execute. Then it collects copies of all those files – including the active Python interpreter! – and puts them with your script in a single folder, or optionally in a single executable file.

PyInstaller is tested against Windows, Mac OS X, and GNU/Linux.

ID: 105222 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 1600
Credit: 11,842,216
RAC: 9,161
Message 105223 - Posted: 26 Feb 2022, 7:56:42 UTC - in response to Message 105222.  

It looks very interesting, which is why we will never see it in the project :-P
Well I've got 3 of 7 machines going on python now instead of 1 of 7, by doing the windows fuckabout described above.
ID: 105223 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 1600
Credit: 11,842,216
RAC: 9,161
Message 105226 - Posted: 26 Feb 2022, 10:01:08 UTC

And now my 1 machine which has crunched Python perfectly since it came out has been refused any further pythons, yet there are 5000 queued. But.... the main page has dropped from 2.1 million to 1.6 million. Perhaps they took some off? Perhaps they're fixing something? Perhaps I'm dreaming?
ID: 105226 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile [VENETO] boboviz

Send message
Joined: 1 Dec 05
Posts: 1994
Credit: 9,625,551
RAC: 6,845
Message 105228 - Posted: 26 Feb 2022, 11:04:13 UTC - in response to Message 105223.  

It looks very interesting, which is why we will never see it in the project :-P
Well I've got 3 of 7 machines going on python now instead of 1 of 7, by doing the windows fuckabout described above.


Good for you!!
But it's not a problem of "feasibility", it's the possibility to have better code/better app/better project to have better and faster science.
Gpu? Tested years ago and never more.
Cpu extensions (SSEx, AVX)? Never tested
Multicore-app? Never tested
Abandon old 32-bit code and "focused" on 64 bit? 32 bit still supported in 2022.
Bugs in the app? Not interesting

So, i'm skeptical about PyInstaller
ID: 105228 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 1600
Credit: 11,842,216
RAC: 9,161
Message 105230 - Posted: 26 Feb 2022, 11:25:02 UTC - in response to Message 105228.  

Good for you!!
But it's not a problem of "feasibility", it's the possibility to have better code/better app/better project to have better and faster science.
Gpu? Tested years ago and never more.
Cpu extensions (SSEx, AVX)? Never tested
Multicore-app? Never tested
Abandon old 32-bit code and "focused" on 64 bit? 32 bit still supported in 2022.
Bugs in the app? Not interesting

So, i'm skeptical about PyInstaller
Agreed. Folding at home can do multithread and GPU. Rosetta is far behind. So is WCG. If you want to run biology on your computer, do Folding at home.
ID: 105230 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile [VENETO] boboviz

Send message
Joined: 1 Dec 05
Posts: 1994
Credit: 9,625,551
RAC: 6,845
Message 105232 - Posted: 26 Feb 2022, 11:33:30 UTC - in response to Message 105230.  

If you want to run biology on your computer, do Folding at home.

This is my account on Folding@Home
I'm using my little gpu on cancer research...
ID: 105232 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 1600
Credit: 11,842,216
RAC: 9,161
Message 105235 - Posted: 26 Feb 2022, 11:43:25 UTC - in response to Message 105232.  

This is my account on Folding@Home
I'm using my little gpu on cancer research...
They seem to have a problem with some of my GPUs. My 7970 doesn't work, yet my 280X does. They're the same Tahiti chip AFAIK, just 5% faster memory on the 280X. Mind you, Einstein Gamma won't work on the 7970 either. I guess there must have been a bugfix or minor update on the 280X.

They also give me work too long to do in time for my antique quad core laptop CPU.
ID: 105235 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile [VENETO] boboviz

Send message
Joined: 1 Dec 05
Posts: 1994
Credit: 9,625,551
RAC: 6,845
Message 105239 - Posted: 26 Feb 2022, 16:39:54 UTC - in response to Message 105235.  

They seem to have a problem with some of my GPUs. My 7970 doesn't work, yet my 280X does. They're the same Tahiti chip AFAIK, just 5% faster memory on the 280X.


7970 is a great gpu, but it's over 10 ys old.
The price/performance ratio is negative and it's difficult to optimize code for these old gpus.
ID: 105239 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 1600
Credit: 11,842,216
RAC: 9,161
Message 105240 - Posted: 26 Feb 2022, 17:05:00 UTC - in response to Message 105239.  

They seem to have a problem with some of my GPUs. My 7970 doesn't work, yet my 280X does. They're the same Tahiti chip AFAIK, just 5% faster memory on the 280X.


7970 is a great gpu, but it's over 10 ys old.
The price/performance ratio is negative and it's difficult to optimize code for these old gpus.
Why do people dismiss old stuff? My car (no D) is 20 years old. I play 3D games 1600*1200 at 30fps on a 280X. I buy 280X and 7970 on purpose because they're the best price/performance ratio for Milkyway at Home (double precision, something the new ones suck at). Even for single precision they're pretty good value, because they're sold cheap, I can get them between £50 and £100. The latest Nvidia my friend bought for games is £1200 and only 7 times faster, so far more price per performance.

Anyway, why does the 280X work on FAH and not the 7970? Same chip!
ID: 105240 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile [VENETO] boboviz

Send message
Joined: 1 Dec 05
Posts: 1994
Credit: 9,625,551
RAC: 6,845
Message 105280 - Posted: 28 Feb 2022, 9:55:51 UTC - in response to Message 105222.  
Last modified: 28 Feb 2022, 9:56:03 UTC

PyInstaller is tested against Windows, Mac OS X, and GNU/Linux.


PyInstaller can also packages AI python frameworks for GPU like Keras, Nvidia DeepStream, Tensorflow.

Or you can use ONNX, that also supports gpu.
ID: 105280 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile [VENETO] boboviz

Send message
Joined: 1 Dec 05
Posts: 1994
Credit: 9,625,551
RAC: 6,845
Message 105281 - Posted: 28 Feb 2022, 9:58:10 UTC - in response to Message 105240.  

Anyway, why does the 280X work on FAH and not the 7970? Same chip!


Well, i don't know.
This is a question for F@H admins...
ID: 105281 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 1600
Credit: 11,842,216
RAC: 9,161
Message 105284 - Posted: 28 Feb 2022, 10:19:35 UTC - in response to Message 105281.  

Anyway, why does the 280X work on FAH and not the 7970? Same chip!


Well, i don't know.
This is a question for F@H admins...
They're not very useful and don't have much time for such things. Like Rosetta, but not so bad, they have limited time to sort end-user problems. There is a new version of the client being developed, but they won't say what improvements they've made. Anyway I've got my resources devoted to Russian projects just now, to counteract this childish boycotting some people are doing.
ID: 105284 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile [VENETO] boboviz

Send message
Joined: 1 Dec 05
Posts: 1994
Credit: 9,625,551
RAC: 6,845
Message 105286 - Posted: 28 Feb 2022, 10:43:51 UTC - in response to Message 105284.  

They're not very useful and don't have much time for such things. Like Rosetta, but not so bad, they have limited time to sort end-user problems.

They are very active on their Twitter account and sometimes interact with volunteers.

Anyway I've got my resources devoted to Russian projects just now, to counteract this childish boycotting some people are doing.

I think it's important to boycott Vladimir Putin, not russian scientists
ID: 105286 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 1600
Credit: 11,842,216
RAC: 9,161
Message 105288 - Posted: 28 Feb 2022, 11:23:41 UTC - in response to Message 105286.  
Last modified: 28 Feb 2022, 11:24:15 UTC

They're not very useful and don't have much time for such things. Like Rosetta, but not so bad, they have limited time to sort end-user problems.

They are very active on their Twitter account and sometimes interact with volunteers.
But don't bother in the proper Boinc forum. That's ridiculous. We shouldn't have to hunt them down. I'm not going to sign up to twitter (which is a poor man's Facebook) just to communicate with one group of people.

Anyway I've got my resources devoted to Russian projects just now, to counteract this childish boycotting some people are doing.
I think it's important to boycott Vladimir Putin, not russian scientists
I wouldn't boycott Putin either, the prices of everything they supplied are going to skyrocket. We're only harming ourselves.
ID: 105288 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile [VENETO] boboviz

Send message
Joined: 1 Dec 05
Posts: 1994
Credit: 9,625,551
RAC: 6,845
Message 105866 - Posted: 8 Apr 2022, 7:10:48 UTC

New version of PyInstaller is out
ID: 105866 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
1 · 2 · 3 · Next

Message boards : Number crunching : Please remove Virtualbox as a dependency.



©2024 University of Washington
https://www.bakerlab.org