Message boards : Number crunching : Not getting any python work
Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 . . . 9 · Next
Author | Message |
---|---|
Grant (SSSF) Send message Joined: 28 Mar 20 Posts: 1681 Credit: 17,854,150 RAC: 20,118 |
My guess is, too small amount of free space or too small total RAM can cause BOINC to not send any Rosetta Python tasks.If so, there should be an error message stating that. There was plenty of that when the project changed the minimum requirements for Rosetta 4.20 Tasks a while back , so i'd expect the same for Python work if memory or disk space were an issue. Grant Darwin NT |
Greg_BE Send message Joined: 30 May 06 Posts: 5691 Credit: 5,859,226 RAC: 0 |
eeh...screw it. It just going to send me 4.2 tasks no matter what. You must be mistaken in your file name as that does not exist. |
Falconet Send message Joined: 9 Mar 09 Posts: 353 Credit: 1,227,479 RAC: 1,013 |
eeh...screw it. It just going to send me 4.2 tasks no matter what. I think Bryn meant the app_config.xml file. |
Greg_BE Send message Joined: 30 May 06 Posts: 5691 Credit: 5,859,226 RAC: 0 |
From Event Log: 11/11/2021 10:42:10 AM | | Starting BOINC client version 7.16.20 for windows_x86_64 11/11/2021 10:42:10 AM | | log flags: sched_ops, task, cpu_sched, cpu_sched_debug, cpu_sched_status 11/11/2021 10:42:10 AM | | log flags: sched_op_debug, work_fetch_debug 11/11/2021 10:42:10 AM | | Libraries: libcurl/7.47.1 OpenSSL/1.0.2s zlib/1.2.8 11/11/2021 10:42:10 AM | | Data directory: C:boinc data 11/11/2021 10:42:10 AM | | Running under account Greg 11/11/2021 10:42:10 AM | | [error] Couldn't parse account file account_universeathome.pl_universe.xml 11/11/2021 10:42:10 AM | | [error] Couldn't parse statistics_universeathome.pl_universe.xml 11/11/2021 10:42:11 AM | | CUDA: NVIDIA GPU 0: NVIDIA GeForce GTX 1080 (driver version 472.12, CUDA version 11.4, compute capability 6.1, 4096MB, 3469MB available, 9070 GFLOPS peak) 11/11/2021 10:42:11 AM | | CUDA: NVIDIA GPU 1: NVIDIA GeForce GTX 1050 Ti (driver version 472.12, CUDA version 11.4, compute capability 6.1, 4096MB, 3376MB available, 2274 GFLOPS peak) 11/11/2021 10:42:11 AM | | OpenCL: NVIDIA GPU 0: NVIDIA GeForce GTX 1080 (driver version 472.12, device version OpenCL 3.0 CUDA, 8192MB, 3469MB available, 9070 GFLOPS peak) 11/11/2021 10:42:11 AM | | OpenCL: NVIDIA GPU 1: NVIDIA GeForce GTX 1050 Ti (driver version 472.12, device version OpenCL 3.0 CUDA, 4096MB, 3376MB available, 2274 GFLOPS peak) 11/11/2021 10:42:11 AM | | Windows processor group 0: 16 processors 11/11/2021 10:42:11 AM | | Host name: DESKTOP-LFM92VN 11/11/2021 10:42:11 AM | | Processor: 16 AuthenticAMD AMD Ryzen 7 3700X 8-Core Processor [Family 23 Model 113 Stepping 0] 11/11/2021 10:42:11 AM | | Processor features: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 htt pni ssse3 fma cx16 sse4_1 sse4_2 movebe popcnt aes f16c rdrandsyscall nx lm avx avx2 svm sse4a osvw ibs skinit wdt tce topx page1gb rdtscp fsgsbase bmi1 smep bmi2 11/11/2021 10:42:11 AM | | OS: Microsoft Windows 10: Professional x64 Edition, (10.00.19043.00) 11/11/2021 10:42:11 AM | | Memory: 23.93 GB physical, 35.43 GB virtual 11/11/2021 10:42:11 AM | | Disk: 208.45 GB total, 103.93 GB free 11/11/2021 10:42:11 AM | | Local time is UTC +1 hours 11/11/2021 10:42:11 AM | | No WSL found. 11/11/2021 10:42:11 AM | | VirtualBox version: 6.1.28 11/11/2021 10:42:11 AM | | Config: allow multiple clients 11/11/2021 10:42:11 AM | | Config: use all coprocessors 11/11/2021 10:42:11 AM | Rosetta@home | General prefs: from Rosetta@home (last modified 08-Nov-2021 21:59:25) 11/11/2021 10:42:11 AM | Rosetta@home | Computer location: home 11/11/2021 10:42:11 AM | Rosetta@home | General prefs: no separate prefs for home; using your defaults 11/11/2021 10:42:11 AM | | Reading preferences override file 11/11/2021 10:42:11 AM | | Preferences: 11/11/2021 10:42:11 AM | | max memory usage when active: 24501.59 MB 11/11/2021 10:42:11 AM | | max memory usage when idle: 24501.59 MB 11/11/2021 10:42:12 AM | | max disk usage: 112.39 GB 11/11/2021 10:42:12 AM | | max CPUs used: 15 11/11/2021 10:42:12 AM | | (to change preferences, visit a project web site or select Preferences in the Manager) 11/11/2021 10:42:12 AM | | [cpu_sched_debug] Request CPU reschedule: Prefs update 11/11/2021 10:42:12 AM | | [work_fetch] Request work fetch: Prefs update 11/11/2021 10:42:12 AM | | [cpu_sched_debug] Request CPU reschedule: Startup 11/11/2021 10:42:12 AM | | [work_fetch] Request work fetch: Startup 11/11/2021 10:42:12 AM | | Setting up project and slot directories 11/11/2021 10:42:12 AM | | Checking active tasks 11/11/2021 10:42:12 AM | Einstein@Home | URL http://einstein.phys.uwm.edu/; Computer ID 12664581; resource share 100 11/11/2021 10:42:12 AM | Einstein@Home | Not using CPU: project preferences 11/11/2021 10:42:12 AM | LHC@home | URL https://lhcathome.cern.ch/lhcathome/; Computer ID 10556945; resource share 100 11/11/2021 10:42:12 AM | PrimeGrid | URL http://www.primegrid.com/; Computer ID 973467; resource share 100 11/11/2021 10:42:12 AM | PrimeGrid | Not using CPU: project preferences 11/11/2021 10:42:12 AM | Rosetta@home | URL https://boinc.bakerlab.org/rosetta/; Computer ID 3433065; resource share 100 11/11/2021 10:42:12 AM | SiDock@home | URL https://www.sidock.si/sidock/; Computer ID 21419; resource share 100 11/11/2021 10:42:12 AM | World Community Grid | URL http://www.worldcommunitygrid.org/; Computer ID 4889728; resource share 100 11/11/2021 10:42:12 AM | | Setting up GUI RPC socket 11/11/2021 10:42:12 AM | | Checking presence of 391 project files Memory load at this time is only 55% BOINC wants only 1773.8MB at this time. Vbox (LHC ATLAS) is only 14.3MB and the Vbox Frontend is 36.6MB, Interface is 5 MB I run FAH as well the "core" is 537.3MB + 206.0, Client is 3.4 MB |
Greg_BE Send message Joined: 30 May 06 Posts: 5691 Credit: 5,859,226 RAC: 0 |
eeh...screw it. It just going to send me 4.2 tasks no matter what. That is possible...that's next then |
Greg_BE Send message Joined: 30 May 06 Posts: 5691 Credit: 5,859,226 RAC: 0 |
<?xml version="1.0"?> -<app_config> -<app> <name>rosetta 4.20</name> <max_concurrent>1</max_concurrent> </app> </app_config> But BOINC sends out multiple tasks using as many cores as it wants to. I have no restrictions set anymore. |
Greg_BE Send message Joined: 30 May 06 Posts: 5691 Credit: 5,859,226 RAC: 0 |
cc_config <?xml version="1.0"?> -<cc_config> -<log_flags> <file_xfer>0</file_xfer> <sched_ops>1</sched_ops> <task>1</task> <app_msg_receive>0</app_msg_receive> <app_msg_send>0</app_msg_send> <async_file_debug>0</async_file_debug> <benchmark_debug>0</benchmark_debug> <checkpoint_debug>0</checkpoint_debug> <coproc_debug>0</coproc_debug> <cpu_sched>1</cpu_sched> <cpu_sched_debug>1</cpu_sched_debug> <cpu_sched_status>1</cpu_sched_status> <dcf_debug>0</dcf_debug> <disk_usage_debug>0</disk_usage_debug> <file_xfer_debug>0</file_xfer_debug> <gui_rpc_debug>0</gui_rpc_debug> <heartbeat_debug>0</heartbeat_debug> <http_debug>0</http_debug> <http_xfer_debug>0</http_xfer_debug> <idle_detection_debug>0</idle_detection_debug> <mem_usage_debug>0</mem_usage_debug> <network_status_debug>0</network_status_debug> <notice_debug>0</notice_debug> <poll_debug>0</poll_debug> <priority_debug>0</priority_debug> <proxy_debug>0</proxy_debug> <rr_simulation>0</rr_simulation> <rrsim_detail>0</rrsim_detail> <sched_op_debug>1</sched_op_debug> <scrsave_debug>0</scrsave_debug> <slot_debug>0</slot_debug> <state_debug>0</state_debug> <statefile_debug>0</statefile_debug> <suspend_debug>0</suspend_debug> <task_debug>0</task_debug> <time_debug>0</time_debug> <trickle_debug>0</trickle_debug> <unparsed_xml>0</unparsed_xml> <work_fetch_debug>1</work_fetch_debug> </log_flags> -<options> <abort_jobs_on_exit>0</abort_jobs_on_exit> <allow_gui_rpc_get>0</allow_gui_rpc_get> <allow_multiple_clients>1</allow_multiple_clients> <allow_remote_gui_rpc>0</allow_remote_gui_rpc> <disallow_attach>0</disallow_attach> <dont_check_file_sizes>0</dont_check_file_sizes> <dont_contact_ref_site>0</dont_contact_ref_site> <lower_client_priority>0</lower_client_priority> <dont_suspend_nci>0</dont_suspend_nci> <dont_use_vbox>0</dont_use_vbox> <dont_use_wsl>0</dont_use_wsl> <exit_after_finish>0</exit_after_finish> <exit_before_start>0</exit_before_start> <exit_when_idle>0</exit_when_idle> <fetch_minimal_work>0</fetch_minimal_work> <fetch_on_update>0</fetch_on_update> <force_auth>default</force_auth> <http_1_0>0</http_1_0> <http_transfer_timeout>300</http_transfer_timeout> <http_transfer_timeout_bps>10</http_transfer_timeout_bps> <max_event_log_lines>2000</max_event_log_lines> <max_file_xfers>8</max_file_xfers> <max_file_xfers_per_project>2</max_file_xfers_per_project> <max_stderr_file_size>0.000000</max_stderr_file_size> <max_stdout_file_size>0.000000</max_stdout_file_size> <max_tasks_reported>0</max_tasks_reported> <ncpus>-1</ncpus> <no_alt_platform>0</no_alt_platform> <no_gpus>0</no_gpus> <no_info_fetch>0</no_info_fetch> <no_opencl>0</no_opencl> <no_priority_change>0</no_priority_change> <os_random_only>0</os_random_only> <process_priority>-1</process_priority> <process_priority_special>-1</process_priority_special> -<proxy_info> <socks_server_name/> <socks_server_port>80</socks_server_port> <http_server_name/> <http_server_port>80</http_server_port> <socks5_user_name/> <socks5_user_passwd/> <socks5_remote_dns>0</socks5_remote_dns> <http_user_name/> <http_user_passwd/> <no_proxy/> <no_autodetect>0</no_autodetect> </proxy_info> <rec_half_life_days>1.000000</rec_half_life_days> <report_results_immediately>0</report_results_immediately> <run_apps_manually>0</run_apps_manually> <save_stats_days>30</save_stats_days> <skip_cpu_benchmarks>0</skip_cpu_benchmarks> <simple_gui_only>0</simple_gui_only> <start_delay>0.000000</start_delay> <stderr_head>0</stderr_head> <suppress_net_info>0</suppress_net_info> <unsigned_apps_ok>0</unsigned_apps_ok> <use_all_gpus>1</use_all_gpus> <use_certs>0</use_certs> <use_certs_only>0</use_certs_only> <vbox_window>0</vbox_window> </options> </cc_config> |
Falconet Send message Joined: 9 Mar 09 Posts: 353 Credit: 1,227,479 RAC: 1,013 |
<?xml version="1.0"?> I've read on these forums that there's a bug regarding the max concurrent option. Instead of limiting the number of tasks, it downloads too many or something like that. Also, I think the Rosetta 4.20 app name is just "rosetta". |
Greg_BE Send message Joined: 30 May 06 Posts: 5691 Credit: 5,859,226 RAC: 0 |
<?xml version="1.0"?> The bug, I thought it was in app_config, but that was many discussions ago You might be on to something with the 4.2 I'll remove that number and see, because over in the BOINC Berkley someone had me use a fake name for RAH and it came back as just Rosetta. |
Bryn Mawr Send message Joined: 26 Dec 18 Posts: 393 Credit: 12,110,248 RAC: 4,952 |
eeh...screw it. It just going to send me 4.2 tasks no matter what. I was looking for the cc_config.xml as I’ve had some similar problems in the past due to settings in there. |
Bryn Mawr Send message Joined: 26 Dec 18 Posts: 393 Credit: 12,110,248 RAC: 4,952 |
cc_config Thanks, the problem I was looking for is not there |
Greg_BE Send message Joined: 30 May 06 Posts: 5691 Credit: 5,859,226 RAC: 0 |
cc_config Eliminated the 4.2 in app_config, but that did not help anything. Still just 4.2 work. You see anything in this cc_config that could change anything? Anywhere else to look for stuff? |
Grant (SSSF) Send message Joined: 28 Mar 20 Posts: 1681 Credit: 17,854,150 RAC: 20,118 |
Something to keep an eye on. There are several different types of Tasks going through at the moment which are taking around 2 hours to process- that's a quarter of the default Target CPU run time. Those along with the higher than usual number of 5nvx_graft_buwei_ Tasks that only last for a few seconds mean there's a good chance we'll be out of Rosetta 4.20 work (other than the odd RB Task or a resend) in the next day or two. Leaving only Python Tasks to work on. Grant Darwin NT |
Greg_BE Send message Joined: 30 May 06 Posts: 5691 Credit: 5,859,226 RAC: 0 |
Something to keep an eye on. I have niv_site1 and 2,epha2 and the famous degrader. These are all default times I have nkg2d and fcgr3a waiting Still 29,000+ in plain Rosetta, python is just under 5,000 |
Bryn Mawr Send message Joined: 26 Dec 18 Posts: 393 Credit: 12,110,248 RAC: 4,952 |
Something to keep an eye on. Overall we’re down to 2,355,000 tasks pending - I don’t know how to split that between 4.20 and Python or why Python could be left when the 4.20 have been exhausted? |
Grant (SSSF) Send message Joined: 28 Mar 20 Posts: 1681 Credit: 17,854,150 RAC: 20,118 |
Overall we’re down to 2,355,000 tasks pending - I don’t know how to split that between 4.20 and Python or why Python could be left when the 4.20 have been exhausted?Based on a WAG using the Project Status numbers. There's generally 5 times as many Rosetta 4.20 Tasks ready to send v Python Tasks, but there are roughly only 3 times as many Rosetta 4.20 Tasks In progress compared to Python Tasks In progress. Given the huge increase in Rosetta 4.20 work that will be done with these (relatively) very short run time Tasks presently going through, we're going to run out of Rosetta 4.20 work well before we run out of Python work (assuming no more of either is being added. If there is more Python work being added (very likely) then it'll take quite a while before it runs out of work Ready to send). Grant Darwin NT |
Bryn Mawr Send message Joined: 26 Dec 18 Posts: 393 Credit: 12,110,248 RAC: 4,952 |
Overall we’re down to 2,355,000 tasks pending - I don’t know how to split that between 4.20 and Python or why Python could be left when the 4.20 have been exhausted?Based on a WAG using the Project Status numbers. Not so wild apparently, total queued is down to 2,317,000 but ready to send is down to 5,000 - all bar one Python |
sam6861 Send message Joined: 25 Mar 20 Posts: 4 Credit: 2,411,420 RAC: 0 |
If so, there should be an error message stating that. No error message if BOINC can get any compatible and available tasks from Rosetta. Lets look at my AMD FX-4100 Computer without VirtualBox. Here is BOINC client logs a few days ago: Wed 10 Nov 2021 03:39:38 PM CST | Rosetta@home | Requesting new tasks for CPU Wed 10 Nov 2021 03:39:40 PM CST | Rosetta@home | Scheduler request completed: got 1 new tasks .. no errors. no message from server ... then 1.4 days later: Fri 12 Nov 2021 02:55:52 AM CST | Rosetta@home | Requesting new tasks for CPU Fri 12 Nov 2021 02:55:53 AM CST | Rosetta@home | Scheduler request completed: got 0 new tasks Fri 12 Nov 2021 02:55:53 AM CST | Rosetta@home | No tasks sent Fri 12 Nov 2021 02:55:53 AM CST | Rosetta@home | Message from server: VirtualBox is not installed Now my computer finally got a message from server, only when it got 0 new tasks. Message from server can be, low disk space, low RAM, or missing VirtualBox or missing VT-X / AMD-V. Server have 0 unsent Rosetta 4.20 tasks and only have some unsent Python tasks at this time, check website, computing, server status. Really would be nice if Rosetta at home website have an option to limit to one specific app or an on/off option on each app. This would make troubleshooting easier. I know some of my computer is missing VirtualBox, but I am unsure what other user's problem could be. |
Grant (SSSF) Send message Joined: 28 Mar 20 Posts: 1681 Credit: 17,854,150 RAC: 20,118 |
Here is BOINC client logs a few days ago:You requested work, and got work, hence no error message. ... then 1.4 days later:See the Problems and Technical Issues with Rosetta@home thread. The project is presently broken and not sending out any Rosetta 4.20 Tasks. And it looks like it's not sending out any Python Tasks either, even for those with VirtualBox. Grant Darwin NT |
Greg_BE Send message Joined: 30 May 06 Posts: 5691 Credit: 5,859,226 RAC: 0 |
<-- I sent a PM to DEK but he didn't reply about this same thing nearly a month ago. In one ear and out the other.If so, there should be an error message stating that. Sam - I have Vbox installed and it works fine. I run LHC ATLAS. So I know Vbox is ok. There was a wild idea in BOINC forum that LHC could interfere with RAH Vbox stuff, but I find that odd since I ran Python alongside LHC. Unless they changed something and if it finds other Vbox projects it doesn't run and then don't make any mention of it? (entirely possible since there is no communication here from the project) |
Message boards :
Number crunching :
Not getting any python work
©2024 University of Washington
https://www.bakerlab.org