troy8d
CLASSIFIED Member
- Total Posts : 2816
- Reward points : 0
- Joined: 2010/10/16 08:10:22
- Status: offline
- Ribbons : 10
I have recently been having a lot of trouble downloading work units. FAH client will complete a WU, attempt to download another and then just hang and never completing the download and stopping my folding. Restarting the client solves this issue, however, I cannot constantly be restarting between every WU. I have reinstalled the FAH client and that has not helped. Below is the most recent log of downloads failing on both slots. Any help appreciated! 16:42:52:WU00:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64) 16:42:52:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:14271 run:0 clone:84 gen:29 core:0x21 unit:0x0000002a80fccb0a5d9761520c4fefab 16:42:52:WU00:FS01:Uploading 85.56MiB to 128.252.203.10 16:42:52:WU00:FS01:Connecting to 128.252.203.10:8080 16:42:54:WU02:FS01:Download 2.00% 16:42:58:WU00:FS01:Upload 78.24% 16:43:00:WU00:FS01:Upload complete 16:43:00:WU00:FS01:Server responded WORK_ACK (400) 16:43:00:WU00:FS01:Final credit estimate, 116507.00 points 16:43:00:WU00:FS01:Cleaning up 16:43:00:WU02:FS01:Download 2.80% 16:43:20:WU02:FS01:Download 3.20% 16:43:28:WU02:FS01:Download 4.40% 16:43:34:WU02:FS01:Download 7.20% 16:43:43:WU02:FS01:Download 11.20% 16:43:49:WU02:FS01:Download 13.20% 16:43:59:WU02:FS01:Download 15.20% 16:44:16:WU02:FS01:Download 15.60% 16:44:19:WU01:FS02:0x21:Completed 3550000 out of 5000000 steps (71%) 16:47:44:WU01:FS02:0x21:Completed 3600000 out of 5000000 steps (72%) 16:51:07:WU01:FS02:0x21:Completed 3650000 out of 5000000 steps (73%) 16:54:29:WU01:FS02:0x21:Completed 3700000 out of 5000000 steps (74%) 16:57:50:WU01:FS02:0x21:Completed 3750000 out of 5000000 steps (75%) 17:01:18:WU01:FS02:0x21:Completed 3800000 out of 5000000 steps (76%) 17:04:40:WU01:FS02:0x21:Completed 3850000 out of 5000000 steps (77%) 17:08:01:WU01:FS02:0x21:Completed 3900000 out of 5000000 steps (78%) 17:11:22:WU01:FS02:0x21:Completed 3950000 out of 5000000 steps (79%) 17:14:44:WU01:FS02:0x21:Completed 4000000 out of 5000000 steps (80%) 17:18:12:WU01:FS02:0x21:Completed 4050000 out of 5000000 steps (81%) 17:21:33:WU01:FS02:0x21:Completed 4100000 out of 5000000 steps (82%) 17:24:55:WU01:FS02:0x21:Completed 4150000 out of 5000000 steps (83%) 17:28:16:WU01:FS02:0x21:Completed 4200000 out of 5000000 steps (84%) 17:31:38:WU01:FS02:0x21:Completed 4250000 out of 5000000 steps (85%) 17:35:06:WU01:FS02:0x21:Completed 4300000 out of 5000000 steps (86%) 17:38:27:WU01:FS02:0x21:Completed 4350000 out of 5000000 steps (87%) 17:41:49:WU01:FS02:0x21:Completed 4400000 out of 5000000 steps (88%) 17:45:10:WU01:FS02:0x21:Completed 4450000 out of 5000000 steps (89%) 17:48:32:WU01:FS02:0x21:Completed 4500000 out of 5000000 steps (90%) 17:52:00:WU01:FS02:0x21:Completed 4550000 out of 5000000 steps (91%) 17:55:21:WU01:FS02:0x21:Completed 4600000 out of 5000000 steps (92%) 17:58:43:WU01:FS02:0x21:Completed 4650000 out of 5000000 steps (93%) 18:02:04:WU01:FS02:0x21:Completed 4700000 out of 5000000 steps (94%) 18:05:26:WU01:FS02:0x21:Completed 4750000 out of 5000000 steps (95%) 18:08:54:WU01:FS02:0x21:Completed 4800000 out of 5000000 steps (96%) 18:12:16:WU01:FS02:0x21:Completed 4850000 out of 5000000 steps (97%) 18:15:37:WU01:FS02:0x21:Completed 4900000 out of 5000000 steps (98%) 18:18:59:WU01:FS02:0x21:Completed 4950000 out of 5000000 steps (99%) 18:22:21:WU01:FS02:0x21:Completed 5000000 out of 5000000 steps (100%) 18:22:22:WU00:FS02:Connecting to 65.254.110.245:8080 18:22:22:WU00:FS02:Assigned to work server 155.247.166.220 18:22:22:WU00:FS02:Requesting new work unit for slot 02: RUNNING gpu:1:GP104 [GeForce GTX 1070] 6463 from 155.247.166.220 18:22:22:WU00:FS02:Connecting to 155.247.166.220:8080 18:22:26:WU00:FS02:Downloading 6.06MiB 18:22:28:WU01:FS02:0x21:Saving result file logfile_01.txt 18:22:28:WU01:FS02:0x21:Saving result file checkpointState.xml 18:22:28:WU01:FS02:0x21:Saving result file checkpt.crc 18:22:28:WU01:FS02:0x21:Saving result file log.txt 18:22:28:WU01:FS02:0x21:Saving result file positions.xtc 18:22:28:WU01:FS02:0x21:Folding@home Core Shutdown: FINISHED_UNIT 18:22:29:WU01:FS02:FahCore returned: FINISHED_UNIT (100 = 0x64) 18:22:29:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:14196 run:16 clone:105 gen:5 core:0x21 unit:0x000000090002894b5d92469968d77abb 18:22:29:WU01:FS02:Uploading 19.39MiB to 155.247.166.219 18:22:29:WU01:FS02:Connecting to 155.247.166.219:8080 18:22:31:WU01:FS02:Upload complete 18:22:31:WU01:FS02:Server responded WORK_ACK (400) 18:22:31:WU01:FS02:Final credit estimate, 126789.00 points 18:22:31:WU01:FS02:Cleaning up
ASSOCIATE CODE : N3OP4FX27BEO113 (3-10% off EVGA.com purchases) | AFFILIATE/REWARDS CODE: K2LS6QIN0Y (EVGA product registration)
|
Cool GTX
EVGA Forum Moderator
- Total Posts : 31005
- Reward points : 0
- Joined: 2010/12/12 14:22:25
- Location: Folding for the Greater Good
- Status: offline
- Ribbons : 122
Re: Download Fails to Complete
2019/10/21 12:16:31
(permalink)
Rebooted your Router ? I've had this happen .... sometimes even have to restart the PC & on occasion clear the "WU files" - or it just sticks there ... like 90% downloaded There were some server issues a little while ago on the F@H side of things ... very slow download if I remember correctly
|
troy8d
CLASSIFIED Member
- Total Posts : 2816
- Reward points : 0
- Joined: 2010/10/16 08:10:22
- Status: offline
- Ribbons : 10
Re: Download Fails to Complete
2019/10/21 12:27:17
(permalink)
Its been happening far too often the past few weeks, impacting my ability to fold at least 8 days of the past 16 days or so...
ASSOCIATE CODE : N3OP4FX27BEO113 (3-10% off EVGA.com purchases) | AFFILIATE/REWARDS CODE: K2LS6QIN0Y (EVGA product registration)
|
planetclown
FTW Member
- Total Posts : 1692
- Reward points : 0
- Joined: 2010/03/02 07:59:51
- Status: offline
- Ribbons : 15
|
ProDigit
iCX Member
- Total Posts : 465
- Reward points : 0
- Joined: 2019/02/20 14:04:37
- Status: offline
- Ribbons : 4
Re: Download Fails to Complete
2019/10/21 21:23:30
(permalink)
FAH router 155.247.166.xxx is a campus router; where the network most likely is being abused by students (aka downloading/uploading stuff) causing network issues. We all suffer from it. All you can do is pay attention, as much as you can. The WUs that are processed, usually get credited to you. Where your system stalls is in successfully downloading a new WU. You can either delete the GPU slot, save, and reinsert it; hoping the system won't try to reassign you a new WU from the same server, or, If all GPUs are down, you can just force end (terminate/kill) all FAHClient tasks in taskmanager, and restart FAHClient. Take note: Pausing or restarting FAHControl or FAHClient won't solve the issue. A forced restart through taskmanager, or through slot removal (aka dumping) is currently the only known fix.
post edited by ProDigit - 2019/10/21 21:25:40
|
planetclown
FTW Member
- Total Posts : 1692
- Reward points : 0
- Joined: 2010/03/02 07:59:51
- Status: offline
- Ribbons : 15
Re: Download Fails to Complete
2019/10/22 05:25:46
(permalink)
ProDigit FAH router 155.247.166.xxx is a campus router; where the network most likely is being abused by students (aka downloading/uploading stuff) causing network issues. We all suffer from it. All you can do is pay attention, as much as you can. The WUs that are processed, usually get credited to you. Where your system stalls is in successfully downloading a new WU. You can either delete the GPU slot, save, and reinsert it; hoping the system won't try to reassign you a new WU from the same server, or, If all GPUs are down, you can just force end (terminate/kill) all FAHClient tasks in taskmanager, and restart FAHClient. Take note: Pausing or restarting FAHControl or FAHClient won't solve the issue. A forced restart through taskmanager, or through slot removal (aka dumping) is currently the only known fix.
Without an actual error message, it's difficult to pinpoint the exact cause. It'd be interesting to know whether other folders are experiencing a stall in work unit downloads. I haven't hit this issue (knock on wood).
EVGA Associates code: OLY2307BPM0MXZU Click for a discount on your next purchase from EVGA.com
|
Cool GTX
EVGA Forum Moderator
- Total Posts : 31005
- Reward points : 0
- Joined: 2010/12/12 14:22:25
- Location: Folding for the Greater Good
- Status: offline
- Ribbons : 122
Re: Download Fails to Complete
2019/10/22 05:30:52
(permalink)
I have seen this many times, in the Past ........ Folding stops, till I catch it like 2 - 6 hour later & then try to shake loose the bad server Basically "Stanford" need to add some sort or auto abort feature to downloads that stall for more than say 10 Min. That automatically move you to a different server / WU- preferably
|
troy8d
CLASSIFIED Member
- Total Posts : 2816
- Reward points : 0
- Joined: 2010/10/16 08:10:22
- Status: offline
- Ribbons : 10
Re: Download Fails to Complete
2019/10/22 05:47:25
(permalink)
planetclown Any chance you're on an older version? 7.5.1 is the latest.
I am using the latest version. This issue is happening daily and I am frustrated to the point I am considering stopping folding if it requires daily restarts/babysitting. I'm leaving things running 24/7 and its just idling on a hung download and my points are down significantly this month because of it.
ASSOCIATE CODE : N3OP4FX27BEO113 (3-10% off EVGA.com purchases) | AFFILIATE/REWARDS CODE: K2LS6QIN0Y (EVGA product registration)
|
notfordman
Omnipotent Enthusiast
- Total Posts : 10345
- Reward points : 0
- Joined: 2007/08/09 23:52:23
- Location: In a van, down by the
- Status: offline
- Ribbons : 28
Re: Download Fails to Complete
2019/10/22 10:17:59
(permalink)
Did you try rebooting your network? There has to be a solution, though I'm not the one with it. I hope it straightens out for you Troy. Also a great suggestion made by CoolGTX, for future improvement.
post edited by notfordman - 2019/10/22 10:20:04
|
STR1D3R_2
FTW Member
- Total Posts : 1431
- Reward points : 0
- Joined: 2017/09/15 16:13:53
- Location: Hudson Valley NY
- Status: offline
- Ribbons : 13
|
SM-71
iCX Member
- Total Posts : 292
- Reward points : 0
- Joined: 2010/08/26 09:51:54
- Status: offline
- Ribbons : 8
Re: Download Fails to Complete
2019/10/22 17:26:03
(permalink)
I've had several failed or EXTREMELY slow downloads this month, and it's ONLY with F @ H. This is happening to far to many people (based on the reports here and at the official F @ H forums) for it just to be coincidence. Seems like something happening with the client, but I usually have to reboot the computer to get back to normal speeds from Stanford - shutting down client & restarting doesn't fix the problem. What I'm seeing is <100Kbps downloads from Stanford when this happens, yet while this is happening, speedtest show's I'm at 25-30Mbps down / 2.5-3Mbps up, and pings to google are in the 30-40ms range, so it's not internet service or connections on my end.
post edited by SM-71 - 2019/10/22 17:30:52
Rebuild 2.0 Specs: Phantek's Enthoo Pro Full Tower case * Gigabyte Z690 Gaming X DDR4 motherboard * Intel i9-13900KS CPU with Kraken X63 AIO * WIN 11 PRO 64bit * MSI 4070 Ti Gaming X Trio GPU * Corsair Vengeance 64GB(4x16GB) RAM * Solidigm P44 Pro 2TB M.2 NVMe SSD (Win11 Pro) + Intel 665p 1TB M.2 NVMe (storage) + Samsung 990 Pro 2TB M.2 NVMe (storage) + Samsung 980 1TB M.2 NVMe (Ubuntu) * Seasonic Vertex GX-1200 1200W ATX 3.0 PSU * Samsung 50 inch QN90A 4K TV/monitor * FANS: Bitfenix Spectre Pro 200mm front intake + 2x Noctua NF-A14 Industrial PPC 140mm exhaust on Kraken X63 radiator + 1 Noctua NF-A12 120mm rear intake
|
DrSchmidt
New Member
- Total Posts : 44
- Reward points : 0
- Joined: 2019/03/16 19:36:16
- Status: offline
- Ribbons : 0
Re: Download Fails to Complete
2019/10/22 18:47:48
(permalink)
I believe the 155.247.166.219 & 155.247.166.220 servers are causing the slow upload and download timeout problems for everyone. When recently rebooted, the servers work okay, but after a day or two of up time, they kick back errors and WU stalls. When this happens, the other servers can become overloaded. The fix on my end has been completely halting and restarting the FAH software, which is inconvenient, frustrating and it doesn't always work the first time. https://apps.foldingathome.org/serverstats shows the up time of all of the assign and collection servers. When Temple hits 2 or 3 days continuously up, the problems get bad. It's frustrating because it's such a stupid problem to have. Both the client software and servers should have a workaround. At the very least, just reboot the stacks every 2 days at 3:30 in the morning. I've been looking at going over to the crunching projects but don't have time to figure out all of the add'l accounts, despite the great guides posted by BCav and others. Will just wait it out a little longer before seriously pushing into something else.
Ryzen 7 3700X; RTX 2070 Super EVGA Black GamingGTX 1660ti MSI Armor 6G OC 6GbAsus AM4 Tuf Gaming Plus Wifi x570
|
bill1024
Omnipotent Enthusiast
- Total Posts : 11110
- Reward points : 0
- Joined: 2008/10/18 01:01:10
- Status: offline
- Ribbons : 65
Re: Download Fails to Complete
2019/10/22 21:42:49
(permalink)
Dr.Schmidt you are welcome to come over and crunch some CPU tasks with the BOINC team. It's really not that hard, "If I can do it..." We try to stay active with challenges and sprints. Many people who fold also crunch. Do as much or as little as you like. Only do one project, or do more. If not no worries, I was hesitant to try it for quite a while.
Life is too short to carry a cheap pocket knife
|
DrSchmidt
New Member
- Total Posts : 44
- Reward points : 0
- Joined: 2019/03/16 19:36:16
- Status: offline
- Ribbons : 0
Re: Download Fails to Complete
2019/10/22 22:00:56
(permalink)
Thanks for the friendly welcome, Bill; I'll definitely commit to check it out further.
Ryzen 7 3700X; RTX 2070 Super EVGA Black GamingGTX 1660ti MSI Armor 6G OC 6GbAsus AM4 Tuf Gaming Plus Wifi x570
|
kougar
CLASSIFIED Member
- Total Posts : 3034
- Reward points : 0
- Joined: 2006/05/08 10:11:19
- Status: offline
- Ribbons : 22
Re: Download Fails to Complete
2019/10/23 00:23:09
(permalink)
Been getting this myself so it is Definitely an issue with Stanford's servers. The F@H client itself shows as running in the systray so there's no visual clue it's stuck on a download and actually idle. Restarting the program will usually restart the download but it often gets stuck around ISDN speeds.
Have water, will cool.
|
castrator86
SSC Member
- Total Posts : 816
- Reward points : 0
- Joined: 2010/07/24 09:33:21
- Status: offline
- Ribbons : 2
Re: Download Fails to Complete
2019/10/23 07:09:48
(permalink)
I was having this problem very frequently. I had to completely remove all my WU folders in AppData and completely re-install the [link=mailto:F@H]F@H[/link] client and it's been much better lately.
|
chrebean1
SSC Member
- Total Posts : 749
- Reward points : 0
- Joined: 2012/10/26 13:20:13
- Location: Colorado
- Status: offline
- Ribbons : 2
Re: Download Fails to Complete
2019/10/23 11:52:51
(permalink)
I turn off my combo cable modem/router for at least 10-15 minutes each week to flush the memory cache before restarting; seems to help somewhat. Kind of like restarting your smartphone for the same purpose. Otherwise, as others have posted here, the download problems reside with the [link=mailto:f@h]f@h[/link] servers. Just hope that Stanford, Temple, and other server locations resolve these issues, or it's going to be an interesting Time Zone Challenge coming up.
Fool me once, shame on you. Fool me twice, shame on me.
|
ProDigit
iCX Member
- Total Posts : 465
- Reward points : 0
- Joined: 2019/02/20 14:04:37
- Status: offline
- Ribbons : 4
Re: Download Fails to Complete
2019/10/23 12:09:34
(permalink)
most of the PC restart procedures work, because FAH is downloading a new WU. Maybe on the same slow server, that just happened to be less congested, a WU can come through. Or maybe because the client has been assigned a WU from a different (faster) server. All your system needs, is to remove FAHClient's CUDA/OpenCL workload threads or processes from it's memory, as well as to restart the client; to request a new WU. Just restarting the client in most cases won't work, when the GPU is still stuck with previous WU folding data. These processes can be killed in Taskmanager in Windows, or an equivalent in Linux; or through a reboot or hard reset (since a normal reboot might take a while, with those threads still working in the background). Once those processes are killed, and the client is rebooted, it will automatically try to download a different WU.
post edited by ProDigit - 2019/10/23 12:11:32
|
drougnor
CLASSIFIED Member
- Total Posts : 2715
- Reward points : 0
- Joined: 2006/07/18 05:57:59
- Location: FL USA /Affiliate MCK692UUS /Assoc HPW7E9T81P8KCCH
- Status: offline
- Ribbons : 18
Re: Download Fails to Complete
2019/10/26 11:22:51
(permalink)
|
Cool GTX
EVGA Forum Moderator
- Total Posts : 31005
- Reward points : 0
- Joined: 2010/12/12 14:22:25
- Location: Folding for the Greater Good
- Status: offline
- Ribbons : 122
Re: Download Fails to Complete
2019/10/27 19:13:44
(permalink)
Thanks d
|
ProDigit
iCX Member
- Total Posts : 465
- Reward points : 0
- Joined: 2019/02/20 14:04:37
- Status: offline
- Ribbons : 4
Re: Download Fails to Complete
2019/10/29 13:49:48
(permalink)
Should be well fixed by now! :)
|
DrSchmidt
New Member
- Total Posts : 44
- Reward points : 0
- Joined: 2019/03/16 19:36:16
- Status: offline
- Ribbons : 0
Re: Download Fails to Complete
2019/10/30 19:30:47
(permalink)
Most of my DL/UL errors have been resolved this week; hopefully, it will stay that way.
Ryzen 7 3700X; RTX 2070 Super EVGA Black GamingGTX 1660ti MSI Armor 6G OC 6GbAsus AM4 Tuf Gaming Plus Wifi x570
|
castrator86
SSC Member
- Total Posts : 816
- Reward points : 0
- Joined: 2010/07/24 09:33:21
- Status: offline
- Ribbons : 2
Re: Download Fails to Complete
2019/11/07 06:16:26
(permalink)
Aaand it's back again. My machine's been idle the past 12 hours failing to download a WU & I didn't notice it until I arrived at work.
|
bain64
Superclocked Member
- Total Posts : 142
- Reward points : 0
- Joined: 2011/07/13 11:15:56
- Status: offline
- Ribbons : 0
Re: Download Fails to Complete
2019/11/07 06:48:01
(permalink)
Download fails here too, just to let you know you're not alone.
|
Cool GTX
EVGA Forum Moderator
- Total Posts : 31005
- Reward points : 0
- Joined: 2010/12/12 14:22:25
- Location: Folding for the Greater Good
- Status: offline
- Ribbons : 122
Re: Download Fails to Complete
2019/11/07 08:23:28
(permalink)
bain64 Download fails here too, just to let you know you're not alone.
+1 yep
|
STR1D3R_2
FTW Member
- Total Posts : 1431
- Reward points : 0
- Joined: 2017/09/15 16:13:53
- Location: Hudson Valley NY
- Status: offline
- Ribbons : 13
Re: Download Fails to Complete
2019/11/07 15:45:21
(permalink)
+2 took a look at my logs and saw quite a few of those. They seem to have been short holdups for me as the ppd has not dropped dramatically.
Affiliate code E1HEL4HYPS
|