VMware && Linux bigadv folding

Page: << < ..2627282930.. > >> Showing page 30 of 32
Author
linuxrouter
Omnipotent Enthusiast
  • Total Posts : 8043
  • Reward points : 0
  • Joined: 2008/02/28 14:47:45
  • Status: offline
  • Ribbons : 102
Re:VMware 3.0 && bigadv folding 2011/03/04 13:51:55 (permalink)
Barbarossa
I just found 2 more HDDs. So I think I´ll use your Image twice for native and twice for
Ubuntu. No need to "waste" cpu cycles on a vm. Then, after a while, I´ll see what I end up with 

 
I made this more detailed guide about a year ago:
 
Link
 
The first part has some screenshots for the native image installation via the CD. I also have a raw disk image you can use to write the image to a hard disk using another tool of your choice.

CaseLabs M-S8 - ASRock X99 Pro - Intel 5960x - XSPC WC - EVGA 980 Ti Hybrid - Samsung 950 512GB - EVGA 1600w Titanium
Affiliate Code: OZJ-0TQ-41NJ
Barbarossa
CLASSIFIED ULTRA Member
  • Total Posts : 5316
  • Reward points : 0
  • Joined: 2008/01/28 11:43:24
  • Status: offline
  • Ribbons : 25
Re:VMware 3.0 && bigadv folding 2011/03/04 20:49:11 (permalink)
Thanks Linuxrouter!

 
     My affiliate code
 
Biffa
New Member
  • Total Posts : 15
  • Reward points : 0
  • Joined: 2009/09/30 13:45:24
  • Status: offline
  • Ribbons : 0
Re:VMware 3.0 && bigadv folding 2011/03/29 06:00:36 (permalink)
Hi Linuxrouter.
Thanks for updating the image, got it working again, but thought you might like some feedback on the Vmware image. :)
 
1. the 7z archive on the page has a corrupt client archive in in (0 bytes) so it won't start ./fah6 (also probably why its only 40MB) The zip file is fine.
2. There seems to be something wrong with the Langouste client, as it errors out when you start it and the FAH client can't connect to localhost:8080, when I edit the client.cfg to change proxy to no it then connects to stanford.
 
Hope this helps mate, otherwise its shaved 2 minutes off a bigadv and added 4K to my PPD on a 2600K :)
 
linuxrouter
Omnipotent Enthusiast
  • Total Posts : 8043
  • Reward points : 0
  • Joined: 2008/02/28 14:47:45
  • Status: offline
  • Ribbons : 102
Re:VMware 3.0 && bigadv folding 2011/03/29 09:01:41 (permalink)
Thanks for the info. The client archive is actually downloaded from Stanford's site and extracted. I'll check the image when I get home this evening to see if something is wrong with the download process. I have already corrected the issue with starting Langouste. I set the USER variable in /etc/rc.d/rc.M file before starting Langouste before starting the service.
Biffa
New Member
  • Total Posts : 15
  • Reward points : 0
  • Joined: 2009/09/30 13:45:24
  • Status: offline
  • Ribbons : 0
Re:VMware 3.0 && bigadv folding 2011/03/29 09:16:52 (permalink)
Cheers mate
 
Like so?:
 



USER=autofah
# Start Langouste if enabled
. /etc/rc.d/rc.fah.conf
LPORT=8080
etc
etc
 

 
 
 
 
linuxrouter
Omnipotent Enthusiast
  • Total Posts : 8043
  • Reward points : 0
  • Joined: 2008/02/28 14:47:45
  • Status: offline
  • Ribbons : 102
Re:VMware 3.0 && bigadv folding 2011/03/29 09:31:06 (permalink)
Add a export in front of the USER, and you should be good to go.
 
export USER=fah
Biffa
New Member
  • Total Posts : 15
  • Reward points : 0
  • Joined: 2009/09/30 13:45:24
  • Status: offline
  • Ribbons : 0
Re:VMware 3.0 && bigadv folding 2011/03/29 14:38:29 (permalink)
Worked great, no errors on Langouste
 
However I'm getting some php errors when hitting submit on the config page:
 
 
Warning: fopen(/usr/local/fah/client.cfg) [function.fopen]: failed to open stream: Permission denied in /srv/httpd/htdocs/configfah.php on line 81

Warning: fwrite(): supplied argument is not a valid stream resource in /srv/httpd/htdocs/configfah.php on line 107

Warning: fclose(): supplied argument is not a valid stream resource in /srv/httpd/htdocs/configfah.php on line 108

Warning: Cannot modify header information - headers already sent by (output started at /srv/httpd/htdocs/configfah.php:81) in /srv/httpd/htdocs/configfah.php on line 267

linuxrouter
Omnipotent Enthusiast
  • Total Posts : 8043
  • Reward points : 0
  • Joined: 2008/02/28 14:47:45
  • Status: offline
  • Ribbons : 102
Re:VMware 3.0 && bigadv folding 2011/03/29 15:15:44 (permalink)
This happens when the folding client is configured manually. Apache web server no longer has access to the client.cfg file. To fix this error, run this command:
 
chown apache:apache client.cfg
Biffa
New Member
  • Total Posts : 15
  • Reward points : 0
  • Joined: 2009/09/30 13:45:24
  • Status: offline
  • Ribbons : 0
Re:VMware 3.0 && bigadv folding 2011/03/29 16:08:40 (permalink)
Gotcha cheers!
Biffa
New Member
  • Total Posts : 15
  • Reward points : 0
  • Joined: 2009/09/30 13:45:24
  • Status: offline
  • Ribbons : 0
Re:VMware 3.0 && bigadv folding 2011/04/04 06:22:42 (permalink)
Hi,
 
Not sure if this is a problem or not, its hard to tell whether these WU's are actually getting sent with the proxy etc.
 
Crunching well so far, but client is reporting upload issues with these errors one after another:
  
[08:37:03] + Attempting to send results [April 2 08:37:03 UTC]
[08:37:03] - Reading file work/wuresults_02.dat from core
[08:37:03] (Read 3523885 bytes from disk)
[08:37:03] Connecting to http://128.143.199.96:8080/
[08:37:03] - Couldn't send HTTP request to server
[08:37:03] + Could not connect to Work Server (results)
[08:37:03] (128.143.199.96:8080)
[08:37:03] + Retrying using alternative port
[08:37:03] Connecting to http://128.143.199.96:80/
[08:37:03] - Couldn't send HTTP request to server
[08:37:03] + Could not connect to Work Server (results)
[08:37:03] (128.143.199.96:80)
[08:37:03] - Error: Could not transmit unit 02 (completed April 2) to work server.
[08:37:03] - 1 failed uploads of this unit.
[08:37:03] Keeping unit 02 in queue.
[08:37:03] Trying to send all finished work units
[08:37:03] Project: 6978 (Run 0, Clone 47, Gen 29)


Eventually it goes to get a new WU, gets it and starts crunching, but you get this error related to the one it couldn't upload.

[14:00:29] - Autosending finished units... [April 2 14:00:29 UTC]  
[14:00:29] Trying to send all finished work units
[14:00:29] Project: 6978 (Run 0, Clone 47, Gen 29)
[14:00:29] - Error: Could not get length of results file work/wuresults_02.dat
[14:00:29] - Error: Could not read unit 02 file. Removing from queue.
[14:00:29] + Sent 0 of 1 completed units to the server
[14:00:29] - Autosend completed

post edited by Biffa - 2011/04/04 10:31:29
linuxrouter
Omnipotent Enthusiast
  • Total Posts : 8043
  • Reward points : 0
  • Joined: 2008/02/28 14:47:45
  • Status: offline
  • Ribbons : 102
Re:VMware 3.0 && bigadv folding 2011/04/04 11:45:45 (permalink)

Some errors are normal in the main folding log. There should be a separate Langouste log found in /tmp/langouste-fah. This log should let you know the status of the work unit transmission to the server.
 
Here is a sample from my Linux folding rig:
 
 root@FAH:/tmp/langouste-fah# more langouste-helper-1273.log  /tmp/langouste-fah/1273/clientdir 
processing work/wuresults_01.dat
unit number '01'
launching fah...

Note: Please read the license agreement (fah6 -license). Further
use of this software requires that you have read and accepted this agreement.



--- Opening Log file [March 21 09:55:31 UTC]


# Linux Console Edition #######################################################
###############################################################################

                       Folding@Home Client Version 6.34

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: /tmp/langouste-fah/1273/clientdir
Executable: /usr/local/fah/fah6
Arguments: -send 01

[09:55:31] - Ask before connecting: No
[09:55:31] - Proxy: localhost:8080
[09:55:31] - User name: linuxrouter (Team 111065)
[09:55:31] - Machine ID: 1
[09:55:31]
[09:55:31] Loaded queue successfully.
[09:55:31] Attempting to return result(s) to server...
[09:55:31] Project: 6965 (Run 0, Clone 4, Gen 6)
[09:55:31] - Read packet limit of 540015616... Set to 524286976.


[09:55:31] + Attempting to send results [March 21 09:55:31 UTC]
[09:56:10] + Results successfully sent
[09:56:10] Thank you for your contribution to Folding@Home.
[09:56:10] + Starting local stats count at 1

Folding@Home Client Shutdown.
unit 01 sent!
all done

post edited by linuxrouter - 2011/04/04 11:46:57

CaseLabs M-S8 - ASRock X99 Pro - Intel 5960x - XSPC WC - EVGA 980 Ti Hybrid - Samsung 950 512GB - EVGA 1600w Titanium
Affiliate Code: OZJ-0TQ-41NJ
linuxrouter
Omnipotent Enthusiast
  • Total Posts : 8043
  • Reward points : 0
  • Joined: 2008/02/28 14:47:45
  • Status: offline
  • Ribbons : 102
Re:VMware 3.0 && bigadv folding 2011/04/07 18:36:11 (permalink)

I have uploaded a new VMware image to my server. I also have an updated native image built but have not had a chance to test that one out yet so that one I'll post up later. The latest image has the export USER set in the init script to allow for startup of Langouste. I was able to successfully submit a work unit using Langouste.
 
There are a number of other updates that can be found in my changelog here.
 
A new feature of this image is that the folding system now has the ability to output in JSON format, system usage/health, detailed folding stats, and TPF history for each client. The JSON interface should make it possible to make custom web pages, signatures, etc. off the folding system. Here is a small web report I put together that uses the JSON from my native folding rig and prints up some details and graphs.
 
http://www.linuxforge.net/fahstat

 
MrAsh
ACX Member
  • Total Posts : 359
  • Reward points : 0
  • Joined: 2010/06/25 23:39:22
  • Location: Australia
  • Status: offline
  • Ribbons : 2
Re:VMware 3.0 && bigadv folding 2011/04/24 19:01:23 (permalink)
I am using your disk image on both my SR-2s and they are working great picked up about 30k PPD each from windows install, is tears "thekraken" affinity wrapper able to be used on this install? if it is would it be hard to do or would I just follow the guides the same as with a ubuntu install.


linuxrouter
Omnipotent Enthusiast
  • Total Posts : 8043
  • Reward points : 0
  • Joined: 2008/02/28 14:47:45
  • Status: offline
  • Ribbons : 102
Re:VMware 3.0 && bigadv folding 2011/04/25 12:16:28 (permalink)
I have not had a chance yet to try out tear's The Kraken affinity wrapper yet. I'll see if I can build the program and test it out with the image. I'll let you know what I can find. Thanks for the feedback.
MrAsh
ACX Member
  • Total Posts : 359
  • Reward points : 0
  • Joined: 2010/06/25 23:39:22
  • Location: Australia
  • Status: offline
  • Ribbons : 2
Re:VMware 3.0 && bigadv folding 2011/04/28 04:43:41 (permalink)
I had to restart my router due to config change and it appears my 2 linux boxes have decided to forget their IPs and are no longer showing up in the attatched devices of my router and cannot be found on their original IPs, I have tried running sudo dhclient but it doesn't appear to do anything do I need to shut down the folding client for it to work?? they are both half way through WUs and I dont want to lose them this far along.  If I leave them running will they try to get another IP when they attempt to upload and if not will it save the WU so I can shut down the client without worry of it losing the WU.


linuxrouter
Omnipotent Enthusiast
  • Total Posts : 8043
  • Reward points : 0
  • Joined: 2008/02/28 14:47:45
  • Status: offline
  • Ribbons : 102
Re:VMware 3.0 && bigadv folding 2011/04/28 09:42:14 (permalink)
You can restart the network connection with the following command:
 
/etc/rc.d/rc.inet restart
MrAsh
ACX Member
  • Total Posts : 359
  • Reward points : 0
  • Joined: 2010/06/25 23:39:22
  • Location: Australia
  • Status: offline
  • Ribbons : 2
Re:VMware 3.0 && bigadv folding 2011/04/28 12:54:30 (permalink)
Thanks I will try it.


alpineb1
New Member
  • Total Posts : 4
  • Reward points : 0
  • Joined: 2009/04/23 13:21:59
  • Status: offline
  • Ribbons : 0
Re:VMware 3.0 && bigadv folding 2011/05/07 19:56:02 (permalink)
Linuxrouter i would like to know something.
 
Which one is better to use, Virtual Box or Vmplayer ?!
Do i will have a better TPF by using one more than the other ?
 
Thanks
 
linuxrouter
Omnipotent Enthusiast
  • Total Posts : 8043
  • Reward points : 0
  • Joined: 2008/02/28 14:47:45
  • Status: offline
  • Ribbons : 102
Re:VMware 3.0 && bigadv folding 2011/05/10 09:49:37 (permalink)
alpineb1

Linuxrouter i would like to know something.

Which one is better to use, Virtual Box or Vmplayer ?!
Do i will have a better TPF by using one more than the other ?

Thanks


 
In the past, VMware performed better with the folding client. However, I just recently received this notice for a new build of Virtualbox that may help with some of the past stability and performance issues seen with bigadv. This is from a troubleticket I opened a two years back:
 
http://www.virtualbox.org/ticket/5292#comment:2
 
I tested out the new VB build and performance with bigadv in VB is not too far off from performance in native Linux.
alpineb1
New Member
  • Total Posts : 4
  • Reward points : 0
  • Joined: 2009/04/23 13:21:59
  • Status: offline
  • Ribbons : 0
Re:VMware 3.0 && bigadv folding 2011/05/10 12:00:29 (permalink)
Hi Linuxrouter.
 
I did have test with Virtualbox this week end. I can't remember exactly the version of that i have used. I think its 4.0.
But VB is very slower than VMplayer.
 
I have a 9 mins slower TPF in VB if i compare on VM player.
 
Anyway,
 
Thanks for your answer
 
linuxrouter
Omnipotent Enthusiast
  • Total Posts : 8043
  • Reward points : 0
  • Joined: 2008/02/28 14:47:45
  • Status: offline
  • Ribbons : 102
Re:VMware 3.0 && bigadv folding 2011/05/10 23:11:01 (permalink)
Hello,
The link I posted above has a link to build 4.0.7 that has not been posted to the Virtualbox site yet. It seems to have given a performance bump over previous versions from the limited testing I have been able to do so far.
farthestkris
CLASSIFIED Member
  • Total Posts : 4109
  • Reward points : 0
  • Joined: 2009/03/30 15:54:27
  • Location: Crunching Location .......... Location Not Found
  • Status: offline
  • Ribbons : 12
Re:VMware 3.0 && bigadv folding 2011/06/01 15:25:01 (permalink)
hi LR, what version would i use on a usb flash drive? 

 
 
 
linuxrouter
Omnipotent Enthusiast
  • Total Posts : 8043
  • Reward points : 0
  • Joined: 2008/02/28 14:47:45
  • Status: offline
  • Ribbons : 102
Re:VMware 3.0 && bigadv folding 2011/06/02 12:35:22 (permalink)
farthestkris

hi LR, what version would i use on a usb flash drive? 

   
Hello,
 
You could try and use my native image. I originally made it for use with hard disks. However, some people have successfully used the image with a USB flash drive. The main modification that needs to be made is that on bootup via LILO bootloader, an option needs to be added to the kernel to give the USB subsystem enough time to initialize the disk before attempting to mount the file system. Here is what to enter for that:
 
core2 rootdelay=15
 
This tells the kernel to wait 15-seconds before attempting to mount the file system. Replace core2, with whichever of the available kernels you choose to use. There will be ongoing writes against the USB flash drive since any new data is written directly to the drive.
linuxrouter
Omnipotent Enthusiast
  • Total Posts : 8043
  • Reward points : 0
  • Joined: 2008/02/28 14:47:45
  • Status: offline
  • Ribbons : 102
Re:VMware 3.0 && bigadv folding 2011/07/14 19:48:43 (permalink)
I have uploaded an updated native Linux folding image to my site. The changes are minimal. I think I have the reported Ethernet issue fixed. The image loaded the Ethernet okay on my i7 test platform. Also, I defaulted to EXT3 file system as this fs was reported to significantly reduce write times on work unit completion. I have not used EXT3 much since 2000 but hopefully it is still a decent file system. I also fixed the psummary downloaded script for the JSON parser as that was not working quite right with the latest psummary.
 
Also, several people have asked me for a USB stick version recently. I made a separate folding image for that. The only difference is that it adds the rootdelay to give the USB subsystem time to initialize the device before trying to mount the file system. The image booted okay on my 4GB USB stick.
mnparadox
FTW Member
  • Total Posts : 1136
  • Reward points : 0
  • Joined: 2009/03/19 20:31:11
  • Location: Minnesota
  • Status: offline
  • Ribbons : 6
Re:VMware 3.0 && bigadv folding 2011/07/22 06:16:56 (permalink)
Woot woot!  Thanks, linuxrouter!  I'll be trying the new image out soon.  I'll let you know if I run into any issues with the LAN ports on my P55 FTW (I had to tweak scripts on the 1.3.1 version to get ETH1 working since I don't have an ETH0).
 
I think I need to download the newest lmsensors as well.  I ran the sensors-detect and it only found one item, and it said that there was no software for it.  *shrug*  Right now, the only temp readings I am getting are from the LED on the MB (which only shows die temps, it doesn't show core temps like lmsensors should).
 
Thanks for your work on this, it's dang near exactly what I was looking for!  The minor little things I can script out myself.
linuxrouter
Omnipotent Enthusiast
  • Total Posts : 8043
  • Reward points : 0
  • Joined: 2008/02/28 14:47:45
  • Status: offline
  • Ribbons : 102
Re:VMware 3.0 && bigadv folding 2011/07/22 11:44:45 (permalink)
mnparadox

Woot woot!  Thanks, linuxrouter!  I'll be trying the new image out soon.  I'll let you know if I run into any issues with the LAN ports on my P55 FTW (I had to tweak scripts on the 1.3.1 version to get ETH1 working since I don't have an ETH0).

I think I need to download the newest lmsensors as well.  I ran the sensors-detect and it only found one item, and it said that there was no software for it.  *shrug*  Right now, the only temp readings I am getting are from the LED on the MB (which only shows die temps, it doesn't show core temps like lmsensors should).

Thanks for your work on this, it's dang near exactly what I was looking for!  The minor little things I can script out myself.

 
From a Google search, it looks like other people are having trouble finding the sensors with the EVGA P55. I know the EVGA x58 uses the Fintek (f71882fg) but I don't have a P55 board to check what this board uses. For the CPU core temps, give this a try:
 
modprobe coretemp
sensors -s
sensors
 
I'll see if I can find some more info on the P55. Thanks for the feedback.
mnparadox
FTW Member
  • Total Posts : 1136
  • Reward points : 0
  • Joined: 2009/03/19 20:31:11
  • Location: Minnesota
  • Status: offline
  • Ribbons : 6
Re:VMware 3.0 && bigadv folding 2011/07/22 14:16:30 (permalink)
linuxrouterFor the CPU core temps, give this a try:
modprobe coretemp
sensors -s
sensors

Worked like a champ!  Reports all four core temps.  I put the following into my personal status script:
 
modprobe coretemp
sensors -s
sensors | fgrep Core

That way, it dumps a nice, neat four-line list of the temps.
 
Here's what I got from the sensors-detect run:
Driver 'to-be-written':
  * ISA bus, address 0xa00
     Chip 'Fintek F71889FG Super IO Sensors' (confidence: 9)
Note: there is no driver for Fintek F71889FG Super IO Sensors yet.
Check http://www.lm-sensors.org/wiki/Devices for updates.

There is an entry for it on the http://www.lm-sensors.org/wiki/Devices site.
 
I'm still learning Linux... is it basically a download of the newest lm-sensors and try again, or is it more involved?
post edited by mnparadox - 2011/07/22 18:42:19
linuxrouter
Omnipotent Enthusiast
  • Total Posts : 8043
  • Reward points : 0
  • Joined: 2008/02/28 14:47:45
  • Status: offline
  • Ribbons : 102
Re:VMware 3.0 && bigadv folding 2011/07/26 11:53:11 (permalink)
mnparadox
Worked like a champ!  Reports all four core temps.  I put the following into my personal status script: 

modprobe coretemp
sensors -s
sensors | fgrep Core

That way, it dumps a nice, neat four-line list of the temps.

Here's what I got from the sensors-detect run:
Driver 'to-be-written':
* ISA bus, address 0xa00
    Chip 'Fintek F71889FG Super IO Sensors' (confidence: 9)
Note: there is no driver for Fintek F71889FG Super IO Sensors yet.
Check http://www.lm-sensors.org/wiki/Devices for updates.

There is an entry for it on the http://www.lm-sensors.org/wiki/Devices site.

I'm still learning Linux... is it basically a download of the newest lm-sensors and try again, or is it more involved?

 
Glad you got the core temps working. From looking at the kernel modules, module f71882fg supports these devices:
 
F71808E/A
F71858FG
F71862FG
F71863FG
F71869F/E/A
F71882FG
F71883FG
F71889FG/ED/A
F8000
F81801U
F81865F
 
You could try this:
 
modprobe f71882fg
sensors -s
 
It may require an lmsensors upgrade as well. I'll look into that.
linuxrouter
Omnipotent Enthusiast
  • Total Posts : 8043
  • Reward points : 0
  • Joined: 2008/02/28 14:47:45
  • Status: offline
  • Ribbons : 102
Re:VMware 3.0 && bigadv folding 2011/07/26 11:59:35 (permalink)
A couple updates:
 
I uploaded a new Virtualbox image that has most of the same updates that the latest VMware image has and the latest vbox-additions of version 4.1. The latest Virtualbox is reported to perform much better on multi-socket systems so it may be worth trying out Virtualbox again if you are using VMware and if you have more than 8-cores in Windows.
 
Secondly, I finally got around to putting a MySQL DB behind my bonus point calculator. The projects will now sync nightly so that the project list is updated on a regular basis and I can still manually add projects that do not show up right away on psummary. Also, since I have the projects in a DB now, I put up a couple links for exporting the projects to JSON or XML, which should be easier to parse than HTML. It uses the same DB as the calc so is only updated once a day.
Biffa
New Member
  • Total Posts : 15
  • Reward points : 0
  • Joined: 2009/09/30 13:45:24
  • Status: offline
  • Ribbons : 0
Re:VMware 3.0 && bigadv folding 2011/07/27 11:23:03 (permalink)
Trying 1.4.0 Vbox version out on Virtualbox 4.1, however am having a few problems.
 
1. http service isn't working on
2. SMB is asking for a password when I try and browse to \\ip\fah
 
Not sure if its using BFS as stock as when I did a dmesg |grep BFS it came back with the BFS message. Can you confirm 1.4.0 is BFS?
 
Thanks mate
 
post edited by Biffa - 2011/07/27 11:24:38
Page: << < ..2627282930.. > >> Showing page 30 of 32
Jump to:
  • Back to Mobile