Associate
F@H Clinent Monitoring Service via Web
#-----------------------------------------------------------------------------------------------------------------------------------#
#
# Title: Folding at Home Client Monitoring via Web-Service
# Website: www.hpcmon.com
# Author: ke1ha, [COLOR="Cyan"][email protected][/COLOR]
# Doc Version: v0.1.0-BBS
# Date: 06-FEB-2010
# Purpose: Enable monitoring of FAH Clinets remotely via any accessable web-server
#
# Specific Credits ( all renderd web content ):
# GNU HFM.net - Ryan Harlamert 2009, David Rawling 2006-2007
#
# GNU Free Documentation License Version 1.3, 3 November 2008
# Copyright (C) 2007 Free Documentation Foundation, Inc. <http://fsf.org/>
#
# Permission is granted to copy, distribute and/or modify this document
# under the terms of the GNU Free Documentation License, Version 1.3
# or any later version published by the Free Software Foundation
# with no Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts
#
#-----------------------------------------------------------------------------------------------------------------------------------#
Overview
Here is what it does: FAHUSER <-- May be Offline During testing Periods
If your like me, and you don't spend your life in front of a computer, but your passionate about Distributed Computing, and the
status of your investiment (e.g. your PPD ), this Service and How-Too is for you. At the moment, this is limited to OCUK Team-10
members only, but if the trial is sucessfull I'll roll it out to other FAH-users.
What Is The Service
It's a way to monitor your "FAH Clinet Status / WU Info / Client Logs" (Windows, Linux, Mac, no PS3) via a web-server which can be
from anywhere, not just your home / work network. It uses the web-content generated from an outstanding product called HFM.NET,
by Ryan Harlamert.
By eanbling web-sycnronization, you can monitor your clients via any web-enabled device, be it Mobile Phone, Laptops, PDA, anything
that allows you to browse the internet. It does not use a Proxy Server (for many reasons), all content tranmission to the server is
encyypted & sent via SSL.
The following How-To will describe a minimal setup for transfering HFM.net generated client pages to a web-server. As with most things
in the computing world, there are many ways to do things, this is just one of hundreds of methods.
General Informaiton:
Before we begin, do yourself and me a favor, read the entire How-Too first and in particular, the method you elect to emply a couple
of times before you start. There's allot to be learned from the whole process aside from just rendering a web-page and will certainly
save you allot of frustration in getting things working.
Disclaimer: I believe there is minimal if any risk in this How-Too, but in today's day & age, one must cover all aspects. By
following this How-Too, you do so on your own accord. I can make no gaurentee nor warranty this process in any manner, and you take
full responsibility for any and all action taken. As with any software installtion / procedure, you should "Backup Your Data"
before doing anything.
Security: To use this service, you have to provide an e-mail address and initial password. This informaiton will "NOT" be used,
sold or redistributed in any way other than to communicate with those participating in the use of the service itself. Every attempt
has been made to protect your informaiton and the resources of the server itself. Any any attmept to compromise the integrity of the
server, intentionally deplete it's resources, or compromise users informaiton will result in being band from it's use, accounts
terminated and blacklisted to relevant authoritys within the computing industry. Basically, use it for it's intended purpose.
What's Needed From The User
-- Email Requesting Web-Service Account:
-- Send To: [email protected]:
-- Subject: HPCMON Account Request
-- Desired User Name: ( Your FAH Username to Prevent Duplicates )
-- Pawwords: Will Be Set By The Server For Higher Security
Setting up HFM.net for rsync Transfers
Background: To use HFM.net, you need to install it in a Windows enviroment. I've installed and tested HFM.net on three diffrent
Windows platforms, Win-Vista-64, Win-Vista-32 and Win-XP-Pro-32. I've not installed HFM.net in a Linux-Wine enviroment, but will be
testing that in the comming weeks. I believe it should also work for Win-7-64 but have no way of testing that it at the moment.
For the purpose of this guide, I will be addressing the How-Too from a typical Windows Home Network standpoint using a Linux
installed F@H node as the file server, rsync server and F@H comupte node. You only need appromiately 10MB of disk space to store
the HFM.net files, and that would be for allot of nodes => 30+ with very large FAHlog.txt files. My current farm is 12 compute nodes
and the disk space required is =< 3MB total, with several log files greater that 100K each.
What you need hardware wise:
** At least one PC running HFM.net applicaiton.
** A PC to house and send HFM.net created pages (can both be the same PC)
** A funtional LAN enviroment ( Wired or Wireless )
** A persistent internet connection is highly recommended, but not required if you schedule your sync's accordingly.
At this point, you need to make a descicion on which way you want to proceed, as that will dictate how the
install & configuraiton proceeds. Method-1 is the easiest to emplement / administer and will be covered first.
** Method-1: Windows PC Running HFM.net + Linux Machine, native or VMware Install ( Recommended Method )
** Method-2: Windows PC Running HFM.net - (No Linux Available) + CWrsync ( workes but can be tricky to set up )
** Method-3: Windows PC Running HFM.net - (No Linux Available) + Cygwin Minimal Install + rsync ( same complexity as CWrsync if not more so )
Part-1: Setup with Windows and Linux ( native or VMware ):
Download the following applicaitons:
- HFM.net Latest Version: HFM.net 0.4.8
- PuTTY SSH Tools: PuTTY SSH Tools
- A HPCMON account. E-Mail [COLOR="Cyan"][email protected][/COLOR] or you can use your own web-server account, your choice.
NOTE(s):
a). There are 7 Files in the putty.zip file, we're only going to use PuttySSH to talk with out Linux machines at first.
b). PuTTY does not require installation, just unzip it to a folder and it's ready to run.
c). This setup will be based on an account at hpcmon.com, but you could be set this up on your own hosting service.
For this Example Installation I will be using a typical home network enviroment, an using this following abbreviation(s):
- Network: Typical Home DHCP / Home Router LAN Wired or Wireless (static IP addresses are a plus, but not needed)
- src_pc = Windows-Vista-64 Desktop for HFM.net
- fs_srv = Laptop with Ubuntu 9.10 Desktop version / Samba, rsync and openssh-server installed, also used as the file server.
- web_server = fahuser.hpcmon.com
- web_svr_un = fahuser
- web_svr_pw = I will keep that private for the time being
- fah_nodes = various Windows GPU+CPU and Linux GPU+CPU 12 Nodes in total.
Part-1-1: Windows HFM.net Installtion & Setup:
a). Browse to where you downloaded HFM.net and run the instller.
b). Use all the default settings, we will confiure things after installation.
c). If HFM.net is not already running, start the program.
d). If your not using FaHMon, you will have to add your clients manually. I used my FaHMon client config and imported it to HFM.
--> File >> Import FaHMon Configuration File.
--> Then save your new configuraiton file to HFM's directory.
e). Configure HFM under Edit >> Prefrences
--> [ Scheduled Tasks TAB] - Under Refresh Client Data, I've found these to work pretty well, but it's your choice here.
--> [ Web Generation ] - This is where you set your refresh interval of the web pages.
--> [ After Full refresh ] - Set this toption for now.
--> [ Target Folder or URL ] Set locally C:\FAH\HFM\Myfolding
--> [ After Full Refresh ] Tool Bar >> Clients >> Refresh All or HIT-F6.
--> Check that your gerrting Web-Content and Browse to C"\FAH\HFM\Myfolding .. you should see some files in there.
f). [ Startup TAB ] - Select Auto Start on Windows Start, Run Minimized. Also, here's where you select your config file from Step-1-d.
g). [ Web Settings TAB ]
--> Set your EOC ID + username + Team Number.
--> Everyone has an EOC ID, it's automatically generated. goto: EOC
--> Under Name Search, add your F@H username, search and when you come up, click your username.
--> Once you've clicked on your user name you will find your EOC ID. It's the last 5 or 6 digits on the Adress line in IE or FF.
--> Enter that ID in HFM, and you can test it with Clicking on the [ Test EOC ID ] on the Web Settings Tab.
--> While your on Web Settings, add in the psumary url for Stanford.
--> Do not use the Web Proxy Settings for the hpcmon process, it's extremely High bandwidth usage.
--> That's it for Web Settings. If you want to change the way the color of the web pages, click on [ Web Visual Styles ].
--> Click "OK" and that should set up all you need initially in HFM Prefrences.
END of HFM Install & Setup.
#-----------------------------------------------------------------------------------------------------------------------------------#
#
# Title: Folding at Home Client Monitoring via Web-Service
# Website: www.hpcmon.com
# Author: ke1ha, [COLOR="Cyan"][email protected][/COLOR]
# Doc Version: v0.1.0-BBS
# Date: 06-FEB-2010
# Purpose: Enable monitoring of FAH Clinets remotely via any accessable web-server
#
# Specific Credits ( all renderd web content ):
# GNU HFM.net - Ryan Harlamert 2009, David Rawling 2006-2007
#
# GNU Free Documentation License Version 1.3, 3 November 2008
# Copyright (C) 2007 Free Documentation Foundation, Inc. <http://fsf.org/>
#
# Permission is granted to copy, distribute and/or modify this document
# under the terms of the GNU Free Documentation License, Version 1.3
# or any later version published by the Free Software Foundation
# with no Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts
#
#-----------------------------------------------------------------------------------------------------------------------------------#
Overview
Here is what it does: FAHUSER <-- May be Offline During testing Periods
If your like me, and you don't spend your life in front of a computer, but your passionate about Distributed Computing, and the
status of your investiment (e.g. your PPD ), this Service and How-Too is for you. At the moment, this is limited to OCUK Team-10
members only, but if the trial is sucessfull I'll roll it out to other FAH-users.
What Is The Service
It's a way to monitor your "FAH Clinet Status / WU Info / Client Logs" (Windows, Linux, Mac, no PS3) via a web-server which can be
from anywhere, not just your home / work network. It uses the web-content generated from an outstanding product called HFM.NET,
by Ryan Harlamert.
By eanbling web-sycnronization, you can monitor your clients via any web-enabled device, be it Mobile Phone, Laptops, PDA, anything
that allows you to browse the internet. It does not use a Proxy Server (for many reasons), all content tranmission to the server is
encyypted & sent via SSL.
The following How-To will describe a minimal setup for transfering HFM.net generated client pages to a web-server. As with most things
in the computing world, there are many ways to do things, this is just one of hundreds of methods.
General Informaiton:
Before we begin, do yourself and me a favor, read the entire How-Too first and in particular, the method you elect to emply a couple
of times before you start. There's allot to be learned from the whole process aside from just rendering a web-page and will certainly
save you allot of frustration in getting things working.
Disclaimer: I believe there is minimal if any risk in this How-Too, but in today's day & age, one must cover all aspects. By
following this How-Too, you do so on your own accord. I can make no gaurentee nor warranty this process in any manner, and you take
full responsibility for any and all action taken. As with any software installtion / procedure, you should "Backup Your Data"
before doing anything.
Security: To use this service, you have to provide an e-mail address and initial password. This informaiton will "NOT" be used,
sold or redistributed in any way other than to communicate with those participating in the use of the service itself. Every attempt
has been made to protect your informaiton and the resources of the server itself. Any any attmept to compromise the integrity of the
server, intentionally deplete it's resources, or compromise users informaiton will result in being band from it's use, accounts
terminated and blacklisted to relevant authoritys within the computing industry. Basically, use it for it's intended purpose.
What's Needed From The User
-- Email Requesting Web-Service Account:
-- Send To: [email protected]:
-- Subject: HPCMON Account Request
-- Desired User Name: ( Your FAH Username to Prevent Duplicates )
-- Pawwords: Will Be Set By The Server For Higher Security
Setting up HFM.net for rsync Transfers
Background: To use HFM.net, you need to install it in a Windows enviroment. I've installed and tested HFM.net on three diffrent
Windows platforms, Win-Vista-64, Win-Vista-32 and Win-XP-Pro-32. I've not installed HFM.net in a Linux-Wine enviroment, but will be
testing that in the comming weeks. I believe it should also work for Win-7-64 but have no way of testing that it at the moment.
For the purpose of this guide, I will be addressing the How-Too from a typical Windows Home Network standpoint using a Linux
installed F@H node as the file server, rsync server and F@H comupte node. You only need appromiately 10MB of disk space to store
the HFM.net files, and that would be for allot of nodes => 30+ with very large FAHlog.txt files. My current farm is 12 compute nodes
and the disk space required is =< 3MB total, with several log files greater that 100K each.
What you need hardware wise:
** At least one PC running HFM.net applicaiton.
** A PC to house and send HFM.net created pages (can both be the same PC)
** A funtional LAN enviroment ( Wired or Wireless )
** A persistent internet connection is highly recommended, but not required if you schedule your sync's accordingly.
At this point, you need to make a descicion on which way you want to proceed, as that will dictate how the
install & configuraiton proceeds. Method-1 is the easiest to emplement / administer and will be covered first.
** Method-1: Windows PC Running HFM.net + Linux Machine, native or VMware Install ( Recommended Method )
** Method-2: Windows PC Running HFM.net - (No Linux Available) + CWrsync ( workes but can be tricky to set up )
** Method-3: Windows PC Running HFM.net - (No Linux Available) + Cygwin Minimal Install + rsync ( same complexity as CWrsync if not more so )
Part-1: Setup with Windows and Linux ( native or VMware ):
Download the following applicaitons:
- HFM.net Latest Version: HFM.net 0.4.8
- PuTTY SSH Tools: PuTTY SSH Tools
- A HPCMON account. E-Mail [COLOR="Cyan"][email protected][/COLOR] or you can use your own web-server account, your choice.
NOTE(s):
a). There are 7 Files in the putty.zip file, we're only going to use PuttySSH to talk with out Linux machines at first.
b). PuTTY does not require installation, just unzip it to a folder and it's ready to run.
c). This setup will be based on an account at hpcmon.com, but you could be set this up on your own hosting service.
For this Example Installation I will be using a typical home network enviroment, an using this following abbreviation(s):
- Network: Typical Home DHCP / Home Router LAN Wired or Wireless (static IP addresses are a plus, but not needed)
- src_pc = Windows-Vista-64 Desktop for HFM.net
- fs_srv = Laptop with Ubuntu 9.10 Desktop version / Samba, rsync and openssh-server installed, also used as the file server.
- web_server = fahuser.hpcmon.com
- web_svr_un = fahuser
- web_svr_pw = I will keep that private for the time being
- fah_nodes = various Windows GPU+CPU and Linux GPU+CPU 12 Nodes in total.
Part-1-1: Windows HFM.net Installtion & Setup:
a). Browse to where you downloaded HFM.net and run the instller.
b). Use all the default settings, we will confiure things after installation.
c). If HFM.net is not already running, start the program.
d). If your not using FaHMon, you will have to add your clients manually. I used my FaHMon client config and imported it to HFM.
--> File >> Import FaHMon Configuration File.
--> Then save your new configuraiton file to HFM's directory.
e). Configure HFM under Edit >> Prefrences
--> [ Scheduled Tasks TAB] - Under Refresh Client Data, I've found these to work pretty well, but it's your choice here.
--> [ Web Generation ] - This is where you set your refresh interval of the web pages.
--> [ After Full refresh ] - Set this toption for now.
--> [ Target Folder or URL ] Set locally C:\FAH\HFM\Myfolding
--> [ After Full Refresh ] Tool Bar >> Clients >> Refresh All or HIT-F6.
--> Check that your gerrting Web-Content and Browse to C"\FAH\HFM\Myfolding .. you should see some files in there.
f). [ Startup TAB ] - Select Auto Start on Windows Start, Run Minimized. Also, here's where you select your config file from Step-1-d.
g). [ Web Settings TAB ]
--> Set your EOC ID + username + Team Number.
--> Everyone has an EOC ID, it's automatically generated. goto: EOC
--> Under Name Search, add your F@H username, search and when you come up, click your username.
--> Once you've clicked on your user name you will find your EOC ID. It's the last 5 or 6 digits on the Adress line in IE or FF.
--> Enter that ID in HFM, and you can test it with Clicking on the [ Test EOC ID ] on the Web Settings Tab.
--> While your on Web Settings, add in the psumary url for Stanford.
--> Do not use the Web Proxy Settings for the hpcmon process, it's extremely High bandwidth usage.
--> That's it for Web Settings. If you want to change the way the color of the web pages, click on [ Web Visual Styles ].
--> Click "OK" and that should set up all you need initially in HFM Prefrences.
END of HFM Install & Setup.
Last edited: