Hadoop On Windows 7 With Eclipse

Here i will try to install Hadoop on my windows 7 machine and post along the progress and / or issue i face during same.

Pre Requisite
I already had following installed on my machine

1. jdk1.7.0_07
2. Eclipse Juno

 Instead of going with lower versions of either i decided to go ahead with the above versions.

Next Step : Install Cygwin
   
What is it?
The Cygwin tools are ports of the popular GNU development tools for Microsoft Windows. They run thanks to the Cygwin library which provides the POSIX system calls and environment these programs expect.

With these tools installed, it is possible to write Windows console or GUI applications that make use of significant parts of the POSIX API. As a result, it is possible to easily port many Unix programs without the need for extensive changes to the source code.

Is it free software?
Yes.

Where Can i get it
http://cygwin.com/

What versions of Windows are supported?
Cygwin can be expected to run on all modern 32 bit versions of Windows This includes, as of the time of writing this, Windows 2000, Windows XP, Windows Server 2003, Windows Vista, Windows Server 2008, Windows 7, as well as the WOW64 32 bit environment on released 64 bit versions of Windows (XP/2003/Vista/2008/7/2008 R2).

There you go ... i have a 64 bit machine.. lets see how it goes!!

Steps to install
Check out this post for more details

Next Step : Set Environment Variables

1. The next step is to set up the PATH environment variable so that Eclipse IDE can access Cygwin commands
2. Find "My Computer" icon either on the desktop or in the start menu, right-click on it and select Properties item from the menu.
3. When you see the Properties dialog box, click on the Environment Variables button as shown below
4. When Environment Variables dialog shows up, click on the Path variable located in the System Variables box and then click the Edit button
5. When Edit dialog appears append the following text to the end of the Variable value field:
6. ;c:\cygwin\bin;c:\cygwin\usr\bin 

 Note: If you installed cygwin in the non-standard location, correct the above value accordingly.

Close all three dialog boxes by pressing OK button of each dialog box.

Next Step : Setup SSH Daemon

1. Open the Cygwin command prompt.
•  Note :- While configuring SSH, you may need to run the cygwin.bat script. While running cygwin.bat in Microsoft Windows Server 2008 and Microsoft Windows Vista or 7, ensure that you invoke it in administrator mode. To do this, right-click the cygwin.bat file and select Run as administrator.
2. Execute the following command: "ssh-host-config"
3. give the following answers

Will try to create an account , also ask you to give a password

Next : Start SSH daemon

1.     Open Services and Applications in the left-hand panel then select the Services item.
2.     Find the CYGWIN sshd item in the main section and right-click on it.
3.     Select Start from the context menu.

On doing so i got message

 

 I checked C:\cygwin\var\log\sshd.log file and found message "Privilege separation user sshd does not exist"

To solve this i will need to make a user SSHD , looking for ways to do the same on Windows 7. But this article and this article

LOOKING FOR SOLUTION !!