Installing Hadoop on Pseudo Distributed Mode

In this video we are discussing installing Hadoop on pseudo distributed mode and this

instruction process will be discussing step by step for your easy understanding

and also this video will be assisted with one practical demonstration we

shall show you that what are the steps we followed so that you can do the same at

your end installing Hadoop in pseudo distributed mode to set up Hadoop for

pseudo distributed mode set up the following XML files located in this folder. You see, this is a path is there and there is a folder under this

particular folder where having these three files are there. Multiple XML files are there

but we are concentrating only on these three files. And each and every file where we'll

be putting some set of XML. So, first one is a core hyphen site.xml, sdfs, hyphen site

dot XML and Map rate hyphen site.com. So three XML files are there and they require some

update. So, set up core hyphen site.xml. That was the first in our list. We're going to

update that one. So open core hyphen site.coml from the given path. You see, we had this

path and this is the respective file name here and put the following lines in the XML files

So you can open this file. It is a text file. You can open it using G-Edit and then put this

files, put these lines onto the respective file. was HDFS hyphen site.xml which will be found in this respective folder and this is the

code's XML codes are to be written into the file so open the file using G edit or any other

text editor and put this XML code there and the last one there is a map rate hyphen

site dot XML it will be found in this respective folder and if the file is not present

copy the map rate site dot XML dot template so this is a file will be there so there is a map

rate hyphen site dot XML dot template file and rename the copied file with the maprate

hyphen site dot XML so if the file is not directly there you will be having one template

file so just make a copy of that and rename it to this name and put the following lines

which are written in XML to that file itself. Open the hadoof hyphen env

S.H from the given path. So, this is the path from where you are supposed to open this shell program

The shell program is there and export the Java underscore home environment variable in that file

So, how to do that one? Put the following lines there. There is an export Java-hifen home

There is a underscore here. export Java underscore home is equal to slash user slash local slash Java slash JTK 1.8.0

underscore 171. So just see your path in my system the path was like this. Whatever I followed the steps. My path was this. But if you're having some different version of Java, then obviously the respective export the string will be also changed. So export Java underscore home is equal to. So this line has to be put in the

the respective file there is a hadup hyphen env dot sh so i think it is better let us go for one

demonstration to show you that how the steps are to be carried out and what are the different

ways to do that one for your better understanding so here is the demonstration for you

so in this video we are going to discuss how to install hadup version 2.4.1 so before

installing haddu version 2.4.1 we are going to install install SSH and R Sync. So what is SSH? SSAH is nothing but secure shell is a secure shell

and it is a cryptographic network protocol for operating network services over an unsecured

network and that is the purpose of SSH. Now what is our sync? So R Sync is nothing but

is a utility for efficiently transferring and synchronizing synchronizing files across computer systems by checking the timestamp and the size of the file

And this R-Sync is having the full form that is a remote sync

And here also we going for the setup for SSH without pass phrase Now actually this pass phrase is actually this concept is required for the additional security

here so to install SSH the command is pseudo APT hyphen get install SSH to

install R sync the command is pseudo APT hyphen get install R sync so we'll be

issuing these commands in the terminal prompt and set up for SSH without pass

phrase is the command will be SSH-ch-ch genn hyphen t r s a say and while installing this

we'll be pressing enter for three times to ignore the next stages so let us go for the demonstration

that how we are doing going to do this one so at first we are going to install this hardu

version 2.4.1 highlighting this one and now we are going for the first command that is a

installation of SSH going to the terminal clearing it up So now here we are issuing the command pressing enter the command is getting executed yes

installation has been done yes the installation is still in process and it has been done

successfully now we are going to copy this pseudo apathe hyphen get install r sync

so this is a command we are going to issue now so we're doing the copy and this

then coming to this paste and the command prompt has been obtained now we are

going for SSH without pass phrase so copying this command here and you shall

press three times enter you can find that and here we are pressing enter three

times you can find that we have entered three times and here we have got we have

got back the prompt so that means the instruction has been done successfully

now here we are copying and this particular file and actually we're concatenating it at the end of the file that is the slash

dot ssh slash authorized underscore keys so the left and side file will be

copied at the end of this right-and-side file if the file on the right-hand side

does not exist then the file will be created and the new content will be pasted there so this is a command we are going to issue now so let us go for this

copy and issue this command so command has been issued you can find that now we

shall come back we shall issue the command that is our SSH local host so going for

this marking SSH local host we shall go for yes pressing enter so the

prompt has been obtained now here we're having some steps are there so we'll

be here downloading this Hadoop version 2.4.1 from the link as it has been given

here we shall do the copy and paste onto the URL box so let us go for that

operation and the Hadoop will get installed on our system copying this URL then

opening the browser and go for paste and go now you are going to select the 132 mb

file that is the Hadoop 2.4.1 dot tarr dot GZ going for save so file is

getting downloaded on our download folder you can click here you can see see the progress how the file is getting downloaded here so now it is

almost getting completed the download has been done onto the download folder

opening the folder now so we are creating one folder under home the name of

the folder will be hadup giving the name and now all the extracted files from the

Jif file we've done the dragging it so that all the files will get copied onto

about Hadoop blank folder shall close this one so this is our Hadoop folder

so we have followed the step that is the extract that downloaded files

into the Hadoop folder so this much we have done now we are going to edit about a

file that is a slash it is C slash profile file and the following two lines are

going to be added at the end of the file that is a profile file which is residing

under the ETC folder. So let us go for opening this there is a ETIS slash

it is slash profile file so let us go for opening so pseudo G edit going for slash ETC slash profile opening the file it is asking for the password giving the password here cannot open i think we should terminate this terminal let us go for

another one let us open another terminal here okay so another terminal has got open

we're going for this pseudo let me execute this one again so pseudo g edit slash etc slash profile

pressing enter giving the password so file has got opened we're coming at the end

creating some space here now coming to this install and copying these two

lines so here we are exporting this Tie-up underscore install this variable is

getting initialized with this path and also export path so is equal to dollar

path colon ha dollar hard hoop underscore install install slash bin so these two these two lines were just doing the copy and paste at the

end of ETC slash profile file so doing the paste so file has got updated now

saving it then I shall close save and close then I shall execute the ETC

profile file so that the respective changes will get effective in the system

Okay, we have done it. So execute the slash ETC slash profile file

So this much we have done. Now Hadoop pseudo distributed mode. So we'll be going for some updates in the XML files and so on

So let me go show you. So at first we are dealing with this code hyphen site.xmL

So this is a file where we are going to do some updates

And this file is residing under the folder that is a Hadoop slash. a Hadoop slash ETC slash Hadoop slash core worden site.xm. So this is a file is there

where we'll be pasting this configuration portion, the portion which is written in this

configuration tag. So let me open this core hyphen site.coml. So it is under this Hadoop

it is C hadoop and here we're having this core C yes C is the starting character

so I should be going for core calories site dot XML so opening this one here you

can find that this configuration tags are blank so let me copy this one at first

so I'm done the copy and then I shall go for this core hyphen site dot XML we have done

the paste you can find that only we have just updated the portion

we're not touching any other portion of this file just updating that portion whatever

you wrote you can pause the video we can do the same you can make this XML ready

and then we're saving and closing it so we have done this code hyphen site dot XML

so required update we have done now we are going for the next one there is a

hadup slash ETC slash hadoop slash sdf sdf side.xml so that is another xml file is there just remember this

path here so hadoop slash etc slash hadup slash sdfs hydfn site.xml so these

are xml file we're going to do some updates we are going to carry out some

updates on this particular file here so what is update so here this

configuration portion has to be written there so let me open the open the

file now so doing the copy here so sdfs the file is already open so that is the sdfs hyphen site dot xml so here you have done the copy and paste here so configuration tags have got updated so here we are having the replication factor of one we can also go for three so here we have gone for the replication factor dfs dot replication so this particular property has been set with the value one here okay so we have done done it now you shall go for the save

then you shall go for the close next we're going for the next file which is the

map red hyphen site.xml which is residing under the folder that is the

Hadoop slash ETC slash Hadoop map red hyphen site so this is a required file where this configuration section has to be updated So here you are putting this map rate dot job tracker and local host colon 9001 So name and the value

So they have they have got enclosed with the respective tags. So we're going for this

So here can find that we are not finding any map red hyphen site dot XML. We're not finding this one

So what we are finding we're getting map read hyphen site dot XML

So what we shall do we shall make a copy and paste so we shall make a replica of this template file and then we shall change the name to map rate hyphen site dot XML and there will be doing the required updates in the tags

So let me make a copy. So I'm done the copy and paste. So it has made a paste here

So now I shall go for this template and this blank space is to be eliminated

Yes, we have made the thing. so now coming to this installation details dot txt taking this configuration portion

okay now going for this map red site dot xml this configuration portion is getting updated

with a new content you can find that here we have done the copy and paste so please remember all these steps because all these steps are necessary and

they are to be done the order in which you are demonstrating here

so now we shall go for this save and exit okay now we're going for this hadoof env hadu hadoop hymnv.sh so here we are supposed to put the

Java path here Java home path so this is a Java home path we are getting so it

does doing the copy don't take that colon in the selection so here here in this

case we're just pasting the required Java home path here so you can find here so

actually this is a put the Java home actually I should write this one as Java home

at hadoop hyphen env.sh. So this particular shell program has to be updated with the java home path

So we have done that one and we have got the java home path by just writing the java home dollar java home we have written that one

So getting the path and we have done the pasting there. Now run the final command to set the set up the hadoop

Okay. So we'll be going for this name note format. We'll be going for this name note format will be

going for the name note format so let us go for that section now so we sure yes we

have done this now we shall go for this name not format so copying and pasting it

here so name not format is taking place yes it has got pasted so formatting has

been done so let me write this lines how to start the Hadoop so as supposed to issue it should be written in capital letters

so dollar Hadoop underscore install slash has been slash start hyphen all dot sH so

this is the this a shell program you are supposed to execute you can find

that Hadoop is now is getting initiated I should go for yes

So we're going to see what are the processes are running

So here you can find that node manager, data node, name node, secondary name node

We're having the resource manager. So these are the respective processes are running in the background

So that means my hub is on. Now let me open this one in the browser

So the command is Local Host colon 50070. So if you just issue this one in the browser you can find that this particular Hadoop has

got so respective GY view we're getting here. So in this way we have shown you that how to install this Hadoop here

So in the browser we are going to write local host 50070 to get the Hadoop overview page on so throughout this demonstration you have

shown you that how to install Hadoop on our system thanks for watching this video