« first day  last day (14 days later) » 

11:46 AM
@DeepanRam
 
12:06 PM
hi
did you find anything ?
 
No bro
Still working on that problem
Could u help me out with hadoop administration query
?
I have query regarding start-all.sh script
?
 
yeah
will give it a try
 
Okay
great
i ll post the query
just a sec
 
if [ -f "${HADOOP_HDFS_HOME}"/sbin/start-dfs.sh ]; then
"${HADOOP_HDFS_HOME}"/sbin/start-dfs.sh --config $HADOOP_CONF_DIR
fi
This is the query in start-all.sh script residing inside hadoop/sbin
 
12:12 PM
ok
you are not able to start hadoop ?
 
So this query states that we should mandatorly have HADOOP_HDFS_HOME in .bashrc of the system
 
yeah
but in case you dont do
 
Yeah
 
you can simply find it and start it
i have made those changes and in my vm i change it differently
 
No this is not about VM
I downloaded hadoop 2.7.2 from Apace site
 
12:14 PM
I don't think I understood ur problem
 
Okay let me make it clear
M running a dual boot operating system
 
with windows and ubuntu
I have downloaded hadoop2.7.2.tar.gz file from Apache opensource
 
The query which i had posted earlier states that we should mandatorly have HADOOP_HDFS_HOME in .bashrc of the computer
Otherwise it wont be able to identify start-dfs.sh script
Is that correct brother?
I tried running the script start-all.sh without HADOOP_HDFS_HOME in .bashrc. It worked
 
12:18 PM
Bash runs whenever it is started interactively
 
Okay
 
it should work
 
Can u explain that. I didnt get u
The query clearly states that start-dfs.sh script location would only be identified with the variable HADOOP_HDFS_HOME
 
it is not mandatory to specify the path
if you use ./
then it will find the location and run the script
sometimes /bin/bash is required
when it is not able to find the start-dfs.sh script
 
Okay
U told me that it would take the location automatically
Could u give a little bit clarity on that part
?
I could find a complete dependency on the variable ${HADOOP_HDFS_HOME}
because when i tried commenting that query
None of the hdfs deamons started
 
12:30 PM
When you run hadoop command, it sources a file hadoop-config.sh that resides in $HADOOP_HDFS_HOME/libexec which sets your classpath (CLASSPATH) by picking jars residing in various directories
 
Any command to view those classpaths
?
 
you can use "env" to check all those entire classpaths set
 
Okay when i hit start-dfs.sh
It would check for my hadoop location automatically
We dont have to give HADOOP_HDFS_HOME
location
 
yes
if you want to hit start-dfs.sh from anywhere
then only you need to set
 
That is fine
 
12:35 PM
else you can go into /sbin/start-dfs.sh
 
If u dont mind
Can u just tell me the background process that would happen when i hit start-all.sh
I tried searching for this answer
but i coudnt find any
M really curious to know what would happen in the background
Let me be specific
I just want to know how hadoop complier would find the location automatically
 
it basically starts 2 things
start-dfs.sh
and the resource manager
 
Okay
 
start-all.sh is obsoleted
 
Where will the command fetch hadoop location from?
Or else let me put it this way
How will the script start-all.sh fetch hadoop location
?
Because without knowing hadoop location it wont be able to execute start-dfs.sh script
 
12:43 PM
if you open the script
you can find out the code
 
I tried but coundnt find
 
in the sbin
cat start-all.sh
 
I read the script start-all.sh
But i coudnt find the answer for my question
 
let me check my vm
 
Okay
hope u understood my question
?
I ll tell u the steps
Get into start-all.sh
U would find the below given script
if [ -f "${HADOOP_HDFS_HOME}"/sbin/start-dfs.sh ]; then
"${HADOOP_HDFS_HOME}"/sbin/start-dfs.sh --config $HADOOP_CONF_DIR
fi

..
 
12:50 PM
ok
 
It clearly states that it could execute start-dfs.sh script if u have HADOOP_HDFS_HOME variable in ur bashrc
Is that correct brother?
Correct me if m wrong?
I dont have HADOOP_HDFS_HOME variable pointing to my hadoop location in my .bashrc
that is
export HADOOP_HDFS_HOME = /usr/local/hadoop
Inspite of that it is executing the script
SO where does the complier take the location of hadoop from for this script to run?
 
one sec bro
my machine is dying when i opened the vm
 
Please take ur time
 
1:05 PM
you are correct
HADOOP_HDFS_HOME variable should point to ~/.bashrc
the install dir of hadoop
 
Yup
I dont have that variable in my .bashrc
But still it is executing the query
So that means it is able to get the location of hadoop from a different source
I need to know about that source
To be precise
What happens in the background?
 
in bashrc
either hadoop install or any other yarn_home path should be there
 
Okay
 
is it ok
i would need to exit
 
Yup
fine
 
1:12 PM
tc bye
 
bye
 

« first day  last day (14 days later) »