Trending questions in Big Data Hadoop

0 votes
0 answers

How Pig programming gets converted into MapReduce jobs?

Could you please give me a brief ...READ MORE

Feb 21, 2019 in Big Data Hadoop by Neha
• 6,300 points
1,347 views
0 votes
1 answer

Change the owner and group of a file in Hadoop.

Hi@akhtar, You can use the Chown command. This ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,460 points
9,336 views
0 votes
1 answer

How to append files from local system to HDFS?

Hi@akhtar, You can use appendToFile in your Hadoop ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,460 points
9,321 views
0 votes
1 answer

How to view contents of file in hadoop hdfs?

Hi@akhtar, You can use the Hadoop filesystem command ...READ MORE

Oct 5, 2020 in Big Data Hadoop by MD
• 95,460 points
9,090 views
0 votes
1 answer

Replace Column names and datatype in Hive

You can replace the column name and ...READ MORE

May 21, 2019 in Big Data Hadoop by John
30,749 views
0 votes
1 answer

Format HDFS Namenode Error: Could not find or load main class ”-Djava.library.path=.home.hadoop.hadoop-3.2.1.lib.native”

Hi@fwood, According to your configuration, you didn't set ...READ MORE

Jun 12, 2020 in Big Data Hadoop by MD
• 95,460 points
13,716 views
0 votes
1 answer

How to set replication factor in Hadoop?

Hi@akhtar, You can find setrep command in the ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,460 points
8,761 views
0 votes
1 answer
0 votes
0 answers

The following pairs are supposed to have one component that stores data in a distributed fashion and another component that performs computations in a distributed manner.

Choose the incorrect pair HDFS, MapReduce HBase, MapReduce HBase, Spark HDFS, ...READ MORE

Apr 10, 2021 in Big Data Hadoop by anonymous

edited Mar 4 276 views
0 votes
1 answer

error: value update is not a member of scala.collection.immutable.Map[String, Int]

Yes, If you try to update the value of ...READ MORE

Nov 17, 2020 in Big Data Hadoop by Gitika
• 65,730 points
6,402 views
0 votes
0 answers

How to Find Specific Column in Hadoop?

First let me say I am super ...READ MORE

Apr 8, 2021 in Big Data Hadoop by Brianne

edited Mar 4 260 views
0 votes
0 answers

Hadoop : command not found

Hello people... I can access hadoop webui ...READ MORE

Mar 11, 2021 in Big Data Hadoop by talal

edited Mar 4 277 views
0 votes
13 answers

What is the difference between Hadoop/HDFS & HBase?

HDFS is a distributed file system whereas ...READ MORE

Apr 26, 2019 in Big Data Hadoop by Arihar
• 160 points
37,010 views
0 votes
0 answers

hdfs dfs -count -h /user/isdoc/tmcss/all_ttc_custome_list/*

I want to do the same with ...READ MORE

Mar 8, 2021 in Big Data Hadoop by 1 bihari

edited Mar 4 375 views
0 votes
0 answers

hdfs dfs -count -h /user/isdoc/tmcss/all_ttc_custome_list/*

I want to do the same with ...READ MORE

Mar 8, 2021 in Big Data Hadoop by 1 bihari

edited Mar 4 334 views
0 votes
0 answers

hdfs dfs -count -h hdfs://sandbox.hortonworks.com/demo/

I want to do the same with ...READ MORE

Mar 8, 2021 in Big Data Hadoop by 1 bihari

edited Mar 4 255 views
+1 vote
1 answer

http://localhost:50070 not working in HADOOP

There are 2 case possible: 1. If you ...READ MORE

Apr 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
45,225 views
0 votes
0 answers

How to provide read-only access to hive views to end users?

I have created some hive tables in ...READ MORE

Feb 18, 2021 in Big Data Hadoop by Jnanaranjan

edited Mar 4 281 views
0 votes
0 answers

What are the pros and cons of parquet format compared to other formats?

Hi Team, I am new to Hadoop I ...READ MORE

Dec 21, 2020 in Big Data Hadoop by akhtar
• 38,260 points
2,809 views
0 votes
1 answer

Installing Zookeeper on Windows

Follow the below-mentioned steps to install Zookeeper ...READ MORE

Feb 22, 2019 in Big Data Hadoop by Omkar
• 69,180 points
31,459 views
0 votes
1 answer

How to remove the directory from HDFS?

Hi@akhtar, You can remove the directory using the ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,460 points
5,509 views
0 votes
1 answer

Is there any way to get the column name along with the output while execute any query in Hive?

If we want to see the column ...READ MORE

Dec 8, 2020 in Big Data Hadoop by Gitika
• 65,730 points
3,031 views
0 votes
1 answer

Name node is in safe mode. Not able to leave

In order to forcefully let the namenode ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,730 points
2,881 views
0 votes
1 answer

User:hdfs not allowed to do 'DECRYPT_EEK' on 'key'.

Hi@Shilpa, I don't think you have given permission ...READ MORE

Nov 20, 2020 in Big Data Hadoop by MD
• 95,460 points
3,234 views
0 votes
2 answers

Unable to start YARN daemons. Error: Could not find or load main class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager

Hi@Akshitha, This seems like a path issue. you ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
• 95,460 points
3,508 views
0 votes
1 answer

Zookeeper server going down frequently.

Hi@B, There may be several reasons behind this. ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
• 95,460 points
3,443 views
0 votes
1 answer

How input splits are done when 2 blocks are spread across different nodes?

Hadoop doesn't copy the blocks to the ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,730 points
2,200 views
0 votes
1 answer

How to copy files from HDFS to local system?

Hi@akhtar, You can use the put command in ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,460 points
5,026 views
+1 vote
1 answer

How to use HDFStore to hold large datasets?

Hi@akhtar, You can store your datasets from pandas ...READ MORE

Dec 17, 2020 in Big Data Hadoop by MD
• 95,460 points
1,645 views
0 votes
0 answers

Hadoop MapReduce - Join of two files and Computation on grouped values

I am fairly new to Hadoop and ...READ MORE

Jan 20, 2021 in Big Data Hadoop by anonymous

edited Mar 4 253 views
0 votes
1 answer

Copy a directory from one node in the cluster to another in HDFS.

Hi@akhtar, You can copy a directory from one ...READ MORE

Oct 20, 2020 in Big Data Hadoop by MD
• 95,460 points
4,013 views
0 votes
1 answer

mkdir: cannot create directory `/var/run/hadoop': Permission denied.

Hi@akhtar, You need to set the path of ...READ MORE

Oct 14, 2020 in Big Data Hadoop by MD
• 95,460 points
4,153 views
+1 vote
1 answer

How to copy file from Local file system to HDFS?

Hi@akhtar, You can copy files from your local ...READ MORE

Oct 20, 2020 in Big Data Hadoop by MD
• 95,460 points
3,865 views
0 votes
1 answer

How do I split a string on a delimiter in Bash?

You can set the internal field separator (IFS) variable, ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,730 points
1,632 views
0 votes
0 answers

Hadoop Datanode runs only once and then does not start again on Windows 10

I was trying to install Hadoop and ...READ MORE

Jan 7, 2021 in Big Data Hadoop by Mueez

edited Mar 4 332 views
0 votes
1 answer

How to update the existing record in HDFS?

Hi@akhtar, HDFS follows Write Once Read Many times ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,460 points
3,898 views
+1 vote
0 answers

How to export all collections in MongoDB?

Hi Team, I have one database in MongoDB. ...READ MORE

Dec 17, 2020 in Big Data Hadoop by akhtar
• 38,260 points
1,068 views
+1 vote
1 answer

How does Hadoop process records split across block boundaries?

Interesting question, I spent some time looking ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,730 points
1,338 views
0 votes
1 answer

Where does hive stores its table?

With an external table the data itself ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,730 points
1,358 views
0 votes
1 answer

How can I import data from mysql to hive tables with incremental data?

Hi@dharmendra, It is common to perform one-time ingestion ...READ MORE

Nov 23, 2020 in Big Data Hadoop by MD
• 95,460 points
1,786 views
0 votes
1 answer

copyFromLocal: `/home/SANDHYA/downloads/game.csv': No such file or directory

Hi@Namrata, I think you are using the wrong ...READ MORE

Nov 19, 2020 in Big Data Hadoop by MD
• 95,460 points
1,887 views
0 votes
1 answer

How to download hadoop jar files for adding eclipse

Hi@Manl, To import jar file in your Eclipse ...READ MORE

Jul 20, 2020 in Big Data Hadoop by MD
• 95,460 points
7,026 views
0 votes
1 answer

How to check the name of the hadoop server?

Hi@akhtar, If you're running a pseudo-distributed setup, you ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,460 points
3,326 views
0 votes
1 answer

How to see the report of Hadoop Cluster from command line?

Hi@akhtar, You can see the report of Hadoop Cluster ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,460 points
4,065 views
0 votes
1 answer

org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: hdfs://localhost:54310/user/hduser/input.

Hi@akhtar, It seems you are providing the wrong ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,460 points
3,233 views
+1 vote
1 answer

When to use Hadoop, HBase, Hive and Pig?

MapReduce is just a computing framework. HBase has ...READ MORE

Nov 20, 2020 in Big Data Hadoop by Gitika
• 65,730 points
1,545 views
0 votes
1 answer

How to write a Scala program in script mode?

Open notepad and add the following code ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
• 65,730 points
1,646 views
+2 votes
10 answers

Is there any difference between “hdfs dfs” and “hadoop fs” shell commands?

hadoop fs <args> fs is used for generic ...READ MORE

Mar 16, 2018 in Big Data Hadoop by anonymous
37,589 views
0 votes
1 answer

How to find the number of blocks for a file in Hadoop?

Hi@akhtar, You can use Hadoop file system command to ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,460 points
3,040 views
0 votes
1 answer

Error: Could not create the Java Virtual Machine in Hadoop.

Hi@akhtar, You can list down all the files ...READ MORE

Oct 16, 2020 in Big Data Hadoop by MD
• 95,460 points
2,894 views