Trending questions in Big Data Hadoop

+1 vote
1 answer

sql exception when exporting

Hello @Hemanth, the error String or binary data ...READ MORE

Sep 4, 2019 in Big Data Hadoop by Ramya
3,190 views
0 votes
2 answers

Hadoop is not able to find jps command

jps is actually not a command of ...READ MORE

Apr 18, 2018 in Big Data Hadoop by Shubham
• 13,490 points
17,615 views
+1 vote
1 answer

2 datanodes is slower ,how to get those details .what is your approach as hadoop admin

First, enable the detection of slow nodes. ...READ MORE

Sep 23, 2019 in Big Data Hadoop by Riya
2,144 views
0 votes
1 answer

How to run Hadoop 2.1.0 in Windows System?

Same problem but with recent Hadoop v. ...READ MORE

Sep 11, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
2,605 views
0 votes
1 answer

Why do we use job.waitForCompletion(true)?

The main reason for job.waitForCompletion exists is ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Josh
5,281 views
0 votes
2 answers

How to see MySql service is running or not using linux command?

Hi, You can simply run the following commands ...READ MORE

Jan 21, 2020 in Big Data Hadoop by anonymous
2,831 views
0 votes
2 answers

How to pass a password to Sqoop import command?

You can directly pass the password in ...READ MORE

May 15, 2019 in Big Data Hadoop by Raj
7,605 views
0 votes
1 answer

How to list files in hdfs that contains a specific string?

Yes, you can do this. You can ...READ MORE

Jan 27, 2019 in Big Data Hadoop by Omkar
• 69,180 points
12,276 views
0 votes
1 answer

Regarding unstructured data handling in hadoop

There are multiple ways to import unstructured ...READ MORE

Jul 9, 2019 in Big Data Hadoop by Jishan
5,127 views
0 votes
1 answer

Different between zkfc and zookeeper

Hey, The key difference between both the components ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Sunny
1 flag 4,182 views
0 votes
1 answer

I am receiving a warning which says: Failed to locate the winutils binary in the Hadoop binary path

I see that you are facing multiple ...READ MORE

May 31, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
6,793 views
0 votes
1 answer

Can I run Hadoop with Docker for both DEV and PROD environments?

Hi, Yes, you can run Hadoop with Docker ...READ MORE

Jan 24, 2020 in Big Data Hadoop by MD
• 95,460 points
959 views
0 votes
1 answer

Not able to upload files to hdfs: No such file or directory

The reason for this error is that ...READ MORE

Jul 11, 2019 in Big Data Hadoop by Srujan
4,879 views
0 votes
2 answers

Explain to me the difference between Name Node and Secondary Name Node

Secondary namenode is just a helper for ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Dhiman
4,699 views
0 votes
2 answers

Why we require SSH during hadoop installation?

Hey, SSH setup is required to do different ...READ MORE

Jun 11, 2019 in Big Data Hadoop by Gitika
• 65,730 points

edited Jun 11, 2019 by Gitika 6,134 views
0 votes
1 answer

How do you handle the failure of Data node?

HDFS has Master Slave architecture in which Master ...READ MORE

Apr 9, 2019 in Big Data Hadoop by Gitika
• 65,730 points

edited Apr 9, 2019 by Gitika 8,831 views
0 votes
3 answers

How to connect Spark to a remote Hive server?

JDBC is not required here. Create a hive ...READ MORE

Mar 8, 2019 in Big Data Hadoop by Vijay Dixon
• 190 points
13,386 views
0 votes
1 answer

How to retrieve/get complete HQL hive query from hive,spark and tez?

To get full query running for the ...READ MORE

Jul 11, 2019 in Big Data Hadoop by Yogi
4,786 views
0 votes
1 answer

why do we need MaPReduce in BigData Hadoop?

Hi, As we know Hadoop provides Hdfs as ...READ MORE

Feb 4, 2020 in Big Data Hadoop by MD
• 95,460 points
1,077 views
0 votes
2 answers

Installing HBase on windows

This procedure worked for me. https://medium.com/@bishupaulose/install ...READ MORE

Aug 16, 2019 in Big Data Hadoop by Sam
6,818 views
0 votes
1 answer

which one is better bigdata or devops for career

I think Big Data will be good ...READ MORE

Aug 26, 2019 in Big Data Hadoop by Karan
2,725 views
0 votes
1 answer

How to choose number of Executors and Executor cores?

Refer to the below when you are ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Veer
3,901 views
+1 vote
1 answer

What are all the Data quality checks we do in our real time Big Data projects.

You can use a checksum to compare ...READ MORE

Sep 4, 2019 in Big Data Hadoop by Tina
2,259 views
0 votes
1 answer

What is thrift in Hive?

Hey, Thrift comes in the architectural part of ...READ MORE

May 13, 2019 in Big Data Hadoop by Gitika
• 65,730 points
7,181 views
0 votes
1 answer

Command to get status of all running Oozie workflow

Hey, You can use this command to get ...READ MORE

Jun 12, 2019 in Big Data Hadoop by Gitika
• 65,730 points
5,874 views
0 votes
1 answer

error:- /zookeeper_server.pid: Permission denied FAILED TO WRITE PID

Hey, The default zookeeper installation (tar extract) comes ...READ MORE

May 27, 2019 in Big Data Hadoop by Gitika
• 65,730 points
6,447 views
0 votes
1 answer

How to select partition in Hive?

Follow these steps: A. Create Database ------------------ create database retail123; B. ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Omkar
• 69,180 points
10,667 views
0 votes
1 answer

Secondary Sorting in Hadoop MapReduce

Grouping Comparator Once the data reaches a reducer, ...READ MORE

Sep 5, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
2,060 views
+1 vote
1 answer

Client not able to connect to cluster

There could be multiple reasons: Make sure you ...READ MORE

Sep 23, 2019 in Big Data Hadoop by Rishi
1,255 views
0 votes
1 answer

How can we retrieve/get complete HQL hive query from hive,spark and tez?

To get full query running for the ...READ MORE

Jul 23, 2019 in Big Data Hadoop by Lohit
3,922 views
0 votes
1 answer

Command to copy file from desktop to hdfs

You can use either of the below ...READ MORE

Jul 11, 2019 in Big Data Hadoop by Firoz
4,436 views
0 votes
1 answer

How to unzip a zipped file stored in Hadoop hdfs?

hadoop fs -text /hdfs-path-to-zipped-file.gz | hadoop fs ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
• 69,180 points
13,539 views
0 votes
1 answer

Managed Table vs External Table

External table is created for external use ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,180 points
13,491 views
0 votes
1 answer

Warning: unable to load hadoop native library

Just append word native to your HADOOP_OPTS lik ...READ MORE

Sep 9, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
1,836 views
0 votes
2 answers

How to use scoop in a Java Program

There is a trick which worked out ...READ MORE

Sep 4, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
1,990 views
0 votes
1 answer

Hadoop HDFS: How to delete old files from HDFS?

You can use commands like this: hdfs dfs ...READ MORE

Nov 15, 2018 in Big Data Hadoop by Omkar
• 69,180 points
14,659 views
0 votes
1 answer

How to restart failed Namenode?

You need to solve the issue which ...READ MORE

Jul 23, 2019 in Big Data Hadoop by Ishan
3,832 views
0 votes
1 answer

Spark Vs Hive LLAP Question

While Apache Hive and Spark SQL perform ...READ MORE

Jul 16, 2019 in Big Data Hadoop by Karan
4,056 views
0 votes
1 answer

Hive: org.apache.hadoop.security.AccessControlException Permission denied: user

This error is generally thrown when the ...READ MORE

Aug 1, 2019 in Big Data Hadoop by Waniku
3,362 views
0 votes
1 answer

Spark : java.lang.ClassNotFoundException: org.apache.hadoop.fs.FSDataInputStream

Create a spark-env.cmd file looking like this @echo off set ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,180 points
12,471 views
0 votes
1 answer

What happens when a datanode that is dead becomes active again?

When NameNode notices that it has not ...READ MORE

Jun 20, 2019 in Big Data Hadoop by Rishi
5,124 views
+1 vote
1 answer
0 votes
1 answer

How to check the size of a file in Hadoop HDFS?

You can use the  hadoop fs -ls command to ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,180 points
14,200 views
0 votes
3 answers

What are differences between NameNode and Secondary NameNode?

File metadata information is stored by Namenode ...READ MORE

Apr 8, 2019 in Big Data Hadoop by anonymous
16,419 views
0 votes
1 answer

Exception in thread "main" java.lang.NoClassDefFoundError

As far I can make out from ...READ MORE

Aug 9, 2019 in Big Data Hadoop by Arpit
2,883 views
0 votes
1 answer

Hadoop: ERROR1070: Could not resolve count using imports: [, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.]

Hi, I can see the error arose because the count ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Gitika
• 65,730 points
2,929 views
0 votes
1 answer

How to call MapReduce program using a simple Java Program?

Because map and reduce run on different ...READ MORE

Sep 4, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
1,707 views
+1 vote
0 answers

hdfs namenode -format not working, not showing anything.

can someone help me with this please, ...READ MORE

Sep 6, 2019 in Big Data Hadoop by nar
1,576 views
+1 vote
0 answers

Missing Service request

Hello All, need assistance on one issue. ...READ MORE

Sep 17, 2019 in Big Data Hadoop by Hemanth
• 250 points
1,089 views
0 votes
1 answer

Granting SELECT privilege in Hive

You can use this command to do ...READ MORE

May 31, 2019 in Big Data Hadoop by Umar
5,783 views