Trending questions in Big Data Hadoop

0 votes
1 answer

Not able to install hadoop using maven

First make sure you have ant installed ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,362 views
0 votes
1 answer

All daemons starting except datanode

There could be more than one reason ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,697 views
–1 vote
1 answer

Mapreduce in Python

mapper.py #!/usr/bin/python import sys #Word Count Example # input comes from ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,765 views
0 votes
1 answer

Mapreduce shuffle and sort

The mapreduce task happens in the following ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,370 views
0 votes
1 answer

How to configure Hosts file for Hadoop Eco-System?

For UBUNTU Hosts File and other configuration for Hadoop ...READ MORE

Sep 25, 2018 in Big Data Hadoop by Frankie
• 9,830 points
5,369 views
0 votes
1 answer

What is local file System?

LocalFS means it may be your LinuxFS ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,023 views
0 votes
1 answer

What is the difference between Hadoop API and Streaming?

Usually we have Map/Reduce pair written in ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Neha
• 6,300 points
1,976 views
0 votes
1 answer

Hadoop MapReduce wordcount "type job is not applicable for the arguments" error

The combiner class is not required in ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,648 views
–1 vote
1 answer

Hadoop cluster is not running in vm

First check if all daemons are running: sudo ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,361 views
0 votes
1 answer

I want to install snappy on Hadoop 1.2.1. How do I do that?

As per Cloudera, if you install hadoop ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,979 views
0 votes
3 answers

How to specify KeyValueTextInputFormat Separator in Hadoop-.20 api?

conf.set("key.value.separator.in.input.line", ","); Job job = new ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Rio
3,070 views
0 votes
1 answer

Which side join is taken by default by hive? Map-side or Reduce-side?

The syntax for Map-side join and Reduce-side ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,871 views
0 votes
1 answer

How to Upgrade Apache Hadoop from 2.4.1 to 2.6.0

If the downtime is not an issue, ...READ MORE

Nov 30, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,436 views
0 votes
1 answer

Not able to list sqoop jobs

It seems like you are missing a ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,843 views
0 votes
1 answer

How to export file from sqoop to sql table?

For SQOOP export please try below command: bin/sqoop ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,800 views
+2 votes
1 answer

How To Configure Tls Encryption For Cloudera Manager?

The Cloudera Connect Partner Program, more than ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,512 views
–1 vote
1 answer

File is available at HDFS location. Still system throws en error.

This is happening because the file name ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,180 points
1,010 views
0 votes
1 answer

Hadoop Hive partitioning

Partitioning: Hive has been one of the preferred ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,799 views
0 votes
1 answer

Hadoop Data node acknowledgement

Let's understand full write mechanism so that ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,585 views
0 votes
1 answer

Datanode not running and not able start

Please type the below command in the ...READ MORE

Dec 20, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,498 views
0 votes
1 answer

In Hadoop what does dfs replicate mean?

The total number of files in the ...READ MORE

Sep 25, 2018 in Big Data Hadoop by Frankie
• 9,830 points
5,203 views
0 votes
1 answer

Sqoop import not working

The error you are getting is because ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,549 views
+1 vote
1 answer

Do Cloudera’s Products Work With My Existing Data Management Infrastructure?

The Cloudera Connect Partner Program, more than ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,479 views
0 votes
1 answer

Hadoop: How to keep duplicates in Hive using collect_set()?

SELECT hash_id, COLLECT_LIST(num_of_cats) AS ...READ MORE

Nov 2, 2018 in Big Data Hadoop by Omkar
• 69,180 points
3,536 views
0 votes
1 answer

What does AM in “AM Container” mean in Hadoop

Here's another link from Hadoop which may ...READ MORE

Nov 2, 2018 in Big Data Hadoop by Frankie
• 9,830 points
3,533 views
–1 vote
1 answer

Namenode start error

Seems like the content in core-site.xml file is ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,225 views
0 votes
1 answer

Hadoop: Not able to start Namenode

Stop all running server 1) stop-all.sh Edit the ...READ MORE

Nov 8, 2018 in Big Data Hadoop by Omkar
• 69,180 points
3,266 views
0 votes
1 answer

How to connect impala to cloud lab?

impala-shell -i <domain_name>: <port > READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,739 views
0 votes
1 answer

Hadoop mapreduce java: NullPoint Exception

Try this: String cords = it.next().toString(); lattitude = Double.toString((inst.decode(cords))[0]); longitude ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,698 views
0 votes
1 answer

Error while connecting to Hive using Java JDBC

Use ​org.apache.hive.jdbc.HiveDriver as your driver ...READ MORE

Nov 22, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,664 views
0 votes
1 answer

Getting some warning/error while loading java file using Hbase commands

In your code, you have set some ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,671 views
+3 votes
5 answers

Hadoop DistributedCache is deprecated - what is the preferred API?

I had the same problem. And not ...READ MORE

Oct 12, 2018 in Big Data Hadoop by Rohan
4,418 views
+1 vote
1 answer

Hadoop: Using composite-key

You can use a Writable, something like ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,993 views
0 votes
1 answer

How to create external Hive table?

It's simple. You just have to add external ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,637 views
0 votes
1 answer

Command to partition table in Hive

Yes, You need to mention the below ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,496 views
0 votes
1 answer

Which is helpful SVN or Git for Hadoop Development?

The official location for Hadoop is the ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,958 views
–1 vote
1 answer

What is shared FS in the standby namenode?

Shared FS Basically implies to the high ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,391 views
0 votes
1 answer

Can not list/access files of local system from hadoop

You can not directory use files from ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,678 views
0 votes
1 answer

How to move Word and PDF documents to Hadoop HDFS?

Try with below commands: hadoop fs -copyFromLocal <localsrc> ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,987 views
0 votes
2 answers

How to convert .txt file to Hadoop's sequence file format

import java.io.IOException; import java.net.URI; import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.fs.FileSystem; import org.apache.hadoop.fs.Path; import org.apache.hadoop.io.IOUtils; import ...READ MORE

Oct 12, 2018 in Big Data Hadoop by Sanjay
4,584 views
0 votes
1 answer

How to provide encryption for Cloudera HDFS?

You can provide security to cloudera hdfs by using HDFS ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,292 views
0 votes
1 answer

Hadoop Spark: What is version to find SparkSession in library Spark?

you need both core and SQL artifacts <repositories> ...READ MORE

Nov 13, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,935 views
0 votes
1 answer

How to implement sqoop jobs?

Step 1: Give the below command to ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,402 views
0 votes
1 answer

Unable to set JAVA_HOME path.

Check if bin/start-all.sh doesn't override JAVA_HOME put echo ...READ MORE

Dec 1, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,176 views
0 votes
1 answer

Free Hadoop Cluster Experiments

I doubt if there is something which ...READ MORE

Nov 27, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,290 views
0 votes
1 answer

How to use sqoop import?

Here is an example of import command. ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,555 views
0 votes
1 answer

Executing mapper and reducer individually

This is what happens: Map reduce framework will ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,364 views
0 votes
1 answer

Hadoop: How to use Jps command with Sun JDK installed?

You can put JPS into your path ...READ MORE

Nov 9, 2018 in Big Data Hadoop by Omkar
• 69,180 points
3,026 views
0 votes
1 answer

What are the different relational operations in “Pig Latin” you worked with?

Different relational operators are: for each order by fil ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,507 views
0 votes
1 answer

Hadoop Pig: java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/filter/Filter

This seems like a problem with the ...READ MORE

Nov 16, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,708 views