Trending questions in Big Data Hadoop

0 votes
1 answer

What is the best way to integrate SAS with Hadoop without losing the parallel processing capacity of Hadoop

One of the major pushes at SAS ...READ MORE

Oct 16, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 3,318 views
0 votes
1 answer

Hadoop: method to send output to multiple directories

setup: MultipleOutputs.addNamedOutput(job, "Output", TextOutputFormat.class, Text.class, Text.class); setup of reducer: mout ...READ MORE

Nov 13, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 2,063 views
0 votes
1 answer

Moving data to hdfs using copyFromLocal command

Actually dfs.data.dir and dfs.name.dir have to point ...READ MORE

Mar 27, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 12,031 views
0 votes
1 answer

can't find start-all.sh in hadoop installation

Actually, you are not mentioning the path for ...READ MORE

Apr 17, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 11,110 views
0 votes
1 answer

How should I provide a URL for hdfs file system?

If you are trying to access your ...READ MORE

Sep 10, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,816 views
0 votes
1 answer

Hadoop Oozie: E0902: Exception occured: [User: oozie is not allowed to impersonate oozie]

Seems like your version of Hadoop does ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 2,069 views
0 votes
1 answer

Where can I find AMI for Hadoop on EC2?

To find that, please try with below ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 2,062 views
+1 vote
1 answer

What is the technique to know the Default scheduler in hadoop?

Default scheduler in hadoop is JobQueueTaskScheduler, which is ...READ MORE

Oct 31, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 2,527 views
0 votes
1 answer

Does Hadoop and Spark support iPv6 now?

It does not. As of today HADOOP-11890, which ...READ MORE

Oct 15, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 3,216 views
0 votes
1 answer

Hadoop: No Such Method Exception

Mapper and reducer classes need to be ...READ MORE

Oct 26, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 2,727 views
+2 votes
1 answer

Hadoop Jersey 1.x injection which is now not supported by Weblogic 12C

Add these lines to your weblogic-application.xml file ...READ MORE

Oct 31, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 2,383 views
0 votes
1 answer

How to upgrade from Hadoop 1.2 to Hadoop 2.2?

Here's the solution that worked for me: <dependency> ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,486 views
0 votes
1 answer

How to configure Yarn from command line?

It's a bit non-intuitive, but it turns ...READ MORE

Oct 16, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 3,037 views
0 votes
1 answer

Is there a way to copy data from one one Hadoop distributed file system(HDFS) to another HDFS?

The distributed copy command, distcp, is a ...READ MORE

Mar 22, 2018 in Big Data Hadoop by Ashish
 • 2,650 points • 12,035 views
0 votes
1 answer

How to find Hadoop version in CDH?

The simplest way to check Hadoop version ...READ MORE

Apr 19, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 10,722 views
0 votes
1 answer

What is the use of sequence file in Hadoop?

Sequence files are binary files containing serialized ...READ MORE

Apr 6, 2018 in Big Data Hadoop by Ashish
 • 2,650 points • 11,310 views
0 votes
1 answer

Hadoop with Python: How to use python to stop Hadoop tasktracker?

Here you go os.system('sudo -u hadoop bin/hadoop-daemon.sh stop ...READ MORE

Nov 16, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,586 views
0 votes
1 answer

Where can I find logs in Spark on YARN?

You can access logs through the command yarn ...READ MORE

Nov 8, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,918 views
0 votes
1 answer

Hadoop: Reading and Writing Sequencefile using Apis?

public class SequenceFilesTest { @Test ...READ MORE

Nov 9, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,863 views
0 votes
1 answer

What is the standard way to create files in your hdfs file-system?

Well, it's so easy. Just enter the below ...READ MORE

Sep 23, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 3,859 views
0 votes
1 answer

Is Linux Skills mandatory to become Hadoop developer?

Hello. Knowing basics of Linux is mandatory ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,927 views
0 votes
1 answer

Hadoop MapReduce intermediate output

keep.task.files.pattern parameter can be used to keep the ...READ MORE

Nov 16, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 1,462 views
0 votes
1 answer

Can someone tell me how apache sqoop works?

This blog would give you answers to ...READ MORE

Nov 16, 2018 in Big Data Hadoop by brat_1
 • 7,200 points • 1,483 views
0 votes
1 answer

Permission denied at hdfs

You can spolve this by adding below ...READ MORE

Sep 27, 2018 in Big Data Hadoop by digger
 • 26,740 points • 3,584 views
+1 vote
1 answer

Hive: How to use insert query like SQL

It is now possible to insert like ...READ MORE

Nov 5, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,790 views
0 votes
1 answer

How do I compile my java program on Ubuntu such that it will refer to hadoop-2.2.0 libraries?

The simplest solution for Linux machines would ...READ MORE

Oct 29, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 2,099 views
0 votes
1 answer

Iterate twice on values (MapReduce)

We have to cache the values from ...READ MORE

Oct 1, 2018 in Big Data Hadoop by digger
 • 26,740 points • 3,307 views
0 votes
1 answer

how is apache sqoop different from flume? Can someone explain?

Apache Sqoop lets you import and export ...READ MORE

Nov 15, 2018 in Big Data Hadoop by brat_1
 • 7,200 points • 1,311 views
+1 vote
2 answers

Execute Pig Script from Grunt Shell

From your current directory run  pig -x local Then ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Kunal
 • 8,236 views
0 votes
1 answer

Backup and Checkpoint Node

Checkpoint Node keeps track of the latest ...READ MORE

Jul 31, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 5,783 views
0 votes
1 answer

How to run Map Reduce program using Ubuntu terminal?

 I used the following steps to execute it ...READ MORE

Aug 7, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 5,462 views
0 votes
1 answer

How to format the output being written by MapReduce in Hadoop?

Here is a simple code demonstrate the ...READ MORE

Sep 5, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,208 views
0 votes
1 answer

Hadoop: How to Group mongodb - mapReduce output?

db.order.mapReduce(function() { emit (this.customer,{count:1,orderDate:this.orderDate.interval_start}) }, function(key,values){ var category; ...READ MORE

Oct 31, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,774 views
0 votes
1 answer

What does a Hadoop tester do?

Hadoop tester, like any other tester, has ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,503 views
0 votes
1 answer

Where is hadoop-test.jar in Hadoop2?

In Hadoop 1, testmapredsort is launched from AllTestDriver.java, which was ...READ MORE

Oct 24, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 2,075 views
+1 vote
1 answer

Where to set hadoop.tmp.dir? core-site.xml or hdfs-site.xml?

hadoop.tmp.dir (A base for other temporary directories) is ...READ MORE

Mar 26, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 11,149 views
0 votes
1 answer

POC for Hadoop in real time scenario

I'd like to point a few things. If ...READ MORE

Oct 11, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 2,598 views
0 votes
1 answer

What skills do I need to become Hadoop Admin?

You have heard it right. There is ...READ MORE

Nov 8, 2018 in Big Data Hadoop by anonymous
 • 1,320 views
0 votes
1 answer

How to exit name node from safe mode?

In order to forcefully let the namenode ...READ MORE

Sep 26, 2018 in Big Data Hadoop by slayer
 • 29,370 points • 3,157 views
0 votes
1 answer

What is a data serialization system?

So when Hadoop was being written by ...READ MORE

Oct 17, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 2,233 views
0 votes
1 answer

What is Hadoop Performance Tuning?

Is it consistent or one-off reading? Is ...READ MORE

Oct 24, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 1,841 views
0 votes
1 answer

Is MapR a substitute for MapReduce?

MapR is a commercial distribution of Apache ...READ MORE

Oct 10, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 2,445 views
+5 votes
2 answers

Hive to HDFS transfer

Hive does not store data. Hive is ...READ MORE

Sep 20, 2018 in Big Data Hadoop by SM
 • 5,348 views
0 votes
1 answer

out of Memory Error in Hadoop

You can assign more memory by editing ...READ MORE

Oct 1, 2018 in Big Data Hadoop by slayer
 • 29,370 points • 2,751 views
0 votes
1 answer

What is the command to check the number of cores in Spark?

Go to your Spark Web UI & ...READ MORE

May 17, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 8,670 views
0 votes
1 answer

How to create smaller table from big table in HIVE?

You could probably best use Hive's built-in sampling ...READ MORE

Sep 24, 2018 in Big Data Hadoop by digger
 • 26,740 points • 3,025 views
0 votes
1 answer

Hadoop absolute path - pwd ?

"hdfs dfs -pwd" does not exist because ...READ MORE

Mar 27, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 10,834 views
0 votes
1 answer

How to avoid a “split-brain” scenario with NameNodes?

Okay, so let me tell you that ...READ MORE

Jul 11, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 6,230 views
0 votes
1 answer

GROUP and COGROUP in PIG

Both GROUP and COGROUP operators are identical ...READ MORE

Jul 25, 2018 in Big Data Hadoop by shams
 • 3,670 points • 5,598 views
0 votes
1 answer

How to pass large records to map/reduce tasks?

Hadoop is not designed for records about ...READ MORE

Sep 25, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 2,877 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.