Recent questions tagged big-data

0 votes
1 answer

How to declare sets with value in Scala?

Jul 30, 2019 in Apache Spark by Dhiraj
 • 2,143 views
0 votes
1 answer

Hive: Assign subquery to variable

Jul 30, 2019 in Big Data Hadoop by Kishan
 • 9,458 views
0 votes
1 answer

PySpark not starting: No active sparkcontext

Jul 30, 2019 in Apache Spark by Karan
 • 6,467 views
0 votes
1 answer

FAILEDError: java.io.IOException: Type mismatch in key from map

Jul 30, 2019 in Big Data Hadoop by Will
 • 3,127 views
0 votes
1 answer

Converting CSV files to Parquet

Jul 30, 2019 in Big Data Hadoop by Shri
 • 8,917 views
0 votes
1 answer

Unable to use ml library in pyspark

Jul 30, 2019 in Apache Spark by Yashita
 • 4,369 views
0 votes
1 answer

Scala: org.apache.poi.openxml4j.exceptions.InvalidFormatException: Your InputStream was neither an OLE2 stream, nor an OOXML stream

Jul 30, 2019 in Apache Spark by Nitin
 • 3,489 views
0 votes
1 answer

Unable to run the java- spark standalone program

Jul 30, 2019 in Apache Spark by Junaid
 • 2,558 views
0 votes
1 answer

java.lang.IllegalArgumentException: Unable to instantiate SparkSession with Hive support because Hive classes are not found.

Jul 30, 2019 in Big Data Hadoop by Will
 • 9,288 views
0 votes
1 answer

What is "java.sql.SQLException: org.apache.thrift.transport.TTransportException" in Hive?

Jul 30, 2019 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 8,657 views
+1 vote
2 answers

Spark: Dataframe vs Dataset

Jul 29, 2019 in Apache Spark by Jesse
 • 48,859 views
0 votes
1 answer

How to choose number of Executors and Executor cores?

Jul 29, 2019 in Big Data Hadoop by Kim
 • 4,807 views
0 votes
1 answer

Date formats : how to cast string to date?

Jul 29, 2019 in Apache Spark by Rahul
 • 7,134 views
0 votes
1 answer

Error while Loading data to Hive.

Jul 29, 2019 in Big Data Hadoop by Will
 • 2,478 views
0 votes
1 answer

How to fit multiple assignment statements into one statement in Scala?

Jul 29, 2019 in Apache Spark by Raghu
 • 2,087 views
0 votes
1 answer

Killing oozie Jobs by userid

Jul 29, 2019 in Big Data Hadoop by Lohit
 • 3,086 views
0 votes
1 answer

How to search for a Key in a Scala Map?

Jul 29, 2019 in Apache Spark by Ronita
 • 2,241 views
0 votes
1 answer

How to concatenate Maps in Scala?

Jul 29, 2019 in Apache Spark by sunny
 • 3,727 views
0 votes
1 answer

How to declare a Empty Scala Map?

Jul 29, 2019 in Apache Spark by Tarinder
 • 4,199 views
0 votes
1 answer

ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: Cannot run program "hive": error=2, No such file or directory

Jul 29, 2019 in Big Data Hadoop by Rasheed
 • 3,395 views
0 votes
1 answer

"main" java.lang.NoClassDefFoundError: org/apache/hadoop/fs/FSDataInputStream

Jul 29, 2019 in Apache Spark by Rishi
 • 7,665 views
+1 vote
3 answers

What is the best way to merge multi-part HDFS files into single file?

Jul 29, 2019 in Big Data Hadoop by Karan
 • 35,981 views
0 votes
1 answer

How the if-else statement is different for Scala and Java?

Jul 29, 2019 in Apache Spark by Nidha
 • 2,257 views
0 votes
1 answer

What is the differentiate between equals() and == in Scala. Is the latter the same as == in Java?

Jul 29, 2019 in Apache Spark by pavitra
 • 2,796 views
0 votes
1 answer

Scala: 30: error: value partitions is not a member of String

Jul 29, 2019 in Apache Spark by Kamal
 • 4,722 views
0 votes
1 answer

Difference between put and copyFromLocal

Jul 29, 2019 in Big Data Hadoop by Karan
 • 14,969 views
0 votes
1 answer

What is Lazy val in Scala?

Jul 29, 2019 in Apache Spark by Ishaan
 • 2,270 views
0 votes
1 answer

What is Case Class in Scala?

Jul 29, 2019 in Apache Spark by Dinesh
 • 2,058 views
0 votes
1 answer

what is an anonymous function Scala?

Jul 29, 2019 in Apache Spark by Ritika
 • 2,255 views
0 votes
1 answer

Consider for-comprehensions in Scala. What are they syntactic sugars for?

Jul 29, 2019 in Apache Spark by Nikita
 • 1,514 views
0 votes
1 answer

What is Options in Scala?

Jul 26, 2019 in Apache Spark by Suraj
 • 1,631 views
0 votes
1 answer

What is tail-recursion in Scala?

Jul 26, 2019 in Apache Spark by Sumit
 • 1,882 views
0 votes
1 answer

What is the work of Yield Keyword in Scala?

Jul 26, 2019 in Apache Spark by Naina
 • 2,389 views
0 votes
1 answer

How to append a list in Scala?

Jul 26, 2019 in Apache Spark by Nishant
 • 7,533 views
0 votes
1 answer

Different types of identifiers in Scala?

Jul 26, 2019 in Apache Spark by rashmi
 • 2,055 views
0 votes
1 answer

How does Closure function works in Scala?

Jul 26, 2019 in Apache Spark by Mehnaj
 • 1,929 views
0 votes
1 answer

What is a lens in Scala?

Jul 26, 2019 in Apache Spark by Sahan
 • 2,214 views
0 votes
1 answer

What is function currying in Scala?

Jul 26, 2019 in Apache Spark by Lima
 • 2,072 views
0 votes
1 answer

How to call the Debug Mode in PySpark?

Jul 26, 2019 in Apache Spark by nitinrawat895
 • 11,380 points • 8,014 views
0 votes
1 answer

How to use nested function in Scala?

Jul 26, 2019 in Apache Spark by Dheer
 • 2,193 views
0 votes
1 answer

Multiple Output format in Hadoop

Jul 26, 2019 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 3,465 views
0 votes
1 answer

How to use Scala anonymous functions and why do we use it?

Jul 26, 2019 in Apache Spark by sunny
 • 2,166 views
0 votes
1 answer

Does HQL query go to all the nodes to process data?

Jul 26, 2019 in Big Data Hadoop by Tina
 • 1,804 views
0 votes
1 answer

Why is Hive called as Data Warehouse?

Jul 26, 2019 in Big Data Hadoop by Will
 • 8,107 views
0 votes
1 answer

Spark Submit: class does not exists

Jul 26, 2019 in Apache Spark by Rohit
 • 2,752 views
0 votes
2 answers

How to pass external date parameter in hive hql

Jul 26, 2019 by anonymous
 • 120 points • 3,739 views
0 votes
1 answer

Spark: Read from Hive, store in HDFS

Jul 26, 2019 in Apache Spark by Kiran
 • 4,066 views
0 votes
1 answer

Write data into hive table in a parquet

Jul 26, 2019 in Big Data Hadoop by Amrita
 • 4,334 views
0 votes
1 answer

Explanation to outputcollector vs context

Jul 26, 2019 in Big Data Hadoop by Jai
 • 2,995 views
0 votes
2 answers

Load data into the hive table

Jul 26, 2019 in Big Data Hadoop by Jai
 • 3,908 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.