Recent questions tagged apache-spark

0 votes
1 answer

Spark memory processing on a not temporary table

Jul 14, 2019 in Apache Spark by Kunal
 • 2,772 views
0 votes
1 answer

Can we change the path where the Hive data is stored in HDFS?

Jul 14, 2019 in Apache Spark by Kevin
 • 2,252 views
0 votes
1 answer

What does the command df.registerTempTable() do?

Jul 14, 2019 in Apache Spark by ophelia
 • 9,963 views
0 votes
1 answer

Spark: How can i create temp views in user defined database instead of default database?

Jul 14, 2019 in Apache Spark by Ashul
 • 6,357 views
0 votes
1 answer

org.apache.spark.sql.AnalysisException: cannot resolve "`id`" given input columns

Jul 14, 2019 in Apache Spark by Esha
 • 19,218 views
0 votes
1 answer

Difference between cogroup and full outer join in spark

Jul 14, 2019 in Apache Spark by Hiran
 • 11,588 views
+1 vote
1 answer

How do I turn off INFO Logging in Spark?

Jul 12, 2019 in Apache Spark by nitinrawat895
 • 11,380 points • 7,843 views
0 votes
1 answer

Working of map function on data

Jul 11, 2019 in Apache Spark by Medha
 • 2,214 views
0 votes
1 answer

Spark error: Caused by: java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

Jul 11, 2019 in Apache Spark by Raghu
 • 9,308 views
0 votes
1 answer

Is fetching data from apache flume webcrawling?

Jul 11, 2019 in Apache Spark by Karan
 • 2,141 views
0 votes
1 answer

Why do we use sc.parallelize?

Jul 11, 2019 in Apache Spark by Sumit
 • 14,866 views
0 votes
1 answer

Error Loading data to mysql in Spark

Jul 11, 2019 in Apache Spark by Karan
 • 2,560 views
0 votes
1 answer

Spark Streaming Pyspark code not working

Jul 11, 2019 in Apache Spark by Rishi
 • 3,635 views
+1 vote
1 answer

How to add package com.databricks.spark.avro in spark?

Jul 10, 2019 in Apache Spark by Karuna
 • 7,717 views
0 votes
1 answer

Query regarding Appending " to a string in Scala

Jul 10, 2019 in Apache Spark by Rishi
 • 3,493 views
0 votes
1 answer

org.apache.spark.sql.AnalysisException: cannot resolve given input columns

Jul 10, 2019 in Apache Spark by Firoz
 • 47,356 views
0 votes
1 answer

Query regarding Operator Overloading in Scala

Jul 10, 2019 in Apache Spark by Rachit
 • 2,786 views
0 votes
2 answers

Error : split value is not a member of org.apache.spark.sql.Row

Jul 10, 2019 in Apache Spark by Kiran
 • 14,813 views
0 votes
1 answer

Scala join comma delimited file as tables

Jul 9, 2019 in Apache Spark by Lohit
 • 2,133 views
0 votes
1 answer

How to use yield keyword in scala and why it is used instead of println?

Jul 6, 2019 in Apache Spark by gandhi
 • 3,286 views
0 votes
1 answer

How to print loop with condition in scala?

Jul 5, 2019 in Apache Spark by neha
 • 1,716 views
0 votes
1 answer

How to implement two level loop in scala?

Jul 5, 2019 in Apache Spark by rajiv
 • 1,753 views
0 votes
1 answer

How can you use "for" statement in scala to print list from collection?

Jul 5, 2019 in Apache Spark by nisha
 • 2,120 views
0 votes
1 answer

How can we iterate any function using "foreach" function in scala?

Jul 5, 2019 in Apache Spark by nisha
 • 2,866 views
0 votes
1 answer

How to print string text in scala?

Jul 5, 2019 in Apache Spark by rajesh
 • 3,931 views
0 votes
1 answer

How can we optimize and minimize the memory when work with scala use case?

Jul 5, 2019 in Apache Spark by nilam
 • 2,070 views
0 votes
1 answer

Which syntax to use to take the sum of list of collection in scala?

Jul 5, 2019 in Apache Spark by tanvi
 • 3,149 views
0 votes
1 answer

How to assign block expression in scala?

Jul 5, 2019 in Apache Spark by tejas
 • 1,892 views
0 votes
1 answer

load/save in spark

Jul 5, 2019 in Apache Spark by Esha
 • 2,671 views
0 votes
1 answer

How to create dataframe for the comma delimited file?

Jul 5, 2019 in Apache Spark by Yogi
 • 5,714 views
0 votes
1 answer

Spark Installation problem

Jul 5, 2019 in Apache Spark by Jin
 • 6,402 views
0 votes
1 answer

When we create an RDD, does it bring the data and load it into the memory?

Jul 5, 2019 in Apache Spark by geeta
 • 2,138 views
0 votes
1 answer

Is it mandatory to start Hadoop to run spark application?

Jul 5, 2019 in Apache Spark by disha
 • 2,289 views
0 votes
1 answer

What is Lazy evaluated in Spark?

Jul 5, 2019 in Apache Spark by rashmi
 • 2,608 views
0 votes
1 answer

Which File System is supported by Apache Spark?

Jul 5, 2019 in Apache Spark by naina
 • 7,562 views
0 votes
1 answer

How will you explain yield keyword in Scala?

Jul 5, 2019 in Apache Spark by jeena
 • 1,943 views
0 votes
1 answer

Do real-time data processing is possible with Spark SQL?

Jul 5, 2019 in Apache Spark by Tina
 • 2,695 views
0 votes
1 answer

What is Spark Driver?

Jul 5, 2019 in Apache Spark by nita
 • 3,783 views
0 votes
1 answer

How to run spark in Standalone client mode?

Jul 5, 2019 in Apache Spark by jinish
 • 3,066 views
0 votes
0 answers

How to create RDD as string file?

Jul 5, 2019 in Apache Spark by anand
 • 1,891 views
0 votes
1 answer

error: reassingment to val

Jul 5, 2019 in Apache Spark by nikhil
 • 4,927 views
0 votes
1 answer

What does reduce action do in Spark?

Jul 4, 2019 in Apache Spark by kanika
 • 1,731 views
0 votes
1 answer

What is RDD Lineage in Spark?

Jul 4, 2019 in Apache Spark by nandini
 • 5,525 views
0 votes
1 answer

What is SparkCore functionalities?

Jul 4, 2019 in Apache Spark by naina
 • 2,194 views
+1 vote
1 answer

Error: value textfile is not a member of org.apache.spark.SparkContext

Jul 4, 2019 in Apache Spark by amrita
 • 6,051 views
0 votes
1 answer

error: identified expected but integer literal found.

Jul 4, 2019 in Apache Spark by NItin
 • 7,819 views
0 votes
1 answer

How to create RDD from an external file source in scala?

Jul 4, 2019 in Apache Spark by Reena
 • 3,129 views
0 votes
1 answer

How to create RDD from existing RDD in scala?

Jul 4, 2019 in Apache Spark by Nihal
 • 2,627 views
0 votes
1 answer

How to create RDD from parallelized collection in scala?

Jul 3, 2019 in Apache Spark by sunny
 • 3,067 views
0 votes
1 answer

error: identifier expected but ']' found.

Jul 3, 2019 in Apache Spark by tara
 • 6,895 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.