Joining Multiple Spark Dataframes

Question

I have 'n' Spark Data-frames like this:

list(d1,d2,d3,d4,.....dn)

How can i join these 'n' Data-frames together?

Answer 1

You can run the below code to join those 'n' spark data-frames:

List(df1,df2,df3,dfN).reduce((a, b) => a.join(b, joinCondition))

Comments

Hi Bharani, Can you please explain a little bit. How are trying to achieve this.