Wednesday, 12 August 2020

How to fetch Spark Application Id programmaticall while running the Spark Job?

How to fetch Spark Application Id programmaticall while running the Spark Job?

scala> spark.sparkContext.applicationId

res124: String = local-1597209112732 


No comments:

Post a Comment

Flume - Simple Demo

// create a folder in hdfs : $ hdfs dfs -mkdir /user/flumeExa // Create a shell script which generates : Hadoop in real world <n>...