Spark

Eclipse & Scala configuration
Dear Rameshbabu, Hope you are doing well.  Please confirm us are you using edureka VM or you have done your own setup? ...
Wed, 6 Jul, 2016 at 12:14 PM
Access my Hive database from Scala or Pyspark using Spark SQL
Dear Indrajit, Hope you are doing well. Please confirm are you using edureka VM? If you are using edureka VM: 1. First you have to copy the ...
Wed, 6 Jul, 2016 at 12:13 PM
Running spark application on yarn
Dear Pavan, Hope you are doing well. Please try the below example I hope this will help you. ...
Wed, 6 Jul, 2016 at 12:09 PM
Spark Codes using Eclipse
Dear Learner, Hope you are doing great. Please have a look on the below video so you can run the Spark codes using Eclipse. https://edur...
Tue, 23 Aug, 2016 at 4:11 PM
spark to beeline
Dear Sampat, Hope you are doing well. Please follow the below steps ==> cd spark1.5.2 ==> ./sbin/start-master.sh ==...
Wed, 15 Mar, 2017 at 4:32 PM
verride in scala.
Dear Rajesh, Hope you are doing well. Overriding is only for methods not to override a variable. What changes if you override a variable wi...
Thu, 16 Mar, 2017 at 11:00 AM
scala plugin on eclipse.
Dear Mamta, Hope you are doing well. Please install scala plugin in eclipse luna and it won't affect any present configuration. ...
Sun, 19 Mar, 2017 at 10:53 AM
WORDCOUNT IN SPARK.
Hi Shubham, Hope you are doing well. It was great speaking to you. As discussed please find the below details for wordcoun...
Thu, 23 Mar, 2017 at 3:35 PM
Spark join and reading a csv
Hi Sudheer, Hope you are doing well. These kind of joins are preffered to be operated by spark-sql and hive integration as with RDD it won&...
Tue, 28 Mar, 2017 at 9:28 AM
Converting dataframe into json
Dear Ravi, Hope you are doing well. The input should be like the below sample. We cannot keep column1 and column2 in dataset because it w...
Thu, 13 Apr, 2017 at 4:07 PM