Spark

Spark master and Spark UI.
Hope you are doing well. 1> Go to spark folder and start the spark master, command: ./sbin/start-master.sh 2...
Sat, 16 Apr, 2016 at 12:26 PM
Spark and twitter.
Spark and twitter.
Sat, 16 Apr, 2016 at 12:25 PM
spark-vs-hadoop assignment
Dear Rehan, Hope you are doing well. As the error suggest Input path does not exist: hdfs://localhost:8020/README.md, it seems ...
Sat, 16 Apr, 2016 at 12:20 PM
Word Count in Spark.
Hope you are doing well. It was great speaking to you. Below is the code for word count. CODE:         import org...
Sat, 16 Apr, 2016 at 12:18 PM
Spark Project
Spark Project Details
Fri, 15 Apr, 2016 at 4:01 PM
pyspark issue in Cloudera quickstart VM | env: /usr/lib/lib/python3.5 permission denied
Query:  By Default the cloudera quickstartvm has python 2.6.6 however that is an old version so for our project requirement we need pytho...
Tue, 24 May, 2016 at 12:33 PM
Concatenate two RDD's in spark | how to join two RDD's
Hope you are doing well It seems that you want to concatenate two RDD's. If so, you can achieve it using UNION command. val...
Wed, 1 Jun, 2016 at 4:01 PM
Inner join in Spark Sql | Example of Sqlcontext
Please refer to the below example that would guide you in performing Inner join in Spark SQL. Input Datasets: ...
Sat, 9 Jul, 2016 at 6:27 PM
Directed Acyclic Graph(DAG) VS Lineage Graph in Spark
Dear Ranganathan, Hope you are doing well Q1) Then what is Lineage Graph  When a new RDD is derived from existi...
Fri, 8 Jul, 2016 at 6:43 PM
Intelli J IDEA IDE Tool
Dear Kumar, Hope you are doing well. It was great speaking to you. As discussed I am sending you all the information....
Wed, 6 Jul, 2016 at 12:32 PM