README.md

Counting words using Spark RDDs

Count the total number of words contained in the dataset constitution.txt

As a reference fot this assignment, please have a look of the lab 11 - Spark RDDs basics

In order to simplify the class execution using right-click -> Run on IntelliJ Idea, when creating the SparkConf object, configure it using .setMaster("local").

So for example:

// Create the SparkConf object
SparkConf conf = new SparkConf()
                    // Set the application name
                    .setAppName("MyApplication")
                    // Configure Spark to run locally instead of on a real cluster
                    .setMaster("local");
// Create the JavaSparkContext object using SparkConf as configured before
JavaSparkContext sc = new JavaSparkContext(conf);
// Program the remaining logic here

Solution is provided here