Overview: A caching system management used in SparkSQL/Apache Spark and HDFS

Requirements: SparkSQL, ApacheSpark, HDFS, Data caching algorithm and English skills.

Motivation: We are now using the HDFS to store and manage the data. And we do also the data analytics using SparkSQL in Apache Spark.

Normally, the Application Driver of Apache Spark will load the distributed data in HDFS into memory and do the processing. Finally, Spark will return the results to the HDFS. Sometime, the results we got from previous queries could be used again once or more time by next queries. Then, we want to cache these result in our memory long enough by using a mechanism of caching, it called semantic caching.

What we want is: an implementation of semantic caching program in Apache Spark. The program should be done by Scala/Java language but Scala is preferable.

ANALYZING AN ARGUMENT THROUGH MULTIPLE LENSES

So far this term we have looked at a discussion on animals and morality through multiple
perspectives. Mark Twain sarcastically told us that humans are the lower animal because
of our morality. On the other hand, E.B. White draws parallels against humans and farm
animals as he contemplates the world as suffering. Lastly, David Foster Wallace
navigates through lobster consumption and asks us to confront our own behavior in this
consumption.
In this assignment you will discuss the arguments from at least two articles that have
been discussed in the second unit this term. Using a discussion of animals, you will first
develop an argument by answering the question: is morals what determines negative
human behavior? (However, you may develop whatever argument you want). There are
three texts that you can use to support your argument: The Lowest Animal by Mark
Twain, Death of a Pig by E.B. White, and Consider the Lobster by David Foster
Wallace. You must use at least two texts in developing your argument however you may
use all three if you wish.
The purpose of this paper is to synthesize multiple texts to support an overall argument.
You will discuss the arguments of your outside sources and put them in conversation with
one another. You can use the texts to illustrate your argument (support). You may also
complicate or challenge your outside sources to support your argument (or show how
they complicate/challenge one another).

Requirements:
1.
Formulate one singular thesis statement (debatable argument) that answers the
question: is morals what determines negative human behavior?
2.
Choose texts that illustrate your argument or that you are interested in
complicating or challenging.
3.
Introduce your sources and articulate their arguments (must use at least two texts)
4.
Put the texts into a conversation with one another. How do they play off of each
other?
DETAILS

Length: 5-7 full pages, not including Works Cited page
Format: Standard MLA, including:
– uniform double-spacing throughout document
– title
– 1 margins all around
– Works Cited page
– Times New Roman, size 12 font