Showing posts with label HDFS. Show all posts
Showing posts with label HDFS. Show all posts

Tuesday, 11 April 2017

Big Data - Kapil Sharma (101)

Big Data consists of five types:

1. Volume

2. Velocity 

3. Variety 

4. Veracity 

5. Value  

More than 90% of big data set created in last 3+ years.

To process this huge data set of unstructured data, big data frameworks comes in picture. 

To retrieve value from processing, computing and analysis data leads to the unique value addition. 




Wednesday, 5 November 2014

What is Hadoop - Kapil Sharma

What is Hadoop?

Hadoop - is an open-source software framework for storing and processing big data in a distributed fashion on large clusters of commodity hardware. Essentially, it accomplishes two tasks: massive data storage and faster processing.

Currently three core components are included with your basic download from the Apache Software Foundation.


HDFS - the Java-based distributed file system that can store all kinds of data without prior organization.

MapReduce – a software programming model for processing large sets of data in parallel.

YARN – a resource management framework for scheduling and handling resource requests from distributed applications.