Hadoop is one of the applications for big data analysis, which is quite popular for its storage system that is Hadoop distributed file system (HDFS). It is a Java-based open source framework which stores big datasets in its distributed file system and processes them using MapReduce programming model. Since the last decade, the size of big datasets has increased exponentially, going up to exabytes. Furthermore, even in a small organisation, big datasets range from hundreds of gigabytes to hundreds of petabytes (1 petabyte = 1000 gigabytes). When the size of datasets increase, it becomes more difficult for traditional applications to analyse them. That is where frameworks like hadoop and its storage file system come into play (Taylor, 2010).
With increasing use of big data applications in various industries, Hadoop has gained popularity over the last decade in data analysis. It is an open-source framework which provides distributed file system for big data sets. This allow users to process and transform big data sets into useful information using MapReduce Programming Model of data processing (White, 2009).
Most part of hadoop framework is written in Java language while some code is written in C. It is based on Java-based API. However programs in other programming languages such as Python can also use the its framework using an utility known as, Hadoop streaming. Read more »
Big data software and big data has been a buzzword in the computing era for over a decade now. It is a term used for large and complex data sets which is difficult to be processed and analysed by traditional data processing software. These large data sets can be structured or unstructured. The data comes from various sources such as:
- social media,
- scientific applications,
- sensors, surveillance,
- video and image archives.
These large data sets are analysed to find hidden patterns, relations between pieces of data, market trends or other information. But, in the end, it is not about the amount of data, it is about what the organization does with the data (Boyd & Crawford, 2011).
Supply chain management and logistics are the crucial part of the business processes. It is the logistics and the supply chain management that manages the distribution, storage, transportation and packaging as well as delivery of the items. Big data plays an important role in managing the logistics and supply chain management (Ghosh 2015). This article is aimed to highlight the importance of big data in supply chain and logistic taking the special case of Amazon. Read more »
It has become important to create a new platform to fulfill the demand of organizations due to the challenges faced by traditional data. By leveraging the talent and collaborative efforts of the people and the resources, innovation in terms of managing massive amount of data has become tedious job for organisations. This can be fulfilled by implementing big data and its tools which are capable to store, analyze and process large amount of data at a very fast pace as compared to traditional data processing systems (Picciano 2012). Big data has become a big game changer in today’s world. The major difference between traditional data and big data are discussed below. Read more »
Complex or massive data sets which are quite impractical to be managed using the traditional database system and software tools are referred to as big data. Big data is utilized by organizations in one or another way. It is the technology which possibly realizes big data’s value. It is the voluminous amount of both multi-structured as well unstructured data. Unstructured data is the one that is not organized and thereby cannot be interpreted by using a software or traditional database (Sawant & Shah 2013). Read more »
The common buzzword of Information Technology era during the last decade is “Cloud Computing”, with many world-market players shaping the field, such as Amazon Elastic Computing Cloud (Amazon EC2), Skype, Box.com, Dropbox, Twitter, Facebook and chatter.com. Read more »
Computer that we use so freely today is a product of years of work by Konrad Zuse (Ceruzzi 1981). Zuse would be amazed at the way the modern world has used his simple invention. Read more »