Posts

PRACTICAL 4: Working with Hadoop Ecosystem

Image
PRACTICAL 4: Working with Hadoop Ecosystem This is a short guide on how to install Hadoop single node cluster on a Windows computer. The process is straight forward. First, we need to download and install the following software: ·          JAVA Download the Java 1.8 from https://java.com/en/download/ Once installed confirm that you’re running the correct version from command line using ‘java -version’ command, output of which you can confirm in command line like this: Figure 1 - checking java ·          HADOOP Install a Hadoop distribution. To do so, Download the most recent release Hadoop 3.0.0-alpha2 (25 Jan, 2017) in a binary form, from the Apache Download Mirror at http://hadoop.apache.org/releases.html Once the hadoop-3.0.0-alpha2.tar.gz (250 MB) downloaded, extract it by using WinRAR into C:\hadoop-3.0.0-alpha2 folder: Figure 2 - extracting hadoop in c: ·  ...

CRUD SQL Operations with Python using SQLite

Image
SQL Operations with Python using SQLite   SQLite is a software library that implements a self-contained, server less, zero-configuration, transactional SQL database engine. SQLite is the most widely deployed SQL database engine in the world. Install SQLite on Windows Step 1 − Go to https://www.sqlite.org/download.html , and download precompiled binaries from Windows section. Step 2 − Download sqlite-shell-win32-*.zip and sqlite-dll-win32-*.zip zipped files. Step 3 − Create a folder C:\>sqlite and unzip above two zipped files in this folder, which will give you sqlite3.def, sqlite3.dll and sqlite3.exe files. Step 4 − Add C:\>sqlite in your PATH environment variable and finally go to the command prompt and issue sqlite3 command, which should display the following result. Creating Database ·          Import the sqlite3 library. ·          Create a connection to the database by ...

Part 1: Spreadsheet Data Analysis and Data Visualization- Problem Statement

This assignment makes use of the following dataset. Titanic Download link:  Titanic.csv Description: Data on passengers of the RMS Titanic. Entries include the name, age, class, fare, gender, and whether or not the passenger survived Notes: A blank entry for age means that the age is unknown Hint: If you're having trouble with VLOOKUP or any of the other functions you want to use, take a look at the  documentation  for Google Sheets. ------------------------------------------------------------------------------------------------------------ Problem 1.  Are there any characteristics shared by all passengers whose fare is 0? Problem 2.  How many married women over age 50 embarked in Cherbourg? (Married women are denoted by "Mrs.") Problem 3.  Which embarkation city had the highest-paying passengers on average? Problem 4.  What is the most common last name among passengers? What is the average number of passengers per last ...

PRACTICAL 2: Hand on with Python

Image
PRACTICAL 2: Hand on with Python Python is an interpreted high-level programming language for general-purpose programming. Created by Guido van Rossum and first released in 1991, Python has a design philosophy that emphasizes code readability, and a syntax that allows programmers to express concepts in fewer lines of code. Python interpreters are available for many operating systems. Python, the reference implementation of Python, is open source software and has a community-based development model, as do nearly all of its variant implementations. Python is managed by the non-profit Python Software Foundation. INSTALLING AND DOWNLOADING (Python: Version 3.6.2) The Python download requires about 30 Mb of disk space; keep it on your machine, in case you need to re-install Python. When installed, Python requires about an additional 90 Mb of disk space. 1.        Logon to https://www.python.org/ The following page will appear in your browser....