64 bit Steamroller on our way
Over the weekend I installed and configured a new build [v. 1421] of the Windows XP x64 Edition on my Compaq Presario 3000 Laptop with a 64-bit processor (just in...
64-bit (1 posts)
Data Structure (1 posts)
Data Structures in Python
In this post we will explore Data types in Python. The important thing about data structures in that you organize data to make certain things efficient.
Python (1 posts)
Data Structures in Python
In this post we will explore Data types in Python. The important thing about data structures in that you organize data to make certain things efficient.
azure (2 posts)
Hortonworks Sandbox with HDP 2.3 is now available on Microsoft Azure Gallery
We are excited to announce the general availability of Hortonworks Sandbox with HDP 2.3 on Microsoft Azure Gallery. Hortonworks Sandbox is already a very popular ...
Configuring Hortonworks Sandbox on Azure
For folks attending the workshop at Hadoop Summit, San Jose 2015 we provided Microsoft Azure Pass. If you already have an Azure account skip this step. If you are...
ec2 (1 posts)
Deploying a Hadoop cluster on EC2
In this post, we’ll walk through the process of deploying an Apache Hadoop 2 cluster on the EC2 cloud service offered by Amazon Web Services (AWS), using Hortonwo...
economy (1 posts)
falcon (2 posts)
Processing Data Pipeline on Hadoop clusters with Apache Falcon
Apache Falcon is a framework to simplify data pipeline processing and management on Hadoop clusters. It makes it much simpler to onboard new workflows/pipelines,...
Mirroring Datasets between Hadoop clusters with Apache Falcon
Apache Falcon is a framework to simplify data pipeline processing and management on Hadoop clusters. It provides data management services such as retention, repl...
future (1 posts)
hadoop (21 posts)
Transporting realtime event stream with Apache Kafka
Introduction Welcome to the three part tutorial on real time data processing with Apache Kafka, Apache Storm, Apache HBase and Hive. This set of tutorials will w...
Processing realtime event stream with Apache Storm
Introduction In this tutorial, we will explore Apache Storm and use it with Apache Kafka to develop a multi-stage event processing pipeline. In an event proce...
Apache Spark Tutorial with Hortonworks Data Platform
Apache Spark is a fast, in-memory data processing engine with an elegant development API that allows data workers to efficiently execute algorithms which require ...
Securing HDFS, Hive and HBase with Knox and Ranger
Introduction Apache Ranger delivers a comprehensive approach to security for a Hadoop cluster. It provides central security policy administration across the core...
Hortonworks Sandbox with HDP 2.3 is now available on Microsoft Azure Gallery
We are excited to announce the general availability of Hortonworks Sandbox with HDP 2.3 on Microsoft Azure Gallery. Hortonworks Sandbox is already a very popular ...
Processing Data Pipeline on Hadoop clusters with Apache Falcon
Apache Falcon is a framework to simplify data pipeline processing and management on Hadoop clusters. It makes it much simpler to onboard new workflows/pipelines,...
Mirroring Datasets between Hadoop clusters with Apache Falcon
Apache Falcon is a framework to simplify data pipeline processing and management on Hadoop clusters. It provides data management services such as retention, repl...
Analyzing Data in IPython Notebook with Apache Spark
In this tutorial, we are going to explore how to use IPython Notebook with Apache Spark to analyze text.
A Lap around Apache Spark 1.3.1 with HDP 2.3
This Apache Spark 1.3.1 with HDP 2.3 guide walks you through many of the newer features of Apache Spark 1.3.1 on YARN.
Using IPython Notebook with Apache Spark
In this tutorial we are going to configure IPython notebook with Apache Spark on YARN in a few steps.
Installing and configuring Zeppelin
git clone https://github.com/apache/incubator-zeppelin.git mv incubator-zeppelin/ /opt/ cd /opt/incubator-zeppelin/
Using Hive and ORC with Apache Spark
In this tutorial, we will explore how you can access and analyze data on Hive from Spark.
Exploring Spark with Scala
In this section we are going to walk through the process of using Scala and Apache Spark to interactively analyze data on a Apache Hadoop Cluster.
A short primer on Scala
Scala is relatively new language based on the JVM. The main difference between other “Object Oriented Languages” and Scala is that everything in Scala is an objec...
Installing Apache Spark 1.2.0 on HDP 2.2
After SSH’ing into your Sandbox, use su to login as root. Now let’s get the bits using the command
Installing Apache Spark 1.3.1 on HDP 2.2.4.2
In this section we will configure Spark 1.3.1 on Hortonworks Sandbox with HDP 2.2.
Configuring Hortonworks Sandbox on Azure
For folks attending the workshop at Hadoop Summit, San Jose 2015 we provided Microsoft Azure Pass. If you already have an Azure account skip this step. If you are...
Covering the HBase
Apache HBase was initially developed by Powerset, a natural language search engine startup in 2006. Then in 2008 they contributed the code base to the Apache Soft...
How to build a Hadoop VM with Ambari and Vagrant
In this post, we will explore how to quickly and easily spin up our own VM with Vagrant and Apache Ambari. Vagrant is very popular with developers as it lets one ...
Deploying a Hadoop cluster on EC2
In this post, we’ll walk through the process of deploying an Apache Hadoop 2 cluster on the EC2 cloud service offered by Amazon Web Services (AWS), using Hortonwo...
hbase (2 posts)
Securing HDFS, Hive and HBase with Knox and Ranger
Introduction Apache Ranger delivers a comprehensive approach to security for a Hadoop cluster. It provides central security policy administration across the core...
Covering the HBase
Apache HBase was initially developed by Powerset, a natural language search engine startup in 2006. Then in 2008 they contributed the code base to the Apache Soft...
hive (2 posts)
Securing HDFS, Hive and HBase with Knox and Ranger
Introduction Apache Ranger delivers a comprehensive approach to security for a Hadoop cluster. It provides central security policy administration across the core...
Using Hive and ORC with Apache Spark
In this tutorial, we will explore how you can access and analyze data on Hive from Spark.
hpc (1 posts)
Data dependency concerns in parallel computing
The most severe bottlenecks in high performance systems in majority cases results from I/O operations. To buffer I/O or other slow accesses, engineers devised cac...
kafka (1 posts)
Transporting realtime event stream with Apache Kafka
Introduction Welcome to the three part tutorial on real time data processing with Apache Kafka, Apache Storm, Apache HBase and Hive. This set of tutorials will w...
knox (1 posts)
Securing HDFS, Hive and HBase with Knox and Ranger
Introduction Apache Ranger delivers a comprehensive approach to security for a Hadoop cluster. It provides central security policy administration across the core...
parallel computing (1 posts)
Data dependency concerns in parallel computing
The most severe bottlenecks in high performance systems in majority cases results from I/O operations. To buffer I/O or other slow accesses, engineers devised cac...
ranger (1 posts)
Securing HDFS, Hive and HBase with Knox and Ranger
Introduction Apache Ranger delivers a comprehensive approach to security for a Hadoop cluster. It provides central security policy administration across the core...
sandbox (1 posts)
Hortonworks Sandbox with HDP 2.3 is now available on Microsoft Azure Gallery
We are excited to announce the general availability of Hortonworks Sandbox with HDP 2.3 on Microsoft Azure Gallery. Hortonworks Sandbox is already a very popular ...
saptak (1 posts)
Saptak Sen
Senior Technical Product Manager @ Hortonworks Current Hortonworks Previous Microsoft Corporation, Myzus, AAL Infotech Send a message on Link...
scala (1 posts)
A short primer on Scala
Scala is relatively new language based on the JVM. The main difference between other “Object Oriented Languages” and Scala is that everything in Scala is an objec...
security (1 posts)
Securing HDFS, Hive and HBase with Knox and Ranger
Introduction Apache Ranger delivers a comprehensive approach to security for a Hadoop cluster. It provides central security policy administration across the core...
spark (10 posts)
Apache Spark Tutorial with Hortonworks Data Platform
Apache Spark is a fast, in-memory data processing engine with an elegant development API that allows data workers to efficiently execute algorithms which require ...
Analyzing Data in IPython Notebook with Apache Spark
In this tutorial, we are going to explore how to use IPython Notebook with Apache Spark to analyze text.
A Lap around Apache Spark 1.3.1 with HDP 2.3
This Apache Spark 1.3.1 with HDP 2.3 guide walks you through many of the newer features of Apache Spark 1.3.1 on YARN.
Using IPython Notebook with Apache Spark
In this tutorial we are going to configure IPython notebook with Apache Spark on YARN in a few steps.
Installing and configuring Zeppelin
git clone https://github.com/apache/incubator-zeppelin.git mv incubator-zeppelin/ /opt/ cd /opt/incubator-zeppelin/
Using Hive and ORC with Apache Spark
In this tutorial, we will explore how you can access and analyze data on Hive from Spark.
Exploring Spark with Scala
In this section we are going to walk through the process of using Scala and Apache Spark to interactively analyze data on a Apache Hadoop Cluster.
Installing Apache Spark 1.2.0 on HDP 2.2
After SSH’ing into your Sandbox, use su to login as root. Now let’s get the bits using the command
Installing Apache Spark 1.3.1 on HDP 2.2.4.2
In this section we will configure Spark 1.3.1 on Hortonworks Sandbox with HDP 2.2.
storm (1 posts)
Processing realtime event stream with Apache Storm
Introduction In this tutorial, we will explore Apache Storm and use it with Apache Kafka to develop a multi-stage event processing pipeline. In an event proce...
vagrant (1 posts)
How to build a Hadoop VM with Ambari and Vagrant
In this post, we will explore how to quickly and easily spin up our own VM with Vagrant and Apache Ambari. Vagrant is very popular with developers as it lets one ...
windows (1 posts)
64 bit Steamroller on our way
Over the weekend I installed and configured a new build [v. 1421] of the Windows XP x64 Edition on my Compaq Presario 3000 Laptop with a 64-bit processor (just in...