fog-hadoop

Fog connector for Hadoop

Installation

Add this line to your application's Gemfile:

gem 'fog-hadoop'

And then execute:

$ bundle

Or install it yourself as:

$ gem install fog-hadoop

Usage

Initial Setup

Require the gem:

require "fog/hadoop"

Connection parameters:

@connection_params = {
  hadoop_yarn_api_url:     "http://<resource_manager_host>:8088/",
  hadoop_hdfs_api_url:     "http://<namenode>:50070/"
}

• Use Yarn
• Use HDFS

Support

Check in this link

Contribute

Read the contribute documentation

Development

You can use this Vagrant Hadoop repo to have a environment to dev.