Page tree
Skip to end of metadata
Go to start of metadata

Datameer Application Server

Recommended Hardware (production environment):
  • 1U Server
  • 2 Quad Core CPUs
  • 8 + GB RAM
  • 2 x 1 TB Hard Drives (Recommended available disk space: 250 GB)
  • RAID - 0 stripping
  • RAID - 1 mirroring
  • Redundant power
  • Failover requires a standby server with the same configuration
Required Software:
  • Unix-based operating system (see Tested Operating Systems for more information)
  • Oracle Java 1.6.x (32-bit or 64-bit) up-to-date bug fix version recommended

    Icon

    OpenJDK will NOT work, due to unimplemented compression and encryption mechanisms (i.e. no kerberos)

  • Installed software: SSH, VI, MySQL 5.1, 5.5, 5.6 (server and client executables must be available via shell search path)

    Icon

    MySQL 5.6 is available in Datameer v2 from 2.1.7.14 and up.

  • optional: SMTP server (for email notification)

Datameer Database Server

The Datameer Database can be hosted on the same machine as the Datameer Application Server or can be located on a hosted database (e.g. RDS from Amazon Web Services). Hosted databases must use MySQL 5.1 or higher. The recommended size is a minimum of 5 GB.

 MySQL 5.6 is supported as of Datameer v2.1.6


Hadoop Cluster

  • One of the supported Hadoop Distributions installed (Datameer will install Hadoop if it not already available)
  • Gigabit switches (10 GigE interconnected)
  • Sufficient power supply & cooling

Hadoop Master (NameNode and JobTracker)

Hardware:
  • 1U Server
  • 2 Quad Core CPUs
  • 16 + GB RAM
  • 2 x 1 TB hard drives
  • RAID - 0 stripped
  • RAID - 1 mirroring
  • Redundant power
  • Failover requires a standby server with the same configuration
Software:
  • Unix-based system (e.g., Ubuntu Linux 10.04)
  • Java 1.6.x (Sun recommended)
  • Set JAVA_HOME to the root of your Java installation
  • Installed software: VI, SSH, SSHD, rsync, and SCP

Hadoop Slave

Hardware:
  • 1U Server
  • 2 Quad Core CPUs
  • 16 GB RAM (2 GB per Core)
  • 4 x 1 TB hard drives
  • 1 Gbps + network
Software:
  • Unix-based system (e.g., Ubuntu Linux 10.04)
  • Java 1.6.x (Sun recommended)
  • Set JAVA_HOME to the root of your Java installation
  • Installed software: VI, SSH, SSHD, rsync, and SCPAWS (Elastic MapReduce)

EC2/Elastic MapReduce Deployments:

  • EC2 Access Key
  • EC2 Secret Access Key
  • EC2 Private Key Name
  • EC2 Private Key File
  • One empty S3 bucket
  • No labels