Big Data Management

Datameer provides robust, enterprise grade data management capabilities. Easy to setup (no programming) with flexible integration points to manage data flow dependencies.

  • Your organization's data hub

    Import, Export, Data Links

    Datameer is ideal as the general purpose data hub for an organization. Datameer includes a wide set of data connectors to import as well as export data and uses the full power of the underlaying server or cluster environment including distributing the loading process to reach terabyte/second throughput. Datameer provides a fine grain configuration of scheduling and trotting to make sure data loading does not max out data sources. Concepts like publish/subscribe are easy to implement and monitor. Orchestrate from the outside via the REST API. 

  • some alt text

  • Manage data from megabytes to petabytes

  • Partition
  • Storage, Data Partitioning

    Datameer transparently manages the storage of data in HDFS from desktop to large Hadoop cluster. A wide set of file systems are supported. From local file systems in the Personal & Workgroup Editions to purpose-built, distributed file systems like HDF over S3 to GFS. Datameer stores data in a folder in the Hadoop Environment or on a local hard drive. The data is put in a Sequence File format, optimized for performance, and with extended support of data types. Datameer allows flexible partitioning of the data to ensure it is easy to work with very large amounts of data and analyze subsets.

  • Algorithms that help optimize hardware

    Compression

    Get the most out of your hardware investment. Datameer optimizes both storage and data throughput. A wide range of compression algorithms allow users to select between high compression, for long-time data storage, or optimize for data throughput. It is possible to mix and match compressions used for different data sets within the system, providing unlimited flexibility. Datameer enables compressing stored data as well as the import and export of compressed data sets. Loading gzip compressed log files is a point and click operation.

  • Compression
  • Retention Policy
  • Manage your own data retention

    Retention Policy

    Datameer's data retention policy management enables flexible data retirement rules. For each imported data set, an individual set of rules can be configured. It is easy to configure both keeping data permanently, or cleaning records that are older than a specific time window. Security rules allow retired data to be either instantly removed, retained until a specified time, or manually removed after system administrator approval.

  • +1.800.874.0569