Supported External Data Types and Sources
INFO
Datameer X supports the following types of structured, semi-structured, and unstructured data types and sources when importing and exporting.
Supported External Databases
INFO
Relational databases include Oracle, DB2, and MySQL.
Database Name | Description |
---|---|
Amazon Athena |
|
Amazon Redshift |
|
Azure Cosmos DB |
|
Azure Databricks |
|
Azure Synapse |
|
DB2 |
|
Greenplum |
|
HSQL_file |
|
MSSQL |
|
MySQL |
|
Netezza |
|
Oracle |
|
PostgreSQL |
|
Sybase IQ |
|
Teradata Aster |
|
Vertica 5.1+ |
|
Supported External Files
INFO
You can import or upload individual sheets from a spreadsheet by first converting the file to a .CSV file type.
File Type | Description |
---|---|
Apache log files |
|
Apache Avro |
|
COBOL Copybook |
|
CSV (comma-delimited text files) |
|
Excel Workbooks |
|
Fixed Width |
|
HTML file |
|
IIS Logs (Internet Information Services) |
|
JSON |
|
Key/ value pair |
|
Log4j log file |
|
Mbox |
|
Netfilter/ IP Tables |
|
ORC (Optimized Row Columnar) |
|
Parquet |
|
Regex Parsable Text Files |
|
Sequence File wit Metadata |
|
Unsecured data |
|
XML data |
|
Supported External File System Connectors
File System | Description |
---|---|
Apache Knox WebHDFS |
|
Amazon S3 (Simple Storage Server) |
|
Azure Blob Storage |
|
Custom Protocol |
|
Datameer X Server Filesystem |
|
FTP (File Transfer Protocol) |
|
HDFS (Hadoop Distributed File System |
|
OpenStack Swift |
|
SFTP (SSH File Transfer Protocol) |
|
SSH (Secure Shell) |
INFO: Datameer X supports Bitverse SSH Server/Client for the Windows platform. The root paths to be specified while creating the connection should look something like: /c:/mydata/folder1 |
MapR FS |
|
Datameer X is able to split large files across multiple mappers enabling parallel data ingestion. Two requirements must be fulfilled for this to be possible.
- Splitting of the file protocol must be supported. Currently splitting all of the above protocols is supported.
- Splitting of the compression type must be supported. Currently LZO and Gzip are splittable, zip and Bz2 aren't supported.
See Importing Data for more information.
Supported Other External Connectors
External Connector | Description |
---|---|
Google BigQuery |
|
HBase |
|
Hive (JDBC) |
|
Hive Server2 (JDBC) |
|
IMAP & POP3 (Internet Message Access Protocol) |
|
Knox Hive Server2 JDBC |
|
Power BI |
|
Tableau Server |
|