Connector for Spark Thrift

This feature is not available when using a Kerberos secure cluster.

Configuring a Spark Thrift as a Connection

In order to import from Spark Thrift, you must first create a connection.

  1. Click the + (plus) button and select Connection or right-click in the browser and select Create new > Connection.
  2. From the drop-down list select Spark Thrift Server as the connection type.
     
  3. Enter the URL for the Spark Thrift JDBC.
  4. Enter the user name and password.
  5. Select if the connection to be used for import, export, or both.
  6. Save the connector.

Importing Data with a Spark Thrift Connector

After configuring a Spark Thrift connection the wizard you can set up one or more import jobs which access that Spark Thrift connector. 

  1.  Click the + (plus) button and select Import or right-click in the browser and select Create new > Import.
  2. Click New and choose the name of your Spark connection (here - Spark_Connection) then click Next.
  3. Select table, view, or create your own SQL statement for import.
  4. Click Next.
  5. A preview of the imported data is displayed. Review the schema and click Next.

  6. Set the import to be triggered manually or set to run on a schedule.
  7. Name and save the import job.

The import job is viewable under Datameer's File Browser tab.