Deep Datameer Spotlight and Snowflake Integration
- Press Release
- June 5, 2020
The native integration enables Snowflake users to scale enterprise analytics workflows while reducing data transfer costs
SAN FRANCISCO, June 4th, 2020 – Datameer, makers of the world’s leading enterprise data pipeline and preparation solution Datameer X and virtual data and analytics hub Datameer Spotlight, today announced its native integration between Datameer Spotlight and Snowflake. Datameer Spotlight, Datameer’s newest product line, uses the latest data virtualization advancements to enable scalable, highly secured, and governed self-service analytics across the enterprise.
With the integration, data and analytics teams can now:
- Search for and discover data in very complex enterprise data landscapes in a highly governed fashion
- Securely access any structured or unstructured data across the enterprise — whether it’s in Snowflake or any other source on-premises or the cloud
Create new datasets from any data source without replicating or moving the data; Datameer Spotlight keeps all data in place at the source, making it the most secured and governed way to deliver data to employees across the enterprise
With this new native integration, Snowflake users can now experience increased access and modeling performance while reducing data movement and, by extension, the costs associated with data storage and transfers over the wire.
Datameer Spotlight leverages the Snowflake Connector for Spark for optimal query performance and, through the integration, enables:
- Push down processing. SQL queries and transformation logic are now executed directly in
Snowflake instead of within Datameer Spotlight or other downstream tools that consume the data. In large volumes of data, this drastically accelerates query times while reducing compute and networking costs. Besides, user data uploaded directly to Datameer Spotlight is intelligently pushed down to Snowflake to optimize join performance where appropriate.
- Caching. Datameer Spotlight users now have the ability to materialize their virtual datasets in Snowflake on demand — whether or not the data comes from Snowflake originally—to leverage the data warehouse’s blazing – fast query execution speed. This allows users to easily enrich existing Snowflake datasets and perform transformations and joins without any coding or costly ETL processes. These datasets are immediately accessible directly from Snowflake, bringing unmatched performance and optimizing Snowflake compute resources.
To learn more about how you can use Datameer Spotlight to create virtual data sets, and maximize your Snowflake investment, watch our VP of Engineering, Matt McManus, demo the integration.
About Datameer & Datameer Spotlight
Datameer Inc. is the company behind Datameer X, the most secure and reliable data pipeline and prep solution for machine learning, and Datameer Spotlight, the virtual data and analytics hub that customers use to virtualize their data landscape and scale highly governed self-service analytics across the enterprise. The company is headquartered in San Francisco, with offices in New York, Toronto, London, and Halle, Germany.