Datameer Spotlight virtualizes your data landscape and connects to all data sources—including cloud object stores like S3, data lakes, data warehouses like Snowflake, Redshift, Teradata or Exadata, files, or catalogs—both in the cloud or on-premises. Datameer Spotlight indexes the metadata of every data source and creates a searchable inventory of assets that can easily be mined by analysts and data scientists—all without moving any data. Typical searchable information includes table and column names, authors, characters of uploaded files, usage patterns, trust scores, and more.
Datameer Spotlight’s virtual modeling capabilities support the most common data transformation functions—like aggregations, filtering, replace/extract, column splits, and JSON parsing—and offer machine learning-guided blend suggestions. A visual point-and-click workbench enables you to accelerate analytics workflows without having to move any data. Beyond that, Datameer Spotlight’s caching functionality further increases performance.
Datameer Spotlight’s Collaboration feature allows analysts and data scientists to share knowledge on assets and analytic workflows—helping you build a community along the way. Datameer Spotlight supports the concept of shared workspaces, including newsfeeds, notifications, tagging, comments, and following, making it easy to find and engage subject matter experts, reuse assets, and develop a framework of trust around people and analytics.
Analysts and data scientists can connect their favorite tools to Datameer Spotlight—like Tableau, Excel. PowerBI, Looker, Qlik, Spotfire, Jupyter Notebooks, and more. Datameer Spotlight brokers the queries and executes them in its Spark SQL compute framework or pushes it down to a lower-level system, like a cloud-based or on-prem data warehouse.
In this brief video, we show you how to access a JSON file from S3 quickly, parse it, and combine it with a Snowflake table, in a few clicks, before visualizing Tableau’s results.