Datameer Blog

Blog

Active Metadata Management: What It Is and Why Static Catalogs Can’t Keep Up

Active Metadata Management: What It Is and Why Static Catalogs Can’t Keep Up

Active metadata management keeps catalogs current with event-driven ingestion and a live metadata graph. See how it works and why static catalogs drift.

  • Infrasity
  • October 19, 2026
Diagram of data sources feeding an AI agent that builds pipelines, monitors runs and fixes issues in agentic data pipelines

Agentic Data Pipelines: How AI Agents Build, Monitor, and Fix Them

Learn how agentic data pipelines work, why AI agents break things downstream, and the lineage context they need to build, monitor and fix pipelines safely.

  • Infrasity
  • October 19, 2026
Snowflake Data Pipelines: A Guide to Real-Time Data Lineage

Snowflake Data Pipelines: A Guide to Real-Time Data Lineage

Learn what real-time data lineage means for Snowflake pipelines, why 2026 regulations raise the stakes, and how runtime-aware lineage catches costly changes.

  • Infrasity
  • October 19, 2026
Real-time vs batch-processed data lineage

Real-Time Data Lineage: How It Differs From Batch-Processed Lineage

Learn how real-time data lineage differs from batch processing, why it matters for incident response, and how event-driven capture works.

  • Infrasity
  • September 29, 2026
DBT and the Challenges of Large-Scale Data Transformation

DBT and the Challenges of Large-Scale Data Transformation

DBT allows users to write transformations as SQL SELECT statements, which makes it easy to understand the transformation logic. But while DBT is a powerful tool, it's not without its challenges.

  • Ndz Anthony
  • October 5, 2023
Reliable AI Models: 10 Data Reliability Checks Every Analyst Should Perform in 2023

Reliable AI Models: 10 Data Reliability Checks Every Analyst Should Perform in 2023

From the fictional AI character JARVIS in the Iron Man series to real-life AI models powering businesses, artificial intelligence has woven itself into

  • Ndz Anthony
  • September 28, 2023
Mastering Snowflake: Your Ultimate How-To Guide Collection

Mastering Snowflake: Your Ultimate How-To Guide Collection

Whether you're a complete beginner or just looking to brush up on some skills, this Snowflake guide has something for you.

  • Ndz Anthony
  • September 21, 2023
KDNuggets-logo

Top 6 Tools to Improve Your Productivity in Snowflake

Let's dive in and explore these top 6 tools to improve your productivity and take your Snowflake operations to the next level.

  • Ndz Anthony
  • August 17, 2023
4 Must-Know Techniques for Effective Anomaly Detection in Data Sets

4 Must-Know Techniques for Effective Anomaly Detection in Data Sets

Anomaly detection is a critical aspect of data analysis that involves identifying data points or patterns that deviate significantly from the norm.

  • Ndz Anthony
  • July 3, 2023
Why Data Validation at Every Stage of the Snowflake Data Pipeline?

Why Data Validation at Every Stage of the Snowflake Data Pipeline?

How Datameer aids in data validation and analysis turning your data into a reliable asset for sound business decisions

  • Ndz Anthony
  • June 20, 2023
data quality management

Elevating Data Quality At Every Stage Of The Pipeline

Improve data quality with effective management strategies. Unlock insights, ensure accuracy, and avoid pitfalls for business success.

  • Ndz Anthony
  • June 19, 2023
Enterprise Data Catalog(EDC): The Power of Organized Data

Enterprise Data Catalog(EDC): The Power of Organized Data

Data has become the backbone of modern businesses. We’re living in a world where data-driven decisions are no longer a luxury, but a necessity. As the In this blog, we’ll dive into the nitty-gritty of EDCs, discuss their benefits, and share some tips on how to implement one in your organization.

  • Ndz Anthony
  • April 27, 2023
What is Enterprise Data Governance and Why Does It Matter?

What is Enterprise Data Governance and Why Does It Matter?

In this article, we will discuss the main components, principles and best practices around enterprise data governance.

  • Ndz Anthony
  • March 27, 2023
data catalog usecases

Data Catalog Use Cases to Accelerate Data Transformation Decisions

Let's dive into Data Catalog use cases to help data analysts accelerate the decision-making processes of any data transformation project.

  • Stephen Butts
  • March 1, 2023
Charting a Course to Data Success: Navigating the Waters of Data Governance Strategies

Charting a Course to Data Success: Navigating the Waters of Data Governance Strategies

In this article, we cover the nuances of data governance; it's benefits, challenges and 7 steps to implementing good Data Governance

  • Ndz Anthony
  • February 27, 2023
The Golden Warehouse Metrics Part II – Governance

The Golden Warehouse Metrics Part II – Governance

TL;DR: We observed decreased performance of our Snowflake warehouses and wanted to implement Snowflake data governance.

  • Martin Nettling
  • December 27, 2022
Snowflake Data Lineage

Utilizing Snowflake Data Lineage to Its Fullest: Tips & Tricks

This article will cover data lineage - it's history, benefits and top 10 tools used for data lineage in Snowflake

  • Ndz Anthony
  • December 20, 2022
The Rationale Behind Using Snowflake for Your Data Mesh

The Rationale Behind Using Snowflake for Your Data Mesh

In this post, we will learn how Snowflake Data Cloud can provide you with the foundation you need to start your Snowflake data mesh journey.

  • Ndz Anthony
  • November 23, 2022
snowflake data catalog

What you Need to Understand about Snowflake Data Catalog

In this article, we will discuss the concept of Snowflake’s data catalog, its benefits, and some frequently asked questions.

  • Ndz Anthony
  • November 22, 2022
snowflake faq

How can I query my staged data in Snowflake?

In this article, we are going to look at how to query staged data in Snowflake and what ways we can use Snowflake to tackle this as well as answer the

  • How-Tos FAQs
  • October 26, 2022
Semantic Layer Feat Img

What is a Semantic Layer?

A semantic layer is a business representation of data. It enables end-users to quickly discover and access data using standard search terms — like customer, recent purchase, and prospect. It also provides human readable terms to data sources that otherwise would be impossible to discover.

  • Justin Reynolds
  • September 28, 2022
Retail and e-commerce companies select Datameer and Snowflake to track Customer Lifetime Value and Marketing ROI

Retail and e-commerce companies select Datameer and Snowflake to track Customer Lifetime Value and Marketing ROI

Skylar uses Datameer and Snowflake to Streamline and Speed Up Data Engineering Processes – Datameer, a leading provider of hybrid no-code and SQL data transformation solutions for Snowflake’s Data Cloud, announced the increased adoption of Datameer with Snowflake in the retail and e-commerce verticals.

  • Press Release
  • July 21, 2022
Monitoring data ecosystems

The How-To Guide for Understanding Data Ecosystems

To understand why understanding data ecosystems are so important let's take a look at the following example. In 2017, The Economist published a story

  • Datameer, Inc.
  • July 12, 2022
Is Analytics Engineering a Necessary Evil?

Is Analytics Engineering a Necessary Evil?

Learn what analytics engineering is and how to make analytics engineering a self-service option for your analytics team members.

  • John Morrell
  • February 10, 2022
Announcing the Datameer + Snowflake Partnership

Announcing the Datameer + Snowflake Partnership

Datameer announces partnership with Snowflake to enable customers, regardless of programming skills, to model and transform data in Snowflake.

  • Press Release
  • January 25, 2022
Insights Through Data

New SQL tool for Analysts on Snowflake: Datameer

Over the years, I have been monitoring the analytics software market with a quite simple requirement: I am (still) looking for a tool to let me generate

  • Insights Through Data
  • January 5, 2022
dzone-feature-img

How to Generate Customer Success Analytics in Snowflake

Here's a quick demonstration on how to generate quick insights on customer success data in Snowflake using the platform Datameer. This post was originally

  • Dzone
  • January 3, 2022
dzone-feature-img

Best Practices for Transforming Data in Snowflake

Some helpful hints to get your data where and how it needs to be, here are some of the best practices for transforming data in Snowflake. This article was

  • Dzone
  • December 22, 2021
Add identity or autoincrement to table in Snowflake

Add identity or autoincrement to table in Snowflake

In this tutorial, we will look at two different ways to add an autoincrement or identity column to an existing table in Snowflake. We will also discuss

  • How-Tos FAQs
  • November 22, 2021
dbt

A Review of Dbt (Data Build Tool) and the Top Missing Features

A Review of Dbt and the Top Missing Features Dbt has become a market darling for data transformation tools – the T in your ELT data stack and processes.

  • John Morrell
  • September 21, 2021
snowflake faq

Handling “No Active Warehouse is Selected” error in Snowflake

If you're trying to query a Snowflake database and getting the message No active warehouse is selected error, it's most likely because you haven't

  • How-Tos FAQs
  • September 12, 2021
data completeness

The Role of Data Completeness in Assuring Overall Data Quality

Learn how to maximize data completeness to improve overall data quality and drive highly effective and accurate decisions.

  • John Morrell
  • August 27, 2021
How to connect DBT to multiple databases in the same project

How to connect DBT to multiple databases in the same project

Let's look at how you can connect DBT to multiple databases in the same project. While this isn't a native function to DBT, there are some workarounds to

  • How-Tos FAQs
  • July 15, 2021
What are the options when it comes to handling data lineage in Snowflake?

What are the options when it comes to handling data lineage in Snowflake?

There is no native tool within Snowflake that provides an excellent out-of-the-box solution. So how do you handle data lineage in Snowflake?

  • How-Tos FAQs
  • June 7, 2021
ETL++

ETL++: Reinvigorating the Data Integration Market

Learn about the advances in data integration with ETL++ and how ETL++ can revolutionize your approach to data integration and data pipelines.

  • John Morrell
  • April 12, 2021
Format Numbers With Comma Separation in Snowflake Result Set

Format Numbers With Comma Separation in Snowflake Result Set

In order to customize format numbers with comma separation in Snowflake result set, fields with a number data type first need to be converted to a string,

  • How-Tos FAQs
  • March 29, 2021
How to connect to Snowflake using SSO authentication from DBT

How to connect to Snowflake using SSO authentication from DBT

How to connect to Snowflake using SSO authentication from Dbt. Dbt Cloud requires a security integration to be configured in Snowflake & Dbt

  • How-Tos FAQs
  • March 29, 2021
How to parse a variable in Snowflake as a source reference in dbt

How to parse a variable in Snowflake as a source reference in dbt

Variables are a way to have a dynamic source in dbt. Let's explore how to parse a variable in Snowflake as a source reference in dbt.

  • How-Tos FAQs
  • March 29, 2021
Dbt to Snowflake Connection Failure via Profiles.yml

Dbt to Snowflake Connection Failure via Profiles.yml

Let's explore the Dbt to Snowflake connection failure via Profiles.yml. When getting started developing with dbt CLI, you will need to configure a

  • How-Tos FAQs
  • March 16, 2021
Querying with dbt from an external source in Snowflake

Querying with dbt from an external source in Snowflake

Native Tables vs External Tables in Snowflake Let's explore querying with dbt from an external source in Snowflake. It is very common to have data stored

  • How-Tos FAQs
  • March 16, 2021
How to run a query with parameters in Snowflake

How to run a query with parameters in Snowflake

Query parameters are a way to specify variables in a query so that a query can be reused with the ability to swap out parts of the query definition

  • How-Tos FAQs
  • March 8, 2021
How to convert month number to month name in SQL and Snowflake

How to convert month number to month name in SQL and Snowflake

There is not a built-in function to convert month number to month name in SQL. But we can use a combo of a few different date functions to achieve this

  • How-Tos FAQs
  • December 18, 2020
Google Partners with Datameer

Datameer Partners with Google Cloud to Deliver Scalable, Secure Migration of Enterprise Data and Analytics Workloads to the Cloud

As a Google Cloud migration partner, Datameer’s union enables customers to more seamlessly move their large volumes of data to Google Cloud and transform into agile

  • Press Release
  • December 2, 2020
snowflake faq

How to Handle Non-UTF-8 Characters in Snowflake

We would like to talk about the Snowflake development environment setup. In our mind, this is how to handle non UTF-8 characters in Snowflake

  • How-Tos FAQs
  • October 25, 2020
What is Data Pipeline

What is a Data Pipeline?

A data pipeline is a system for moving structured and unstructured data across an organization in layman's terms. Read for more.

  • Justin Reynolds
  • June 14, 2020
Data Mesh

New Paradigm for Enterprise Data Management: The Data Mesh

A data mesh solves the issues presented by centralized, monolithic data lakes and data warehouses by treating domain-based data as the end product

  • Benoite Yver
  • April 2, 2020
Data Lineage

What is Data Lineage?

The need is steadily increasing for solutions that can analyze data as it flows across the enterprise to its final destination. This process of tracking and analyzing the origin, movement, and quality of data is referred to as data lineage.

  • Justin Reynolds
  • February 8, 2020
Data Visualization

What is Data Visualization? A Complete Introductory Overview

Why is data visualization necessary? For most people, it’s much easier to read a colorful and organized chart than to sift through data in a spreadsheet or report.

  • Justin Reynolds
  • December 7, 2019
How to add an IDENTITY to an existing column in SQL?

How to add an IDENTITY to an existing column in SQL?

There is no straightforward way to add IDENTITY to an existing column. We need to follow a series of steps to achieve this. There are two ways to do this.

  • How-Tos FAQs
  • February 2, 2019
How to get only the DATE part from the DATETIME in SQL Server and Snowflake

How to get only the DATE part from the DATETIME in SQL Server and Snowflake

Follow along for a few different methods on how to get only DATE from the DATETIME in SQL Server 1. A Low-Code Method Using Datameer (On Snowflake)

  • How-Tos FAQs
  • February 2, 2019
How to create an AUTO_INCREMENT column in a table on Oracle DB using SQL?

How to create an AUTO_INCREMENT column in a table on Oracle DB using SQL?

Before Oracle 12c, we don’t have a direct method of generating an AUTO_INCREMENT column in a table. We need to use the combination of Sequences and

  • How-Tos FAQs
  • February 1, 2019
DELETE data from a table by joining with another table in SQL

DELETE data from a table by joining with another table in SQL

We can join multiple tables in the DELETE statement, just like in the SELECT statement. DELETE data from a table by joining with another table in SQL Let

  • How-Tos FAQs
  • December 18, 2018
Can we use stored procedures in a SELECT statement in SQL SERVER?

Can we use stored procedures in a SELECT statement in SQL SERVER?

We can not directly use stored procedures in a SELECT statement. The database objects that can be used in a SELECT statement are:Table-Valued FunctionView

  • How-Tos FAQs
  • December 18, 2018
How to display all the tables from a database in SQL?

How to display all the tables from a database in SQL?

Different databases have different system views or catalogs to list all the tables in a database. Let us see some ways to check this in a few database

  • How-Tos FAQs
  • December 18, 2018
How to display the tables containing particular strings in SQL?

How to display the tables containing particular strings in SQL?

Display tables containing particular strings in SQL. In SQL Server, we have four different ways to list all the tables in a database.

  • How-Tos FAQs
  • December 18, 2018
How to reset an IDENTITY column value In SQL Server?

How to reset an IDENTITY column value In SQL Server?

Learn how to reset an IDENTITY column value In SQL Server. An IDENTITY column is an auto-incrementing column. This column cannot be updated directly. If

  • How-Tos FAQs
  • December 17, 2018
How to handle divide by zero error in SQL

How to handle divide by zero error in SQL

Whenever we perform a division in SQL, we must remember to handle a ‘divide by zero’ error. Even though there is no data with value zero in the

  • How-Tos FAQs
  • December 17, 2018
How to SELECT data from a table which is not present in another table with SQL

How to SELECT data from a table which is not present in another table with SQL

How to SELECT data from a table which is not present in another table with SQL is a common operation in databases. There are many ways to query this, like

  • How-Tos FAQs
  • December 17, 2018
How to insert a line break in SQL on Snowflake

How to insert a line break in SQL on Snowflake

We can insert a line break in SQL in many ways. Also, different databases have different ways for this. MySQL and SQL Server.

  • How-Tos FAQs
  • December 17, 2018
How to return the first day of a month in SQL and Snowflake

How to return the first day of a month in SQL and Snowflake

There is no date function to calculate and return the first day of a month in SQL. We can use other available date functions for this. We will show an

  • How-Tos FAQs
  • December 17, 2018
How to convert DATETIME value to VARCHAR value in SQL Server

How to convert DATETIME value to VARCHAR value in SQL Server

We can convert the DATETIME value to VARCHAR value in SQL server using the CONVERT function. Convert function has three arguments. CONVERT (target_type,

  • How-Tos FAQs
  • December 17, 2018
How to calculate percentage in SQL on Snowflake

How to calculate percentage in SQL on Snowflake

Try the different ways to calculate percentage in SQL: Using Ratio_to_report() function or the Percent_Rank function, Using OVER() clause,

  • How-Tos FAQs
  • December 17, 2018
How to return the duplicate data on multiple columns in SQL

How to return the duplicate data on multiple columns in SQL

We can return the duplicate data from a table on multiple columns in SQL using the GROUP BY and HAVING clause. Let us consider the ‘orders’ table below.

  • How-Tos FAQs
  • December 17, 2018
How to alter the selected column value based on the value of another column in SQL?

How to alter the selected column value based on the value of another column in SQL?

How to: For MySQL set column value based on another column. For this, we have two options: IF function and CASE statement.

  • How-Tos FAQs
  • December 17, 2018
How to use the command line to import SQL files in MySQL

How to use the command line to import SQL files in MySQL

Import SQL files in MySQL with command line. 1. Open MySQL Command Line 2. Insert the user name and the password 3. mysql > use your_database

  • How-Tos FAQs
  • December 17, 2018
How to UPDATE a table by joining multiple tables in SQL?

How to UPDATE a table by joining multiple tables in SQL?

To UPDATE a table by joining multiple tables in SQL, let’s create the two tables ‘order’ and ‘order_detail.’ We can update the data of a table using

  • How-Tos FAQs
  • December 17, 2018
How to insert the result of a stored procedure in a table in SQL?

How to insert the result of a stored procedure in a table in SQL?

Let’s create a simple stored procedure (SP) with a SELECT query. There are different ways to insert the result of SP into a temporary table according to

  • How-Tos FAQs
  • December 17, 2018
Governance Feat Img

Five Highly Effective Approaches to Governance

We see five major approaches to governance that vary in how data is organized, secured, shared, and operationalized. To choose which one would be best for your organization, think about your business, organization, and security models.

  • Datameer, Inc.
  • February 27, 2018
Data Governance Featured Image Blog

What’s Needed for Data Governance Today?

Hear from Andrew Brust, blogger at ZDNet and Datameer’s Senior Director of Market Strategy and Intelligence, or skim through the transcripts to learn about what's needed for data governance in the modern world.

  • Datameer, Inc.
  • February 27, 2018