eG Help

Snowpipe enables loading data from files as soon as they're available in a stage. This means you can load data from files in micro-batches, making it available to users within minutes, rather than manually executing COPY statements on a schedule to load larger batches. Snowflake provides and manages the compute resources, automatically growing or shrinking capacity based on the current Snowpipe load. Accounts are charged based on their actual compute resource usage; in contrast with customer-managed virtual warehouses, which consume credits when active, and may sit idle or be overutilized. This makes it difficult to predict the credit usage of snowpipes for data load. eG Enterprise makes it possible for administrators to monitor the usage of snowpipes in real-time so that there are no surprises in billing.

This test monitors the usage of Snowpipes and collects credit usage-related metrics as files and bytes are inserted and credits used

Outputs of the test: One set of results for each Snowflake pipes present in the service account being monitored.

Measurement	Description	Measurement Unit	Interpretation
TotalCreditsUsed	Indicates the total number of credits used by pipes during the last measurement period.	Number
AverageCreditUsed	Indicates the average credits used by pipes.	Number	A high value of this measure is the cause for concern. Detailed diagnosis of this measure will indicate error details.
CreditsUsedPerSecond	Indicates the rate at which credits were consumed during the last measurement period.	Credits / Second
TotalbytesInserted	Indicates the data inserted by pipes in the last measurement period.	MB
AverageBytesInserted	Indicates the data inserted by pipes in the last measurement period.	MB
TotalFilesInserted	Indicates the total number of files inserted by pipes during the last measurement period.	Number
AverageFilesInserted	Indicates the average number of files inserted by pipes in one measurement period.	MB