Support for connection properties

[JonathonO]

Hi there. I couldn't see any mention in documentation about the Sink supporting connection properties, but it's a requirement for partner integrations as you have to provide an application identifier.

I don't know whether it makes any difference or not, but most, if not all of our Snowflake connections use snowpipe_streaming too.

Please can you advise on whether or not it's possible right now with the Sink and from which version.

Thanks in advance 👍

[sfc-gh-xhuang]

Let me look into this a bit more and get back to you. I'm not too familiar with the partner requirements but we are working closely with partner engagement teams on tracking.

[JonathonO]

Hi @sfc-gh-xhuang, what's the latest on this?

[sfc-gh-xhuang]

It is not available for Snowpipe Streaming at this time but I have on the backlog to add tracking capabilities

[JonathonO]

Hello @sfc-gh-xhuang, can you please let me know what the ETA for adding tracking capabilities will be? We're not able to progress with partner integration without it unfortunately.

[JonathonO]

Hello @sfc-gh-japatel @sfc-gh-xhuang please excuse me chasing this again. Do you happen to have an ETA for the tracking capabilities?

[sfc-gh-xhuang]

@JonathonO It's being discussed at the moment but there is a current workaround.
Let me email you

[d-levin]

@JonathonO It's being discussed at the moment but there is a current workaround. Let me email you

@sfc-gh-xhuang Could you share the workaround please? I'd like to add QUERY_TAG to the connection props.

[sfc-gh-xhuang]

@d-levin This workaround was mainly for partner integrations. Is this your use case?

[d-levin]

@d-levin This workaround was mainly for partner integrations. Is this your use case?

@sfc-gh-xhuang I'd like to add a QUERY_TAG to all queries executed by the Connector. The easiest approach is to just add it in the connection string &QUERY_TAG=MY_TAG

[d-levin]

@sfc-gh-xhuang Do you know if that's supported or if there are plans to support it in the future?

[sfc-gh-xhuang]

We have plans to support a partner tag for tracking purposes but it would not allow you to filter queries executed by the connector on Snowflake side.
There are no explicit queries that Snowpipe streaming uses to ingest data.

[sfc-gh-gjachimko]

we will raise this during our planning and see if we can squeeze that into backlog.