Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Actual row count vs Expected row count #523

Open
chadana1 opened this issue Sep 6, 2023 · 0 comments
Open

Actual row count vs Expected row count #523

chadana1 opened this issue Sep 6, 2023 · 0 comments

Comments

@chadana1
Copy link

chadana1 commented Sep 6, 2023

Seeing this intermittent error

org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 9582.0 failed 4 times, most recent failure: Lost task 0.3 in stage 9582.0 (TID 136905) (10.138.1.6 executor 14): net.snowflake.client.jdbc.SnowflakeSQLException: JDBC driver internal error: The actual read row count 1230892 is not equal to the expected row count 1114384 for partition ID:0. Related query ID is 01ae613e-0202-bf2e-0000-ab7920c9be4e
T
he pipeline is using spark jdbc driver 3.13.14 (via dbx run time 11.2) and latest spark-snowflake 2.11.0 release.

When checking the query id in snowflake's query history, the query is in success status
Any help is appreciated.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant