Apache Iceberg version
None
Please describe the bug 馃悶
From slack,
Hi! We鈥檝e noticed that after creating an empty table in the Glue catalog with PyIceberg, initially there are no snapshots. Then if we run a glue job with a merge statement to upsert some CDC records in this table, the job fails with an error Error Category: UNCLASSIFIED_ERROR; IllegalArgumentException: Cannot parse missing long: current-snapshot-id. A workaround that resolved this was to insert and delete a dummy row after creating the table, but that doesn鈥檛 seem right. Is this a Glue / Spark bug or did we miss something?
Error Category: UNCLASSIFIED_ERROR; IllegalArgumentException: Cannot parse missing long: current-snapshot-id
Apache Iceberg version
None
Please describe the bug 馃悶
From slack,
Hi! We鈥檝e noticed that after creating an empty table in the Glue catalog with PyIceberg, initially there are no snapshots. Then if we run a glue job with a merge statement to upsert some CDC records in this table, the job fails with an error Error Category: UNCLASSIFIED_ERROR; IllegalArgumentException: Cannot parse missing long: current-snapshot-id. A workaround that resolved this was to insert and delete a dummy row after creating the table, but that doesn鈥檛 seem right. Is this a Glue / Spark bug or did we miss something?