Null pointer exception during sync

[sivankumar86]

Topic

Null pointer exception

Relevant information

Sync is facing null pointer exception intermittently and ports are not getting released after that. Retry gets succesful and could you shed some light on this.

Error:

"2024-07-22 10:45:58.793","2024-07-22 00:45:58 �[46mplatform�[0m > Unable to gobble line(s) from input stream provided by generic: input stream is null."
"2024-07-22 10:45:58.793","2024-07-22 00:45:58 �[46mplatform�[0m > Unexpected error while checking connection: "
"2024-07-22 10:45:58.793","java.lang.NullPointerException: null"
"2024-07-22 10:45:58.793"," at java.base/java.io.Reader.(Reader.java:168) ~[?:?]"
"2024-07-22 10:45:58.793"," at java.base/java.io.InputStreamReader.(InputStreamReader.java:123) ~[?:?]"
"2024-07-22 10:45:58.793"," at io.airbyte.commons.io.IOs.newBufferedReader(IOs.java:74) ~[io.airbyte-airbyte-commons-dev.jar:?]"
"2024-07-22 10:45:58.793"," at io.airbyte.workers.WorkerUtils.getMessagesByType(WorkerUtils.java:205) ~[io.airbyte-airbyte-commons-worker-dev.jar:?]"
"2024-07-22 10:45:58.793"," at io.airbyte.workers.general.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:80) ~[io.airbyte-airbyte-commons-worker-dev.jar:?]"
"2024-07-22 10:45:58.793"," at io.airbyte.workers.general.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:44) ~[io.airbyte-airbyte-commons-worker-dev.jar:?]"
"2024-07-22 10:45:58.793"," at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:142) ~[io.airbyte-airbyte-workers-dev.jar:?]"
"2024-07-22 10:45:58.793"," at io.airbyte.workers.temporal.check.connection.CheckConnectionActivityImpl.lambda$runWithJobOutput$1(CheckConnectionActivityImpl.java:226) ~[io.airbyte-airbyte-workers-dev.jar:?]"
"2024-07-22 10:45:58.793"," at io.airbyte.workers.temporal.check.connection.CheckConnectionActivityImpl.runWithJobOutput(CheckConnectionActivityImpl.java:211) ~[io.airbyte-airbyte-workers-dev.jar:?]"
"2024-07-22 10:45:58.793"," at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103) ~[?:?]"
"2024-07-22 10:45:58.793"," at java.base/java.lang.reflect.Method.invoke(Method.java:580) ~[?:?]"
"2024-07-22 10:45:58.793"," at io.temporal.internal.activity.RootActivityInboundCallsInterceptor$POJOActivityInboundCallsInterceptor.executeActivity(RootActivityInboundCallsInterceptor.java:64) ~[temporal-sdk-1.22.3.jar:?]"
"2024-07-22 10:45:58.793"," at io.temporal.internal.activity.RootActivityInboundCallsInterceptor.execute(RootActivityInboundCallsInterceptor.java:43) ~[temporal-sdk-1.22.3.jar:?]"
"2024-07-22 10:45:58.793"," at io.temporal.internal.activity.ActivityTaskExecutors$BaseActivityTaskExecutor.execute(ActivityTaskExecutors.java:107) ~[temporal-sdk-1.22.3.jar:?]"
"2024-07-22 10:45:58.793"," at io.temporal.internal.activity.ActivityTaskHandlerImpl.handle(ActivityTaskHandlerImpl.java:124) ~[temporal-sdk-1.22.3.jar:?]"
"2024-07-22 10:45:58.793"," at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handleActivity(ActivityWorker.java:278) ~[temporal-sdk-1.22.3.jar:?]"
"2024-07-22 10:45:58.793"," at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:243) ~[temporal-sdk-1.22.3.jar:?]"
"2024-07-22 10:45:58.793"," at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:216) ~[temporal-sdk-1.22.3.jar:?]"
"2024-07-22 10:45:58.793"," at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:105) ~[temporal-sdk-1.22.3.jar:?]"
"2024-07-22 10:45:58.793"," at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]"
"2024-07-22 10:45:58.793"," at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]"
"2024-07-22 10:45:58.793"," at java.base/java.lang.Thread.run(Thread.java:1583) [?:?]"
"2024-07-22 10:45:58.792","2024-07-22 00:45:58 �[46mplatform�[0m > Pod IP: 10.56.98.36"
"2024-07-22 10:45:58.792","2024-07-22 00:45:58 �[46mplatform�[0m > Using null stdin output stream..."
"2024-07-22 10:45:58.785","2024-07-22 00:45:58 �[46mplatform�[0m > Reading pod IP..."
"2024-07-22 10:45:56.508","2024-07-22 00:45:56 �[46mplatform�[0m > Waiting until pod is ready..."
"2024-07-22 10:45:56.507","2024-07-22 00:45:56 �[46mplatform�[0m > kubectl cp complete, closing process"
"2024-07-22 10:45:56.154","2024-07-22 00:45:56 �[46mplatform�[0m > Waiting for kubectl cp to complete"
"2024-07-22 10:45:56.150","2024-07-22 00:45:56 �[46mplatform�[0m > kubectl cp /tmp/8cd5e017-3e64-414e-b04b-b2b73b0e3e96/FINISHED_UPLOADING product-analytics/destination-snowflake-check-697013-1-mmjzg:/config/FINISHED_UPLOADING -c init --retries=3"
"2024-07-22 10:45:56.149","2024-07-22 00:45:56 �[46mplatform�[0m > kubectl cp complete, closing process"
"2024-07-22 10:45:56.149","2024-07-22 00:45:56 �[46mplatform�[0m > Uploading file: FINISHED_UPLOADING"
"2024-07-22 10:45:55.764","2024-07-22 00:45:55 �[46mplatform�[0m > Waiting for kubectl cp to complete"
"2024-07-22 10:45:55.760","2024-07-22 00:45:55 �[46mplatform�[0m > Init container ready.."
"2024-07-22 10:45:55.760","2024-07-22 00:45:55 �[46mplatform�[0m > Copying files..."
"2024-07-22 10:45:55.760","2024-07-22 00:45:55 �[46mplatform�[0m > Uploading file: source_config.json"
"2024-07-22 10:45:55.760","2024-07-22 00:45:55 �[46mplatform�[0m > kubectl cp /tmp/770e1830-5fd1-40e2-bf28-13d5c5a9d474/source_config.json product-analytics/destination-snowflake-check-697013-1-mmjzg:/config/source_config.json -c init --retries=3"
"2024-07-22 10:45:53.943","2024-07-22 00:45:53 �[46mplatform�[0m > Waiting for init container to be ready before copying files..."
"2024-07-22 10:45:53.499","2024-07-22 00:45:53 �[46mplatform�[0m > Creating pod destination-snowflake-check-697013-1-mmjzg..."
"2024-07-22 10:45:53.498","2024-07-22 00:45:53 �[46mplatform�[0m > Creating stderr socket server..."
"2024-07-22 10:45:53.498","2024-07-22 00:45:53 �[46mplatform�[0m > Creating stdout socket server..."
"2024-07-22 10:45:53.497","2024-07-22 00:45:53 �[46mplatform�[0m > workerPorts remaining capacity: 39"
"2024-07-22 10:45:53.497","2024-07-22 00:45:53 �[46mplatform�[0m > destination-snowflake-check-697013-1-mmjzg stderrLocalPort = 9035"
"2024-07-22 10:45:53.496","2024-07-22 00:45:53 �[46mplatform�[0m > workerPorts remaining capacity: 40"
"2024-07-22 10:45:53.496","2024-07-22 00:45:53 �[46mplatform�[0m > destination-snowflake-check-697013-1-mmj

[sivankumar86]

Uploading logresults-2024-07-23 19_46_13.csv…

[sivankumar86]

Nullpointer exception is not releasing resources example, ports . more NPE creating sync fails due to no ports available issue. Irrespective of status of sync and all the resource needs to be released once sync completes (either fail or success)

airbytehq/airbyte-platform#343