Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Spark] Native test TestPrestoSparkNativeWindowQueries.testLeadOrderDate fails in CI #24263

Open
czentgr opened this issue Dec 14, 2024 · 0 comments
Labels
bug flaky-test spark Apache Spark related

Comments

@czentgr
Copy link
Contributor

czentgr commented Dec 14, 2024

The stack is similar to other failures in flaky spark tests having the NULL pointer exception.

TestPrestoSparkNativeWindowQueries.testLeadOrderDate fails

2024-12-13T22:10:15.2526624Z [ERROR] com.facebook.presto.spark.TestPrestoSparkNativeWindowQueries.testLeadOrderDate  Time elapsed: 19.744 s  <<< FAILURE!
2024-12-13T22:10:15.2528919Z java.lang.AssertionError: Execution of 'actual' query failed: SELECT lead(orderdate) OVER (PARTITION BY orderdate, orderkey ROWS BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING), lead(orderdate) OVER (PARTITION BY orderdate, orderkey ROWS BETWEEN 5 PRECEDING AND CURRENT ROW), lead(orderdate) OVER (PARTITION BY orderdate, orderkey ROWS BETWEEN CURRENT ROW AND 5 FOLLOWING), lead(orderdate) OVER (PARTITION BY orderdate, orderkey ROWS BETWEEN orderkey PRECEDING AND CURRENT ROW), lead(orderdate) OVER (PARTITION BY orderdate, orderkey ROWS BETWEEN CURRENT ROW AND orderkey FOLLOWING) FROM orders
2024-12-13T22:10:15.2531251Z 	at org.testng.Assert.fail(Assert.java:98)
2024-12-13T22:10:15.2531941Z 	at com.facebook.presto.tests.QueryAssertions.assertQuery(QueryAssertions.java:178)
2024-12-13T22:10:15.2532823Z 	at com.facebook.presto.tests.QueryAssertions.assertQuery(QueryAssertions.java:106)
2024-12-13T22:10:15.2533849Z 	at com.facebook.presto.tests.AbstractTestQueryFramework.assertQuery(AbstractTestQueryFramework.java:169)
2024-12-13T22:10:15.2535106Z 	at com.facebook.presto.tests.AbstractTestQueryFramework.assertQuery(AbstractTestQueryFramework.java:164)
2024-12-13T22:10:15.2536615Z 	at com.facebook.presto.nativeworker.AbstractTestNativeWindowQueries.testWindowFunction(AbstractTestNativeWindowQueries.java:135)
2024-12-13T22:10:15.2538306Z 	at com.facebook.presto.nativeworker.AbstractTestNativeWindowQueries.testLeadOrderDate(AbstractTestNativeWindowQueries.java:227)
2024-12-13T22:10:15.2539820Z 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2024-12-13T22:10:15.2540956Z 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2024-12-13T22:10:15.2542228Z 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2024-12-13T22:10:15.2543266Z 	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
2024-12-13T22:10:15.2544239Z 	at org.testng.internal.invokers.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:135)
2024-12-13T22:10:15.2545569Z 	at org.testng.internal.invokers.TestInvoker.invokeMethod(TestInvoker.java:673)
2024-12-13T22:10:15.2546546Z 	at org.testng.internal.invokers.TestInvoker.invokeTestMethod(TestInvoker.java:220)
2024-12-13T22:10:15.2547482Z 	at org.testng.internal.invokers.MethodRunner.runInSequence(MethodRunner.java:50)
2024-12-13T22:10:15.2548358Z 	at org.testng.internal.invokers.TestInvoker$MethodInvocationAgent.invoke(TestInvoker.java:945)
2024-12-13T22:10:15.2549384Z 	at org.testng.internal.invokers.TestInvoker.invokeTestMethods(TestInvoker.java:193)
2024-12-13T22:10:15.2550307Z 	at org.testng.internal.invokers.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:146)
2024-12-13T22:10:15.2551412Z 	at org.testng.internal.invokers.TestMethodWorker.run(TestMethodWorker.java:128)
2024-12-13T22:10:15.2552469Z 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
2024-12-13T22:10:15.2553558Z 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2024-12-13T22:10:15.2554295Z 	at java.base/java.lang.Thread.run(Thread.java:829)
2024-12-13T22:10:15.2554737Z Caused by: java.lang.NullPointerException
2024-12-13T22:10:15.2555630Z 	at com.facebook.presto.spark.util.PrestoSparkFailureUtils.toPrestoSparkFailure(PrestoSparkFailureUtils.java:59)
2024-12-13T22:10:15.2557189Z 	at com.facebook.presto.spark.execution.AbstractPrestoSparkQueryExecution.execute(AbstractPrestoSparkQueryExecution.java:395)
2024-12-13T22:10:15.2558566Z 	at com.facebook.presto.spark.PrestoSparkQueryRunner.executeWithStrategies(PrestoSparkQueryRunner.java:548)
2024-12-13T22:10:15.2559822Z 	at com.facebook.presto.spark.PrestoSparkQueryRunner.execute(PrestoSparkQueryRunner.java:522)
2024-12-13T22:10:15.2560814Z 	at com.facebook.presto.tests.QueryAssertions.assertQuery(QueryAssertions.java:175)
2024-12-13T22:10:15.2561457Z 	... 20 more
2024-12-13T22:10:15.2561620Z 

See https://github.com/prestodb/presto/actions/runs/12323348049/job/34399055454?pr=24236

Your Environment

  • Presto version used:
  • Storage (HDFS/S3/GCS..):
  • Data source and connector used:
  • Deployment (Cloud or On-prem):
  • Pastebin link to the complete debug logs:

Expected Behavior

Current Behavior

Possible Solution

Steps to Reproduce

Screenshots (if appropriate)

Context

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug flaky-test spark Apache Spark related
Projects
Status: 🆕 Unprioritized
Status: 🆕 Unprioritized
Development

No branches or pull requests

2 participants