Could not increase the Playwright default timeout limit - 30000ms through artillery tests

[sruthii38]

I have a scenario where an action to upload 3k records through xls is taking around 30s and sometimes more. We are planning to increase this limit of xls record to 10k and I cannot validate the performance because playwright's default time is timing out 50% of my transactions when I try it for 3k limit. I have tried the following.

Action timeout: .click{timeout:60000} - no impact Timeout happened at 3000ms

test.setTimeout(60000) - worked only for Playwright and errored when Artillery picked with error - test.setTimeout can only be used with test.

contextOptions:
defaultTimeout: 60000 - no impact timeouts happened at 30000ms

[hassy]

hi @sruthii38 👋

this should work:

config:
  engines:
    playwright:
      defaultTimeout: 60000

please make sure you're on the most recent version of the engine as well (v0.2.2)

[sruthii38]

Hi hassy, the version you mentioned does not align with either my artillery or Playwright. here is what I have
Artillery - 2.0.0-31
Playwright - 1.33.0
they both are ahead of v0.2.2, can you please clarify if I am not on right track. Thanks

[sruthii38]

just as benefit of doubt, I got the latest v for artillery 2.0.0-32. But that did not solve the issue, the timeouts are still happening at 30000ms. Please someone reply if we have a fix, this is such a blocker for my tests that can't even get baseline for existing functionality.

[hassy]

@sruthii38 you need to update Artillery/Playwright integration with:

npm install artillery-engine-playwright@latest

(Depending on how your project is set up it may need to be a global install)

We will bundle the integration into Artillery itself in the upcoming release, but right now it needs to be updated separately.

[jracabado]

For anyone reading this, the defaultTimeout is in seconds and not in milliseconds as @hassy example shows.

[sruthii38]

I see this warning
⠙ WARNING: engine contextOptions specified but module artillery-engine-contextOptions could not be loaded
Error: Cannot find module 'artillery-engine-contextOptions'

[hassy]

Your config isn't right. Try using the configuration I shared above making sure that defaultTimeout is under playwright which is under engines in config. That should work.

[sruthii38]

Okay, I took off the contextOptions and gave it exactly how you quoted. But I still see timeout at 30000ms
config:
target: 'xxx'
environments:
beta:
target:'xxx'
gamma:
target:'xxx'
engines:
playwright:
defaultTimeout: 60000

for some reason, I could not correct the hierarchy so posting a pic

[hassy]

The value of defaultTimeout is expected to be in seconds, so you need to set it to just 60.

I can't reproduce aggregateByName not working when used with defaultTimeout. They seem to work as expected for me. The issue is likely to be with your test scripts or your environment.

[sruthii38]

There you go, that is the issue I was always using 60000 for defaultTimeout to bump it from default. Not sure if there is no polling in between, and looks like it is hanging at that high timeouts. Everything worked once after I used 60s. Thanks @hassy for being very responsive. Have a good rest of your day!

[hassy]

Glad to hear it's working! :)

[Romarionijim]

@sruthii38 @hassy The globalTimeout in playwright.config.ts does not have an affect? meaning I need to set the timeout explicitly in each yml test file?

[hassy]

@Romarionijim Artillery does not currently load the playwright.config.ts file. It's used by the Playwright Test Runner which Artillery does not support yet. Artillery's integration uses Playwright as a library.