Rows in banded/shaded table being skipped

[ashleych]

I have a shaded table, with every alternate row shaded. Only the shaded rows seem to get picked.
The image below is the original image

Code being attempted is

ts = {
    "vertical_strategy": "lines",
    "horizontal_strategy": "lines"}

p0.extract_tables(table_settings=ts)

Output obtained is : (every second row is skipped). Any pointers would be very helpful

[samkit-jain]

Hi @ashleych Appreciate your interest in the library. For such cases, you can have a high value for join_tolerance (start with a high value like 50 and then either go down or up depending on the table). That will connect the vertical lines and fill out the gap. But, it will miss out on the last row. For that, instead of lines as the horizontal strategy, use text.

[adicognext]

Hi, @samkit-jain I tried 3 workarounds out of the 4 you have mentioned, still no luck with the results. Can you please help me out here?

1) Cropping the image.

2) Downgrading to version 0.5.22.

3) Trying out the settings you've mentioned.

In the first 2 cases, I have used the settings as:
ts = {
"vertical_strategy": "lines",
"horizontal_strategy": "text",
"join_tolerance":50
}

also, I tried the same on a different pdf with the same structure and the problem persists.
Thank you so much in advance.

[samkit-jain]

Hi @adicognext Could you please share the PDF you are using and the page number redacting any sensitive information from the PDF so that I can assist better. Please also include your expected output. Looking at the screenshots, what happens when you try using snap_tolerance (to merge those multiple close lines into one) and intersection_tolerance (to pick up the last row).

[adicognext]

The concerned pdf.

002_3D Systems Corporation.pdf

The expected output is where the last row is also getting recognized.

[samkit-jain]

Thanks for sharing the PDF. I was able to get the desired results by using the following extraction settings

{
    "vertical_strategy": "lines",
    "horizontal_strategy": "text",
    "snap_tolerance": 5,
    "intersection_tolerance": 15,
}

Result when running on page 6 with pdfplumber 0.5.22

[adicognext]

Hii, Thank you so much for your help, this is exactly what was expected.