Trying flare first time. How to read these annotations?

[nasser1]

Thanks for your package.

Someone suggested I try it.

I tried it on a PDF file I have which has some annotations/marking that I am including in Latex. But it is not reading the markings in the PDF.

Could you please have a look if possible at this question I posted at tex site and see if you have any suggestions what to do or workarounds? Your package can be very useful.

how-to-keep-all-added-markings-notes-in-pdf-when-using-includegraphics

Thank you
--Nasser

[AndreasMatthias]

I added support for /Ink annotations a few days ago but missed to push a new release. Please download the latest release from github again. /Widget annotations are not supported yet, but I'm working on it.

[nasser1]

Thanks. I just downloaded it and replaced the old one. But now I get core dump.

\documentclass[12pt]{article}
\usepackage{flare}
%\usepackage{graphicx}% it seems that flare loads graphicx automatically
\begin{document}
\includegraphics[scale=0.9,page=1]{p}
\end{document}

and now

(base) >lualatex foo.tex
This is LuaHBTeX, Version 1.12.0 (TeX Live 2020)
 restricted system commands enabled.
(./foo.tex
LaTeX2e <2020-10-01> patch level 2

 L3 programming layer <2020-12-07> xparse <2020-03-03> (/usr/local/texlive/2020/texmf-dist/tex/latex/base/article.cls
Document Class: article 2020/04/10 v1.4m Standard LaTeX document class
(/usr/local/texlive/2020/texmf-dist/tex/latex/base/size12.clo)) (/home/me/texmf/tex/latex/flare/flare.sty (/usr/local/texlive/2020/texmf-dist/tex/latex/l3packages/l3keys2e/l3keys2e.sty (/usr/local/texlive/2020/texmf-dist/tex/latex/l3kernel/expl3.sty (/usr/local/texlive/2020/texmf-dist/tex/latex/l3backend/l3backend-luatex.def))) (/usr/local/texlive/2020/texmf-dist/tex/luatex/luatexbase/luatexbase.sty (/usr/local/texlive/2020/texmf-dist/tex/luatex/ctablestack/ctablestack.sty)) (/usr/local/texlive/2020/texmf-dist/tex/latex/graphics/graphicx.sty (/usr/local/texlive/2020/texmf-dist/tex/latex/graphics/keyval.sty) (/usr/local/texlive/2020/texmf-dist/tex/latex/graphics/graphics.sty (/usr/local/texlive/2020/texmf-dist/tex/latex/graphics/trig.sty) (/usr/local/texlive/2020/texmf-dist/tex/latex/graphics-cfg/graphics.cfg) (/usr/local/texlive/2020/texmf-dist/tex/latex/graphics-def/luatex.def))) (/usr/local/texlive/2020/texmf-dist/tex/generic/kvsetkeys/kvsetkeys.sty)
(/usr/local/texlive/2020/texmf-dist/tex/latex/etoolbox/etoolbox.sty)) (./foo.aux) (/usr/local/texlive/2020/texmf-dist/tex/latex/base/ts1cmr.fd) (/usr/local/texlive/2020/texmf-dist/tex/context/base/mkii/supp-pdf.mkii
[Loading MPS to PDF converter (version 2006.09.02).]
) (/usr/local/texlive/2020/texmf-dist/tex/latex/epstopdf-pkg/epstopdf-base.sty (/usr/local/texlive/2020/texmf-dist/tex/latex/latexconfig/epstopdf-sys.cfg))
Module Flare Warning: Annotation of type 'Widget' not supported on input line 8
Segmentation fault (core dumped)
(base) >

You could try it yourself. Please see the post I have at tex forum, with link to my p.pdf one page file I am trying to load. Here is the link again to p.pdf file used in the above MWE

p.pdf

I am on linux using

(base) >lualatex --version
This is LuaHBTeX, Version 1.12.0 (TeX Live 2020)

Thanks
--Nasser

[AndreasMatthias]

It's running without a segfault for me. I'm using LuaTeX 1.13.2, the latest from TeX Live 2021. The issue you are experiencing could be related to https://tug.org/pipermail/luatex/2021-March/007481.html

[nasser1]

Thanks. I will update my Texlive and see what happens. Will update here to let you know. it might take few hrs or so.

[nasser1]

FYI,

I updated now to latest TL 2021. Now the core dump is gone, but it still does not work. Those marking in the PDF file included using include graphics do not show up.

Do they show up with you when you tried it? i.e. The red markings in the p.pdf file?

Below is the output from the command

>which lualatex
/usr/local/texlive/2021/bin/x86_64-linux/lualatex

>lualatex  foo.tex
This is LuaHBTeX, Version 1.13.2 (TeX Live 2021)
 restricted system commands enabled.
(./foo.tex
LaTeX2e <2021-06-01>
 L3 programming layer <2021-06-01>
(/usr/local/texlive/2021/texmf-dist/tex/latex/base/article.cls
Document Class: article 2021/02/12 v1.4n Standard LaTeX document class
(/usr/local/texlive/2021/texmf-dist/tex/latex/base/size12.clo))
(/home/me/texmf/tex/latex/flare/flare.sty
(/usr/local/texlive/2021/texmf-dist/tex/latex/l3packages/l3keys2e/l3keys2e.sty
(/usr/local/texlive/2021/texmf-dist/tex/latex/l3kernel/expl3.sty
(/usr/local/texlive/2021/texmf-dist/tex/latex/l3backend/l3backend-luatex.def)))
 (/usr/local/texlive/2021/texmf-dist/tex/luatex/luatexbase/luatexbase.sty
(/usr/local/texlive/2021/texmf-dist/tex/luatex/ctablestack/ctablestack.sty))
(/usr/local/texlive/2021/texmf-dist/tex/latex/graphics/graphicx.sty
(/usr/local/texlive/2021/texmf-dist/tex/latex/graphics/keyval.sty)
(/usr/local/texlive/2021/texmf-dist/tex/latex/graphics/graphics.sty
(/usr/local/texlive/2021/texmf-dist/tex/latex/graphics/trig.sty)
(/usr/local/texlive/2021/texmf-dist/tex/latex/graphics-cfg/graphics.cfg)
(/usr/local/texlive/2021/texmf-dist/tex/latex/graphics-def/luatex.def)))
(/usr/local/texlive/2021/texmf-dist/tex/generic/kvsetkeys/kvsetkeys.sty)
(/usr/local/texlive/2021/texmf-dist/tex/latex/etoolbox/etoolbox.sty))
(./foo.aux) (/usr/local/texlive/2021/texmf-dist/tex/latex/base/ts1cmr.fd)
(/usr/local/texlive/2021/texmf-dist/tex/context/base/mkii/supp-pdf.mkii
[Loading MPS to PDF converter (version 2006.09.02).]
) (/usr/local/texlive/2021/texmf-dist/tex/latex/epstopdf-pkg/epstopdf-base.sty
(/usr/local/texlive/2021/texmf-dist/tex/latex/latexconfig/epstopdf-sys.cfg))
Module Flare Warning: Annotation of type 'Widget' not supported on input line 8


warning  (file p.pdf) (pdf inclusion): PDF inclusion: found PDF version '1.6',
but at most version '1.5' allowed
[1{/usr/local/texlive/2021/texmf-var/fonts/map/pdftex/updmap/pdftex.map}<./p.pd
f>] (./foo.aux))
(see the transcript file for additional information)
 406 words of node memory still in use:
   3 hlist, 1 vlist, 1 rule, 2 glue, 3 kern, 1 glyph, 4 attribute, 48 glue_spec
, 4 attribute_list, 1 write nodes
   avail lists: 2:41,3:10,4:2,5:24,6:2,7:46,8:6,9:52
</usr/local/texlive/2021/texmf-dist/fonts/opentype/public/lm/lmroman12-regular.
otf>
Output written on foo.pdf (1 page, 33613 bytes).
Transcript written on foo.log.

Is it possible these specific marking in the p.pdf file are still not supported by your package?
I also get an error when opening the generated PDF file (which includes p.pdf) it says

"An error exists on this page. Acrobat may not display the page correctly. Please contact the person who created the PDF document to correct the problem."

Thanks
--Nasser

[AndreasMatthias]

There seems to be an issue with compresslevel. The following works fine for me:

\pdfvariable compresslevel = 0
\documentclass[a4paper]{article}
\usepackage{flare}
\begin{document}
\fbox{\includegraphics[scale=.5]{p.pdf}}
\end{document}

I've no idea why it doesn't work with other compresslevels. I will look into it.

[AndreasMatthias]

I forgot to decompress the stream while reading it. Thus the already compressed stream was compressed once again with compresslevel > 0. Fixed in 1a45462

[nasser1]

Hello; As I was testing it more, found couple of problems.

1. using \includegraphics[width=0.6\paperwidth,page=1]{p} gives error

(/usr/local/texlive/2021/texmf-dist/tex/latex/translations/translations-basic-d
ictionary-english.trsl)
No file foo.toc.
[\directlua]:1: invalid escape sequence near '"{{key='width',val='0.6\p'.
\FLR@CopyAnnotations ...yAnnots()page:copyDests()}
                                                  \latelua {page:cacheData()}
l.8 \includegraphics[width=0.6\paperwidth,page=1]{p}

?

Similar error using \includegraphics[width=0.6\pagewidth,page=1]{p} and \includegraphics[width=0.6\columnwidth,page=1]{p}

2. No error when using \includegraphics[width=0.6\textwidth,page=1]{p} but there was a problem when looking at the generated PDF. The marking were now shifted from their original positions in the file that was included (p.pdf in this case).

3. Only when using scale did it work correctly (i.e. no error, and the marking were in the same positions as in the included pdf file.

Is scale meant to be the only option to now use in order to have those markings and notes included with the pdf file and to remain in the correct location? Or is this something because your package is still under development and in a future version they will work similar to using scale? For now, will changed my code to use scale instead of any of the other options I was using to change the included pdf pages size.

\documentclass[12pt]{article}
\ifdefined\HCode  
\usepackage{graphicx}
\else 
\usepackage{flare} %6/10/21. This includes graphics. do not use with make4ht. gives errors
\fi 

\begin{document}

%\includegraphics[width=0.6\paperwidth,page=1]{p}%error

\clearpage 

%\includegraphics[width=0.6\columnwidth,page=1]{p}%error

\includegraphics[width=0.6\textwidth,page=1]{p}%problem, marking shifted

\clearpage 

\includegraphics[scale=0.6,page=1]{p}%OK
\end{document}

thanks
--Nasser

[nasser1]

As I am replacing graphicx with your package (since flare loads graphicx itself) and trying it on other files, I found some more errors.

/usr/local/texlive/2021/bin/x86_64-linux/texfot: invoking: lualatex --shell-escape --file-line-error \def\isLegal{1} \input{index.tex}
This is LuaHBTeX, Version 1.13.2 (TeX Live 2021)
Package etex Warning: Extended allocation already in use.
Package tocloft Warning: \@starttoc has already been redefined; tocloft bailing
Package fancyhdr Warning: \headheight is too small (12.0pt):
Package fancyhdr Warning: \headheight is too small (12.0pt):
...ocal/texlive/2021/texmf-dist/tex/latex/base/ltluatex.lua:109:
Module Flare Error: Argument 'kv_str' must be a string representing a Lua table
        ...ocal/texlive/2021/texmf-dist/tex/latex/base/ltluatex.lua:109: in function <
...ocal/texlive/2021/texmf-dist/tex/latex/base/ltluatex.lua:108>
        /home/me/texmf/tex/latex/flare/flare-keyval.lua:55: in function 'flare-keyval.
processKeyvals'
        [\directlua]:1: in main chunk.
\FLR@CopyAnnotations ...yAnnots()page:copyDests()}

I will try to make a MWE for above, as it is from a larger file I had which compiled OK before. But the error are coming from flare package it looks like. In addition, when I remove the flare package and put back the graphicx package, the errors go away. So it looks like a conflict between your package and some other package.

[AndreasMatthias]

Flare needs to get hold of the CTM (current transformation matrix) which is used for inserting an image with \includegraphics. This CTM is then used to transform all coordinates appearing in annotations. So far I'm still looking for a perfect place to hook into \includegraphics and to retrieve the CTM without redoing each and every calculation that is done inside \includegraphics, let alone \scalebox, \rotatebox, ... The way it's implemented right now seems to be working quite well for scale, but not for other options like width, ...

Concerning the last error message (Argument 'kv_str' must be a string representing ...) I'd be really interested in learning how you triggered this error. This message is comming from function processKeyvals() which processes the given options of \includegraphics.

[nasser1]

The error about 'kv_str' came when I was building a very large latex trying your package. I do not know now if I can make a MWE as it is very complicated and loads many packages. I think I will wait for your package updates when it will support width=... option, because scale=... does not work with tex4ht. The images come out very small in HTML. Only when I use width=.... do they come the right size. This might be a tex4ht issue. But because I build everything with tex4ht as well as to PDF, I can't use scale at this time.

I will keep an eye on your package in the future, and if and when it supports width I will try it again.

Thanks for all your work on this.