Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Overviews to MRF #89

Open
Lorne-CoE opened this issue May 30, 2019 · 3 comments
Open

Overviews to MRF #89

Lorne-CoE opened this issue May 30, 2019 · 3 comments
Assignees

Comments

@Lorne-CoE
Copy link

Hi,

I've run into an issue trying to convert overviews to MRF. The process starts fine and then trows a [Errno 13] permission denied.

The log file is as follows:

<?xml version="1.0" ?>
<Projects>
	<OptimizeRasters>
		<StartTime>20190530T131714</StartTime>
		<EndTime>20190530T131735</EndTime>
		<TotalDuration>20</TotalDuration>
		<Message>version=v2.0.5c/20190522</Message>
		<Message>Copying files to -tempinput path (D:/Temp/)</Message>
		<Message>[CPY] D:/Temp/Ov_i02_L01_R00000D81_C000004CB.tif</Message>
		<Message>[CPY] D:/Temp/Ov_i02_L01_R00000D81_C000004CA.tif</Message>
		<Message>[CPY] D:/Temp/Ov_i02_L01_R00000D82_C000004CA.tif</Message>
		<Message>[CPY] D:/Temp/Ov_i02_L01_R00000D82_C000004CB.tif</Message>
		<Message>[CPY] D:/Temp/Ov_i02_L02_R00000480_C00000198.tif</Message>
		<Message>[CPY] D:/Temp/Ov_i02_L02_R00000480_C00000199.tif</Message>
		<Message>[CPY] D:/Temp/Ov_i02_L03_R00000180_C00000088.tif</Message>
		<Message>[CPY] D:/Temp/Ov_i02_L04_R00000080_C0000002D.tif</Message>
		<Message>Converting..</Message>
		<Message>[Resume] Creating job (C:\Image_Mgmt_Workflows\OptimizeRasters\OR_20190530T131714680147.orjob)</Message>
		<Message>
			Copying non rasters/aux files (D:/Projects/MRF_Test/MRF_Test.Overviews/=&gt;D:/mrf_jpeg_overviews/)..
			<Error>
				<type>critical</type>
				<text>([Errno 13] Permission denied: 'D:/Projects/MRF_Test/MRF_Test.Overviews/MRF_JPEG_Test.Overviews')</text>
			</Error>
		</Message>
		<Message>[CPY] MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CA.tif.msk</Message>
		<Message>[CPY] MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CA.tif.msk</Message>
		<Message>[CPY] MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CB.tif.msk</Message>
		<Message>[CPY] MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CB.tif.msk</Message>
		<Message>[CPY] MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000198.tif.msk</Message>
		<Message>[CPY] MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000199.tif.msk</Message>
		<Message>[CPY] MRF_JPEG_Test.Overviews/Ov_i02_L03_R00000180_C00000088.tif.msk</Message>
		<Message>[CPY] MRF_JPEG_Test.Overviews/Ov_i02_L04_R00000080_C0000002D.tif.msk</Message>
		<Message>Done.</Message>
		<Message>Converting..</Message>
		<Message>Applying compression (D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CA.tif)</Message>
		<Message>Applying compression (D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CB.tif)</Message>
		<Message>Applying compression (D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CA.tif)</Message>
		<Message>Applying compression (D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CB.tif)</Message>
		<Message>warnings/errors:</Message>
		<Message>ERROR 4: D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CA.tif: No such file or directory</Message>
		<Message>warnings/errors:</Message>
		<Message>ERROR 4: D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CA.tif: No such file or directory</Message>
		<Message>warnings/errors:</Message>
		<Message>ERROR 4: D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CB.tif: No such file or directory</Message>
		<Message>warnings/errors:</Message>
		<Message>ERROR 4: D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CB.tif: No such file or directory</Message>
		<Message>Status: (FAILED).</Message>
		<Message>Status: (FAILED).</Message>
		<Message>Status: (FAILED).</Message>
		<Message>Status: (FAILED).</Message>
		<Message>Applying compression (D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000198.tif)</Message>
		<Message>Applying compression (D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000199.tif)</Message>
		<Message>warnings/errors:</Message>
		<Message>ERROR 4: D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000198.tif: No such file or directory</Message>
		<Message>Status: (FAILED).</Message>
		<Message>Applying compression (D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L03_R00000180_C00000088.tif)</Message>
		<Message>Applying compression (D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L04_R00000080_C0000002D.tif)</Message>
		<Message>warnings/errors:</Message>
		<Message>ERROR 4: D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000199.tif: No such file or directory</Message>
		<Message>Status: (FAILED).</Message>
		<Message>warnings/errors:</Message>
		<Message>ERROR 4: D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L04_R00000080_C0000002D.tif: No such file or directory</Message>
		<Message>warnings/errors:</Message>
		<Message>ERROR 4: D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L03_R00000180_C00000088.tif: No such file or directory</Message>
		<Message>Status: (FAILED).</Message>
		<Message>Status: (FAILED).</Message>
		<Message>Removing input rasters at (D:/Temp/)</Message>
		<Message>Done.</Message>
		<Message>Done..
</Message>
		<Status>[Failed!]</Status>
		<Duration>5</Duration>
		<Cmd-line>
			<Message>-config=C:\Image_Mgmt_Workflows\OptimizeRasters\UserTemplates\Overviews_to_MRF_LERC_20190530131714.xml -output=D:\mrf_jpeg_overviews -tempinput=D:\Temp -tempoutput=D:\Temp -input=D:\Projects\MRF_Test\MRF_Test.Overviews\MRF_JPEG_Test.Overviews -resume=True</Message>
			<Duration>0</Duration>
		</Cmd-line>
		<Input-config-values>
			<Message>Mode=mrf</Message>
			<Message>RasterFormatFilter=['tif', 'tiff', 'TIF', 'TIFF', 'img', 'jp2', 'JP2', 'IMG']</Message>
			<Message>ExcludeFilter=['tmp', 'rrd', 'idx', 'lrc', 'mrf_cache', 'pjp', 'ppng', 'pft', 'pzp', 'ovr', 'aux.xml', 'aux', 'tfw', 'TFW', 'pjg']</Message>
			<Message>IncludeSubdirectories=true</Message>
			<Message>Compression=LERC</Message>
			<Message>LERCPrecision=0.5</Message>
			<Message>BuildPyramids=false</Message>
			<Message>PyramidSampling=avg</Message>
			<Message>PyramidCompression=LERC</Message>
			<Message>BlockSize=512</Message>
			<Message>KeepExtension=false</Message>
			<Message>Threads=4</Message>
			<Message>CloudUpload=false</Message>
			<Message>Out_S3_DeleteAfterUpload=true</Message>
			<Duration>0</Duration>
		</Input-config-values>
		<Copy>
			<Message>Copying non rasters/aux files (D:/Projects/MRF_Test/MRF_Test.Overviews/MRF_JPEG_Test.Overviews/=&gt;D:/mrf_jpeg_overviews/)..</Message>
			<Message>Done.</Message>
			<Duration>0</Duration>
		</Copy>
	</OptimizeRasters>
</Projects>

Here's the orjob file:

# config=C:/Image_Mgmt_Workflows/OptimizeRasters/UserTemplates/Overviews_to_MRF_LERC_20190530131714.xml
# output=D:/mrf_jpeg_overviews/
# tempinput=D:/Temp/
# tempoutput=D:/Temp/
# input=D:/Projects/MRF_Test/MRF_Test.Overviews/
# resume=True
# op=report
# pyramids=false
SOURCE	COPIED	PROCESSED	UPLOADED
D:/Projects/MRF_Test/MRF_Test.Overviews/MRF_JPEG_Test.Overviews	no		
D:/Projects/MRF_Test/MRF_Test.Overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CA.tif.msk	yes		
D:/Projects/MRF_Test/MRF_Test.Overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CA.tif.msk	yes		
D:/Projects/MRF_Test/MRF_Test.Overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CB.tif.msk	yes		
D:/Projects/MRF_Test/MRF_Test.Overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CB.tif.msk	yes		
D:/Projects/MRF_Test/MRF_Test.Overviews/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000198.tif.msk	yes		
D:/Projects/MRF_Test/MRF_Test.Overviews/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000199.tif.msk	yes		
D:/Projects/MRF_Test/MRF_Test.Overviews/MRF_JPEG_Test.Overviews/Ov_i02_L03_R00000180_C00000088.tif.msk	yes		
D:/Projects/MRF_Test/MRF_Test.Overviews/MRF_JPEG_Test.Overviews/Ov_i02_L04_R00000080_C0000002D.tif.msk	yes		
D:/Projects/MRF_Test/MRF_Test.Overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CB.tif		no	
D:/Projects/MRF_Test/MRF_Test.Overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CA.tif		no	
D:/Projects/MRF_Test/MRF_Test.Overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CA.tif		no	
D:/Projects/MRF_Test/MRF_Test.Overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CB.tif		no	
D:/Projects/MRF_Test/MRF_Test.Overviews/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000198.tif		no	
D:/Projects/MRF_Test/MRF_Test.Overviews/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000199.tif		no	
D:/Projects/MRF_Test/MRF_Test.Overviews/MRF_JPEG_Test.Overviews/Ov_i02_L03_R00000180_C00000088.tif		no	
D:/Projects/MRF_Test/MRF_Test.Overviews/MRF_JPEG_Test.Overviews/Ov_i02_L04_R00000080_C0000002D.tif		no

I get the same error if I use either the Overviews_to_MRF_LERC or Overviews_to_JPEG. I also got the same error trying the process on a different computer.

Cheers

@Chamlika
Copy link
Contributor

Chamlika commented May 31, 2019 via email

@Lorne-CoE
Copy link
Author

Lorne-CoE commented May 31, 2019

Hi,

The output folder is valid and has the following in it after running the tool the msk files are in D:\mrf_jpeg_overviews\MRF_JPEG_Test.Overviews.

image

But no files are in D:\mrf_jpeg_overviews

image

The temp folder has the tif files created in it as shown below:

image

But there is nothing in D:\Temp\MRF_JPEG_Test.Overviews

image

It appears the tif files are not being copied to the correct folder. As a test I copied the tif into D:Temp\MRF_JPEG_Test.Overviews and ran the process and it seems to completed correctly with the overview being created in the output folder.

image

However the permission error is still happening.

C:\Users\lordmi\AppData\Local\ESRI\conda\envs\arcgispro-py3-2.3\python.exe D:/src/MRF_Test/OptimizeTest.py
OptimizeRasters.py v2.0.5c/20190522
Convert raster formats to a valid output format through GDAL_Translate.

Please Note:
OptimizeRasters.py is entirely case-sensitive, extensions/paths in the config file are case-sensitive and the program will fail if the correct path/case is not entered at the cmd-line or in the config file.

Log-path set to (C:\Image_Mgmt_Workflows\OptimizeRasters\logs)
log-msg:version=v2.0.5c/20190522
log-msg:-config=C:\Image_Mgmt_Workflows\OptimizeRasters\UserTemplates\Overviews_to_MRF_JPEG_20190531075917.xml -output=D:\mrf_jpeg_overviews -tempinput=D:\Temp -tempoutput=D:\Temp -input=D:\Projects\MRF_Test\MRF_Test.Overviews\MRF_JPEG_Test.Overviews -resume=True
log-msg:Mode=mrf
log-msg:RasterFormatFilter=['tif', 'tiff', 'TIF', 'TIFF', 'img', 'jp2', 'JP2', 'IMG']
log-msg:ExcludeFilter=['tmp', 'rrd', 'idx', 'lrc', 'mrf_cache', 'pjp', 'ppng', 'pft', 'pzp', 'ovr', 'aux.xml', 'aux', 'tfw', 'TFW', 'pjg']
log-msg:IncludeSubdirectories=true
log-msg:Compression=JPEG
log-msg:Quality=90
log-msg:LERCPrecision=0.5
log-msg:BuildPyramids=false
log-msg:PyramidSampling=avg
log-msg:PyramidCompression=LERC
log-msg:BlockSize=512
log-msg:KeepExtension=false
log-msg:Threads=4
log-msg:CloudUpload=false
log-msg:Out_S3_DeleteAfterUpload=true
log-msg:Copying non rasters/aux files (D:/Projects/MRF_Test/MRF_Test.Overviews/MRF_JPEG_Test.Overviews/=>D:/mrf_jpeg_overviews/)..
log-msg:Done.
log-msg:Copying files to -tempinput path (D:/Temp/)
log-msg:[CPY] D:/Temp/Ov_i02_L01_R00000D81_C000004CB.tif
log-msg:[CPY] D:/Temp/Ov_i02_L01_R00000D81_C000004CA.tif
log-msg:[CPY] D:/Temp/Ov_i02_L01_R00000D82_C000004CA.tif
log-msg:[CPY] D:/Temp/Ov_i02_L01_R00000D82_C000004CB.tif
log-msg:[CPY] D:/Temp/Ov_i02_L02_R00000480_C00000198.tif
log-msg:[CPY] D:/Temp/Ov_i02_L02_R00000480_C00000199.tif
log-msg:[CPY] D:/Temp/Ov_i02_L03_R00000180_C00000088.tif
log-msg:[CPY] D:/Temp/Ov_i02_L04_R00000080_C0000002D.tif
log-msg:Converting..
log-msg:[Resume] Creating job (C:\Image_Mgmt_Workflows\OptimizeRasters\OR_20190531T075917079225.orjob)
log-msg:Copying non rasters/aux files (D:/Projects/MRF_Test/MRF_Test.Overviews/=>D:/mrf_jpeg_overviews/)..
WARNING: log-critical:([Errno 13] Permission denied: 'D:/Projects/MRF_Test/MRF_Test.Overviews/MRF_JPEG_Test.Overviews')
log-msg:[CPY] MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CA.tif.msk
log-msg:[CPY] MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CA.tif.msk
log-msg:[CPY] MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CB.tif.msk
log-msg:[CPY] MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CB.tif.msk
log-msg:[CPY] MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000198.tif.msk
log-msg:[CPY] MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000199.tif.msk
log-msg:[CPY] MRF_JPEG_Test.Overviews/Ov_i02_L03_R00000180_C00000088.tif.msk
log-msg:[CPY] MRF_JPEG_Test.Overviews/Ov_i02_L04_R00000080_C0000002D.tif.msk
log-msg:Done.
log-msg:Converting..
log-msg:Applying compression (D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CA.tif)
log-msg:Applying compression (D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CB.tif)
log-msg:Applying compression (D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CB.tif)
log-msg:Applying compression (D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CA.tif)
log-msg:messages:
log-msg:b'Input file size is 704, 1200'
log-msg:b'0...10...20...30...40...50...60...70...80...90...100 - done.'
log-msg:messages:
log-msg:b'Input file size is 704, 2968'
log-msg:b'0...10...20...30...40...50...60...70...80...90...100 - done.'
log-msg:messages:
log-msg:b'Input file size is 4297, 1200'
log-msg:b'0...10...20...30...40...50...60...70...80...90...100 - done.'
log-msg:Status: (OK).
log-msg:Status: (OK).
log-msg:Status: (OK).
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CA.tif
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CA.tif
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CA.mrf
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CB.tif
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CA.mrf
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CA.idx
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CB.mrf
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CA.idx
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CA.pjg
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CB.idx
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CA.pjg
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CA.mrf.aux.xml
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CB.pjg
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CA.mrf.aux.xml
log-msg:Status: (OK).
log-msg:messages:
log-msg:b'Input file size is 4297, 2968'
log-msg:b'0...10...20...30...40...50...60...70...80...90...100 - done.'
log-msg:Status: (OK).
log-msg:Applying compression (D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000198.tif)
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CB.mrf.aux.xml
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CB.tif
log-msg:Status: (OK).
log-msg:Status: (OK).
log-msg:Applying compression (D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000199.tif)
log-msg:messages:
log-msg:b'Input file size is 235, 1390'
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CB.mrf
log-msg:Status: (OK).
log-msg:Applying compression (D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L03_R00000180_C00000088.tif)
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000198.tif
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CB.idx
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000198.mrf
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CB.pjg
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000198.idx
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CB.mrf.aux.xml
log-msg:Status: (OK).
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000198.pjg
log-msg:messages:
log-msg:b'Input file size is 1433, 1390'
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000198.mrf.aux.xml
log-msg:Applying compression (D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L04_R00000080_C0000002D.tif)
log-msg:messages:
log-msg:b'Input file size is 557, 464'
log-msg:Status: (OK).
log-msg:Status: (OK).
log-msg:Status: (OK).
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000199.tif
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L03_R00000180_C00000088.tif
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000199.mrf
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L03_R00000180_C00000088.mrf
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000199.idx
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L03_R00000180_C00000088.idx
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L03_R00000180_C00000088.pjg
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000199.pjg
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L03_R00000180_C00000088.mrf.aux.xml
log-msg:Status: (OK).
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000199.mrf.aux.xml
log-msg:Status: (OK).
log-msg:messages:
log-msg:b'Input file size is 186, 155'
log-msg:b'0...10...20...30...40...50...60...70...80...90...100 - done.'
log-msg:Status: (OK).
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L04_R00000080_C0000002D.tif
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L04_R00000080_C0000002D.mrf
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L04_R00000080_C0000002D.idx
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L04_R00000080_C0000002D.pjg
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L04_R00000080_C0000002D.mrf.aux.xml
log-msg:Status: (OK).
log-msg:Removing input rasters at (D:/Temp/)
log-msg:Done.
log-msg:Done..

log-status:[Failed!]

Process finished with exit code 0 
C:\Users\lordmi\AppData\Local\ESRI\conda\envs\arcgispro-py3-2.3\python.exe D:/src/MRF_Test/OptimizeTest.py
OptimizeRasters.py v2.0.5c/20190522
Convert raster formats to a valid output format through GDAL_Translate.

Please Note:
OptimizeRasters.py is entirely case-sensitive, extensions/paths in the config file are case-sensitive and the program will fail if the correct path/case is not entered at the cmd-line or in the config file.

Log-path set to (C:\Image_Mgmt_Workflows\OptimizeRasters\logs)
log-msg:version=v2.0.5c/20190522
log-msg:-config=C:\Image_Mgmt_Workflows\OptimizeRasters\UserTemplates\Overviews_to_MRF_JPEG_20190531075917.xml -output=D:\mrf_jpeg_overviews -tempinput=D:\Temp -tempoutput=D:\Temp -input=D:\Projects\MRF_Test\MRF_Test.Overviews\MRF_JPEG_Test.Overviews -resume=True
log-msg:Mode=mrf
log-msg:RasterFormatFilter=['tif', 'tiff', 'TIF', 'TIFF', 'img', 'jp2', 'JP2', 'IMG']
log-msg:ExcludeFilter=['tmp', 'rrd', 'idx', 'lrc', 'mrf_cache', 'pjp', 'ppng', 'pft', 'pzp', 'ovr', 'aux.xml', 'aux', 'tfw', 'TFW', 'pjg']
log-msg:IncludeSubdirectories=true
log-msg:Compression=JPEG
log-msg:Quality=90
log-msg:LERCPrecision=0.5
log-msg:BuildPyramids=false
log-msg:PyramidSampling=avg
log-msg:PyramidCompression=LERC
log-msg:BlockSize=512
log-msg:KeepExtension=false
log-msg:Threads=4
log-msg:CloudUpload=false
log-msg:Out_S3_DeleteAfterUpload=true
log-msg:Copying non rasters/aux files (D:/Projects/MRF_Test/MRF_Test.Overviews/MRF_JPEG_Test.Overviews/=>D:/mrf_jpeg_overviews/)..
log-msg:Done.
log-msg:Copying files to -tempinput path (D:/Temp/)
log-msg:[CPY] D:/Temp/Ov_i02_L01_R00000D81_C000004CB.tif
log-msg:[CPY] D:/Temp/Ov_i02_L01_R00000D81_C000004CA.tif
log-msg:[CPY] D:/Temp/Ov_i02_L01_R00000D82_C000004CA.tif
log-msg:[CPY] D:/Temp/Ov_i02_L01_R00000D82_C000004CB.tif
log-msg:[CPY] D:/Temp/Ov_i02_L02_R00000480_C00000198.tif
log-msg:[CPY] D:/Temp/Ov_i02_L02_R00000480_C00000199.tif
log-msg:[CPY] D:/Temp/Ov_i02_L03_R00000180_C00000088.tif
log-msg:[CPY] D:/Temp/Ov_i02_L04_R00000080_C0000002D.tif
log-msg:Converting..
log-msg:[Resume] Creating job (C:\Image_Mgmt_Workflows\OptimizeRasters\OR_20190531T075917079225.orjob)
log-msg:Copying non rasters/aux files (D:/Projects/MRF_Test/MRF_Test.Overviews/=>D:/mrf_jpeg_overviews/)..
WARNING: log-critical:([Errno 13] Permission denied: 'D:/Projects/MRF_Test/MRF_Test.Overviews/MRF_JPEG_Test.Overviews')
log-msg:[CPY] MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CA.tif.msk
log-msg:[CPY] MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CA.tif.msk
log-msg:[CPY] MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CB.tif.msk
log-msg:[CPY] MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CB.tif.msk
log-msg:[CPY] MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000198.tif.msk
log-msg:[CPY] MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000199.tif.msk
log-msg:[CPY] MRF_JPEG_Test.Overviews/Ov_i02_L03_R00000180_C00000088.tif.msk
log-msg:[CPY] MRF_JPEG_Test.Overviews/Ov_i02_L04_R00000080_C0000002D.tif.msk
log-msg:Done.
log-msg:Converting..
log-msg:Applying compression (D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CA.tif)
log-msg:Applying compression (D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CB.tif)
log-msg:Applying compression (D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CB.tif)
log-msg:Applying compression (D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CA.tif)
log-msg:messages:
log-msg:b'Input file size is 704, 1200'
log-msg:b'0...10...20...30...40...50...60...70...80...90...100 - done.'
log-msg:messages:
log-msg:b'Input file size is 704, 2968'
log-msg:b'0...10...20...30...40...50...60...70...80...90...100 - done.'
log-msg:messages:
log-msg:b'Input file size is 4297, 1200'
log-msg:b'0...10...20...30...40...50...60...70...80...90...100 - done.'
log-msg:Status: (OK).
log-msg:Status: (OK).
log-msg:Status: (OK).
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CA.tif
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CA.tif
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CA.mrf
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CB.tif
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CA.mrf
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CA.idx
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CB.mrf
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CA.idx
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CA.pjg
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CB.idx
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CA.pjg
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CA.mrf.aux.xml
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CB.pjg
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CA.mrf.aux.xml
log-msg:Status: (OK).
log-msg:messages:
log-msg:b'Input file size is 4297, 2968'
log-msg:b'0...10...20...30...40...50...60...70...80...90...100 - done.'
log-msg:Status: (OK).
log-msg:Applying compression (D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000198.tif)
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D82_C000004CB.mrf.aux.xml
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CB.tif
log-msg:Status: (OK).
log-msg:Status: (OK).
log-msg:Applying compression (D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000199.tif)
log-msg:messages:
log-msg:b'Input file size is 235, 1390'
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CB.mrf
log-msg:Status: (OK).
log-msg:Applying compression (D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L03_R00000180_C00000088.tif)
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000198.tif
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CB.idx
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000198.mrf
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CB.pjg
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000198.idx
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L01_R00000D81_C000004CB.mrf.aux.xml
log-msg:Status: (OK).
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000198.pjg
log-msg:messages:
log-msg:b'Input file size is 1433, 1390'
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000198.mrf.aux.xml
log-msg:Applying compression (D:/Temp/MRF_JPEG_Test.Overviews/Ov_i02_L04_R00000080_C0000002D.tif)
log-msg:messages:
log-msg:b'Input file size is 557, 464'
log-msg:Status: (OK).
log-msg:Status: (OK).
log-msg:Status: (OK).
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000199.tif
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L03_R00000180_C00000088.tif
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000199.mrf
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L03_R00000180_C00000088.mrf
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000199.idx
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L03_R00000180_C00000088.idx
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L03_R00000180_C00000088.pjg
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000199.pjg
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L03_R00000180_C00000088.mrf.aux.xml
log-msg:Status: (OK).
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L02_R00000480_C00000199.mrf.aux.xml
log-msg:Status: (OK).
log-msg:messages:
log-msg:b'Input file size is 186, 155'
log-msg:b'0...10...20...30...40...50...60...70...80...90...100 - done.'
log-msg:Status: (OK).
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L04_R00000080_C0000002D.tif
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L04_R00000080_C0000002D.mrf
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L04_R00000080_C0000002D.idx
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L04_R00000080_C0000002D.pjg
[MV] D:/mrf_jpeg_overviews/MRF_JPEG_Test.Overviews/Ov_i02_L04_R00000080_C0000002D.mrf.aux.xml
log-msg:Status: (OK).
log-msg:Removing input rasters at (D:/Temp/)
log-msg:Done.
log-msg:Done..

log-status:[Failed!]

Process finished with exit code 0

Cheers

@abhiataero
Copy link
Collaborator

@Lorne-CoE did the isssue get resolved

@Chamlika Chamlika self-assigned this Jul 16, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants