new file/project couldn't be created

pavlinb

@cvp said:

@pavlinb I don't want to take the risk to need to reinstall, sorry.

Sure, no problem.

If you remove Pythonista app from active apps list, and wait some time, does the memory vary?

After 1 hour memory is the same - 3GB.

cvp

@pavlinb I think it is now time to ask help from our big guru's...

JonB

I wonder can you check the pythonista temp directory?

Are you using a local file when you load your model? Or an internet url?

JonB

Also... What is your model_url? We need to check that is actually valid.

pavlinb

@JonB said:

I wonder can you check the pythonista temp directory?

Sure, what do you need?

Are you using a local file when you load your model? Or an internet url?

I use local files.

JonB

I mean check it for excessively large temp files.

What is your exact model_url?

Can you get a small model to work?

Have you already pre-compiled the model?

JonB

https://alexsosn.github.io/ml/2017/06/09/Core-ML-will-not-Work-for-Your-App.html

This mentions that complex models can turn into several GB on the device. You might also try backing up after, and looking at what files get created and where. Possibly, I'm thinking if you put your file into a folder starting with a period, that keeps pythonista from showing /indexing it.

cvp

If he uses the mlmodel I found, it is here

but I also used it without any problems, with images of short texts

pavlinb

Yes, I used mentioned model.

And with clean images with few symbols all is ok.

Probably the problem occurs with complex images.

cvp

@JonB said:

Have you already pre-compiled the model?

The omz code compiles the model before using it.

cvp

For each character, the compiled model is generated as
file:///private/var/mobile/Containers/Data/Application/C285FD04-6489-45E5-A6C5-D4A44D300BBC/tmp/(A%20Document%20Being%20Saved%20By%20Pythonista3%20643)/OCR.mlmodelc/

Omz code needs to be improved so this compilation is done only once, not for each character...

JonB

It might be a good idea to compile it once, copy it to a regular location, then delete the tmp file. That's what Apple recommends

If you run the code that does a fresh compile every time, you will quickly fill up the tmp storage. I'm not how reliable the cleaning of tmp files is.

pavlinb

Agree. .

cvp

Set vn_model global,
call load_model at begin of main and
remove load_model in _classify_image_data

Script is quicker and does not generate a compiled model at each character

cvp

After run, tmp folder is empty

cvp

def load_model():
	global vn_model
	
def _classify_img_data(img_data):
	global vn_model
	'''The main image classification method, used by `classify_image` (for camera images) and `classify_asset` (for photo library assets).'''
	#vn_model = load_model()
	
def main():
    global vn_model
    vn_model = load_model()

cvp

After some tests with small texts, Pythonista storage has increased of 1GB but I hope this will decrease in some hours...

cvp

import os
d = '/private/var/mobile/Containers/Data/Application/C285FD04-6489-45E5-A6C5-D4A44D300BBC/tmp/'
os.chdir(d)
l = os.listdir()
for e in l:
	print(e)

Shows ....a lot of

(A Document Being Saved By Pythonista3 92)
(A Document Being Saved By Pythonista3 315)
(A Document Being Saved By Pythonista3 262)
(A Document Being Saved By Pythonista3 628)
(A Document Being Saved By Pythonista3 563)
(A Document Being Saved By Pythonista3 54)

cvp

Trying to remove it gives

PermissionError: [Errno 1] Operation not permitted: '(A Document Being Saved By Pythonista3 92)'

cvp

Each file has a size of 96 bytes??????????