Text detection with Vison coreML

[pavlinb]

@cvp I found a project in Swift that is good for Detecting in real time. But for me is hard to translate to Python.

[cvp]

@pavlinb You can post the url but I don't promise anything, if too long or too complex for me

[pavlinb]

@cvp https://developer.apple.com/documentation/vision/recognizing_objects_in_live_capture

There is download button at the top.

[cvp]

@pavlinb I think you (we?) Could do it, starting from @JonB script https://github.com/jsbain/objc_hacks/blob/master/live_camera_view.py

[pavlinb]

@cvp I thought the same :-)

[cvp]

@pavlinb First draft here

back camera on my iPad mini 4 does not work, I don't know why

[pavlinb]

@cvp class LiveCameraView(ui.View):
''' device=1== front, device=2==back

back camera is device=0

[cvp]

@pavlinb Thanks, gist corrected

[pavlinb]

@cvp A big step in right direction. Thanks.

[cvp]

@pavlinb Next step is to integrate AVCaptureVideoDataOutput from example here

If you follow the logic of this code, you will fall on UIImageFromSampleBuffer function
which is bery very complex (for me, at least)

[pavlinb]

@cvp My fifty cents link

[cvp]

@pavlinb Super. Do you think I have to try to intercept real frames of the camera or are you happy with this way of taking still photos?

[cvp]

@pavlinb On my (old) iPad mini 4, the script takes 2 photos per second, far from a real time process for frames...

[pavlinb]

@cvp For my current needs it’s perfect.

[cvp]

@pavlinb 👍

[pavlinb]

@cvp But it would be good if i can avoid shutter sound. I assume it is caused by the method used to capture frames?

[cvp]

@pavlinb for info, AVCaptureStillImageOutput is deprecated, we should use AVCapturePhotoOutput

[cvp]

@pavlinb said:

But it would be good if i can avoid shutter sound. I assume it is caused by the method used to capture frames?

Following this,
I tried this without success

      c.AudioServicesDisposeSystemSoundID(1108,restype=None, argtypes=[c_int32]) # 1108 = shutter sound

[pavlinb]

@cvp said:

@pavlinb Next step is to integrate AVCaptureVideoDataOutput from example here

If you follow the logic of this code, you will fall on UIImageFromSampleBuffer function
which is bery very complex (for me, at least)

Hi, did you manage to run given code? It seems it contains number of functions (ready to use or not).

Regards.

[cvp]

@pavlinb No, sorry.