Cheers everyone, Jon that’s where I nabbed that snippet from in first place! The issue is the proximity to the edge of the image I think, mine were very close to the edge so I tried a bigger black border and I did try messing with the numbers a bit on properties.Seems to work better but still not perfect.

Hmm ok so your saying 2 colour works better - I only used that test image as I couldn’t work out how to upload an image here…
this is more like the kind of images I want to use though, ie long thin horizontal rectangles mostly - seems to struggle, try :

iow:drag_256

It creates extra rectangles at top and bottom bounds- how can I remove these?

I found another post regarding text recognition and iOS vision and recognise rectangle is mentioned there so cut out the text aspect and adapted it: (thanks jonb)

But I can’t get what I need from this - I have tried altering the VNDetectRectanglesRequest properties.
Basic issue is even though it’s a very simple image = seems to struggle identifying accurately the edges.

from objc_util import *
import ui


ui_image=ui.Image.named('test:Gray21')
ui_image.show()

load_framework('Vision')
VNDetectRectanglesRequest = ObjCClass('VNDetectRectanglesRequest')
VNImageRequestHandler = ObjCClass('VNImageRequestHandler')

handler = VNImageRequestHandler.alloc().initWithData_options_(ui_image.to_png(), None).autorelease()

req = VNDetectRectanglesRequest.alloc().init().autorelease()

req.maximumObservations=0
req.minimumSize=0.01
req.minimumAspectRatio=0.0
req.maximumAspectRatio=1.0
req.quadratureTolerance=10

success = handler.performRequests_error_([req], None)
with ui.ImageContext(*tuple(ui_image.size) ) as ctx:
   ui_image.draw()
   for result in req.results():
      cgpts=[result.bottomLeft(),
                                        result.topLeft(),
                                        result.topRight(),
                                        result.bottomRight(),
                                        result.bottomLeft()] 
      verts = [(p.x*ui_image.size.w, (1-p.y)*ui_image.size.h) for p in cgpts]
      pth = ui.Path()
      pth.move_to(*verts[0]) 
      for p in verts[1:]:
         pth.line_to(*p)  
      ui.set_color('red')
      pth.stroke()
      x,y = verts[0]
      w,h =(verts[2][0]-x), (verts[2][1]-y)
     
   marked_img = ctx.get_image()
   marked_img.show()

Vision iOS framework looks perfect actually so yes please would be interested in how to implement such a thing in Pythonista for sure.

Hiya
So I don’t have an image it’s just in my head but initially yes I’m thinking rectangles black on white or white on black.They could be arbitrary sizes I’m thinking - I just want use them to create edges that I can repurpose as coordinates for building other elements with.

Hi
Say I have a 2 colour image containing a number of rectangles.I would like to convert that image into an array of x,y cords at the corners of those rectangles.
Given that opencv won’t work for Pythonista what would be the best way to approach this?

Thanks that’s done it and is a lot easier.
I used :
button. content_mode=ui.CONTENT_SCALE_ASPECT_FIT
So seems to work ok without objC.
Thanks!

What’s the simplest way to be able to programmatically resize a ui.Image generated from a jpg file for a button background image?
Can I do it with imageContext? Or is PIL the way to go?

Hi
I am trying to provide some shortcuts to open some pdfs that I have in a Dropbox folder.
Firstly how do I establish a useable file path to a file in a Dropbox folder?
Secondly how would I open a pdf via Pythonista? I’m thinking quick look or at a push iBooks?

thanks
Rich

Wow above and beyond the call of duty thankyou!