Reinforcement Learning setup

[trigaten]

Is there a way to taken screen captures within the iMessage app and also execute touches on the screen? If so, where should I look in the docs to find this, Im trying to make an RL agent play a game with me. Thanks

[ccc]

Apple works hard to make sure that one iOS app can not "drive" another iOS app for security reasons.

If you have the source code for both apps you can do things or if one app exposes URLs then the other can use those URLs to drive things.

With iMessage, you can build a message from another app but you can NOT click the send button. This is a good thing from a security perspective.