Welcome!
This is the community forum for my apps Pythonista and Editorial.
For individual support questions, you can also send an email. If you have a very short question or just want to say hello โ I'm @olemoritz on Twitter.
Flick button keyboard.
-
@shinya-ta Ok, thus now I know that you have both the last version. and I am not surprised that you are having problems with this version. I must say that given the number of segmentation errors raised, it will not be easy at all to solve the problem
-
When I use it normally, I can use it without any problem, but if my wife uses voice over, the application will drop no matter what characters she enters.
-
@shinya-ta said
if my wife uses voice over, the application will drop no matter what characters she enters.
Wow, sorry for her. I'll test (if I can) next week... And you confirm that this problem has appeared from the last Pythonista version,
-
@shinya-ta I'm sincerely sorry but as I have health problems again, I haven't found the time or the concentration to try to understand the problem your wife is having when using the "flick button keyboard" with VoiceOver.
-
We are fine. First, please give priority to your health.
-
If you use voice over, the application will fall down.
Do I have to wait until the new version comes out?The current version is 3.4.
-
@shinya-ta I know and I don't understand, sincerely, after some research. With the new Pythonista version, there are some problems without any help to understand, sorry for that. No info at all in different logs (_objc_exception.txt, fault_log). And one more time, problem is not reproductible, does not happen each time. ๐ข
I have a friend for whom I wrote a very big Pythonista program and this program crashs with the new version, I advised him not to upgrade Pythonista.
-
Dear cvp.
As a result of trying with the past version, the script of version 00.15 was stable.
In the version after that, the application fell down when I used Voice Over. Will it be stable if I make improvements based on the script of 00.15?
-
@shinya-ta I don't understand. The actual version is 0.62 and you say that the last stable version is 0.15.
But you never mention a problem before new Pythonista version. -
I have saved the past version of the script separately, so this is the result I tried with the current Pythonista.
-
@shinya-ta I understand that but the previous version just before the actual is not 0.15, the are a lot of intermediate versions with functionalities you asked.
-
It doesn't function normally from version 0.16.
-
@shinya-ta I don't remember that you mentioned this in the past, but perhaps I'm wrong. Please confirm you said it.
I don't keep old versions thus perhaps could you post both versions 0.15 and 0.16 -
00.15 - katakena sub-keyboard: use only rows 2 and 3 to be sure all sub-keys to be visible - alphabet sub-keyboard: sub-keys all at left and right of key to be sure to be visible - semi-voiced is a sub-key of flicking voiced key todo - long key title "x...y' on iphone => compute font size so it is visible - voice,semi-voiced, punctuation, kanji, new line, read - You need new flick input buttons for voiced sound mark, semi-voiced sound mark and small case conversion. Also, there is a punctuation mark button. For example. โใฏ,ใฒ,ใต,ใธ,ใปโ โ โใฐ,ใณ,ใถ,ใน,ใผโ โใฏ,ใฒ,ใต,ใธ,ใปโ โ โใฑ,ใด,ใท,ใบ,ใฝโ In order to use this, it is necessary to operate the button after entering characters. After entering characters, you operate the button in the temporary determination state. The muddy point character is completed by the final determination. The temporary determination state is also an operation necessary for Kanji conversion, so this is also a function that cannot be removed. For example, enter "ใฏ". Then tap the voiced sound mark button. Then, the input of "ใฐ" is completed. Press the enter button again. This is the flow to complete the final character. Honestly, I'm not sure if this is possible to make. If Kanji conversion is necessary, I will choose from the list of Kanji at this stage and decide. bugs - ''' import keyboard import ui from objc_util import * import clipboard #import speech import sys from gestures import * import time version = '00.15' # use ObjectiveC speech: start ================================================= AVSpeechUtterance=ObjCClass('AVSpeechUtterance') AVSpeechSynthesizer=ObjCClass('AVSpeechSynthesizer') AVSpeechSynthesisVoice=ObjCClass('AVSpeechSynthesisVoice') voices=AVSpeechSynthesisVoice.speechVoices() for i in range(0,len(voices)): #print(i,voices[i].language(),voices[i].identifier()) if 'ja-JP' in str(voices[i].identifier()): # if u have Japanese Siri voice, replace from 'ja-JP' to 'siri_O-ren_ja-JP' vi = i break synthesizer=AVSpeechSynthesizer.new() def speech_say(t,unused): utterance=AVSpeechUtterance.speechUtteranceWithString_(t) utterance.rate = 0.5 utterance.useCompactVoice=False utterance.voice = voices[vi] synthesizer.speakUtterance_(utterance) # use ObjectiveC speech: end =================================================== class MyView(ui.View): def __init__(self, *args, **kwargs): super().__init__(self, *args, **kwargs) self.background_color = 'lightgray' # bounds not yet known in init, let some delay ui.delay(self.dimensions,0.1) def b_top_action(self, sender): t = keyboard.get_input_context() # current line if not t: return l = len(t[0]) keyboard.move_cursor(-l) def b_up_action(self, sender): t = keyboard.get_input_context() # current line if not t: return l0 = len(t[0]) l1 = len(t[1]) keyboard.move_cursor(-l0) keyboard.move_cursor(-1) # end of previous line t = keyboard.get_input_context() # previous line if not t: return l2 = len(t[0]) l3 = len(t[1]) #sender.title = str(l0)+' '+str(l1)+' '+str(l2)+' '+str(l3) if l2 >= l0: keyboard.move_cursor(-(l2-l0)) else: pass # line is shorter than l0, thus stay at end def b_left_action(self, sender): keyboard.move_cursor(-1) def b_right_action(self, sender): keyboard.move_cursor(+1) def b_bottom_action(self, sender): try: t = keyboard.get_input_context() # current line l = len(t[1]) keyboard.move_cursor(+l) except Exception as e: pass def b_down_action(self, sender): t = keyboard.get_input_context() # current line if not t: return l0 = len(t[0]) l1 = len(t[1]) keyboard.move_cursor(l1) keyboard.move_cursor(1) # begin of next line t = keyboard.get_input_context() # next line l2 = len(t[0]) l3 = len(t[1]) if (l2+l3) >= l0: keyboard.move_cursor(l0) else: pass #keyboard.move_cursor(2)#l0-l2) def b_delete_action(self, sender): keyboard.backspace(times=1) def b_copy_action(self, sender): context = keyboard.get_input_context() t = keyboard.get_selected_text() clipboard.set(t) def b_read_to_cursor_action(self, sender): t = keyboard.get_input_context() try: speech_say(t[0],'jp-JP') except Exception as e: pass #speech.say(t[0],'en-EN') def b_read_all_action(self, sender): keyboard.move_cursor(-1000) t = keyboard.get_input_context() try: speech_say(t[1],'jp-JP') except Exception as e: pass #speech.say(t[1],'en-EN') def long_press_handler(self, data): #print('long_press') b = data.view xp,yp = data.location xp,yp = ui.convert_point(point=(xp,yp), from_view=b, to_view=b.superview) #print(b.name) if data.state == 1: # start long press b.background_color = 'blue' #speech.say(sv.title,'jp-JP') for sv in b.superview.subviews: if isinstance(sv, ui.Button): if sv.action == None and sv.assoc == b: sv.hidden = False sv.bring_to_front() elif sv != b: sv.background_color = 'lightgray' elif data.state == 2: # move long press # if location in one of original + 4 new, set it blue for sv in b.superview.subviews: if isinstance(sv, ui.Button): if (sv.action == None and sv.assoc == b) or sv == b: if xp >= sv.x and xp <= (sv.x + sv.width) and yp >= sv.y and yp <= (sv.y + sv.height): if sv.background_color != 'blue': sv.background_color = 'blue' #speech_say(sv.title,'jp-JP') #ObjCInstance(sv).isAccessibilityElement = True else: sv.background_color = 'white' elif data.state == 3: # end long press b.background_color = 'white' for sv in b.superview.subviews: if isinstance(sv, ui.Button): if sv.action == None and sv.assoc == b: sv.background_color = 'white' #ObjCInstance(sv).isAccessibilityElement = True sv.hidden = True elif sv != b: sv.background_color = 'white' if (sv.action == None and sv.assoc == b) or sv == b: if xp >= sv.x and xp <= (sv.x + sv.width) and yp >= sv.y and yp <= (sv.y + sv.height): self.typeChar(sv) def sub_keys(self, x,y,keys,b,super=None): dxdy = [(-1,0), (+1,0), (0,-1), (0,+1)] for i in range(4): if keys[i] != ' ': xx = x + dxdy[i][0] * (self.dx+self.dd) yy = y + dxdy[i][1] * (self.dy+self.dd) title = keys[i] act = None if title == 'ยฐ': title = 'semi\nvoiced\nsound' act = self.semi_voiced_sound bb = self.make_button(xx,yy,self.dx,self.dy,title, act, super=super) bb.hidden = True bb.assoc = b if len(title) == 1: bb.font = ('.SFUIText', self.dy-2) #ObjCInstance(bb).isAccessibilityElement = True #ObjCInstance(bb).accessibilityLabel = keys[i] def hide_all(self): for k in self.vs.keys(): self.vs[k].hidden = True def b_japan_action(self, sender): self.hide_all() self.v_japan.hidden = False def b_katakana_action(self, sender): self.hide_all() self.v_katakana.hidden = False def b_alpha_action(self, sender): self.hide_all() self.v_alpha.hidden = False self.caps = True self.caps_lock = False self.capsKey('unused') def b_digit_action(self, sender): self.hide_all() self.v_digit.hidden = False def b_emoji_action(self, sender): self.hide_all() self.v_emoji.hidden = False def make_button(self,x,y,dx,dy,title,action, super=None): b = ui.Button() b.frame = (x,y,dx,dy) b.background_color = 'white' b.border_width = 1 b.corner_radius = self.dy/4 if title == 'โช': o = ObjCClass('UIImage').systemImageNamed_('capslock') UIImagePNGRepresentation = c.UIImagePNGRepresentation UIImagePNGRepresentation.restype = c_void_p UIImagePNGRepresentation.argtypes = [c_void_p] UIImage_data = nsdata_to_bytes(ObjCInstance(UIImagePNGRepresentation(o))) b.image = ui.Image.from_data(UIImage_data) b.name = title b.title = '' else: b.title = title if '\n' in title: bo = ObjCInstance(b) for sv in bo.subviews(): if hasattr(sv,'titleLabel'): tl = sv.titleLabel() tl.numberOfLines = 0 b.action = action if super: super.add_subview(b) else: self.add_subview(b) b.assoc = None return b def dimensions(self): w,h = self.bounds.size dd = 2 nx = 7 ny = 4 self.ny = ny dx = (w - (nx+1)*dd)/nx dy = (h - (ny+1)*dd)/ny self.dx = dx self.dy = dy self.dd = dd self.v_japan = ui.View() self.v_japan.background_color = self.background_color self.v_japan.frame = (0,0,w,h) self.v_japan.hidden = False self.add_subview(self.v_japan) self.v_katakana = ui.View() self.v_katakana.background_color = self.background_color self.v_katakana.frame = (0,0,w,h) self.v_katakana.hidden = True self.add_subview(self.v_katakana) self.v_alpha = ui.View() self.v_alpha.background_color = self.background_color self.v_alpha.frame = (0,0,w,h) self.v_alpha.hidden = True self.add_subview(self.v_alpha) self.v_digit = ui.View() self.v_digit.background_color = self.background_color self.v_digit.frame = self.frame self.v_digit.hidden = True self.add_subview(self.v_digit) self.v_emoji = ui.View() self.v_emoji.background_color = self.background_color self.v_emoji.frame = self.frame self.v_emoji.hidden = True self.add_subview(self.v_emoji) self.vs = {'japan':self.v_japan, 'alpha':self.v_alpha, 'digit':self.v_digit, 'emoji':self.v_emoji, 'katakana':self.v_katakana} ''' The second line is "ใ", "ใ","ใ","ใ", and "ใช". The third line is "ใฏ","ใพ","ใ", โใโand "ใ". ''' # https://www.nhk.or.jp/lesson/fr/letters/kanji.html keyboards = {'japan':[ [1,0,'โฌ ๏ธ',self.b_left_action,''], [2,0,'ๆ้ ญ',self.b_top_action,''], [3,0,'copy' if keyboard.has_full_access() else 'no full' ,self.b_copy_action,''], [4,0,'ๆๆซ',self.b_bottom_action,''], # end of sentence [5,0,'โก๏ธ',self.b_right_action,''], [6,0,'ๅทฆๅ้ค',self.b_delete_action,''], [1,1,'ใ',self.typeChar,'ใใใใ'], [2,1,'ใ',self.typeChar,'ใใใใ'], [3,1,'ใ',self.typeChar,'ใใใใ'], [4,1,'ใ',self.typeChar,'ใกใคใฆใจ'], [5,1,'ใช',self.typeChar,'ใซใฌใญใฎ'], [6,1,'ๆฟ็น',self.voiced_sound,' ยฐ '], [1,2,'ใฏ',self.typeChar,'ใฒใตใธใป'], [2,2,'ใพ',self.typeChar,'ใฟใใใ'], [3,2,'ใ',self.typeChar,'ใใใใ'], [4,2,'ใ',self.typeChar,'ใใใใ'], [5,2,'ใ',self.typeChar,'ใใใผ '], [6,2,'ๆผขๅญ',None,''], # Kanji [1,3,'โฌ๏ธ',self.b_up_action,''], [2,3,'่ชญไธใ',self.b_read_to_cursor_action,''], [3,3,'ๅ จ่ชญ',self.b_read_all_action,''], [4,3,'ๅฅ็น',None,''], [5,3,'โฌ๏ธ',self.b_down_action,''], [6,3,'return',None,''], [0,0,'ใซใฟใซใ', self.b_katakana_action,''], [0,1,'๐ค', self.b_alpha_action,''], [0,2,'๐ข', self.b_digit_action,''], [0,3,'๐', self.b_emoji_action,''] ], 'katakana':[ [1,1,'ใข',self.typeChar,'ใคใฆใจใช'], [2,1,'ใซ',self.typeChar,'ใญใฏใฑใณ'], [3,1,'ใต',self.typeChar,'ใทในใปใฝ'], [4,1,'ใฟ',self.typeChar,'ใใใใ'], [5,1,'ใ',self.typeChar,'ใใใใ'], [1,2,'ใ',self.typeChar,'ใใใใ'], [2,2,'ใ',self.typeChar,'ใใ ใกใข'], [3,2,'ใค',self.typeChar,'ใใฆใใจ'], [4,2,'ใฉ',self.typeChar,'ใชใซใฌใญ'], [5,2,'ใฏ',self.typeChar,'ใฒใณใผ '], [0,0,'ๅนณไปฎๅ', self.b_japan_action,''], [0,1,'๐ค', self.b_alpha_action,''], [0,2,'๐ข', self.b_digit_action,''], [0,3,'๐', self.b_emoji_action,''] ], 'alpha':[ [2,0,'a',self.typeChar,'bc '], [3,0,'d',self.typeChar,'ef '], [4,0,'g',self.typeChar,'hi '], [2,1,'j',self.typeChar,'kl '], [3,1,'m',self.typeChar,'no '], [4,1,'p',self.typeChar,'qrs '], [2,2,'t',self.typeChar,'uv '], [3,2,'w',self.typeChar,'xyz '], [1,3,'โง',self.capsKey,''], [1,2,'โช',self.capsLock,''], [0,0,'ใซใฟใซใ', self.b_katakana_action,''], [0,1,'ๅนณไปฎๅ', self.b_japan_action,''], [0,2,'๐ข', self.b_digit_action,''], [0,3,'๐', self.b_emoji_action,''] ], 'digit':[ [2,0,'1',self.typeChar,''], [3,0,'2',self.typeChar,''], [4,0,'3',self.typeChar,''], [2,1,'4',self.typeChar,''], [3,1,'5',self.typeChar,''], [4,1,'6',self.typeChar,''], [2,2,'7',self.typeChar,''], [3,2,'8',self.typeChar,''], [4,2,'9',self.typeChar,''], [3,3,'0',self.typeChar,''], [0,0,'ใซใฟใซใ', self.b_katakana_action,''], [0,1,'๐ค', self.b_alpha_action,''], [0,2,'ๅนณไปฎๅ', self.b_japan_action,''], [0,3,'๐', self.b_emoji_action,''] ], 'emoji':[ [0,0,'ใซใฟใซใ', self.b_katakana_action,''], [0,1,'๐ค', self.b_alpha_action,''], [0,2,'๐ข', self.b_digit_action,''], [0,3,'ๅนณไปฎๅ', self.b_japan_action,''], [5,2,'โฉ',self.nextSet,''], [5,3,'โช',self.prevSet,''] ] } #self.emojis = '๐๐๐ฑ๐ฆโ๏ธ(็ฌ)โ๏ธโ๏ธโ๏ธโ๏ธ๐๐๐๐โญ๏ธ๐๐๐๐๐๐ ๐๐คฃโบ๏ธ๐๐๐๐๐๐๐๐ฅฐ๐๐๐๐๐๐๐๐๐คช๐คจ๐ง๐ค๐๐คฉ๐ฅณ๐๐๐๐๐๐๐โน๏ธ๐ฃ๐๐ซ๐ฉ๐ฅบ๐ข๐ญ๐ค๐ ๐ก๐คฌ๐คฏ๐ณ๐ฅต๐ฅถ๐จ๐ฐ๐ฅ๐๐ค๐ค๐คญ๐คซ๐คฅ๐ถ๐๐๐ฌ๐ฆ๐ง๐ฎ๐ฒ๐ด' # an emoji can use more than one character, thus if you define emojis as a str, # and you scan it by character, you could get a part of an emoji and seen it # as blank in a key. Thus we devine the set of emojis as an array and thus # scan it by element will give each emoji as a str of 1 to 4 characters. self.emojis = ['๐','๐','๐ฑ','๐ฆ','โ๏ธ','(็ฌ)','โ๏ธ','โ๏ธ','โ๏ธ','โ๏ธ','๐','๐','๐','๐', 'โญ๏ธ','๐','๐','๐','๐','๐','๐ ','๐','๐คฃ','โบ๏ธ','๐','๐','๐','๐', '๐','๐','๐','๐ฅฐ','๐','๐','๐','๐','๐','๐','๐','๐','๐คช','๐คจ', '๐ง','๐ค','๐','๐คฉ','๐ฅณ','๐','๐','๐','๐','๐','๐','๐','โน๏ธ','๐ฃ', '๐','๐ซ','๐ฉ','๐ฅบ','๐ข','๐ญ','๐ค','๐ ','๐ก','๐คฌ','๐คฏ','๐ณ','๐ฅต','๐ฅถ', '๐จ','๐ฐ','๐ฅ','๐','๐ค','๐ค','๐คญ','๐คซ','๐คฅ','๐ถ','๐','๐','๐ฌ','๐ฆ', '๐ง','๐ฎ','๐ฒ','๐ด'] self.last_emoji = -1 for ix in range(1,5): for iy in range(0,4): self.last_emoji += 1 keyboards['emoji'].append([ix,iy,self.emojis[self.last_emoji], self.typeChar,'']) for kbd in keyboards.keys(): for ix,iy,t,act,flick in keyboards[kbd]: x = dd + ix * (dx+dd) y = dd + iy * (dy + dd) b = self.make_button(x,y,dx,dy,t,act,super=self.vs[kbd]) if t in ['๐ค','๐ข','๐','โฌ๏ธ','โฌ ๏ธ','โฌ๏ธ','โก๏ธ', 'โง', 'โช'] or len(t) == 1: b.font = ('.SFUIText', dy-2) if t in ['โช','โง']: b.background_color = 'lightgray' if flick: long_press(b,self.long_press_handler) self.sub_keys(x,y,flick,b, super=self.vs[kbd]) if kbd == 'emoji': if t == 'โฉ': b.name = 'nextSet' elif t == 'โช': b.name = 'prevSet' elif act == self.typeChar: self.set_emoji_font_size(b) lv = ui.Label() lv.text = 'V' + version lv.font = ('Menlo', 12) lv.text_color = 'red' lvw = ui.measure_string(lv.text, font=lv.font) ix = nx-1 iy = 0 x = dd + ix * (dx + dd) + dx - lvw[0] - dd*2 y = dd + iy * (dy + dd) + dy - lvw[1] - dd*2 lv.frame = (x,y,lvw[0],20) lv.bring_to_front() self.v_japan.add_subview(lv) def set_emoji_font_size(self,b): # some emojis could be like multiple characters ex: '(็ฌ)' # thus we have to find the font size which permits to see the emoji, # else it will be seen as '...' (font size to big) fs = self.dy-2 wt,ht = ui.measure_string(b.title,font=('.SFUIText', fs)) while wt > self.dy: fs = fs/2 wt,ht = ui.measure_string(b.title,font=('.SFUIText', fs)) b.font = ('.SFUIText', fs) def nextSet(self,sender): for b in self.v_emoji.subviews: if b.action == self.typeChar: self.last_emoji += 1 if self.last_emoji == len(self.emojis): self.last_emoji = 0 b.title = self.emojis[self.last_emoji] self.set_emoji_font_size(b) def prevSet(self,sender): for b in self.v_emoji.subviews: if b.action == self.typeChar: self.last_emoji -= 1 if self.last_emoji < 0: self.last_emoji = len(self.emojis)-1 b.title = self.emojis[self.last_emoji] self.set_emoji_font_size(b) def capsKey(self, sender): self.caps = not self.caps if not self.caps: self.caps_lock = False for b in self.v_alpha.subviews: if b.title == 'โง': # caps b.background_color = 'white' if self.caps else 'lightgray' elif b.name == 'โช': # caps lock b.background_color = 'lightgray' elif b.title.isalpha(): b.title = b.title.upper() if self.caps else b.title.lower() def capsLock(self, sender): self.caps_lock = not self.caps_lock for b in self.v_alpha.subviews: if b.title == 'โง': # caps b.background_color = 'lightgray' elif b.name == 'โช': # caps lock b.background_color = 'white' if self.caps_lock else 'lightgray' elif b.title.isalpha(): b.title = b.title.upper() if self.caps_lock else b.title.lower() def typeChar(self,sender): keyboard.insert_text(sender.title) if not self.v_alpha.hidden: if sender.title.isalpha(): if self.caps: self.capsKey('unused') def voiced_sound(self, sender): t = keyboard.get_selected_text() # check if Hirgana or Katakana t = t + u'\u3099' keyboard.insert_text(t) def semi_voiced_sound(self, sender): t = keyboard.get_selected_text() # check if Hirgana or Katakana t = t + u'\u309C' keyboard.insert_text(t) def main (): if not keyboard.is_keyboard(): return v = MyView() keyboard.set_view(v, 'expanded') if __name__ == '__main__': main() ``` -
todo - Please do the Kanji conversion in the same way as the Braille application. Character inputโ Provisional decisionโ Kanji conversion buttonโ Kanji listโ Kanji selectionโ Final decision. bugs - long key title "x...y' on iphone => compute font size so it is visible - read all => crash? dixit user ''' import keyboard import ui from objc_util import * import clipboard #import speech import sys from gestures import * import time import sqlite3 version = '00.16' # use ObjectiveC speech: start ================================================= AVSpeechUtterance=ObjCClass('AVSpeechUtterance') AVSpeechSynthesizer=ObjCClass('AVSpeechSynthesizer') AVSpeechSynthesisVoice=ObjCClass('AVSpeechSynthesisVoice') voices=AVSpeechSynthesisVoice.speechVoices() for i in range(0,len(voices)): #print(i,voices[i].language(),voices[i].identifier()) if 'ja-JP' in str(voices[i].identifier()): # if u have Japanese Siri voice, replace from 'ja-JP' to 'siri_O-ren_ja-JP' vi = i break synthesizer=AVSpeechSynthesizer.new() def speech_say(t,unused): utterance=AVSpeechUtterance.speechUtteranceWithString_(t) utterance.rate = 0.5 utterance.useCompactVoice=False utterance.voice = voices[vi] synthesizer.speakUtterance_(utterance) # use ObjectiveC speech: end =================================================== class MyView(ui.View): def __init__(self, *args, **kwargs): super().__init__(self, *args, **kwargs) self.background_color = 'lightgray' # https://github.com/Doublevil/JmdictFurigana self.conn = sqlite3.connect("HiraganaToKanji.db",check_same_thread=False) self.cursor = self.conn.cursor() # read and store eventual supplementar Kanji's suppl_kanjis = 'HiraganaToKanji.txt' if os.path.exists(suppl_kanjis): with open(suppl_kanjis,encoding='utf-8') as fil: self.local_kanjis = fil.read().split('\n') else: self.local_kanjis = [] # get sentences as examples for Kanjis # https://www.manythings.org/anki/ with open('SentencesEngJpn.dat',encoding='utf-8') as fil: self.sentences = fil.read().split('\n') # bounds not yet known in init, let some delay ui.delay(self.dimensions,0.1) def b_top_action(self, sender): t = keyboard.get_input_context() # current line if not t: return l = len(t[0]) keyboard.move_cursor(-l) def b_up_action(self, sender): t = keyboard.get_input_context() # current line if not t: return l0 = len(t[0]) l1 = len(t[1]) keyboard.move_cursor(-l0) keyboard.move_cursor(-1) # end of previous line t = keyboard.get_input_context() # previous line if not t: return l2 = len(t[0]) l3 = len(t[1]) #sender.title = str(l0)+' '+str(l1)+' '+str(l2)+' '+str(l3) if l2 >= l0: keyboard.move_cursor(-(l2-l0)) else: pass # line is shorter than l0, thus stay at end def b_left_action(self, sender): keyboard.move_cursor(-1) def b_right_action(self, sender): keyboard.move_cursor(+1) def b_bottom_action(self, sender): try: t = keyboard.get_input_context() # current line l = len(t[1]) keyboard.move_cursor(+l) except Exception as e: pass def b_down_action(self, sender): t = keyboard.get_input_context() # current line if not t: return l0 = len(t[0]) l1 = len(t[1]) keyboard.move_cursor(l1) keyboard.move_cursor(1) # begin of next line t = keyboard.get_input_context() # next line l2 = len(t[0]) l3 = len(t[1]) if (l2+l3) >= l0: keyboard.move_cursor(l0) else: pass #keyboard.move_cursor(2)#l0-l2) def b_delete_action(self, sender): keyboard.backspace(times=1) def b_return_action(self, sender): keyboard.insert_text('\n') def b_copy_action(self, sender): context = keyboard.get_input_context() t = keyboard.get_selected_text() clipboard.set(t) def b_read_to_cursor_action(self, sender): t = keyboard.get_input_context() try: speech_say(t[0],'jp-JP') except Exception as e: pass #speech.say(t[0],'en-EN') def b_read_all_action(self, sender): keyboard.move_cursor(-1000) t = keyboard.get_input_context() try: speech_say(t[1],'jp-JP') except Exception as e: pass #speech.say(t[1],'en-EN') def long_press_handler(self, data): #print('long_press') b = data.view xp,yp = data.location xp,yp = ui.convert_point(point=(xp,yp), from_view=b, to_view=b.superview) #print(b.name) if data.state == 1: # start long press b.background_color = 'blue' #speech.say(sv.title,'jp-JP') for sv in b.superview.subviews: if isinstance(sv, ui.Button): if sv.action == None and sv.assoc == b: sv.hidden = False sv.bring_to_front() elif sv != b: sv.background_color = 'lightgray' elif data.state == 2: # move long press # if location in one of original + 4 new, set it blue for sv in b.superview.subviews: if isinstance(sv, ui.Button): if (sv.action == None and sv.assoc == b) or sv == b: if xp >= sv.x and xp <= (sv.x + sv.width) and yp >= sv.y and yp <= (sv.y + sv.height): if sv.background_color != 'blue': sv.background_color = 'blue' #speech_say(sv.title,'jp-JP') #ObjCInstance(sv).isAccessibilityElement = True else: sv.background_color = 'white' elif data.state == 3: # end long press b.background_color = 'white' for sv in b.superview.subviews: if isinstance(sv, ui.Button): if sv.action == None and sv.assoc == b: sv.background_color = 'white' #ObjCInstance(sv).isAccessibilityElement = True sv.hidden = True elif sv != b: sv.background_color = 'white' if (sv.action == None and sv.assoc == b) or sv == b: if xp >= sv.x and xp <= (sv.x + sv.width) and yp >= sv.y and yp <= (sv.y + sv.height): self.typeChar(sv) def sub_keys(self, x,y,keys,b,super=None): dxdy = [(-1,0), (+1,0), (0,-1), (0,+1)] for i in range(4): if keys[i] != ' ': xx = x + dxdy[i][0] * (self.dx+self.dd) yy = y + dxdy[i][1] * (self.dy+self.dd) title = keys[i] if title == u'\u309A': title += ' ' bb = self.make_button(xx,yy,self.dx,self.dy,title, None, super=super) bb.hidden = True bb.assoc = b if len(title) == 1: bb.font = ('.SFUIText', self.dy-2) #ObjCInstance(bb).isAccessibilityElement = True #ObjCInstance(bb).accessibilityLabel = keys[i] def hide_all(self): for k in self.vs.keys(): self.vs[k].hidden = True def b_japan_action(self, sender): self.hide_all() self.v_japan.hidden = False def b_katakana_action(self, sender): self.hide_all() self.v_katakana.hidden = False def b_alpha_action(self, sender): self.hide_all() self.v_alpha.hidden = False self.caps = True self.caps_lock = False self.capsKey('unused') def b_digit_action(self, sender): self.hide_all() self.v_digit.hidden = False def b_emoji_action(self, sender): self.hide_all() self.v_emoji.hidden = False def make_button(self,x,y,dx,dy,title,action, super=None): b = ui.Button() b.frame = (x,y,dx,dy) b.background_color = 'white' b.border_width = 1 b.corner_radius = self.dy/4 if title == 'โช': o = ObjCClass('UIImage').systemImageNamed_('capslock') UIImagePNGRepresentation = c.UIImagePNGRepresentation UIImagePNGRepresentation.restype = c_void_p UIImagePNGRepresentation.argtypes = [c_void_p] UIImage_data = nsdata_to_bytes(ObjCInstance(UIImagePNGRepresentation(o))) b.image = ui.Image.from_data(UIImage_data) b.name = title b.title = '' else: b.title = title if '\n' in title: bo = ObjCInstance(b) for sv in bo.subviews(): if hasattr(sv,'titleLabel'): tl = sv.titleLabel() tl.numberOfLines = 0 b.action = action if super: super.add_subview(b) else: self.add_subview(b) b.assoc = None return b def dimensions(self): w,h = self.bounds.size dd = 2 nx = 7 ny = 4 self.ny = ny dx = (w - (nx+1)*dd)/nx dy = (h - (ny+1)*dd)/ny self.dx = dx self.dy = dy self.dd = dd self.v_japan = ui.View() self.v_japan.background_color = self.background_color self.v_japan.frame = (0,0,w,h) self.v_japan.hidden = False self.add_subview(self.v_japan) self.v_katakana = ui.View() self.v_katakana.background_color = self.background_color self.v_katakana.frame = (0,0,w,h) self.v_katakana.hidden = True self.add_subview(self.v_katakana) self.v_alpha = ui.View() self.v_alpha.background_color = self.background_color self.v_alpha.frame = (0,0,w,h) self.v_alpha.hidden = True self.add_subview(self.v_alpha) self.v_digit = ui.View() self.v_digit.background_color = self.background_color self.v_digit.frame = self.frame self.v_digit.hidden = True self.add_subview(self.v_digit) self.v_emoji = ui.View() self.v_emoji.background_color = self.background_color self.v_emoji.frame = self.frame self.v_emoji.hidden = True self.add_subview(self.v_emoji) self.vs = {'japan':self.v_japan, 'alpha':self.v_alpha, 'digit':self.v_digit, 'emoji':self.v_emoji, 'katakana':self.v_katakana} ''' The second line is "ใ", "ใ","ใ","ใ", and "ใช". The third line is "ใฏ","ใพ","ใ", โใโand "ใ". ''' # https://www.nhk.or.jp/lesson/fr/letters/kanji.html keyboards = {'japan':[ [1,0,'โฌ ๏ธ',self.b_left_action,''], [2,0,'ๆ้ ญ',self.b_top_action,''], [3,0,'copy' if keyboard.has_full_access() else 'no full' ,self.b_copy_action,''], [4,0,'ๆๆซ',self.b_bottom_action,''], # end of sentence [5,0,'โก๏ธ',self.b_right_action,''], [6,0,'ๅทฆๅ้ค',self.b_delete_action,''], [1,1,'ใ',self.typeChar,'ใใใใ'], [2,1,'ใ',self.typeChar,'ใใใใ'], [3,1,'ใ',self.typeChar,'ใใใใ'], [4,1,'ใ',self.typeChar,'ใกใคใฆใจ'], [5,1,'ใช',self.typeChar,'ใซใฌใญใฎ'], [6,1,u'\u3099 ',self.typeChar,u'\u309A '], [1,2,'ใฏ',self.typeChar,'ใฒใตใธใป'], [2,2,'ใพ',self.typeChar,'ใฟใใใ'], [3,2,'ใ',self.typeChar,'ใใใใ'], [4,2,'ใ',self.typeChar,'ใใใใ'], [5,2,'ใ',self.typeChar,'ใใใผ '], [6,2,'ๆผขๅญ',None,''], # Kanji [1,3,'โฌ๏ธ',self.b_up_action,''], [2,3,'read to\ncursor',self.b_read_to_cursor_action,''], [3,3,'read\nall',self.b_read_all_action,''], [4,3,"ใ,ใ",self.typeChar,"ใ๏ผ๏ผ "], [5,3,'โฌ๏ธ',self.b_down_action,''], [6,3,'return',self.b_return_action,''], [0,0,'ใซใฟใซใ', self.b_katakana_action,''], [0,1,'๐ค', self.b_alpha_action,''], [0,2,'๐ข', self.b_digit_action,''], [0,3,'๐', self.b_emoji_action,''] ], 'katakana':[ [1,1,'ใข',self.typeChar,'ใคใฆใจใช'], [2,1,'ใซ',self.typeChar,'ใญใฏใฑใณ'], [3,1,'ใต',self.typeChar,'ใทในใปใฝ'], [4,1,'ใฟ',self.typeChar,'ใใใใ'], [5,1,'ใ',self.typeChar,'ใใใใ'], [1,2,'ใ',self.typeChar,'ใใใใ'], [2,2,'ใ',self.typeChar,'ใใ ใกใข'], [3,2,'ใค',self.typeChar,'ใใฆใใจ'], [4,2,'ใฉ',self.typeChar,'ใชใซใฌใญ'], [5,2,'ใฏ',self.typeChar,'ใฒใณใผ '], [0,0,' โฌ๏ธ\nโฌ ๏ธโก๏ธ\n โฌ๏ธ', self.b_japan_action,''], [0,1,'๐ค', self.b_alpha_action,''], [0,2,'๐ข', self.b_digit_action,''], [0,3,'๐', self.b_emoji_action,''] ], 'alpha':[ [2,0,'a',self.typeChar,'bc '], [3,0,'d',self.typeChar,'ef '], [4,0,'g',self.typeChar,'hi '], [2,1,'j',self.typeChar,'kl '], [3,1,'m',self.typeChar,'no '], [4,1,'p',self.typeChar,'qrs '], [2,2,'t',self.typeChar,'uv '], [3,2,'w',self.typeChar,'xyz '], [1,3,'โง',self.capsKey,''], [1,2,'โช',self.capsLock,''], [0,0,'ใซใฟใซใ', self.b_katakana_action,''], [0,1,' โฌ๏ธ\nโฌ ๏ธโก๏ธ\n โฌ๏ธ', self.b_japan_action,''], [0,2,'๐ข', self.b_digit_action,''], [0,3,'๐', self.b_emoji_action,''] ], 'digit':[ [2,0,'1',self.typeChar,''], [3,0,'2',self.typeChar,''], [4,0,'3',self.typeChar,''], [2,1,'4',self.typeChar,''], [3,1,'5',self.typeChar,''], [4,1,'6',self.typeChar,''], [2,2,'7',self.typeChar,''], [3,2,'8',self.typeChar,''], [4,2,'9',self.typeChar,''], [3,3,'0',self.typeChar,''], [0,0,'ใซใฟใซใ', self.b_katakana_action,''], [0,1,'๐ค', self.b_alpha_action,''], [0,2,' โฌ๏ธ\nโฌ ๏ธโก๏ธ\n โฌ๏ธ', self.b_japan_action,''], [0,3,'๐', self.b_emoji_action,''] ], 'emoji':[ [0,0,'ใซใฟใซใ', self.b_katakana_action,''], [0,1,'๐ค', self.b_alpha_action,''], [0,2,'๐ข', self.b_digit_action,''], [0,3,' โฌ๏ธ\nโฌ ๏ธโก๏ธ\n โฌ๏ธ', self.b_japan_action,''], [5,2,'โฉ',self.nextSet,''], [5,3,'โช',self.prevSet,''] ] } #self.emojis = '๐๐๐ฑ๐ฆโ๏ธ(็ฌ)โ๏ธโ๏ธโ๏ธโ๏ธ๐๐๐๐โญ๏ธ๐๐๐๐๐๐ ๐๐คฃโบ๏ธ๐๐๐๐๐๐๐๐ฅฐ๐๐๐๐๐๐๐๐๐คช๐คจ๐ง๐ค๐๐คฉ๐ฅณ๐๐๐๐๐๐๐โน๏ธ๐ฃ๐๐ซ๐ฉ๐ฅบ๐ข๐ญ๐ค๐ ๐ก๐คฌ๐คฏ๐ณ๐ฅต๐ฅถ๐จ๐ฐ๐ฅ๐๐ค๐ค๐คญ๐คซ๐คฅ๐ถ๐๐๐ฌ๐ฆ๐ง๐ฎ๐ฒ๐ด' # an emoji can use more than one character, thus if you define emojis as a str, # and you scan it by character, you could get a part of an emoji and seen it # as blank in a key. Thus we devine the set of emojis as an array and thus # scan it by element will give each emoji as a str of 1 to 4 characters. self.emojis = ['๐','๐','๐ฑ','๐ฆ','โ๏ธ','(็ฌ)','โ๏ธ','โ๏ธ','โ๏ธ','โ๏ธ','๐','๐','๐','๐', 'โญ๏ธ','๐','๐','๐','๐','๐','๐ ','๐','๐คฃ','โบ๏ธ','๐','๐','๐','๐', '๐','๐','๐','๐ฅฐ','๐','๐','๐','๐','๐','๐','๐','๐','๐คช','๐คจ', '๐ง','๐ค','๐','๐คฉ','๐ฅณ','๐','๐','๐','๐','๐','๐','๐','โน๏ธ','๐ฃ', '๐','๐ซ','๐ฉ','๐ฅบ','๐ข','๐ญ','๐ค','๐ ','๐ก','๐คฌ','๐คฏ','๐ณ','๐ฅต','๐ฅถ', '๐จ','๐ฐ','๐ฅ','๐','๐ค','๐ค','๐คญ','๐คซ','๐คฅ','๐ถ','๐','๐','๐ฌ','๐ฆ', '๐ง','๐ฎ','๐ฒ','๐ด'] self.last_emoji = -1 for ix in range(1,5): for iy in range(0,4): self.last_emoji += 1 keyboards['emoji'].append([ix,iy,self.emojis[self.last_emoji], self.typeChar,'']) for kbd in keyboards.keys(): for ix,iy,t,act,flick in keyboards[kbd]: x = dd + ix * (dx+dd) y = dd + iy * (dy + dd) b = self.make_button(x,y,dx,dy,t,act,super=self.vs[kbd]) if t in ['๐ค','๐ข','๐','โฌ๏ธ','โฌ ๏ธ','โฌ๏ธ','โก๏ธ', 'โง', 'โช'] or len(t) == 1: b.font = ('.SFUIText', dy-2) if t in ['โช','โง']: b.background_color = 'lightgray' if flick: long_press(b,self.long_press_handler) self.sub_keys(x,y,flick,b, super=self.vs[kbd]) if kbd == 'emoji': if t == 'โฉ': b.name = 'nextSet' elif t == 'โช': b.name = 'prevSet' elif act == self.typeChar: self.set_emoji_font_size(b) lv = ui.Label() lv.text = 'V' + version lv.font = ('Menlo', 12) lv.text_color = 'red' lvw = ui.measure_string(lv.text, font=lv.font) ix = nx-1 iy = 0 x = dd + ix * (dx + dd) + dx - lvw[0] - dd*2 y = dd + iy * (dy + dd) + dy - lvw[1] - dd*2 lv.frame = (x,y,lvw[0],20) lv.bring_to_front() self.v_japan.add_subview(lv) def set_emoji_font_size(self,b): # some emojis could be like multiple characters ex: '(็ฌ)' # thus we have to find the font size which permits to see the emoji, # else it will be seen as '...' (font size to big) fs = self.dy-2 wt,ht = ui.measure_string(b.title,font=('.SFUIText', fs)) while wt > self.dy: fs = fs/2 wt,ht = ui.measure_string(b.title,font=('.SFUIText', fs)) b.font = ('.SFUIText', fs) def nextSet(self,sender): for b in self.v_emoji.subviews: if b.action == self.typeChar: self.last_emoji += 1 if self.last_emoji == len(self.emojis): self.last_emoji = 0 b.title = self.emojis[self.last_emoji] self.set_emoji_font_size(b) def prevSet(self,sender): for b in self.v_emoji.subviews: if b.action == self.typeChar: self.last_emoji -= 1 if self.last_emoji < 0: self.last_emoji = len(self.emojis)-1 b.title = self.emojis[self.last_emoji] self.set_emoji_font_size(b) def capsKey(self, sender): self.caps = not self.caps if not self.caps: self.caps_lock = False for b in self.v_alpha.subviews: if b.title == 'โง': # caps b.background_color = 'white' if self.caps else 'lightgray' elif b.name == 'โช': # caps lock b.background_color = 'lightgray' elif b.title.isalpha(): b.title = b.title.upper() if self.caps else b.title.lower() def capsLock(self, sender): self.caps_lock = not self.caps_lock for b in self.v_alpha.subviews: if b.title == 'โง': # caps b.background_color = 'lightgray' elif b.name == 'โช': # caps lock b.background_color = 'white' if self.caps_lock else 'lightgray' elif b.title.isalpha(): b.title = b.title.upper() if self.caps_lock else b.title.lower() def typeChar(self,sender): t = sender.title[0] if t in [u'\u3099',u'\u309A']: # we should check if previous character is Hirgana (Python import re ....) t = keyboard.get_selected_text() + t keyboard.insert_text(t) if not self.v_alpha.hidden: if sender.title.isalpha(): if self.caps: self.capsKey('unused') def main (): if not keyboard.is_keyboard(): return v = MyView() keyboard.set_view(v, 'expanded') if __name__ == '__main__': main() ``` -
@shinya-ta ok, I'll check the differences between both versions but not immediately, I have just tested positive for Covid after a week at the Invictus Games 2023 in Dรผsseldorf. most Belgian athletes, friends and staff seem to get the virus...
But I still don't understand why you did not react when version 0.16 gave problems for VoiceOver
in November 2022 -
At that time, it was functioning normally.
I can't use the latest version now, so I was trying the old version. -
