Welcome!
This is the community forum for my apps Pythonista and Editorial.
For individual support questions, you can also send an email. If you have a very short question or just want to say hello — I'm @olemoritz on Twitter.
git clone ssh failing
-
Thanks again for your help, @JonB. It sounds like you're confident that the problem is on the server rather than in dulwich. I'll see if I can get any other information from our server administrator.
-
well, no, i am not at all confident!
It would be worth installing the latest dulwich, and trying porcelain.clone().
Do the same from a pc, to isolate the problem to a dulwich one, in which case you should open an issue at the dulwich page. You might need to note what server software you are using. -
I haven't tried github, but I can clone repos from our server using other clients over ssh. I'm pretty certain it's a problem with dulwich, since the server session close message is logged well after dulwich gives up. I'll log an issue on the dulwich page. Thanks again for your help!
-
it is a dulwich problem, but what we have to discover is whether it is a pythonista stash dulwich problem, or dulwich in general, or a problem with your specific setup.
If you can't clone from github, then we know the problem is in your setup.
If you can clone from a desktop to your server using dulwich, the problem is in the ios +dulwich combo. If you can clone using dulwich without stash, the problem is with stash git. -
Makes sense, thanks. I'll do some more digging when I get a chance.
-
Quick update. I'm not sure when I'll have time to debug dulwich, but I wanted to at least log where I got to.
I can clone from github.
I can also clone from our company Git repository using the Working Copy iOS app with its ssh support.
-
I just realized that I have been working with Pythonista 2, rather than Pythonista 3. I wondered if that made a difference. So I deleted Pythonista 2 and installed Pythonista 3. The first time I did a git clone ssh, it installed dulwich for me. But as I was testing straight ssh connections, somehow dulwich was deleted. Subsequent tries of git clone ssh won't reinstall dulwich. How do I install the appropriate version of dulwich now?
-
@mstonespeedy As far as I know stash git automatically installs any missing libraries that it needs, it's not a one-time thing. Make sure that there is no dulwich in any of the three site-packages folders, then restart Pythonista to get a clean Python environment (with no cached modules), then stash should install dulwich again the next time you use git.
-
That's what I thought, too. But dulwich is nowhere to be found, in any of the 3 site-packages folders. I've restarted Pythonista and tried git clone ssh multiple times. I get the message:
stash: <class 'paramiko.ssh_exception.SSHException'>: No authentication methods available
-
stash by default installs the git dependencies into stash/lib.
Make sure you install your ssh keys into ~/.ssh. This might be a d fferent folder than in py2, so you may want to copy them
cp ~/../.ssh ~/.ssh
. I should have mentioned that whilessh
looks in two places, git only looks in ~/.ssh. -
Also, I will point out that stash actually uses the python2 interpreter within pythonista 3. Also, in recent beta versions, subprocess got mucked up, which breaks the exceptions that get caught in dulwich. The fix is
import subprocess if not hasattr(subprocess,'call'): def Popen(*args,**kwargs): pass def call(*args,**kwargs): return 0 subprocess.Popen=Popen subprocess.call=call
If you try using dulwich directly, just move the dulwich folder from stash/lib to site-packages, and you can then try using dulwich.porcelain.clone.That should work in either the py2 or py3 interpreter. You may need
dulwich.client.get_ssh_vendor = dulwich.client.ParamikoSSHVendor
-
Thanks for the additional detail, @JonB.
I did indeed need that second .ssh folder to get back where I was with Pythonista 2. And I did find the dulwich folder in stash/lib. Oh, and git.py has the ParamikoSSHVendor line. However, I'm back to the same error as before ("The remote server unexpectedly closed the connection.").
I'll try to look into the subprocess issue later today. Is Jelmer aware of it?
-
The subprocess issue is a pythonista issue, not dulwich. Because IOS does not let you spawn a subprocess, the newer betas commented out those parts of the standard lib (earlier versions still had all the named defined, but raised errors). dulwich imports Popen and call, but the normal workflow does not need them. (used for executing hooks, or certain type of local repositories)
BTW, in stash, you can use
stashconf py_pdb 1
to enable pdb when an error is encountered. Orstashconf py_traceback 1
to print a full traceback.You might try importing dulwich and using porcelain. There are some ways to try to request just a single branch for instance, or, say a single commit, just to see if the connection works.
-
Thanks for the tips, @JonB.
Has the subprocess issue been reported? I don't have a beta version of anything I'm using, as far as I know. Which files should I look for?
I tried using dulwich.porcelain.clone('ssh://user@git.myCompany.com/MyRepository.git'). I get the following error. Any ideas?
TypeError: MyRepository.git
-
May be you can get workingcopy and use @ccc's scripts to sync with pythonista.
https://github.com/cclauss/Pythonista-and-Working-Copy -
Thanks, @abcabc. Yes, I have Working Copy successfully cloning as I mentioned earlier. However, I'd like to see if I can get dulwich working properly, since it would be much more convenient for me.
Jelmer says that the TypeError is a known issue with Python 3, and that it is in the bug tracker. So, I may be stuck for now.
-
Use the python 2 interpreter -- either prepend the script with #!python2, or long press and select run with 2.7.
-
@JonB, I get the same TypeError with Python 2 or 3. However, if I run the Python 2 script from the command line, I get the following:
stash: <type 'exceptions.OSError'>: [Errno 1] Operation not permitted
Traceback (most recent call last):
File "/private/var/mobile/Containers/Shared/AppGroup/E35AE39A-48FB-44A1-BC2A-EE57EF6EAA4D/Pythonista3/Documents/site-packages/stash/system/shruntime.py", line 490, in exec_py_file
execfile(file_path, namespace, namespace)
File "test.py", line 6, in <module>
dulwich.porcelain.clone('ssh://user@git.myCompany.com/MyRepository.git')
File "/private/var/mobile/Containers/Shared/AppGroup/E35AE39A-48FB-44A1-BC2A-EE57EF6EAA4D/Pythonista3/Documents/site-packages/dulwich/porcelain.py", line 258, in clone
progress=errstream.write)
File "/private/var/mobile/Containers/Shared/AppGroup/E35AE39A-48FB-44A1-BC2A-EE57EF6EAA4D/Pythonista3/Documents/site-packages/dulwich/client.py", line 251, in fetch
def abort():
File "/private/var/mobile/Containers/Shared/AppGroup/E35AE39A-48FB-44A1-BC2A-EE57EF6EAA4D/Pythonista3/Documents/site-packages/dulwich/client.py", line 557, in fetch_packFile "/private/var/mobile/Containers/Shared/AppGroup/E35AE39A-48FB-44A1-BC2A-EE57EF6EAA4D/Pythonista3/Documents/site-packages/dulwich/client.py", line 921, in _connect
raise TypeError(path)
File "/private/var/mobile/Containers/Shared/AppGroup/E35AE39A-48FB-44A1-BC2A-EE57EF6EAA4D/Pythonista3/Documents/site-packages/dulwich/client.py", line 877, in run_command
if port is not None:
File "/var/containers/Bundle/Application/297756CD-F73E-44E6-AB25-42E99062FE48/Pythonista3.app/Frameworks/PythonistaKit.framework/pylib/subprocess.py", line 711, in init
errread, errwrite)
File "/var/containers/Bundle/Application/297756CD-F73E-44E6-AB25-42E99062FE48/Pythonista3.app/Frameworks/PythonistaKit.framework/pylib/subprocess.py", line 1205, in _execute_child
self.pid = os.fork()
OSError: [Errno 1] Operation not permitted -
Sorry, should have mentioned, after importing dulwich.client, you need to use
dulwich.client.get_ssh_vendor = dulwich.client.ParamikoSSHVendor
which tells dulwich to use paramiko instead of using the built in ssh
-
Thanks, @JonB. Sorry, I thought I had already done that. OK, now that I have that back in there, I'm getting the same dulwich.errors.HangupException as I started with.
Any other ideas for figuring out what's happening?