Advanced shell - shellista

[pudquick51]

https://gist.github.com/4139094

<u><b>Commands and features:</b></u><ul>
<li>cd - change directory</li>
<li>pwd - print current working directory</li>
<li>ls - list directory contents (and file sizes)</li>
<li>cat - print the contents of a file</li>
<li>q/quit/exit/logoff/logout - exit the shell</li>
<li>mkdir - make a directory</li>
<li>mv - move or rename files / directories</li>
<li>cp - copy files / directories (recursively)</li>
<li>rm - delete files / directories (recursively)</li>
<li><b>unzip</b> - unzip zip archives</li>
<li><b>untar</b> - untar tar archives</li>
<li><b>ungzip / gunzip</b> - ungzip gzipped files</li>
<li>Supports <b>wildcard matches</b> (matching any number of characters)</li>
<li>Supports <b>? / question mark matches</b> (matching exactly one of any character)</li>
<li>Supports <b>[ranges]</b> (like [a-z], [0-9], [a-f0-9], etc.)</li>
<li>Supports <b>~ / tilde replacement</b> (defaults to Documents folder)</li>
<li>Supports <b>environment variables</b> ($HOME, but you can expand it)</li>
<li>Supports <b>single quote escaping</b> (special characters are disabled)</li>
<li>Supports <b>backslash escaping</b> (for individual special characters)</li>
<li>Supports <b>double quotes</b> (for preserving spaces, but allowing special sequences)</li></ul>

<u>Examples of advanced usage:</u>
<b>ls .py /.py</b> (lists all .py files in current directory and at the top level of any folders in current directory)
<b>cp ~/.py backup</b> (copies all python scripts in the root scripts directory to a folder named 'backup')
<b>rm test[1-3]?.txt</b> (removes files test1a.txt, test2a.txt, test2b.txt, test2c.txt, test3-.txt, etc.)

This is an intial (rough) port of a script I put together for another python interpreter on the app store. I'll be porting the rest of the commands soon: unzip, ungzip, untar, wget/curl (basic download functionality)

Enjoy :)

<br>
<b>For the interested programmer:</b>

This script uses a pure python re-implementation of some of the more basic globbing of "bash" which I wrote up myself. It's a little different than shlex, glob, or shlex+glob in that matching happens in a single parsing run through. It depends on glob for wildcard handling, but only after my code has already handled all character escapes and word parsing.

<u>An example where shlex/glob fails:</u>

In the current working directory are three files: 'test apple', 'peach', 'test a*' (with an asterisk as part of the name)

The command to parse is the string: rm 'test a*' peach

shlex interprets it as ['rm', 'test a*', 'peach'], which glob then interprets the file portion as a match of three files: ['test apple', 'test a*', 'peach']. shlex unfortunately clobbers quotes that in a bash environment specify that the special character should be treated as a literal. This would result in deletion of <b>all 3 files</b>.

With my parser, the single quotes around 'test a*' are interpreted bash-style to mean escaping of the special character '' - disabling it as a wildcard match and turning it into a literal match, resulting in the deletion of only two files: 'test a' and 'peach'.

[pudquick51]

You're welcome :)

[DanG170]

This is handy, thanks for sharing!

Is there a way to get sub directories to show up in the Library view?

[pudquick51]

@DanG - if you're talking about the script list GUI in Pythonista, omz would have to add that. The script list only shows files directly inside it ending in .py.

[omz]

@DanG @pudquick The library view will also show directories in the next update (1.3).

[Cubbarooney104]

Took me a few minutes to get used to it, but once I did I found it VERY useful! Now I can manage those files. :) Thank you!

Cubbarooney

[justinclift244]

@pudquick - Thanks Michael, this is very cool. Shell prompt with no need to jailbreak. :)

The thing I'm missing most so far is "-la" on ls. Not being able to see file ownership, permissions, size, and date, is a bit frustrating.

But, I suppose if I get frustrated enough I'll fix it myself. :)

[pudquick51]

I'll add in the permissions bit, possibly, but considering that Pythonista on iOS can't launch a +x file / executable anyways ... I'm not sure what it is you're caring about in regards to permissions/modes.

[briarfox]

@pudquick I've been using shellista extensively for moving files around as the Pythonista move to function is rather slow when you begin to accumulate lots of projects.

I've extended shellista with

• zip
• gzip
• tar
• wget
• mail.

I'm working on adding multi-file gist support with gist. The prompt also now shows the current working directory. I found this to be easier when working with files. Do you have a github repository for shellista? Would you mind if I shared my extended Shellista?

[ihf]

where can I find the latest and greatest shellista?

[dgelessus]

We don't yet have a Shellista Git, do we? In that case the newest version is the gist linked in the OP.

By the way, there seems to be a bug when working with the file system root (/) as a path. Due to how the path handling is coded, the single slash will get rstriped away, leaving only a n empty string and causing problems. This should be easy to fix by replacing the rstrip() with os.path.normpath(), which works as expected on /.

[ihf]

@briarfox I was looking for your extended version.

[transistor1]

Thanks @pudquick for the awesome shellista module.

I added pipista integration and basic Git integration into shellista: https://github.com/transistor1/shellista

• Integrate minimal pipista functionality
  • pdown - PyPi download
  • psrch - PyPi search
• Minimal Git functionality
• git init - Initialize git repo
• git add - Stage one or more files
• git commit - Commit staged files
• git clone - clone a public repo (no auth)
• git push - push commits via web
• git modified - see which files are currently modified
• git log - doesn't currently work
• untgz - a convenience wrapper to untar and ungzip at the same time
• Also ripped @mark_tully's wget - thanks Mark!
• Simple Python sub-shell by typing 'shell', 'python', or '!'
• Running a file directly doesn't work (e.g. 'python somefile.py'), though I tried
• Single-line commands only

It should automatically download all the needed requirements. It uses Gittle with Dulwich to manage the Git functionality. Contributions welcome!

I pushed the code directly to GitHub from my iPad with the git extensions.

[ccc]

I am so happy to see that this is now a GitHub repo instead of a gist so that this community can all collaborate on making one Shellista better instead of dealing with divergent code bases.

[Rothrock42]

What is the best way to get this into pythonista? And keep it updated? I'm pretty new to all this and have just been cutting and pasting, but I imagine there is something more efficient.

[briarfox]

@transistor1 Nice additions to shellista. I went with a more modular approach to shellista to make it easier to add new features. I'll need to take a look at your git functionality. I added ssh to mine so I could git from my work computer. Would You mind if I added your git as a module to ShellistaExt?

https://github.com/briarfox/ShellistaExt

ShellistaExt

[transistor1]

@Rothrock42 - Pasting is probably the quickest way to get started. I have a "shellista" subfolder & I am keeping everything in there.

If you are using <a href='https://github.com/transistor1/shellista'>this version</a>, you can stay synced with this repo using git clone:

This assumes you're storing shellista in a subfolder of your home folder called "shellista".

1. Launch your existing shellista version
2. cd ~
3. mkdir update (you can call this folder anything you want)
4. cd update
5. git clone https://github.com/transistor1/shellista.git
6. cd ..
7. rm shellista
8. mv update shellista
9. Close Pythonista and reload
10. Open shellista and run it. It will re-download all the dependencies.

Time willing, I'd like to add a git pull command to pull the latest updates.

[briarfox]

@transistor1 I edited my above post just as you posted. Would you mind if I used your code for a git plugin?

[transistor1]

@briarfox - please be my guest ... all of this code is under the MIT license so it's all fair game! The modular approach sounds like a great idea! I was trying to maintain the original single-file approach to make it easy to paste into Pythonista-- but I thought about making it more modular too, because it's getting big.

My mods to shellista download the Git/pipista dependencies automatically using @mark_tully's wget... I thought that a modular approach might work well if it automatically downloaded its plugins too. Does your version do that? That would be awesome.

[transistor1]

@briarfox - I like your version a lot! If I had seen this a couple of days earlier I would have written my add-ins for your version. If the core module had a way of downloading the plugins, that would be ideal for new users -- they could just paste the core file into Pythonista and then it would bootstrap the plugins.

[briarfox]

@transistor1 Thanks! I just broke up the cmd into separate files that automatically load into shellista, it uses a very simple template. Most of ShellistaExt is the original code just broken apart. To get by the issue of the initial load into pythonista, just create a single script that grabs the zip from the github and loads it. Take a look at the setup of shellistaExt and let me know what you think. If you'd like to move to a plugin approach I'd be more then happy to contribute. I was finding that I was adding a lot of personal projects into shellista to make it easier to access and being able to just drop in a plugin or even a whole projects like pipista was handy.

Currently the plugins do not auto update but thats a great idea. I'm still working on sftp and ssh auth keys instead of just password. I'm really curious how you got the git working. I tried for a bit and gave up and just wrote the ssh client to access another computer that syncs to dropbox.