xonsh/docs/tutorial.rst

891 lines
31 KiB
ReStructuredText
Raw Normal View History

2015-03-08 01:01:59 -06:00
.. _tutorial:
*******************
Tutorial
*******************
2015-03-22 15:48:26 -04:00
xonsh is a shell language and command prompt. Unlike other shells, xonsh is
based on Python, with additional syntax added that makes calling subprocess
commands, manipulating the environment, and dealing with the file system
easily. The xonsh command prompt gives users interactive access to the xonsh
language.
2015-03-08 01:01:59 -06:00
While all Python code is also xonsh, not all BASH code can be used in xonsh.
2015-03-22 15:48:26 -04:00
That would defeat the purpose, and Python is better anyway! Still, xonsh is
BASH-wards compatible in the ways that matter, such as for running commands,
2015-03-08 01:01:59 -06:00
reading in the BASH environment, and utilizing BASH tab completion.
The purpose of this tutorial is to teach you xonsh. There are many excellent
2015-03-22 15:48:26 -04:00
guides out there for learning Python, and this will not join their ranks.
Similarly, you'd probably get the most out of this tutorial if you have already
used a command prompt or interactive interpreter.
2015-03-08 01:01:59 -06:00
Let's dive in!
Starting xonsh
========================
Assuming you have successfully installed xonsh (see http://xonsh.org),
you can start up the xonsh interpreter via the ``xonsh`` command. Suppose
you are in a lesser terminal:
.. code-block:: bash
bash $ xonsh
2015-03-08 01:50:48 -06:00
snail@home ~ $
2015-03-08 01:01:59 -06:00
Now we are in a xonsh shell. Our username happens to be ``snail``, our
hostname happens to be ``home``, and we are in our home directory (``~``).
2015-03-22 15:48:26 -04:00
Alternatively, you can setup your terminal emulator (xterm, gnome-terminal,
2015-03-08 20:52:56 -05:00
etc) to run xonsh automatically when it starts up. This is recommended.
2015-03-08 01:01:59 -06:00
Basics
=======================
2015-03-22 15:48:26 -04:00
The xonsh language is based on Python, and the xonsh shell uses Python to
interpret any input it receives. This makes simple things, like arithmetic,
2015-03-08 01:50:48 -06:00
simple:
2015-03-30 20:50:20 -05:00
.. code-block:: xonshcon
2015-03-08 01:50:48 -06:00
>>> 1 + 1
2
2015-03-22 15:48:26 -04:00
.. note:: From here on we'll be using ``>>>`` to prefix (or prompt) any
xonsh input. This follows the Python convention and helps trick
2015-03-08 01:50:48 -06:00
syntax highlighting, though ``$`` is more traditional for shells.
2015-03-22 15:48:26 -04:00
Since this is just Python, we are able import modules, print values,
2015-03-08 01:50:48 -06:00
and use other built-in Python functionality:
2015-03-30 20:50:20 -05:00
.. code-block:: xonshcon
2015-03-08 01:50:48 -06:00
>>> import sys
>>> print(sys.version)
2015-03-22 15:48:26 -04:00
3.4.2 |Continuum Analytics, Inc.| (default, Oct 21 2014, 17:16:37)
2015-03-08 01:50:48 -06:00
[GCC 4.4.7 20120313 (Red Hat 4.4.7-1)]
We can also create and use literal data types, such as ints, floats, lists,
2015-03-22 15:48:26 -04:00
sets, and dictionaries. Everything that you are used to if you already know
2015-03-08 01:50:48 -06:00
Python is there:
2015-03-30 20:50:20 -05:00
.. code-block:: xonshcon
2015-03-08 01:50:48 -06:00
>>> d = {'xonsh': True}
>>> d.get('bash', False)
False
2015-03-22 15:48:26 -04:00
The xonsh shell also supports multi-line input for more advanced flow control.
2015-03-08 20:52:56 -05:00
The multi-line mode is automatically entered whenever the first line of input
2015-03-22 15:48:26 -04:00
is not syntactically valid on its own. Multi-line mode is then exited when
2015-03-08 01:50:48 -06:00
enter (or return) is pressed when the cursor is in the first column.
2015-03-30 20:50:20 -05:00
.. code-block:: xonshcon
2015-03-08 01:50:48 -06:00
>>> if True:
... print(1)
... else:
... print(2)
...
1
Flow control, of course, includes loops.
2015-03-30 20:50:20 -05:00
.. code-block:: xonshcon
2015-03-08 01:50:48 -06:00
>>> for i, x in enumerate('xonsh'):
... print(i, x)
...
0 x
1 o
2 n
3 s
4 h
2015-03-22 15:48:26 -04:00
We can also define and call functions and classes. I'll mostly spare you the
2015-03-08 01:50:48 -06:00
details, but this *is* pretty cool:
2015-03-30 20:50:20 -05:00
.. code-block:: xonshcon
2015-03-08 01:50:48 -06:00
>>> def f():
... return "xonsh"
...
>>> f()
'xonsh'
2015-03-19 17:39:10 +02:00
For easier indentation, Shift+Tab will enter 4 spaces.
2015-03-22 15:48:26 -04:00
And that about wraps it up for the basics section. It is just like Python.
2015-03-08 15:11:36 -05:00
Environment Variables
=======================
2015-03-22 15:48:26 -04:00
Environment variables are written as ``$`` followed by a name. For example,
``$HOME``, ``$PWD``, and ``$PATH``.
2015-03-08 15:11:36 -05:00
2015-03-30 20:50:20 -05:00
.. code-block:: xonshcon
2015-03-08 15:11:36 -05:00
>>> $HOME
'/home/snail'
2015-03-22 15:48:26 -04:00
You can set (and export) environment variables like you would set any other
2015-03-08 15:11:36 -05:00
variable in Python. The same is true for deleting them too.
2015-03-31 01:10:19 -05:00
.. code-block:: xonshcon
2015-03-08 15:11:36 -05:00
>>> $GOAL = 'Become the Lord of the Files'
>>> print($GOAL)
Become the Lord of the Files
>>> del $GOAL
2015-03-22 15:48:26 -04:00
Very nice. All environment variables live in the built-in
``__xonsh_env__`` mapping. You can access this mapping directly, but in most
2015-03-08 15:11:36 -05:00
situations, you shouldn't need to.
Like other variables in Python, environment variables have a type. Sometimes
this type is imposed based on the variable name. The current rules are pretty
simple:
* ``PATH``: any variable whose name contains PATH is a list of strings.
* ``XONSH_HISTORY_SIZE``: this variable is an int.
xonsh will automatically convert back and forth to untyped (string-only)
representations of the environment as needed (mostly by subprocess commands).
2015-03-22 15:48:26 -04:00
When in xonsh, you'll always have the typed version. Here are a couple of
2015-03-08 15:11:36 -05:00
PATH examples:
2015-03-31 01:10:19 -05:00
.. code-block:: xonshcon
2015-03-08 15:11:36 -05:00
>>> $PATH
2015-03-22 15:48:26 -04:00
['/home/snail/.local/bin', '/home/snail/sandbox/bin',
'/home/snail/miniconda3/bin', '/usr/local/bin', '/usr/local/sbin',
2015-03-08 15:11:36 -05:00
'/usr/bin', '/usr/sbin', '/bin', '/sbin', '.']
>>> $LD_LIBRARY_PATH
2015-03-08 17:57:12 -05:00
['/home/snail/.local/lib', '']
2015-03-08 15:11:36 -05:00
Also note that *any* Python object can go into the environment. It is sometimes
2015-03-08 20:52:56 -05:00
useful to have more sophisticated types, like functions, in the environment.
2015-03-08 15:11:36 -05:00
There are handful of environment variables that xonsh considers special.
They can be seen in the table below:
================== =========================== ================================
variable default description
================== =========================== ================================
2015-03-22 15:48:26 -04:00
PROMPT xosh.environ.default_prompt The prompt text, may be str or
2015-03-08 15:11:36 -05:00
function which returns a str.
The str may contain keyword
arguments which are
auto-formatted (see below).
2015-03-08 15:11:36 -05:00
MULTILINE_PROMPT ``'.'`` Prompt text for 2nd+ lines of
2015-03-22 15:48:26 -04:00
input, may be str or
2015-03-08 15:11:36 -05:00
function which returns a str.
TITLE xonsh.environ.default_title The title text for the window
in which xonsh is running. As
with PROMPT, may be a str or a
function that returns a str.
The str is formatted in the
2015-03-22 15:48:26 -04:00
same manner as PROMPT (see
below).
2015-03-08 15:11:36 -05:00
XONSHRC ``'~/.xonshrc'`` Location of run control file
XONSH_HISTORY_SIZE 8128 Number of items to store in the
history.
XONSH_HISTORY_FILE ``'~/.xonsh_history'`` Location of history file
2015-03-22 15:48:26 -04:00
BASH_COMPLETIONS ``[] or ['/etc/...']`` This is a list of strings that
specifies where the BASH
completion files may be found.
The default values are platform
dependent, but sane.
SUGGEST_COMMANDS ``True`` When a user types an invalid
command, xonsh will try to offer
2015-03-22 15:48:26 -04:00
suggestions of similar valid
commands if this is ``True``.
SUGGEST_THRESHOLD ``3`` An error threshold. If the
Levenshtein distance between the
entered command and a valid
command is less than this value,
2015-03-22 15:48:26 -04:00
the valid command will be
offered as a suggestion.
SUGGEST_MAX_NUM ``5`` xonsh will show at most this
many suggestions in response to
2015-03-22 15:48:26 -04:00
an invalid command. If
negative, there is no limit to
how many suggestions are shown.
2015-03-08 15:11:36 -05:00
================== =========================== ================================
Customizing the prompt is probably the most common reason for altering an
environment variable. To make this easier, you can use keyword
arguments in a prompt string that will get replaced automatically:
2015-03-31 01:10:19 -05:00
.. code-block:: xonshcon
>>> $PROMPT = '{user}@{hostname}:{cwd} > '
snail@home:~ > # it works!
You can also color your prompt easily by inserting keywords such as ``{GREEN}``
or ``{BOLD_BLUE}`` -- for the full list of keyword arguments, refer to the API
documentation of :py:func:`xonsh.environ.format_prompt`.
2015-03-08 15:11:36 -05:00
Environment Lookup with ``${}``
================================
2015-03-22 15:48:26 -04:00
The ``$NAME`` is great as long as you know the name of the environment
2015-03-08 15:11:36 -05:00
variable you want to look up. But what if you want to construct the name
2015-03-22 15:48:26 -04:00
programatically, or read it from another variable? Enter the ``${}``
2015-03-08 15:11:36 -05:00
operator.
.. warning:: In BASH, ``$NAME`` and ``${NAME}`` are syntactically equivalent.
In xonsh, they have separate meanings.
2015-03-23 01:57:17 -05:00
We can place any valid Python expression inside of the curly braces in
``${<expr>}``. This result of this expression will then be used to look up a
value in the environment. In fact, ``${<expr>}`` is the same as doing
2015-03-22 15:48:26 -04:00
``__xonsh_env__[<expr>]``, but much nicer to look at. Here are a couple of
2015-03-08 15:11:36 -05:00
examples in action:
2015-03-31 01:10:19 -05:00
.. code-block:: xonshcon
2015-03-08 15:11:36 -05:00
>>> x = 'USER'
>>> ${x}
'snail'
>>> ${'HO' + 'ME'}
'/home/snail'
2015-03-08 16:58:10 -05:00
Not bad, xonsh, not bad.
Running Commands
==============================
2015-03-22 15:48:26 -04:00
As a shell, xonsh is meant to make running commands easy and fun.
2015-03-08 16:58:10 -05:00
Running subprocess commands should work like any other in any other shell.
2015-03-31 01:10:19 -05:00
.. code-block:: xonshcon
2015-03-08 16:58:10 -05:00
>>> echo "Yoo hoo"
Yoo hoo
>>> cd xonsh
>>> ls
2015-03-09 10:54:59 +01:00
build docs README.rst setup.py xonsh __pycache__
2015-03-08 16:58:10 -05:00
dist license scripts tests xonsh.egg-info
>>> git status
On branch master
Your branch is up-to-date with 'origin/master'.
Changes not staged for commit:
(use "git add <file>..." to update what will be committed)
(use "git checkout -- <file>..." to discard changes in working directory)
modified: docs/tutorial.rst
no changes added to commit (use "git add" and/or "git commit -a")
>>> exit
This should feel very natural.
Python-mode vs Subprocess-mode
================================
It is sometimes helpful to make the distinction between lines that operate
2015-03-22 15:48:26 -04:00
in pure Python mode and lines that use shell-specific syntax, edit the
2015-03-08 20:52:56 -05:00
execution environment, and run commands. Unfortunately, it is not always
2015-03-08 16:58:10 -05:00
clear from the syntax alone what mode is desired. This ambiguity stems from
most command line utilities looking a lot like Python operators.
2015-03-22 15:48:26 -04:00
Take the case of ``ls -l``. This is valid Python code, though it could
have also been written as ``ls - l`` or ``ls-l``. So how does xonsh know
2015-03-08 16:58:10 -05:00
that ``ls -l`` is meant to be run in subprocess-mode?
2015-03-22 15:48:26 -04:00
For any given line that only contains an expression statement (expr-stmt,
see the Python AST docs for more information), if the left-most name cannot
be found as a current variable name xonsh will try to parse the line as a
subprocess command instead. In the above, if ``ls`` is not a variable,
then subprocess mode will be attempted. If parsing in subprocess mode fails,
2015-03-08 16:58:10 -05:00
then the line is left in Python-mode.
2015-03-22 15:48:26 -04:00
In the following example, we will list the contents of the directory
2015-03-08 16:58:10 -05:00
with ``ls -l``. Then we'll make new variable names ``ls`` and ``l`` and then
2015-03-22 15:48:26 -04:00
subtract them. Finally, we will delete ``ls`` and ``l`` and be able to list
2015-03-08 16:58:10 -05:00
the directories again.
2015-03-31 01:10:19 -05:00
.. code-block:: xonshcon
2015-03-08 16:58:10 -05:00
>>> # this will be in subproc-mode, because ls doesn't exist
>>> ls -l
total 0
-rw-rw-r-- 1 snail snail 0 Mar 8 15:46 xonsh
>>> # set an ls variable to force python-mode
>>> ls = 44
>>> l = 2
>>> ls -l
42
>>> # deleting ls will return us to supbroc-mode
>>> del ls
>>> ls -l
total 0
-rw-rw-r-- 1 snail snail 0 Mar 8 15:46 xonsh
The determination between Python- and subprocess-modes is always done in the
safest possible way. If anything goes wrong, it will favor Python-mode.
The determination between the two modes is done well ahead of any execution.
2015-03-22 15:48:26 -04:00
You do not need to worry about partially executed commands - that is
2015-03-08 16:58:10 -05:00
impossible.
If absolutely want to run a subprocess command, you can always force xonsh
to do so with the syntax that we will see in the following sections.
2015-03-08 20:52:56 -05:00
Captured Subprocess with ``$()``
2015-03-08 16:58:10 -05:00
================================
2015-03-22 15:48:26 -04:00
The ``$(<expr>)`` operator in xonsh executes a subprocess command and
*captures* the output. The expression in the parentheses will be run and
stdout will be returned as string. This is similar to how ``$()`` performs in
2015-03-08 16:58:10 -05:00
BASH. For example,
2015-03-30 22:20:22 -05:00
.. code-block:: xonshcon
2015-03-08 16:58:10 -05:00
>>> $(ls -l)
'total 0\n-rw-rw-r-- 1 snail snail 0 Mar 8 15:46 xonsh\n'
2015-03-22 15:48:26 -04:00
The ``$()`` operator is an expression itself. This means that we can
2015-03-08 20:52:56 -05:00
assign the results to a variable or perform any other manipulations we want.
2015-03-08 16:58:10 -05:00
2015-03-30 22:20:22 -05:00
.. code-block:: xonshcon
2015-03-08 16:58:10 -05:00
>>> x = $(ls -l)
>>> print(x.upper())
TOTAL 0
-RW-RW-R-- 1 SNAIL SNAIL 0 MAR 8 15:46 XONSH
2015-03-22 15:48:26 -04:00
While in subprocess-mode or inside of a captured subprocess, we can always
still query the environment with ``$NAME`` variables.
2015-03-08 16:58:10 -05:00
2015-03-31 01:10:19 -05:00
.. code-block:: xonshcon
2015-03-08 16:58:10 -05:00
>>> $(echo $HOME)
'/home/snail\n'
2015-03-08 20:52:56 -05:00
Uncaptured Subprocess with ``$[]``
2015-03-08 16:58:10 -05:00
===================================
2015-03-22 15:48:26 -04:00
Uncaptured subprocess are denoted with the ``$[<expr>]`` operator. They are
the same as ``$()`` captured subprocesses in almost every way. The only
2015-03-08 16:58:10 -05:00
difference is that the subprocess's stdout passes directly through xonsh and
2015-03-22 15:48:26 -04:00
to the screen. The return value of ``$[]`` is always ``None``.
2015-03-08 16:58:10 -05:00
2015-03-08 17:22:23 -05:00
In the following, we can see that the results of ``$[]`` are automatically
2015-03-08 16:58:10 -05:00
printed and the return value is not a string.
2015-03-31 01:10:19 -05:00
.. code-block:: xonshcon
2015-03-08 16:58:10 -05:00
>>> x = $[ls -l]
total 0
2015-03-08 17:57:12 -05:00
-rw-rw-r-- 1 snail snail 0 Mar 8 15:46 xonsh
2015-03-08 16:58:10 -05:00
>>> x is None
True
Previously when we automatically entered subprocess-mode, uncaptured
2015-03-22 15:48:26 -04:00
subprocesses were used. Thus ``ls -l`` and ``$[ls -l]`` are usually
2015-03-08 16:58:10 -05:00
equivalent.
2015-03-20 17:30:24 -04:00
Python Evaluation with ``@()``
===============================
2015-03-22 15:48:26 -04:00
2015-03-20 17:30:24 -04:00
The ``@(<expr>)`` operator from will evaluate arbitrary Python code in
subprocess mode, and the result will be appended to the subprocess command
2015-03-28 17:55:48 -05:00
list. If the result is a string, it is appended to the argument list.
If the result is a list or other non-string sequence, the contents are
converted to strings and appended to the argument list in order. Otherwise, the
result is automatically converted to a string. For example,
2015-03-20 17:30:24 -04:00
2015-03-31 01:10:19 -05:00
.. code-block:: xonshcon
2015-03-20 17:30:24 -04:00
>>> x = 'xonsh'
>>> y = 'party'
>>> echo @(x + ' ' + y)
xonsh party
>>> echo @(2+2)
4
2015-03-28 17:55:48 -05:00
>>> echo @([42, 'yo'])
42 yo
2015-03-20 17:30:24 -04:00
This syntax can be used inside of a captured or uncaptured subprocess, and can
be used to generate any of the tokens in the subprocess command list.
2015-03-30 20:50:20 -05:00
.. code-block:: xonshcon
2015-03-20 17:30:24 -04:00
>>> out = $(echo @(x + ' ' + y))
>>> out
'xonsh party\n'
>>> @("ech" + "o") "hey"
hey
2015-03-22 15:48:26 -04:00
Thus, ``@()`` allows us to create complex commands in Python-mode and then
2015-03-20 17:30:24 -04:00
feed them to a subprocess as needed. For example:
2015-03-31 01:10:19 -05:00
.. code-block:: xonsh
2015-03-20 17:30:24 -04:00
for i in range(20):
$[touch @('file%02d' % i)]
2015-03-08 16:58:10 -05:00
2015-03-08 17:22:23 -05:00
Nesting Subprocesses
=====================================
2015-03-20 17:30:24 -04:00
Though I am begging you not to abuse this, it is possible to nest the
subprocess operators that we have seen so far (``$()``, ``$[]``, ``${}``,
``@()``). An instance of ``ls -l`` that is on the wrong side of the border of
the absurd is shown below:
2015-03-08 17:22:23 -05:00
2015-03-31 01:10:19 -05:00
.. code-block:: xonshcon
2015-03-08 17:22:23 -05:00
2015-03-20 17:30:24 -04:00
>>> $[$(echo ls) @('-' + $(echo l).strip())]
2015-03-08 17:22:23 -05:00
total 0
2015-03-08 17:57:12 -05:00
-rw-rw-r-- 1 snail snail 0 Mar 8 15:46 xonsh
2015-03-08 17:22:23 -05:00
With great power, and so forth...
2015-03-20 17:30:24 -04:00
.. note:: Nesting these subprocess operators inside of ``$()`` and/or ``$[]``
works, because the contents of those operators are executed in
subprocess mode. Since ``@()`` and ``${}`` run their contents in
Python mode, it is not possible to nest other subprocess operators
inside of them.
2015-03-08 17:22:23 -05:00
2015-03-08 17:49:18 -05:00
Pipes with ``|``
2015-03-08 17:22:23 -05:00
====================================
In subprocess-mode, xonsh allows you to use the ``|`` character to pipe
together commands as you would in other shells.
2015-03-31 01:10:19 -05:00
.. code-block:: xonshcon
2015-03-08 17:22:23 -05:00
>>> env | uniq | sort | grep PATH
DATAPATH=/usr/share/MCNPX/v260/Data/
DEFAULTS_PATH=/usr/share/gconf/awesome-gnome.default.path
2015-03-08 17:57:12 -05:00
LD_LIBRARY_PATH=/home/snail/.local/lib:
2015-03-08 17:22:23 -05:00
MANDATORY_PATH=/usr/share/gconf/awesome-gnome.mandatory.path
PATH=/home/snail/.local/bin:/home/snail/sandbox/bin:/usr/local/bin
XDG_SEAT_PATH=/org/freedesktop/DisplayManager/Seat0
XDG_SESSION_PATH=/org/freedesktop/DisplayManager/Session0
2015-03-22 15:48:26 -04:00
This is only available in subprocess-mode because ``|`` is otherwise a
2015-03-08 17:49:18 -05:00
Python operator.
2015-03-08 20:52:56 -05:00
If you are unsure of what pipes are, there are many great references out there.
2015-03-08 17:22:23 -05:00
You should be able to find information on StackOverflow or Google.
2015-03-08 17:49:18 -05:00
Writing Files with ``>``
=====================================
In subprocess-mode, if the second to last element is a greater-than sign
2015-03-22 15:48:26 -04:00
``>`` and the last element evaluates to a string, the output of the
preceding command will be written to file. If the file already exists, the
current contents will be erased. For example, let's write a simple file
2015-03-08 17:49:18 -05:00
called ``conch.txt`` using ``echo``:
2015-03-31 01:10:19 -05:00
.. code-block:: xonshcon
2015-03-08 17:49:18 -05:00
>>> echo Piggy > conch.txt
'Piggy\n'
2015-03-22 15:48:26 -04:00
>>> cat conch.txt
2015-03-08 17:49:18 -05:00
Piggy
2015-03-22 15:48:26 -04:00
2015-03-08 17:49:18 -05:00
This can be pretty useful. This does not work in Python-mode, since ``>``
is a valid Python operator.
Appending to Files with ``>>``
=====================================
Following the same syntax as with ``>`` in subprocess-mode, the ``>>``
operator allows us to append to a file rather than overwriting it completely.
2015-03-22 15:48:26 -04:00
If the file doesn't exist, it is created. Let's reuse the ``conch.txt``
2015-03-08 17:49:18 -05:00
file from above and add a line.
2015-03-31 01:10:19 -05:00
.. code-block:: xonshcon
2015-03-08 17:49:18 -05:00
>>> echo Ralph >> conch.txt
'Ralph\n'
2015-03-22 15:48:26 -04:00
>>> cat conch.txt
2015-03-08 17:49:18 -05:00
Piggy
Ralph
Again, the ``>>`` does not work as shown here in Python-mode, where it takes
2015-03-08 17:57:12 -05:00
on its usual meaning.
2015-03-08 20:47:35 -05:00
Non-blocking with ``&``
2015-03-08 20:33:33 -05:00
====================================
2015-03-22 15:48:26 -04:00
In subprocess-mode, you can make a process no-blocking if the last element on
2015-03-08 20:47:35 -05:00
a line is an ``&``. The following shows an example with ``emacs``.
2015-03-08 20:33:33 -05:00
2015-03-31 01:10:19 -05:00
.. code-block:: xonshcon
2015-03-08 20:33:33 -05:00
>>> emacs &
>>>
2015-03-08 20:47:35 -05:00
Note that the prompt is returned to you afterwards.
2015-03-08 20:33:33 -05:00
2015-03-08 17:57:12 -05:00
String Literals in Subprocess-mode
====================================
2015-03-22 15:48:26 -04:00
Strings can be used to escape special characters in subprocess-mode. The
contents of the string are passed directly to the subprocess command as a
2015-03-08 17:57:12 -05:00
single argument. So whenever you are in doubt, or if there is a xonsh syntax
2015-03-22 15:48:26 -04:00
error because of a filename, just wrap the offending portion in a string.
2015-03-08 17:57:12 -05:00
2015-03-22 15:48:26 -04:00
A common use case for this is files with spaces in their names. This
2015-03-08 17:57:12 -05:00
detestable practice refuses to die. "No problem!" says xonsh, "I have
strings." Let's see it go!
2015-03-31 01:10:19 -05:00
.. code-block:: xonshcon
2015-03-08 17:57:12 -05:00
>>> touch "sp ace"
>>> ls -l
total 0
-rw-rw-r-- 1 snail snail 0 Mar 8 17:50 sp ace
-rw-rw-r-- 1 snail snail 0 Mar 8 15:46 xonsh
2015-03-08 20:52:56 -05:00
Spaces in filenames, of course, are just the beginning.
2015-03-08 17:57:12 -05:00
2015-03-08 19:06:39 -05:00
Filename Globbing with ``*``
===============================
Filename globbing with the ``*`` character is also allowed in subprocess-mode.
2015-03-08 20:52:56 -05:00
This simply uses Python's glob module under-the-covers. See there for more
2015-03-08 19:06:39 -05:00
details. As an example, start with a lovely bunch of xonshs:
2015-03-31 01:10:19 -05:00
.. code-block:: xonshcon
2015-03-08 19:06:39 -05:00
>>> touch xonsh conch konk quanxh
>>> ls
conch konk quanxh xonsh
>>> ls *h
conch quanxh xonsh
>>> ls *o*
conch konk xonsh
2015-03-22 15:48:26 -04:00
This is not available in Python-mode, because multiplication is pretty
2015-03-08 19:06:39 -05:00
important.
Regular Expression Filename Globbing with Backticks
=====================================================
2015-03-22 15:48:26 -04:00
If you have ever felt that normal globbing could use some more octane,
2015-03-08 19:06:39 -05:00
then regex globbing is the tool for you! Any string that uses backticks
2015-03-22 15:48:26 -04:00
(`````) instead of quotes (``'``, ``"``) is interpreted as a regular
expression to match filenames against. Like with regular globbing, a
2015-03-08 19:06:39 -05:00
list of successful matches is returned. In Python-mode, this is just a
2015-03-08 20:52:56 -05:00
list of strings. In subprocess-mode, each filename becomes its own argument
to the subprocess command.
2015-03-08 19:06:39 -05:00
Let's see a demonstration with some simple filenames:
2015-03-31 01:10:19 -05:00
.. code-block:: xonshcon
2015-03-08 19:06:39 -05:00
>>> touch a aa aaa aba abba aab aabb abcba
>>> ls `a(a+|b+)a`
aaa aba abba
>>> print(`a(a+|b+)a`)
['aaa', 'aba', 'abba']
>>> len(`a(a+|b+)a`)
3
2015-03-22 15:48:26 -04:00
Other than the regex matching, this functions in the same way as normal
2015-03-08 19:06:39 -05:00
globbing.
For more information, please see the documentation for the ``re`` module in
the Python standard library.
2015-03-08 20:52:56 -05:00
.. warning:: This backtick syntax has very different from that of BASH. In
2015-03-08 19:06:39 -05:00
BASH, backticks means to run a captured subprocess ``$()``.
Help & Superhelp with ``?`` & ``??``
=====================================================
From IPython, xonsh allows you to inspect objects with question marks.
A single question mark (``?``) is used to display normal level of help.
2015-03-22 15:48:26 -04:00
Double question marks (``??``) are used to display higher level of help,
2015-03-08 19:06:39 -05:00
called superhelp. Superhelp usually includes source code if the object was
2015-03-22 15:48:26 -04:00
written in pure Python.
2015-03-08 19:06:39 -05:00
Let's start by looking at the help for the int type:
2015-03-31 01:10:19 -05:00
.. code-block:: xonshcon
2015-03-08 19:06:39 -05:00
>>> int?
Type: type
String form: <class 'int'>
Init definition: (self, *args, **kwargs)
Docstring:
int(x=0) -> integer
int(x, base=10) -> integer
Convert a number or string to an integer, or return 0 if no arguments
are given. If x is a number, return x.__int__(). For floating point
numbers, this truncates towards zero.
If x is not a number or if base is given, then x must be a string,
bytes, or bytearray instance representing an integer literal in the
given base. The literal can be preceded by '+' or '-' and be surrounded
by whitespace. The base defaults to 10. Valid bases are 0 and 2-36.
Base 0 means to interpret the base from the string as an integer literal.
>>> int('0b100', base=0)
4
<class 'int'>
Now, let's look at the superhelp for the xonsh built-in that enables
regex globbing:
2015-03-30 20:50:20 -05:00
.. code-block:: xonshcon
2015-03-08 19:06:39 -05:00
>>> __xonsh_regexpath__??
Type: function
String form: <function regexpath at 0x7fef91612950>
File: /home/scopatz/.local/lib/python3.4/site-packages/xonsh-0.1-py3.4.egg/xonsh/built_ins.py
Definition: (s)
Source:
def regexpath(s):
"""Takes a regular expression string and returns a list of file
paths that match the regex.
"""
s = expand_path(s)
return reglob(s)
<function regexpath at 0x7fef91612950>
Note that both help and superhelp return the object that they are inspecting.
2015-03-22 15:48:26 -04:00
This allows you to chain together help inside of other operations and
2015-03-08 20:52:56 -05:00
ask for help several times in an object hierarchy. For instance, let's get
help for both the dict type and its key() method simultaneously:
2015-03-08 19:06:39 -05:00
2015-03-30 20:50:20 -05:00
.. code-block:: xonshcon
2015-03-08 19:06:39 -05:00
>>> dict?.keys??
Type: type
String form: <class 'dict'>
Init definition: (self, *args, **kwargs)
Docstring:
dict() -> new empty dictionary
dict(mapping) -> new dictionary initialized from a mapping object's
(key, value) pairs
dict(iterable) -> new dictionary initialized as if via:
d = {}
for k, v in iterable:
d[k] = v
dict(**kwargs) -> new dictionary initialized with the name=value pairs
in the keyword argument list. For example: dict(one=1, two=2)
Type: method_descriptor
String form: <method 'keys' of 'dict' objects>
Docstring: D.keys() -> a set-like object providing a view on D's keys
<method 'keys' of 'dict' objects>
Of course, for subprocess commands, you still want to use the ``man`` command.
2015-03-08 19:19:30 -05:00
Compile, Evaluate, & Execute
================================
Like Python and BASH, xonsh provides built-in hooks to compile, evaluate,
and execute strings of xonsh code. To prevent this functionality from having
serious name collisions with the Python built-in ``compile()``, ``eval()``,
and ``exec()`` functions, the xonsh equivalents all append an 'x'. So for
2015-03-22 15:48:26 -04:00
xonsh code you want to use the ``compilex()``, ``evalx()``, and ``execx()``
2015-03-08 19:19:30 -05:00
functions. If you don't know what these do, you probably don't need them.
2015-03-08 17:57:12 -05:00
2015-03-08 20:06:59 -05:00
Aliases
==============================
2015-03-22 15:48:26 -04:00
Another important xonsh built-in is the ``aliases`` mapping. This is
like a dictionary that effects how subprocess commands are run. If you are
2015-03-08 20:06:59 -05:00
familiar with the BASH ``alias`` built-in, this is similar. Alias command
matching only occurs for the first element of a subprocess command.
The keys of ``aliases`` are strings that act as commands in subprocess-mode.
2015-03-22 03:34:02 +01:00
The values are lists of strings, where the first element is the command and
the rest are the arguments. You can also set the value to a string, in which
case it will be converted to a list automatically with ``shlex.split``.
2015-03-08 20:06:59 -05:00
2015-03-22 03:34:02 +01:00
For example, here are some of the default aliases:
2015-03-08 20:06:59 -05:00
2015-03-31 01:10:19 -05:00
.. code-block:: python
2015-03-08 20:06:59 -05:00
DEFAULT_ALIASES = {
2015-03-22 03:34:02 +01:00
'ls': 'ls --color=auto -v',
'grep': 'grep --color=auto',
2015-03-08 20:06:59 -05:00
'scp-resume': ['rsync', '--partial', '-h', '--progress', '--rsh=ssh'],
'ipynb': ['ipython', 'notebook', '--no-browser'],
}
2015-03-22 03:34:02 +01:00
If you were to run ``ls dir/`` with the aliases above in effect (by running
``aliases.update(DEFAULT_ALIASES)``), it would reduce to
``["ls", "--color=auto", "-v", "dir/"]`` before being executed.
2015-03-22 15:48:26 -04:00
Lastly, if an alias value is a function (or other callable), then this
2015-03-08 20:52:56 -05:00
function is called *instead* of going to a subprocess command. Such functions
2015-03-08 20:06:59 -05:00
must have the following signature:
2015-03-31 01:10:19 -05:00
.. code-block:: python
2015-03-08 20:06:59 -05:00
def mycmd(args, stdin=None):
2015-03-22 15:48:26 -04:00
"""args will be a list of strings representing the arguments to this
2015-03-09 22:06:29 -05:00
command. stdin will be a string, if present. This is used to pipe
2015-03-08 20:06:59 -05:00
the output of the previous command into this one.
"""
2015-03-22 15:48:26 -04:00
# do whatever you want! Anything you print to stdout or stderr
# will be captured for you automatically. This allows callable
2015-03-10 20:29:28 -05:00
# aliases to support piping.
print('I go to stdout and will be printed or piped')
# Note: that you have access to the xonsh
2015-03-08 20:06:59 -05:00
# built-ins if you 'import builtins'. For example, if you need the
2015-03-10 20:29:28 -05:00
# environment, you could do to following:
import bulitins
env = builtins.__xonsh_env__
# The return value of the function can either be None,
return
2015-03-11 01:40:48 -05:00
# a single string representing stdout
return 'I am out of here'
2015-03-22 15:48:26 -04:00
# or you can build up strings for stdout and stderr and then
2015-03-10 20:29:28 -05:00
# return a (stdout, stderr) tuple. Both of these may be
2015-03-22 15:48:26 -04:00
# either a str or None. Any results returned like this will be
2015-03-10 20:29:28 -05:00
# concatenated with the strings printed elsewhere in the function.
2015-03-08 20:06:59 -05:00
stdout = 'I commanded'
stderr = None
return stdout, stderr
2015-03-22 15:48:26 -04:00
We can dynamically alter the aliases present simply by modifying the
2015-03-08 20:06:59 -05:00
built-in mapping. Here is an example using a function value:
2015-03-30 20:50:20 -05:00
.. code-block:: xonshcon
2015-03-08 20:06:59 -05:00
>>> aliases['banana'] = lambda args, stdin=None: ('My spoon is tooo big!', None)
2015-03-22 15:48:26 -04:00
>>> banana
2015-03-08 20:06:59 -05:00
'My spoon is tooo big!'
2015-03-22 15:52:02 -04:00
Aliasing is a powerful way that xonsh allows you to seamlessly interact to
2015-03-22 15:48:26 -04:00
with Python and subprocess.
2015-03-08 20:47:35 -05:00
Up, Down, Tab
==============
2015-03-22 15:48:26 -04:00
The up and down keys search history matching from the start of the line,
2015-03-08 20:47:35 -05:00
much like they do in the IPython shell.
Tab completion is present as well. In Python-mode you are able to complete
2015-03-22 15:48:26 -04:00
based on the variable names in the current builtins, globals, and locals,
as well as xonsh languages keywords & operator, files & directories, and
2015-03-08 20:47:35 -05:00
environment variable names. In subprocess-mode, you additionally complete
2015-03-22 15:48:26 -04:00
on any file names on your ``$PATH``, alias keys, and full BASH completion
2015-03-08 20:47:35 -05:00
for the commands themselves.
Executing Commands and Scripts
==============================
When started with the ``-c`` flag and a command, xonsh will execute that command
and exit, instead of entering the command loop.
.. code-block:: bash
bash $ xonsh -c "echo @(7+3)"
10
Longer scripts can be run either by specifying a filename containing the script,
or by feeding them to xonsh via stdin. For example, consider the following
2015-03-31 01:10:19 -05:00
script, stored in ``test.xsh``:
2015-03-31 01:10:19 -05:00
.. code-block:: xonsh
#!/usr/bin/env xonsh
2015-03-22 15:48:26 -04:00
$[ls]
2015-03-22 15:48:26 -04:00
print('removing files')
$[rm `file\d+.txt`]
2015-03-22 15:48:26 -04:00
$[ls]
2015-03-22 15:48:26 -04:00
print('adding files')
# This is a comment
for i, x in enumerate("xonsh"):
$[echo @(x) > @("file%d.txt" % i)]
2015-03-22 15:48:26 -04:00
print($(ls).replace('\n', ' '))
This script could be run by piping its contents to xonsh:
.. code-block:: bash
2015-03-31 01:10:19 -05:00
bash $ cat test_script.xsh | xonsh
file0.txt file1.txt file2.txt file3.txt file4.txt test_script.sh
removing files
test_script.sh
adding files
2015-03-22 15:48:26 -04:00
file0.txt file1.txt file2.txt file3.txt file4.txt test_script.sh
or by invoking xonsh with its filename as an argument:
.. code-block:: bash
2015-03-31 01:10:19 -05:00
bash $ xonsh test_script.xsh
file0.txt file1.txt file2.txt file3.txt file4.txt test_script.sh
removing files
test_script.sh
adding files
file0.txt file1.txt file2.txt file3.txt file4.txt test_script.sh
xonsh scripts can also accept arguments. These arguments are made available to
the script in two different ways:
2015-03-23 01:15:48 -05:00
#. In either mode, as individual variables ``$ARG<n>`` (e.g., ``$ARG1``)
#. In Python mode only, as a list ``$ARGS``
2015-03-22 15:48:26 -04:00
For example, consider a slight variation of the example script from above that
operates on a given argument, rather than on the string ``'xonsh'`` (notice how
``$ARGS`` and ``$ARG1`` are used):
2015-03-31 01:10:19 -05:00
.. code-block:: xonsh
#!/usr/bin/env xonsh
2015-03-22 15:48:26 -04:00
print($ARGS)
$[ls]
2015-03-22 15:48:26 -04:00
print('removing files')
$[rm `file\d+.txt`]
2015-03-22 15:48:26 -04:00
$[ls]
2015-03-22 15:48:26 -04:00
print('adding files')
# This is a comment
for i, x in enumerate($ARG1):
$[echo @(x) > @("file%d.txt" % i)]
2015-03-22 15:48:26 -04:00
print($(ls).replace('\n', ' '))
print()
.. code-block:: bash
2015-03-31 01:10:19 -05:00
bash $ xonsh test_script2.xsh snails
['test_script.sh', 'snails']
file0.txt file1.txt file2.txt file3.txt file4.txt file5.txt test_script.sh
removing files
test_script.sh
adding files
file0.txt file1.txt file2.txt file3.txt file4.txt file5.txt test_script.sh
2015-03-22 15:48:26 -04:00
bash $ echo @(' '.join($(cat @('file%d.txt' % i)).strip() for i in range(6)))
s n a i l s
2015-03-08 20:47:35 -05:00
2015-03-29 18:56:25 -05:00
Importing Xonsh (``*.xsh``)
==============================
You can import xonsh source files with the ``*.xsh`` file extension using
the normal Python syntax. Say you had a file called ``mine.xsh``, you could
therefore perform a Bash-like source into your current shell with the
following:
2015-03-31 01:10:19 -05:00
.. code-block:: xonsh
2015-03-29 18:56:25 -05:00
from mine import *
2015-03-08 20:47:35 -05:00
That's All, Folks
======================
2015-03-23 01:57:17 -05:00
To leave xonsh, hit ``Crtl-D``, type ``EOF``, type ``quit``, or type ``exit``.
2015-03-08 20:47:35 -05:00
2015-03-31 01:10:19 -05:00
.. code-block:: xonshcon
2015-03-08 20:47:35 -05:00
>>> exit
Now it is your turn.