Advancing in the Bash Shell
samrowe.com
samrowe.com
Alt-. will generally add the prior last argument into the current command, and repeated presses will cycle through previous commands.
Ctrl-r will dynamically update to show you the prior command matched as you start typing afterwards, so you can confirm it's correct.
Both are essential if you want to reuse prior commands but either can't trust that you were the last person using the shell, or don't want a typo to ruin your day, and possibly many other people's day as well. That is, if you're a sysadmin using the automatic variants, I don't want you anywhere near systems I rely on, I want you far away. Perhaps working for a competitor.
I think this not just "partially helps", I think it completely addresses the problem described by the above commenter. Perhaps s/he is not aware of this feature.
Not even "sudo !!" ?
You can see the command you just typed in the line above, and you just forgot to add sudo to it.
Another way of putting it is that I'll gladly press another 2-3 keys if it prevents a class or errors and also reduces the number of special bash instructions I have to keep in memory. !! isn't even in my repertoire, but I don't feel its loss.
$ yum install bash-completion
Error: This command has to be run under the root user.
$ sudo <Alt-.>
$ sudo bash-completionFor example, say you want to run "chown root:root foo". Alt-. gets you "foo", not the entire command, and "sudo foo" isn't useful,and in some cases could do something else entirely. For example, with the command "service foo restart", you would end up with "sudo restart" (which while it doesn't execute right away, is exactly what I'm guarding against).
Unlike Emacs, M-1 etc. can't be typed as C-u 1 etc.
But I'm an epic coward that even looks both to the left and the right before crossing a street. :-)
#!/bin/bash
echo -n "Are you SURE you dumbass? [N/y] " >/dev/stderr
read -n 1
if [ "$REPLY" = "y" ]; then
echo >/dev/stderr
exec /usr/bin/sudo "$@"
else
exec echo -e "\n:-)" >/dev/stderr
fi
That way even if I already typed my password, I systematically get asked if I'm sure I want to execute the command.I think I'm pretty proficient as a basher, but I also never use the bang, nor do I use the 'history' bit. Didn't know about alt-. tho, that's handy.
I could toss 'control-k' for 'delete to end of line' that hasn't been mentioned. And of course control-P/N for previous/next commands (or arrows obviously).
The class of shortcuts I love is:
[command] !:1-$
which copies the arguments to the previous command to this one. Or:
!:3
which copies the fourth argument.
Once those were under my fingers my fellow architects were astounded.
shopt -s histverify
versus
shopt -u histverify
and then add whatever you prefer (-s probably) to your bashrc
I use zsh (with oh-my-zsh) and when I type e.g. "sudo !!" and press enter, it doesn't execute the command, instead it expands the !!. Another enter will then actually execute it.
I believe it's default behavior for oh-my-zsh. At least, I don't recall manually changing this.
I don't use history expansions, though, so YMMV
shopt -s histverify
shopt -s histreedit
If set, and readline is being used, a user is given the opportunity to re-edit a failed history substitution.history-expand-line is documented in: https://www.gnu.org/software/bash/manual/html_node/Miscellan...
sudo !!:p
which tells bash to do the history expansion, but print the result and add it to the command line history, instead of actually running it. If the command looks correct, it's only two more keystrokes (up-arrow, enter) to run it for real.Neither do I, intentionally at least.
This week I encountered a very bizarre problem when running GHCi (a Haskell REPL), invoked from bash in an Emacs "shell" buffer.
In Haskell, "!!" is a function for getting an element from a list, e.g.
> let myList = ["a", "b", "c"]
> (myList !! 1, myList !! 2)
This would normally return the pair ("b", "c"), which GHCi prints to the screen. However, for some reason it was performing bash-like subtitution, giving me (on subsequent retries): parse error on input 'let'
(myList (myList !! 1, myList !! 2) 1, myList (myList !! 1, myList !! 2) 2)
(myList (myList (myList !! 1, myList !! 2) 1, myList (myList !! 1, myList !! 2) 2) 1, myList (myList (myList !! 1, myList !! 2) 1, myList (myList !! 1, myList !! 2) 2) 2)
and so on exponentially!On a similar note, I always get nervous when using "rm -rf", since the path is written in big-endian order, so an accidental nudge halfway through typing can cause something like
rm -rf ~/Pictures/Scans/NeedConverting/*
To become rm -rf ~rm -rfi
lets you get an interactive mode so you can confirm what's happening before it gets erased.
That's a much more interactive way of getting to the command I want, and if the first match isn't what I want I can either keep typing more of the command or type control-r for the next match. I can also type control-s to go to the previous match. For that last trick to work, you need to do something like this first: stty stop ""
Granted, I use zsh, but I think it works pretty much the same in bash.
Another trick I really like, which I've only used in zsh, but which might exist in bash too (since bash and zsh have so much feature parity these days) is to bind a keystroke to "insert-last-word". When this keystroke is hit, it appends the last argument of the previous command to the end of the current line, further typing of this same keystroke will remove the appended argument and instead append the last argument of the previous command, and so on. I use this all the time and therefore never have to type !$
And my favorite shell trick of all time: set -o vi
I'm a little wary of precompiled binaries.
There's `Meta-_` to insert the previous last word, but you cannot cycle with the previous words--it inserts the last word of the previous commands. You can give it a count, though (with Meta+nums).
Personally I bind them to up/down which on OS X at least involves:
# Put this in some file like ~/.readline-bindings
"\e[A": history-search-backward
"\e[B": history-search-forward
# And this in your ~/.bashrc or ~/.zshrc
bind -f ~/.readline-bindings
That way if you haven't typed any input it behaves like normal up (previous command), but if you've typed some characters it only retrieves matching commands.http://codeinthehole.com/writing/the-most-important-command-...
I also use zsh and I don't even use ctrl+r anymore. I just type a portion of the command I remember and hit the up arrow key. Almost always the command I want is only one to three arrow keys away. zsh matches partial commands really well.
I can start typing and then type more once I see some results to hone in more precisely to what I want, or even backspace over some of what I've typed and type some more without having to start all over again.
Also, using control-r instead of the arrow keys doesn't force me to move my wrists and lets me keep my fingers mostly on the home row. I try to use the arrow keys as little as possible.
Now I gotta retrain my muscle memory :)
bindkey '^r' history-incremental-pattern-search-backward
When you remember parts of the commands, you can do "C-r" then "echo*something".
> While the [ctrl-r] method is more powerful, when doing some redundant task, it’s much easier to remember !22 than it is to muck with ctrl-r type searches or even the arrow keys.
how?!
Cherry on top? These work on other readline using tools! They work in the interactive repl's like python, node, irb, ghcim the exact same shortcuts... it makes working with repl's much more pleasant for me.
[0] https://cnswww.cns.cwru.edu/php/chet/readline/rltop.html [1] quick note, node might use a readline like but it doesn't support yanking (pasting) unfortunately.
ctrl-R is not bash, it's GNU readline.
http://cnswww.cns.cwru.edu/php/chet/readline/rluserman.html
If you are going to use command line, than absolutely you should use command history editing, but why limiting yourself to a few commands learned through osmosis or haphazardly rather than use a full editor? Why use C-r to search backwards, but not M-backspace to delete an entire word?
When I explain this, people usually argue that "there are two many weird commands to learn, and I only need the few I know". The same type of people often go on a rant about how much vim is so much better than emacs.
There are not weird command to learn, none, zero!
Use your preferred editor! You already know it, you already know all those commands, and if you don't buy a book and learn them! You know and like emacs? Great, that's the default in readline. Go ahead C-r, C-backspace, C-a, C-e, M-f all you need. You already know all of those.
But you don't like emacs, or don't even know that it exists beside the fact that it's something fun to shit on? You think you're a big shot because you know vim really well? Not an issue, type the magic command "set -o vi" and you are now in vi mode, you can esc-/ to search, esc-k to call the last command, and once editing a command, cw to change word, $ to go to the end of the line, etc...
I do not buy "I'm a vim person, but I just use ctrl-R and the arrows", because you are basically limiting yourself just because you had not realised readline is a full editor. You have nothing to learn, just set the editor mode in your preferred editor mode, and start using it, trust me, you will start getting use to it and use its power very quickly.
BONUS: It' snot just bash! Any program that use readline can do the same! psql etc... use it (or a something like readline, because of GPL vs non-gpl etc...).
BONUS 2: You can use readline with software that don't use it, it's call rlwrap. Go ahead, use "rlwrap sqlplus" once, then try to use oracle without it!
So I +1 your comment. And I +1 the article too.
As readline was codeveloped with bash, I think it's incorrect to say it's not bash. It is bash by way of readline - additional information important for some contexts, not for others.
> cw to change word, $ to go to the end of the line, etc...
But not, sadly, ci" to change what's inside quotes.
----
As to your obviously troubling experiences with some vim users, I apologize on behalf of my sect. But tone down your characterizations - there are plenty of smug and superior emacs users as well. (For my part, I don't much care what others use as long as they actually learn their way around some sort of powerful editor.)
I certainly understand being skeptical of "vim modes" - they are often incomplete in painful ways. As mentioned above, I often run up against the limitations of bash vim mode when trying to change what's inside quotes.
{1..99} will give 1 2 3 4 5 .. 9 10 11 12 .. 98 99
{01..99} will give 01 02 03 04 05 .. 09 10 11 12 .. 98 99
And so on. I think it also works with letters.
$ echo {a..c}{1..5}
a1 a2 a3 a4 a5 b1 b2 b3 b4 b5 c1 c2 c3 c4 c5
It is worthwhile noting that brace expansion is strictly textual and is performed before any other expansion.Indeed it does. According to the man page : "When characters are supplied, the expression expands to each character lexicographically between x and y, inclusive, using the default C locale."
$ echo {a..z}
a b c d e f g h i j k l m n o p q r s t u v w x y z
But it does not seem to work with ranges outside ASCII such as "à..é", "あ..お", or smileys range, even though my locale should be ".UTF-8" compliant.
Also, you can specify an increment value :
$ echo {0..42..7}
0 7 14 21 28 35 42
$ echo {z..a..3}
z w t q n k h e b
I think 'x' and 'y' are probably the worst variable names they could have chosen for this sentence :)
And as your last example illustrates, downward ranges are automatically invoked:
$ echo {10..1}
10 9 8 7 6 5 4 3 2 1
As are negative endpoints (shown below with some automatic number formatting, which is turned on when either the first or the second endpoint is padded): $ echo {2..-002}
0002 0001 0000 -001 -002
I just noticed that all this is documented behavior -- another illustration of how rococo this shell has become. while true
clear
df
sleep 1
end while sleep 1; do
clear
df
doneI just don't see the point. Bash might have flaws, nothing is perfect, but it's one vital piece of software that most distros have installed.
I certainly don't demand that everything in Fish be an improvement over everything in bash for Fish to nonetheless be superior... but this was presented specifically as an example of how Fish is great, and I could just as well say "Guess what this does" of the obvious bash equivalent:
while true; do
clear
df
sleep 1
endIt works for both Vim & Bash.
Bash Shortcuts For Maximum Productivity [0]
[0] http://www.skorks.com/2009/09/bash-shortcuts-for-maximum-pro...
Is there something that goes through the words, instead? So I hit a key, it inserts the last word of the previous command, then I hit the key again and it replaces it with the penultimate word of the previous command?
I think using bang, I can do "!-3:1" to get the second word of the command three lines up?
I've heard more people say this than that GUI is faster. Also it really depends on what you are doing.
1: https://blog.codinghorror.com/revisiting-keyboard-vs-the-mou...
Think of DrRaket, Swift Playgrounds or Jupyter like experience.
alias ssh=’ssh -AX’
alias ls=’ls –color=auto’
Let me quote the Mercurial manual:> It is possible to create aliases with the same names as existing commands, which will then override the original definitions. This is almost always a bad idea![0]
I was recently bitten by this when running a build on a new machine. I was doing a
log -r "$revision"
and instead of getting one commit message (as usual), I was getting the entire log history up to $revision.I managed to find that Mercurial had made a breaking change[1] so that `log -fr` would now have the observed behavior. But I was only running `log -r`!
But on the old machine, I had in my .hgrc the alias
log=log -f
To top it off, I also had a comment with the above quote that this is "almost always a bad idea!" Consider me burned![0] https://www.selenic.com/mercurial/hgrc.5.html#alias
[1] https://www.mercurial-scm.org/wiki/UpgradeNotes#A3.4:_minor_...
>rsync ~/20160604/apache-tomcat-7.0.63/webapps/ROOT/contact.html apache-tomcat-1:/svr/apache-tomcat-7.0.63/webapps/ROOT/
I'm rsyncing the contact.html file to my website. Now I want to rsync the index.html page. I do this by:
1. Pressing the up arrow key to get the previous command.
2. Press and hold the back arrow key until it gets to "contact.html"
3. Press and hold backspace to delete "contact.html" and type "index.html"
My question is: How to quickly move the cursor to a location on the line. For example, in Vi I could do "F+c" twice to move to the first "c" if this were a text file. I know I can enabled Vi commands for Bash, but this seems cumbersome. There has to be a way in Bash to jump around the already typed line.
Otherwise, typing ^contact^index after your step 1 should also work.
> $ mroe file1 ; mroe file2
> $ !!:gs/mroe/more
But instead, you would do:
>$ rsync ~/20160604/apache-tomcat-7.0.63/webapp /ROOT/contact.html apache-tomcat-1:/svr/apache-tomcat-7.0.63/webapps/ROOT/
> $ !!:gs/contact/index
Typing "Ctrl-r aString" will recall the previous command and position the cursor where the string "aString" occurs. You can then Alt-d, Ctrl-w, whatever.
"\e[1;5C":forward-word
"\e[1;5D":backward-word
The readline manual shows more sophisticated argument operations. Zsh, IIRC, has more features for command processing.M-b: back one word
M-f: forward one word
C-a: beginning of line
C-e: end of line
I also don't like to use the arrow keys because they are so far away, so:
C-b: back one character
C-f: forward one character
C-p: previous command
C-n: next command
And since I'm making a list now anyway:
C-k: Kill to end of line.
C-u: Kill to beginning of line.
C-y: Yank (put/paste) last killed string. You can then cycle further through the kill ring with M-y.
But I have a question concerning Emacs movement: M-b and M-f are rather similar to vim's b and e, respectively, meaning they don't jump to the beginning/end of the non-whitespace-string. That's why vim has B and E. Is there anything similar in Emacs?
Alt+<number> followed by that goes to that <number> occurrence of the character, so "Alt+4 Ctrl+] c" would go to the 4th c. Ctrl+Alt+] searches backwards in the same way.
But I find just about anything better.
!!:s/contact/index/ ^contact^index alias r='fc -e - --' # if not already present r contact=index
or if you know ahead of time, do them both together
rsync ~/20160604/apache-tomcat-7.0.63/webapps/ROOT/{contact,index}.html
I don't need colors, or anything fancy in my prompt, but those two things I find to be really useful.
export PS1='[\u@\h \W](\!/$?)$ 'I featured it in the cron.weekly newsletter 2 weeks ago: https://www.cronweekly.com/issue-44/
A missing piece of information IMHO: Ubuntu now maps a nice readline features to PgUp and PgDn: history-search-backward and history-search-forward.
Type the beginning of a command line, and with PgUp-PgDn, you will traverse your history for the command lines beginning with what you have typed.
That's a no-brainer in my Bash life.
Note: to enable that feature in your Bash, here is a tutorial: http://dqxtech.net/blog/2011-03-06/linux-bash-history-pgup-p...
Also, look at the screen tips by the same author - http://samrowe.com/wordpress/2010/06/16/gnu-screen-quick-tip...
I have to admit, that -- at some time in the past -- I've even tried to activate vim mode. As a heavy vim user i thought it would make sense.
At the end I'm stuck with the Emacs-inspired (is it really Emacs?) shortcuts.
They seem to be the ones that make most sense in the short living, very interactive, shell command line:
- Arrows for going up/down one or two commands,
- ctrl-r for interactive searching in the history,
- ctrl-a for going back to the beginning of the row,
- ctrl-e to the end,
- del & and backscape for deleting a bunch of chars,
- in some case ctrl-w for deleting words backwards (mostly for deleting the url in the latest wget command),
- and, of course, tab completion.
When I'm in need for more complex interactions:
- I start vim and
- work with a mix of !! commands (shell that outputs the result in the current vim buffer),
- vim manipulations (vertical selections, ctrl-x-f, qq short living macros), A and I with a . repeat),
- join everything in a row and yank it and, finally,
- a :!ctrl-r" to run it.
When the interaction is even more complex, than it's time for a shell script.
Last resort being a Python script.
Now, why would I take the time to write `rm my-file{-01,-02,old}` and risk getting a typo into it, instead of relying on the tab-autocomplete?
does not work here on a mac, but i can think of using it!
thanks for mentioning.
the safest method for you is to edit your ~/.inputrc with vi(m). go to insert mode,
type "
type Ctrl-v
type PgUp (->a strange string is displayed),
type the following string ": history-search-backward
Do the same on another line for PgDn (replace backward with forward).
Save. Relaunch a Bash session. And that's it.
If you write `rm my-file{-01,-02,old}` and then press tab, it will expand it for you before you run it.
$ C-x C-e
# in vim
ipushd dir
do stuff
popd
<esc>:wq
Everything gets run.This takes whatever is piped in and loads it into the quickfix list. So I get locations out of anything with lines of the format "file:line: something" or "file:line:col: something".
Eg: git grep -n | cbuf
diff <(tar tzf f1.tgz) <(tar tzf f2.tgz)
Or diffs of diffs: diff <(git diff --cached) the-patch-alice-proposedOutside vi mode, C-x C-e does the same thing.
It's "edit-and-execute-command" in readline. Incidentally, this really does what it says on the tin: if you use "read -e" to enable readline support at a prompt, and you try to edit what you're inputting this way, it won't pass the result into the read - it will try to execute it.
> !$:<tab>
& -- repeat substitution
A -- absolute path resolving symbolic links
Q -- strip quotes
a -- absolute path
c -- PATH search for command
e -- leave only extension
g -- globally apply s or &
h -- head - strip trailing path element
l -- lower case all words
q -- quote to escape further substitutions
r -- root - strip suffix
s -- substitute string
t -- tail - strip directories
u -- upper case all words $ mount /mnt/floppy
$ mv !$/file_I_needed .
$ u!mo
The last command would umount(8) the floppy.I use !! all the time, specially when first using find to see which files I will operate on and then doing the actual operation:
$ find . -name '*Foo*.scala'
path/src/main/scala/foo/Foo.scala
path/src/test/scala/foo/FooSpec.scala
$ git add "$(!!)"
Shameless plug: I actually use nq, my find wrapper: https://github.com/rbonvall/nqIf you're unsure of a command, press insert a leading "#" to make it a comment (Up-Arrow, Ctrl-A, #, Enter). Then "fc" will load that command into $EDITOR where you can have full text edit capabilities before writing and exiting the file to execute the command.
I know there's some magic keystrokes to get into vi-mode from the command line but I can never remember them, whereas "fc" is pretty easy to remember for the rare occasion when I need it.
If you're in emacs mode, it's C-x C-e. Mnemonic: e for editor, x because it's emacs and lots of stuff starts with C-x
If you're in vi mode, it's v from normal mode, so if you're in insert mode it's escape, then v. Mnemonic: v for vi
M-# (i.e. alt-shift-3)
Comments the line currently being edited and places it at the top of history. Great when searching back through history and editing a line safely before executing it.Those are usually more important then speed.
wha?