This is disruptive when you use counsel-find-file to quickly jump to another file in or near the current directory. There's already gf for this sort of thing anyway.
