Follow @Openwall on Twitter for new release announcements and other news
[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Message-ID: <20120818065751.GA26464@openwall.com>
Date: Sat, 18 Aug 2012 10:57:51 +0400
From: Solar Designer <solar@...nwall.com>
To: john-users@...ts.openwall.com
Subject: Re: Passphrase Creation

Hi Kevin,

Thank you for posting, as well as for being with us for the contest.

What hash types did you test this on in the contest?

On Fri, Aug 17, 2012 at 10:04:35AM -0600, Kevin Young wrote:
> I also create a no-space version at the same time. (Is there a mangling
> rule that can handle this?)

Yes.  It's either:

@?w

or:

@ :

depending on whether you want to remove all whitespace characters (both
space and tabs) or just the space character.  In the latter rule, the
colon (a no-op command) prevents the would-be trailing space from being
inadvertently removed when editing the conf file.

> Step 6. Optimize and reduce
> As expected there are lot of duplicates so my script performs a dictionary
> sort and filters out the duplicates (sort and uniq). I also filter out
> (grep) things like open source verbiage, distribution notices, credits, etc.

FWIW, the "unique" program included with JtR is generally a lot faster
than "sort -u" (or "sort | uniq"), but you may need to tune its memory
usage (set it to the max of 2 GB with "-mem=25" in jumbo if you can
afford that - which I guess you can given modern computers' RAM sizes).
Of course, the result is different (not sorted), which may be good or
bad depending on your input data and your needs.

GNU sort may also be made a lot faster by letting it use more memory,
e.g. "sort -S 14G" works well for me on a 16 GB RAM machine (and at this
setting it may even outperform our "unique", which is limited to 2 GB,
as long as the input is large enough).

Alexander

Powered by blists - more mailing lists

Confused about mailing lists and their use? Read about mailing lists on Wikipedia and check out these guidelines on proper formatting of your messages.