I've spent quite some time looking at those histograms, but I haven't found a good way to display it usefully yet.
The most popular commands are 'git', 'ls', and 'cd', and the table of most used commands is too long to be able to easily digest. Any suggestions would be appreciated, though!
It'd be awesome to see a dump of the data so that we can examine it on our own - many people may think of ways to use it that you haven't, or draw different conclusions from it. :D
Yeah! This is something that I'm interested in, but there are a bunch of privacy issues with a raw data dump (references to specific files/URLs and possibly passwords), and I haven't gotten around to making sure it's safe yet.
(note: I haven't actually seen any passwords, but that doesn't mean there aren't any)
Oh, that totally skipped my mind. Maybe run something to recognize URLs (replace with $URL, or some kind of placeholder), and then try to obfuscate filenames and the like in a similar way? By normalizing the data like this, you could get much better results with regards to command line switches and the like.
I would have to guess that the first "word" with the command only is clean? Have you seen any evidence to the contrary? That data set alone would tell an interesting story.
Excellent point. I'm definitely going to put that caveat at the beginning of any analysis I post. (and thanks to ctrl_freak for posting an alternative!)
Thanks for the link in 5)! That's really useful.
I really like the two visualizations you've made -- I'll definitely look into incorporating some of those ideas when I have time.