R-fx Networks

LMD: One Year Later

by on Nov.08, 2010, under Development, My Blog

With my move back to Canada behind me and adjusting to some new routines with life, its about time to get back into the mix with the projects. Though things have been slow the last couple of months, it has not stopped me from making sure regular and prompt malware updates are released.

Today, we reflect on the first year of Linux Malware Detect, which was released in a very infantile beta release about a year ago. The project has evolved in allot of ways from its original goals, it has certainly changed in every way for the better. What was originally to be a closed project, relegated to mostly internal work related needs, ended up like most of my projects morphing into a public release. The first release saw the world with less than 200 signatures, no reliable signature update method, manual upgrade options and very flawed scanning and detection methods (v 0.7<). Now, we sit at version 1.3.6, with 4,813 signatures, a scanning method that though still needs some work, is far superior than what was originally in place, a detection routine based on solid md5 hashes and hex signatures. We have cleaner rules that can clean some nasty injected malware, we got a fully functional quarantine and restore system, reporting system, real-time file based monitoring, integrated signature updater and version updater and a vibrant community of users that regularly submit malware for review. Yes, LMD has grown up!

The most grown-up part of LMD has to be how signatures are handled and how the processing of them is almost an entirely automated process now, this was detailed a little more in Signature Updates & Threat Database posted in September. The key part here though, is “almost entirely automated”, everyday that the processing scripts run to bring in new malware, there is always a number of files that cant be processed automatically and these are moved to a manual review queue. With how busy life has been the last couple of months, the review queue has slowly risen to 1,097 files pending review. This queue is at the top of my list for tackling over the next couple of days and weeks, its allot of work to review that much malware but it will get done. Many of the files to review are actual user-submissions so if you did submit something and find its still not detected by LMD, this would be why :).

There is still allot on the to-do list for LMD going forward, with the upcoming release of version 2.0 we will see some changes in how LMD does business. The first and to me the biggest will be optional usage statistics, which will allow users to have LMD report anonymized statistics back to rfxn.com. These statistics will show us which malware hits are found on your servers, which in turn contributes towards better focus on what type of malware threats are prioritized in the daily processing queue for hashing & review. The statistics will also help create informative profiles on the soon-to-be-released dailythreats.org web site about how maldet is used and what are the most prevalent threats in the wild.

Other additions to LMD 2.0 will be a refined scanner that will provide greater speed with large file sets (50k – 1M+ files), an ability to fork scans to the background, better and more predictable logging format for 3rd party processing of LMD log data, redesigned reporting system, full BSD support, ability to create custom signatures from the LMD command line, expanded cleaner rules, wildcard support for exclude paths, a number of security and bug refinements and as always, more signatures.

If you have any feature requests for LMD 2.0, go ahead and post them as a comment and I will make sure they get added to the list. Thank you to everyone who continues to support rfxn.com projects through donations, feedback and by just using & spreading the word about the projects. I look forward to another year of LMD and seeing it become the premier malware detection tool for Linux and all Unix variant OS’s.

:, , ,

7 Comments for this entry

  • Duane Gordon

    I second that! Data recover is crucial with any business. In order to keep things running smoothly in case of an emergency you need to be able to access your data.

  • Alan Miles

    Data recovery is an important factor when you are dealing with operating system. If a operating system crashes, there are chances of data getting lost. London data recovery provides effective techniques to save your data from any crisis.

  • Knuspergilb

    Hi there.. nice App.

    You should extract the current system editor and use this instead of nano as default.

    Thanks :)

  • Sean

    Ooh, one last thing. We see TONS of javascript and PHP injections into files, so it’d be great if LMD could intelligently strip those bad tags out and leave the rest of the file alone. Usually they’ll be PHP gzinflate(base64decode(… stuff.

  • Sean

    Please think about making the next version implement some form of map / reduce so it can work in parallel across multiple cores. The easiest way to do this would be to build the file list, then break the list into as many sections as there are CPU cores. The more efficient way to do this (in order not to create so much random seek disk I/O) would be to run through the list and “round robin” the CPUs so coreA gets file1, coreB gets file2, coreC gets file3, etc.

    To do this, you’d have to implement some stack manager / background threading manager in bash…it’s possible, but ugly.

  • Constantino Pinto

    Este es un muy buen proyecto confiamos en el en mas de 40 servidores…
    Gracias Ryan

  • Peter M. Abraham

    Canada is a beautiful country; there are times I would rather live there than in the states.

    If you can black box LMD where you have the stand-alone application plus the ability to tie it into ftp services such as proftpd and others, that would be great. Especially if such a tie in, did not require recompiles.

    Thank you, and welcome home.

Leave a Reply

Looking for something?

Use the form below to search the site:

Site Links

A few links to navigate our site quicker...