Sysop Blog » Uncategorized

using find plus xargs with whitespace

admin — Wed, 21 Apr 2010 20:38:12 +0000

Often I find myself needing to search the filesystem or a particular directory for anything containing a certain phrase.
This was done by find . | xargs grep “phrase”
However if a file or directory contained a space or any other whitespace in the name it would barf.

An easy way to overcome this is to run find like this:
find . -print0 | xargs -0 grep “phrase”

What this does is tells find to print the path to the file and terminate it with a NULL character. Then “-0″ tells xargs to split arguments on NULL instead of whitespace.

Akismet Spam Assassin Plugin

admin — Wed, 09 Dec 2009 20:05:00 +0000

This is a plugin I wrote a while back to test using Akismet with spam assassin for outbound email coming off our web cluster. It seemed to work nicely and caught a large volume of spam with not too many false positives. We didn’t end up using it because of the prices of the commercial license the Akismet folks wanted. Anyways I thought I would post it here in case anyone was interested and before it got lost forever in a clutter of files.

#package sa_akismet; use strict; use Mail::SpamAssassin; use Mail::SpamAssassin::Plugin; use Akismet;


our @ISA = qw(Mail::SpamAssassin::Plugin);
sub new {

    my ($class, $mailsa) = @_;

    $class = ref($class) || $class;

    my $self = $class->SUPER::new($mailsa);

    bless ($self, $class);

    $self->register_eval_rule ("check_sa_akismet");

    return $self;

}
sub parse_config {

  my ($self, $opts) = @_;
  my $key = $opts->{key};
  if ($key eq 'akismet_api_key') {

    $opts->{conf}->{api_key} = $opts->{value};

    $self->inhibit_further_callbacks();

    return 1;

  }

  if ($key eq 'akismet_url') {

    $opts->{conf}->{akismet_url} = $opts->{value};

    $self->inhibit_further_callbacks();

    return 1;

  }
  return 0;

}
sub check_sa_akismet {

  my ($self, $permsgstatus) = @_;

  my $array = $permsgstatus->get_decoded_stripped_body_text_array();

  my $str = join (' ', @$array);

  $str =~ s/\s+/ /gs;
  my $rule_name = "check_sa_akismet";

  my $api_key =  $permsgstatus->{conf}->{api_key};

  my $url     =  $permsgstatus->{conf}->{akismet_url};

  my $email_name =  $permsgstatus->get("From:name");

  my $email_addr =  $permsgstatus->get("From:addr");

  my $userip = "10.10.10.11";

     $userip =  $permsgstatus->get("X-Remote-Ip:");

  if($userip eq "") {

      $userip = "10.10.10.11";

  }

  my $akismet = Net::Akismet->new(

		KEY => "$api_key",

		URL => "$url",

                ) or die('Key verification failure!');
  my $verdict = $akismet->check(

		USER_IP                 => "$userip",

		COMMENT_USER_AGENT      => 'Mozilla/5.0',

		COMMENT_CONTENT         => "$str",

		COMMENT_AUTHOR          => "$email_name",

		COMENT_AUTHOR_EMAIL     => "$email_addr",

		REFERRER                => "$url",

	) or die("Is the server here? $api_key $url $userip ");
  if ('true' eq $verdict) {

    $permsgstatus->got_hit("$rule_name", "");

  }
 return 0;

}

1;

Back Plates keep more then just dust out

admin — Tue, 02 Sep 2008 22:19:54 +0000

I received a call from a old co-worker today needing help to trouble shoot a T1 customer of his. The line kept bouncing up and down. The telco checked the line and said it looked fine up to the CSU/DSU. After talking to him for a few minutes and him explaining the situation to me I told him we should replace the router. I told him to hook it up to a console so I could copy the config off of it. During this conversation he kept telling me how there was rat crap all over the place and how bad the place smelt. When he got the router to a console that I could log into I saw the output that shows below. He also told me that the router was missing one of the WIC card slots and rat crap had actually poured out of the router when he tipped on its back. Rats in the router anyone?

program load complete, entry point: 0×80008000, size: 0x7ee488
Self decompressing the image : #################################################
################################################################################
######## [OK]

Smart Init is enabled
smart init is sizing iomem
ID            MEMORY_REQ         TYPE
MainBoard       0X00027A80 1720
0X000F3BB0 public buffer pools
0X00211000 public particle pools
0X0002          0X0000DC00 Card in slot 1
TOTAL:          0X0033A230

If any of the above Memory Requirements are
“UNKNOWN”, you may be using an unsupported
configuration or there is a software problem and
system operation may be compromised.

Memory required: 36400364 bytes, Memory available: 33554432 bytes
INSUFFICIENT MEMORY TO LOAD IMAGE!
The difference between Memory required and Memory available is the additional
memory you need to run the router. Alternatel
may cause the memory requirement to decrease, and may allow you to at least
use the router with reduced functionality until you get more memory.

*** System received a Software forced crash ***
signal= 0×17, code= 0×200, context= 0x8000620c
PC = 0xffffffff, Vector = 0×200, SP = 0xffffffff

System Bootstrap, Version 12.0(3)T, RELEASE SOFTWARE (fc1)
Copyright (c) 1999 by cisco Systems, Inc.
C1700 platform with 32768 Kbytes of main memory

$$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $
$$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $
*** line too large ***

$$ large ***

monitor: command “large” not found
$$ und

monitor: command “und” not found
$$ not found

monitor: command “not” not found
$$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$
$$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $$ $
*** line too large ***

AND it continues to repeat from there….

Stay tuned for pictures of dead rats or whatever we may find inside the router.

When perl and rpm don’t get along

admin — Wed, 30 Apr 2008 19:29:06 +0000

Sometimes when building rpm packages you will get an rpm that requires a file that it already contains. This seems pretty lame (which it is) but here is an example and a workaround.

Building a package for freepbx we see this output:
rpmbuild -ba freepbx.spec --------snip----------------- Provides: config(freepbx) = 2.4.0-0 Requires(interp): /bin/sh /bin/sh Requires(rpmlib): rpmlib(CompressedFileNames) <= 3.0.4-1 rpmlib(PayloadFilesHavePrefix) <= 4.0-1 Requires(post): /bin/sh Requires(postun): /bin/sh Requires: /bin/bash /usr/bin/env /usr/bin/perl /usr/bin/php config(freepbx) = 2.4.0-0 perl(DBI) perl(FindBin) perl(retrieve_parse_amportal_conf.pl)

The file we don’t want is: “perl(retrieve_parse_amportal_conf.pl)”

What rpmbuild does is go through the list of files and run “ldd” against all executables to find required libraries.
It also goes through each perl file and looks for “use / require” flags to pull out required perl modules.
When a developer does a legitimate thing like ‘require “retrieve_parse_amportal_conf.pl“‘ to include functions and such into their program, rpmbuild sees that this file is needed adds it too it’s list of required files.

Now rpmbuild also goes through and looks for what packages/files perl programs provide. It does this by scanning through the files and looking for “package“. If you just have an include file with functions, you don’t have a complete module and won’t have the package statement either. Thus rpmbuild will never see your file provides itself! Fortunatly there are a couple work arounds.

In your perl file that rpmbuild is requiring you can define ‘ our $RPM_Provides = “yourfilename.pl” ‘. rpmbuild will pick this up and happily add it to the provided file list. The other method is slightly more complicated but works well if you don’t want to patch the source code.

In your rpm spec file under the %prep section after the %setup add the following code:
cat << \EOF > %{name}-req #!/bin/sh %{__perl_requires} $* |\ sed -e '/perl(yourperlfile.pl)/d' EOF %define __perl_requires %{_builddir}/%{name}-%{version}/%{name}-req chmod 755 %{__perl_requires}

Where yourperlfile.pl is the file you want to exclude from the rpm requires check.
This should make your rpm build hapily and exlude that file from the requires check.

If you want to see the actuall files rpmbuild runs take a look at:
/usr/lib/rpm/perl.prov
and
/usr/lib/rpm/perl.req