forum.bitel.ru
http://forum.bitel.ru/

flow-tools проблемы...
http://forum.bitel.ru/viewtopic.php?f=7&t=701		 Страница 1 из 1
Автор:  Roy [ 24 янв 2008, 20:18 ]
Заголовок сообщения:  flow-tools проблемы...
Проблема со связкой.

запускаю вручную

billy# ./flow2bitel.sh
java.net.SocketTimeoutException: Receive timed out
at java.net.PlainDatagramSocketImpl.receive0(Native Method)
at java.net.PlainDatagramSocketImpl.receive(PlainDatagramSocketImpl.java:136)
at java.net.DatagramSocket.receive(DatagramSocket.java:712)
at bitel.billing.server.netflow.ipn.Collector.executeCommand(Collector.java:102)
at bitel.billing.server.netflow.ipn.Collector.main(Collector.java:63)
Error in param list
billy#

скрипт:

billy# cat flow2bitel.sh
#!/bin/sh

year=`date \+\%Y`
mon=`date \+\%m`
day=`date \+\%d`
hour=`date \+\%H`

flow_sources="/mysql/flows/rt94"

bg_prefix="/usr/local/BGIPNNetflowCollector"
bg_loader="/usr/local/BGIPNNetflowCollector/netflow.sh"

my_name=`dirname $0`/`basename $0 | awk -F. '{print $1}'`
bg_converter=$my_name.bin
LOG=$my_name.log

sleep 10

echo -n "Started $0 withh pid=$$ at " >>$LOG
date >>$LOG
echo Working on file $1 >>$LOG

#load_date=`basename $1 | awk -F. '{print $2}' | awk -F- '{print $1"."$2"."$3}'`
#load_time=`basename $1 | awk -F. '{print $3}' | awk '{print substr($1, 1, 2) ":" substr($1, 3, 2)}'`
#year=`echo $load_date | awk -F. '{print $1}'`
#mon=`echo $load_date | awk -F. '{print $2}'`
#day=`echo $load_date | awk -F. '{print $3}'`
#hour=`echo $load_time | awk -F: '{print $1}'`

sources=`$bg_loader sourcelist`

cmd_convert=""

for i in `echo $sources | sed 'y/;/\n/'`
do
address=`echo $i | awk -F: '{print $1}'`
source_id=`echo $i | awk -F: '{print $2}'`

cur_dir="$bg_prefix/source_$source_id/$year/$mon/$day"

[ ! -d $cur_dir ] ; mkdir -p $cur_dir

cmd_convert="$cmd_convert $cur_dir/log_$hour $address "
done

filelist=""

for i in `echo $flow_sources`
do
cfile=`ls $i/$year/$year-$mon/$year-$mon-$day/ft-v05.$year-$mon-$day.16*`
filelist="$cfile $filelist"
done

echo $bg_converter $cmd_convert sb $filelist >>$LOG
$bg_converter $cmd_convert sb $filelist >>$LOG

for i in `echo $sources | sed 'y/;/\n/'`
do
source_id=`echo $i | awk -F: '{print $2}'`
echo $bg_loader isload $source_id $year-$mon-$day-$hour >>$LOG
$bg_loader isload $source_id $year-$mon-$day-$hour >>$LOG
done

echo -n "Finished $0 with pid=$$ at " >>$LOG
date >>$LOG
billy#

Все файлы существуют...

Запуск вручную:

billy# ./flow2bitel.bin /mysql/flows/rt94/log1 81.9.104.138 sb /mysql/flows/rt94/2008/2008-01/2008-01-24/ft-v05.2008-01-24.134258+0000
Work on file /mysql/flows/rt94/2008/2008-01/2008-01-24/ft-v05.2008-01-24.134258+0000
Lines in /mysql/flows/rt94/log1: 0
Total lines: 166278

Я что-то гдето упустил?
Автор:  MiB [ 25 янв 2008, 12:57 ]
Заголовок сообщения: 
аналогичная проблема с одним из раутеров:
Цитата:
Started /usr/local/sbin/flow2bitel.sh withh pid=31707 at Чтв Янв 24 13:00:10 MSK 2008
Working on file 2008/2008-01/2008-01-24/ft-v05.2008-01-24.120001+0300
/usr/local/sbin/flow2bitel.bin /usr/local/BGIPNNetflowCollector/log/flow/source_2/2008/01/24/log_12 10.10.10.1 /usr/local/BGIPNNetflowCollector/log/flow/source_1/2008/01/24/log_12 10.11.10.1 sb /var/flows/vrn/2008/2008-01/2008-01-24/ft-v05.2008-01-24.120000+0300 /var/flows/lptsk/2008/2008-01/2008-01-24/ft-v05.2008-01-24.120001+0300
Work on file /var/flows/vrn/2008/2008-01/2008-01-24/ft-v05.2008-01-24.120000+0300
Work on file /var/flows/lptsk/2008/2008-01/2008-01-24/ft-v05.2008-01-24.120001+0300
Lines in /usr/local/BGIPNNetflowCollector/log/flow/source_2/2008/01/24/log_12: 0
Lines in /usr/local/BGIPNNetflowCollector/log/flow/source_1/2008/01/24/log_12: 10020
Total lines: 4239060
/usr/local/BGIPNNetflowCollector/netflow.sh isload 2 2008-01-24-12
OK log is marked, process started..
/usr/local/BGIPNNetflowCollector/netflow.sh isload 1 2008-01-24-12
OK log is marked, process started..
Finished /usr/local/sbin/flow2bitel.sh with pid=31707 at Чтв Янв 24 13:00:16 MSK 2008


при ручном запуске аналогично.
Автор:  Roy [ 25 янв 2008, 18:16 ]
Заголовок сообщения: 
в логах:

Started /usr/local/BGBillingServer/flow2bitel-15min.sh withh pid=6393 at Fri Jan 25 15:00:00 UTC 2008
Working on file 2008/2008-01/2008-01-25/ft-v05.2008-01-25.144500+0000
/usr/local/BGBillingServer/flow2bitel-15min.bin /usr/local/BGIPNNetflowCollector/source_1/2008/01/25/log_00 81.9.104.238 /usr/local/BG
IPNNetflowCollector/source_2/2008/01/25/log_00 81.9.104.254 sb
/usr/local/BGIPNNetflowCollector/netflow.sh isload 1 2008-01-25-00
OK log is marked, process started..
/usr/local/BGIPNNetflowCollector/netflow.sh isload 2 2008-01-25-00
OK log is marked, process started..
Finished /usr/local/BGBillingServer/flow2bitel-15min.sh with pid=6393 at Fri Jan 25 15:00:02 UTC 2008
Страница 1 из 1 Часовой пояс: UTC + 5 часов [ Летнее время ]
Powered by phpBB® Forum Software © phpBB Group
http://www.phpbb.com/