forum.bitel.ru :: Просмотр темы - [5.2] Обработка cdr

08-08/08:01:49 INFO [Thread-22] dataloader - 7 Load data from: /opt/billing/phone/2012/07/01_00.zip
08-08/08:01:49 INFO [Thread-22] dataloader - 7 Set to load /opt/billing/phone/2012/07/01_00.zip
08-08/08:01:49 INFO [Thread-23] dataloader - 8 Load data from: /opt/billing/phone/2012/07/01_01.zip
08-08/08:01:49 INFO [Thread-23] dataloader - 8 Set to load /opt/billing/phone/2012/07/01_01.zip
08-08/08:01:50 INFO [Thread-0] dataloader - 7 End task => 0/0 sec. [358]
08-08/08:01:50 INFO [Thread-0] dataloader - 8 End task => 0/0 sec. [168]
08-08/08:01:54 INFO [Thread-0] dataloader - tariff.only.month=false store.incoming.calls=true
08-08/08:01:54 INFO [Thread-0] dataloader - Create new traffic cache
08-08/08:01:54 INFO [Thread-0] dataloader - Create new month item finder...
08-08/08:01:54 INFO [Thread-0] dataloader - Create new item finder...
08-08/08:01:54 INFO [Thread-0] RangeMapCache - (Re)loading costMap cache and geo codes for mid 4
08-08/08:01:54 INFO [Thread-0] dataloader - Item loaded By num: 11; by port: 0; rules: 0
08-08/08:01:54 INFO [Thread-0] CostMapCache - (Re)loading costMap cache and geo codes for mid 4
08-08/08:01:54 INFO [Thread-0] dataloader - proccess [01-07-2012 00:00:00; mid => 4; param => 1] ; records => 358; cl_ses => 0; in_ses => 0; op_ses => 0; time => 111/18 ms.
08-08/08:01:54 INFO [pool-1-thread-3] dataloader - proccess [01-07-2012 00:00:00; mid => 4; param => 1] session inserted => 4 ms.
08-08/08:01:54 INFO [Thread-0] dataloader - tariff.only.month=false store.incoming.calls=true
08-08/08:01:54 INFO [Thread-0] dataloader - Use zone traffic cache..
08-08/08:01:54 INFO [Thread-0] dataloader - Use month item cache..
08-08/08:01:54 INFO [Thread-0] dataloader - Use item cache...
08-08/08:01:54 INFO [Thread-0] dataloader - Item loaded By num: 11; by port: 0; rules: 0
08-08/08:01:54 INFO [Thread-0] dataloader - proccess [01-07-2012 01:00:00; mid => 4; param => 1] ; records => 168; cl_ses => 0; in_ses => 0; op_ses => 0; time => 49/0 ms.
08-08/08:01:54 INFO [pool-1-thread-4] dataloader - proccess [01-07-2012 01:00:00; mid => 4; param => 1] session inserted => 3 ms.

# генерация ошибки обработки, когда для CDR записи не найдено правила, 1 - включить
error.on.session.rule.notfound=0

[root@billing 07]# pwd
/opt/billing/phone/2012/07
[root@billing 07]# ls

[root@billing 07]# ftp
ftp> open ftp.bgbilling.ru
Trying 81.30.195.156...
Connected to ftp.bgbilling.ru (81.30.195.156).
220 (vsFTPd 2.0.5)
Name (ftp.bgbilling.ru:root): anonymous
331 Please specify the password.
Password:
230 Login successful.
Remote system type is UNIX.
Using binary mode to transfer files.
ftp> cd pub/bgbilling/phone/log/source_1/2007/09/
250 Directory successfully changed.
ftp> get 01_00.zip
local: 01_00.zip remote: 01_00.zip
227 Entering Passive Mode (81,30,195,156,183,39)
150 Opening BINARY mode data connection for 01_00.zip (4886 bytes).
226 File send OK.
4886 bytes received in 0,0123 secs (397,53 Kbytes/sec)
ftp> get 01_01.zip
local: 01_01.zip remote: 01_01.zip
227 Entering Passive Mode (81,30,195,156,95,56)
150 Opening BINARY mode data connection for 01_01.zip (2544 bytes).
226 File send OK.
2544 bytes received in 0,0119 secs (213,17 Kbytes/sec)
ftp> quit
221 Goodbye.

[root@billing 07]# ls
01_00.zip 01_01.zip

[root@billing 07]# tail -f ../../../log/dataloader.log
...

08-08/09:13:05 INFO [Thread-28] dataloader - 9 Load data from: /opt/billing/phone/2012/07/01_00.zip
08-08/09:13:05 INFO [Thread-28] dataloader - 9 Set to load /opt/billing/phone/2012/07/01_00.zip
08-08/09:13:06 INFO [Thread-0] dataloader - 9 End task => 0/0 sec. [358]
08-08/09:13:10 INFO [Thread-29] dataloader - 10 Load data from: /opt/billing/phone/2012/07/01_01.zip
08-08/09:13:10 INFO [Thread-29] dataloader - 10 Set to load /opt/billing/phone/2012/07/01_01.zip
08-08/09:13:10 INFO [Thread-0] dataloader - 10 End task => 0/0 sec. [168]
08-08/09:13:14 INFO [Thread-0] Setup - Load config for mid=4
08-08/09:13:14 INFO [Thread-0] dataloader - tariff.only.month=false store.incoming.calls=true
08-08/09:13:14 INFO [Thread-0] dataloader - Create new traffic cache
08-08/09:13:14 INFO [Thread-0] dataloader - Create new month item finder...
08-08/09:13:14 INFO [Thread-0] dataloader - Create new item finder...
08-08/09:13:14 INFO [Thread-0] RangeMapCache - (Re)loading costMap cache and geo codes for mid 4
08-08/09:13:14 INFO [Thread-0] dataloader - Item loaded By num: 11; by port: 0; rules: 0
08-08/09:13:14 INFO [Thread-0] CostMapCache - (Re)loading costMap cache and geo codes for mid 4
08-08/09:13:14 INFO [Thread-0] dataloader - proccess [01-07-2012 00:00:00; mid => 4; param => 1] ; records => 358; cl_ses => 0; in_ses => 0; op_ses => 0; time => 267/9 ms.
08-08/09:13:14 INFO [pool-1-thread-5] dataloader - proccess [01-07-2012 00:00:00; mid => 4; param => 1] session inserted => 3 ms.
08-08/09:13:14 INFO [Thread-0] dataloader - tariff.only.month=false store.incoming.calls=true
08-08/09:13:14 INFO [Thread-0] dataloader - Use zone traffic cache..
08-08/09:13:14 INFO [Thread-0] dataloader - Use month item cache..
08-08/09:13:14 INFO [Thread-0] dataloader - Use item cache...
08-08/09:13:14 INFO [Thread-0] dataloader - Item loaded By num: 11; by port: 0; rules: 0
08-08/09:13:15 INFO [Thread-0] dataloader - proccess [01-07-2012 01:00:00; mid => 4; param => 1] ; records => 168; cl_ses => 0; in_ses => 0; op_ses => 0; time => 194/0 ms.
08-08/09:13:15 INFO [pool-1-thread-6] dataloader - proccess [01-07-2012 01:00:00; mid => 4; param => 1] session inserted => 2 ms.
^C

[root@billing 07]# ls
[root@billing 07]# pwd
/opt/billing/phone/2012/07

Changing dir to /pub/bgbilling/5.2
Checking updates for dialup..
Found update for dialup build 343 packet dialup_5.2_347.zip updating to build 347
Checking updates for ipn..
Found update for ipn build 230 packet ipn_5.2_233.zip updating to build 233
Checking updates for npay..
Found update for npay build 183 packet npay_5.2_185.zip updating to build 185
Checking updates for reports..
Checking updates for card..
Found update for card build 179 packet card_5.2_181.zip updating to build 181
Checking updates for bill..
Found update for bill build 265 packet bill_5.2_270.zip updating to build 270
Checking updates for trayinfo..
Found update for trayinfo build 156 packet trayinfo_5.2_158.zip updating to build 158
Checking updates for ru.bitel.bgbilling.plugins.cashcheck..
Checking updates for ru.bitel.bgbilling.plugins.crm..
Found update for crm build 182 packet crm_5.2_186.zip updating to build 186
Checking updates for ru.bitel.bgbilling.plugins.documents..
Found update for documents build 142 packet documents_5.2_145.zip updating to build 145
Checking updates for ru.bitel.bgbilling.plugins.helpdesk..
Found update for helpdesk build 163 packet helpdesk_5.2_167.zip updating to build 167
Checking updates for mps..
Found update for mps build 151 packet mps_5.2_152.zip updating to build 152
Checking updates for voiceip..
Found update for voiceip build 183 packet voiceip_5.2_184.zip updating to build 184
Checking updates for phone..
Found update for phone build 240 packet phone_5.2_242.zip updating to build 242
Checking updates for ru.bitel.bgbilling.plugins.organizer..
Found update for organizer build 57 packet organizer_5.2_58.zip updating to build 58
Checking updates for ru.bitel.bgbilling.plugins.cladr..
Checking updates for ru.bitel.bgbilling.plugins.dispatch..
Found update for dispatch build 38 packet dispatch_5.2_40.zip updating to build 40
Checking updates for dba..
Checking updates for inet..
Found update for inet build 924 packet inet_5.2_935.zip updating to build 935
Checking updates for server..
Found update for BGBillingServer build 1229 packet update_5.2.zip updating to build 1248
Checking updates for update_lib..
Checking updates for client..
Found update for BGBillingClient build 1007 packet update_5.2.zip updating to build 1013
Install 16 updates (y/n):

1239 18.07.2012 12:57:30 ИСПРАВЛЕНО При загрузки логов телефонии , ресурсы файлов не закрывались.

Автор:	Andrew [ 08 авг 2012, 10:07 ]
Заголовок сообщения:	[5.2] Обработка cdr
Настроил модуль. Подсунул тестовые данные с фтп. Сделал обработку логов. Код: 08-08/08:01:49 INFO [Thread-22] dataloader - 7 Load data from: /opt/billing/phone/2012/07/01_00.zip 08-08/08:01:49 INFO [Thread-22] dataloader - 7 Set to load /opt/billing/phone/2012/07/01_00.zip 08-08/08:01:49 INFO [Thread-23] dataloader - 8 Load data from: /opt/billing/phone/2012/07/01_01.zip 08-08/08:01:49 INFO [Thread-23] dataloader - 8 Set to load /opt/billing/phone/2012/07/01_01.zip 08-08/08:01:50 INFO [Thread-0] dataloader - 7 End task => 0/0 sec. [358] 08-08/08:01:50 INFO [Thread-0] dataloader - 8 End task => 0/0 sec. [168] 08-08/08:01:54 INFO [Thread-0] dataloader - tariff.only.month=false store.incoming.calls=true 08-08/08:01:54 INFO [Thread-0] dataloader - Create new traffic cache 08-08/08:01:54 INFO [Thread-0] dataloader - Create new month item finder... 08-08/08:01:54 INFO [Thread-0] dataloader - Create new item finder... 08-08/08:01:54 INFO [Thread-0] RangeMapCache - (Re)loading costMap cache and geo codes for mid 4 08-08/08:01:54 INFO [Thread-0] dataloader - Item loaded By num: 11; by port: 0; rules: 0 08-08/08:01:54 INFO [Thread-0] CostMapCache - (Re)loading costMap cache and geo codes for mid 4 08-08/08:01:54 INFO [Thread-0] dataloader - proccess [01-07-2012 00:00:00; mid => 4; param => 1] ; records => 358; cl_ses => 0; in_ses => 0; op_ses => 0; time => 111/18 ms. 08-08/08:01:54 INFO [pool-1-thread-3] dataloader - proccess [01-07-2012 00:00:00; mid => 4; param => 1] session inserted => 4 ms. 08-08/08:01:54 INFO [Thread-0] dataloader - tariff.only.month=false store.incoming.calls=true 08-08/08:01:54 INFO [Thread-0] dataloader - Use zone traffic cache.. 08-08/08:01:54 INFO [Thread-0] dataloader - Use month item cache.. 08-08/08:01:54 INFO [Thread-0] dataloader - Use item cache... 08-08/08:01:54 INFO [Thread-0] dataloader - Item loaded By num: 11; by port: 0; rules: 0 08-08/08:01:54 INFO [Thread-0] dataloader - proccess [01-07-2012 01:00:00; mid => 4; param => 1] ; records => 168; cl_ses => 0; in_ses => 0; op_ses => 0; time => 49/0 ms. 08-08/08:01:54 INFO [pool-1-thread-4] dataloader - proccess [01-07-2012 01:00:00; mid => 4; param => 1] session inserted => 3 ms. 1. ДЛ удаляет логи из папки (после обработки файлов нет) 2. В журнале пусто, хотя в теории должен ругнуться на отсутствие тарифа, номеров и тд. Версия последняя.

Автор:	Phricker [ 08 авг 2012, 10:23 ]
Заголовок сообщения:	Re: [5.2] Обработка cdr
Andrew писал(а): 1. ДЛ удаляет логи из папки (после обработки файлов нет) 2. В журнале пусто, хотя в теории должен ругнуться на отсутствие тарифа, номеров и тд. 1) Впервые слышу О.о 2) Код: # генерация ошибки обработки, когда для CDR записи не найдено правила, 1 - включить error.on.session.rule.notfound=0

Автор:	Andrew [ 08 авг 2012, 11:19 ]
Заголовок сообщения:	Re: [5.2] Обработка cdr
расписываю =) Смотрим папку и там пусто Код: [root@billing 07]# pwd /opt/billing/phone/2012/07 [root@billing 07]# ls Идем на фтп и скачиваем два файла на обработку Код: [root@billing 07]# ftp ftp> open ftp.bgbilling.ru Trying 81.30.195.156... Connected to ftp.bgbilling.ru (81.30.195.156). 220 (vsFTPd 2.0.5) Name (ftp.bgbilling.ru:root): anonymous 331 Please specify the password. Password: 230 Login successful. Remote system type is UNIX. Using binary mode to transfer files. ftp> cd pub/bgbilling/phone/log/source_1/2007/09/ 250 Directory successfully changed. ftp> get 01_00.zip local: 01_00.zip remote: 01_00.zip 227 Entering Passive Mode (81,30,195,156,183,39) 150 Opening BINARY mode data connection for 01_00.zip (4886 bytes). 226 File send OK. 4886 bytes received in 0,0123 secs (397,53 Kbytes/sec) ftp> get 01_01.zip local: 01_01.zip remote: 01_01.zip 227 Entering Passive Mode (81,30,195,156,95,56) 150 Opening BINARY mode data connection for 01_01.zip (2544 bytes). 226 File send OK. 2544 bytes received in 0,0119 secs (213,17 Kbytes/sec) ftp> quit 221 Goodbye. Смотрим снова папку и там естественно появилось два файла Код: [root@billing 07]# ls 01_00.zip 01_01.zip Запускаем лог и делаем загрузку логов Код: [root@billing 07]# tail -f ../../../log/dataloader.log ... 08-08/09:13:05 INFO [Thread-28] dataloader - 9 Load data from: /opt/billing/phone/2012/07/01_00.zip 08-08/09:13:05 INFO [Thread-28] dataloader - 9 Set to load /opt/billing/phone/2012/07/01_00.zip 08-08/09:13:06 INFO [Thread-0] dataloader - 9 End task => 0/0 sec. [358] 08-08/09:13:10 INFO [Thread-29] dataloader - 10 Load data from: /opt/billing/phone/2012/07/01_01.zip 08-08/09:13:10 INFO [Thread-29] dataloader - 10 Set to load /opt/billing/phone/2012/07/01_01.zip 08-08/09:13:10 INFO [Thread-0] dataloader - 10 End task => 0/0 sec. [168] 08-08/09:13:14 INFO [Thread-0] Setup - Load config for mid=4 08-08/09:13:14 INFO [Thread-0] dataloader - tariff.only.month=false store.incoming.calls=true 08-08/09:13:14 INFO [Thread-0] dataloader - Create new traffic cache 08-08/09:13:14 INFO [Thread-0] dataloader - Create new month item finder... 08-08/09:13:14 INFO [Thread-0] dataloader - Create new item finder... 08-08/09:13:14 INFO [Thread-0] RangeMapCache - (Re)loading costMap cache and geo codes for mid 4 08-08/09:13:14 INFO [Thread-0] dataloader - Item loaded By num: 11; by port: 0; rules: 0 08-08/09:13:14 INFO [Thread-0] CostMapCache - (Re)loading costMap cache and geo codes for mid 4 08-08/09:13:14 INFO [Thread-0] dataloader - proccess [01-07-2012 00:00:00; mid => 4; param => 1] ; records => 358; cl_ses => 0; in_ses => 0; op_ses => 0; time => 267/9 ms. 08-08/09:13:14 INFO [pool-1-thread-5] dataloader - proccess [01-07-2012 00:00:00; mid => 4; param => 1] session inserted => 3 ms. 08-08/09:13:14 INFO [Thread-0] dataloader - tariff.only.month=false store.incoming.calls=true 08-08/09:13:14 INFO [Thread-0] dataloader - Use zone traffic cache.. 08-08/09:13:14 INFO [Thread-0] dataloader - Use month item cache.. 08-08/09:13:14 INFO [Thread-0] dataloader - Use item cache... 08-08/09:13:14 INFO [Thread-0] dataloader - Item loaded By num: 11; by port: 0; rules: 0 08-08/09:13:15 INFO [Thread-0] dataloader - proccess [01-07-2012 01:00:00; mid => 4; param => 1] ; records => 168; cl_ses => 0; in_ses => 0; op_ses => 0; time => 194/0 ms. 08-08/09:13:15 INFO [pool-1-thread-6] dataloader - proccess [01-07-2012 01:00:00; mid => 4; param => 1] session inserted => 2 ms. ^C Смотрим снова папку Код: [root@billing 07]# ls [root@billing 07]# pwd /opt/billing/phone/2012/07

Автор:	Phricker [ 08 авг 2012, 11:40 ]
Заголовок сообщения:	Re: [5.2] Обработка cdr
Эээээээээээээээ... Ууууууууууу... 2Разработчики. Что еще теперь необходимо проверять после обновлений? У меня тоже самое. В базе загруженные данные есть - исходные логи потерлись. Произошло после обновления от Цитата: log_update_28_00:19:19 Код: Changing dir to /pub/bgbilling/5.2 Checking updates for dialup.. Found update for dialup build 343 packet dialup_5.2_347.zip updating to build 347 Checking updates for ipn.. Found update for ipn build 230 packet ipn_5.2_233.zip updating to build 233 Checking updates for npay.. Found update for npay build 183 packet npay_5.2_185.zip updating to build 185 Checking updates for reports.. Checking updates for card.. Found update for card build 179 packet card_5.2_181.zip updating to build 181 Checking updates for bill.. Found update for bill build 265 packet bill_5.2_270.zip updating to build 270 Checking updates for trayinfo.. Found update for trayinfo build 156 packet trayinfo_5.2_158.zip updating to build 158 Checking updates for ru.bitel.bgbilling.plugins.cashcheck.. Checking updates for ru.bitel.bgbilling.plugins.crm.. Found update for crm build 182 packet crm_5.2_186.zip updating to build 186 Checking updates for ru.bitel.bgbilling.plugins.documents.. Found update for documents build 142 packet documents_5.2_145.zip updating to build 145 Checking updates for ru.bitel.bgbilling.plugins.helpdesk.. Found update for helpdesk build 163 packet helpdesk_5.2_167.zip updating to build 167 Checking updates for mps.. Found update for mps build 151 packet mps_5.2_152.zip updating to build 152 Checking updates for voiceip.. Found update for voiceip build 183 packet voiceip_5.2_184.zip updating to build 184 Checking updates for phone.. Found update for phone build 240 packet phone_5.2_242.zip updating to build 242 Checking updates for ru.bitel.bgbilling.plugins.organizer.. Found update for organizer build 57 packet organizer_5.2_58.zip updating to build 58 Checking updates for ru.bitel.bgbilling.plugins.cladr.. Checking updates for ru.bitel.bgbilling.plugins.dispatch.. Found update for dispatch build 38 packet dispatch_5.2_40.zip updating to build 40 Checking updates for dba.. Checking updates for inet.. Found update for inet build 924 packet inet_5.2_935.zip updating to build 935 Checking updates for server.. Found update for BGBillingServer build 1229 packet update_5.2.zip updating to build 1248 Checking updates for update_lib.. Checking updates for client.. Found update for BGBillingClient build 1007 packet update_5.2.zip updating to build 1013 Install 16 updates (y/n): Все файлы которые созданы после этого обновления - пропали, хотя в базе есть данные по ним. Все файлы которые были созданы до обновления - на месте. Я не делал в источниках "Загрузить логи"

Автор:	Phricker [ 08 авг 2012, 12:12 ]
Заголовок сообщения:	Re: [5.2] Обработка cdr

forum.bitel.ru http://forum.bitel.ru/

[5.2] Обработка cdr http://forum.bitel.ru/viewtopic.php?f=10&t=7060	Страница 1 из 1

Автор:	Phricker [ 08 авг 2012, 19:42 ]
Заголовок сообщения:	Re: [5.2] Обработка cdr
ап

Автор:	Andrew [ 09 авг 2012, 11:50 ]
Заголовок сообщения:	Re: [5.2] Обработка cdr
10 апов) ну неудобно отлаживать модуль( каждый раз нужно парсить все...

Автор:	stark [ 09 авг 2012, 15:03 ]
Заголовок сообщения:	Re: [5.2] Обработка cdr
Это на самом деле сломалось в этом билде Код: 1239 18.07.2012 12:57:30 ИСПРАВЛЕНО При загрузки логов телефонии , ресурсы файлов не закрывались. Исправили, обновление выложено.

Страница 1 из 1	Часовой пояс: UTC + 5 часов [ Летнее время ]
Powered by phpBB® Forum Software © phpBB Group http://www.phpbb.com/