Добрый день,
с некоторых пор почему то "подвисают" тяжёлые задачи в планировщике (см. скрин). очередь может расти видимо бесконечно и висеть сколько угодно долго. я наблюдал за некоторыми процессами которые висели пару суток.
Рестарт сервера\шедулера\даталоадера решает проблему на пару перерасчетов, потом задачи начинают подвисать. причем никакой закономерности поймать не могу. на одном и том же договоре, в одном и том же месяце перерасчёта, может подвиснуть, а может перерасчитать.
в логах ниже поймал подвисшую задачу сразу после рестарта сервера.
на момент написания темы (спустя 15 минут) она все еще висит.
Код:
08-24/14:55:34 INFO [main] DefaultServerSetup - Binding javax.jms.ConnectionFactory[org.apache.activemq.ActiveMQConnectionFactory@113a53d] to java:comp/env/mq/connectionFactory
08-24/14:55:34 DEBUG [main] JNDIReferenceFactory - Creating reference: org.apache.activemq.ActiveMQConnectionFactory,org.apache.activemq.ActiveMQConnectionFactory@113a53d
08-24/14:55:34 INFO [main] DefaultServerSetup - Init DB connection pools
08-24/14:55:34 INFO [main] DefaultServerSetup - Binding JDBC pool "master" to java:comp/env/jdbc/master
08-24/14:55:34 INFO [main] DefaultServerSetup - Init trash pools..
08-24/14:55:34 INFO [main] Server - Starting BGBillingServer..
08-24/14:55:34 INFO [main] Server - HTTP Connector: *:8080
08-24/14:55:34 INFO [main] Server - Starting HTTP connector...
08-24/14:55:34 INFO [main] Server - HTTPS Connector: *:8443
08-24/14:55:34 INFO [main] Server - Starting HTTPS connector..
08-24/14:55:35 INFO [main] Server - Browsing installed modules and plugins...
08-24/14:55:35 INFO [main] Server - bill v.5.1 build 238 from 10.08.2011 16:39:44
08-24/14:55:35 INFO [main] Server - card v.5.1 build 170 from 07.07.2011 12:48:08
08-24/14:55:35 INFO [main] Server - dialup v.5.1 build 183 from 06.07.2011 14:13:51
08-24/14:55:35 INFO [main] Server - drweb v.5.1 build 52 from 23.08.2011 12:25:03
08-24/14:55:35 INFO [main] Server - ipn v.5.1 build 241 from 06.07.2011 14:18:05
08-24/14:55:35 INFO [main] Server - mps v.5.1 build 166 from 07.07.2011 13:54:59
08-24/14:55:35 INFO [main] Server - npay v.5.1 build 180 from 06.07.2011 17:35:06
08-24/14:55:35 INFO [main] Server - rentsoft v.5.1 build 8 from 11.05.2011 15:27:04
08-24/14:55:35 INFO [main] Server - reports v.5.1 build 176 from 27.06.2011 18:48:24
08-24/14:55:35 INFO [main] Server - rscm v.5.1 build 150 from 06.07.2011 14:17:40
08-24/14:55:35 INFO [main] Server - trayinfo v.5.1 build 146 from 20.05.2011 16:24:48
08-24/14:55:35 DEBUG [main] LocalEventProcessor - Add listener bitel.billing.server.ipn.Module$1@1b22920 to BG.LocalEvent.ru.bitel.bgbilling.kernel.event.events.GetErrorLogModulesEvent
08-24/14:55:35 INFO [main] Server - Add servlet for modules and plugins...
08-24/14:55:35 INFO [main] Server - Add mapping: bitel.billing.server.bill.PDFExecuter to /pdfexecuter
08-24/14:55:35 INFO [main] Server - Add mapping: bitel.billing.server.mps.MPSExecuter to /mpsexecuter/*
08-24/14:55:35 INFO [main] Server - Add mapping: ru.bitel.bgbilling.modules.rentsoft.server.RentsoftApi to /rentsoft_api/*
08-24/14:55:35 INFO [main] Server - Add mapping: bitel.billing.server.card.DealerExecuter to /dealer
08-24/14:55:35 INFO [main] Server - Add mapping: bitel.billing.server.card.idealer.IDealerExecuter to /idealer
08-24/14:55:35 INFO [main] Server - Add mapping: ru.bitel.bgbilling.modules.trayinfo.server.BalanceSender to /balance_sender
08-24/14:55:35 INFO [main] Server - Creating installed modules map...
08-24/14:55:35 INFO [main] server - Starting listen admin port 2005
08-24/14:55:36 INFO [main] AbstractTilesApplicationContextFactory - Initializing Tiles2 application context. . .
08-24/14:55:36 INFO [main] AbstractTilesApplicationContextFactory - Finished initializing Tiles2 application context.
08-24/14:55:36 INFO [main] TilesContainerFactory - Initializing Tiles2 container. . .
08-24/14:55:36 DEBUG [main] BaseLocaleUrlDefinitionDAO - Adding resource 'jndi:/localhost.localdomain/bgbilling/WEB-INF/tiles-defs.xml' to definitions factory.
08-24/14:55:36 DEBUG [main] Digester - register('-//Apache Software Foundation//DTD Tiles Configuration 2.0//EN', 'jar:file:/srv/BGBillingServer/lib/tiles-core.jar!/org/apache/tiles/resources/tiles-config_2_0.dtd'
08-24/14:55:36 DEBUG [main] Digester - register('-//Apache Software Foundation//DTD Tiles Configuration 2.1//EN', 'jar:file:/srv/BGBillingServer/lib/tiles-core.jar!/org/apache/tiles/resources/tiles-config_2_1.dtd'
08-24/14:55:36 INFO [main] TilesContainerFactory - Tiles2 container initialized
08-24/14:55:36 INFO [main] TilesAccess - Publishing TilesContext for context: org.apache.tiles.servlet.context.ServletTilesApplicationContext
08-24/14:55:42 DEBUG [http-8080-1] server - Web auth modes:
08-24/14:55:42 DEBUG [http-8080-1] server - 0 => 1
08-24/14:55:42 DEBUG [http-8080-1] server - 1 => 1
08-24/14:55:42 DEBUG [http-8080-1] server - 4 => 1
08-24/14:55:42 DEBUG [http-8080-1] server - clid=null
08-24/14:55:42 DEBUG [http-8080-2] server - load module actions for module card (mid=3)
08-24/14:55:42 DEBUG [http-8080-2] server - load module actions for module reports (mid=5)
08-24/14:55:42 DEBUG [http-8080-2] server - load module actions for module mps (mid=6)
08-24/14:55:42 DEBUG [http-8080-2] server - load module actions for module drweb (mid=9)
08-24/14:55:42 DEBUG [http-8080-2] server - load module actions for module trayinfo (mid=4)
08-24/14:55:42 DEBUG [http-8080-2] server - load module actions for kernel
08-24/14:55:42 DEBUG [http-8080-2] server - load module actions for module ipn (mid=1)
08-24/14:55:42 DEBUG [http-8080-2] server - load module actions for module bill (mid=7)
08-24/14:55:43 DEBUG [http-8080-2] server - load module actions for module dialup (mid=11)
08-24/14:55:43 DEBUG [http-8080-2] server - load module actions for module npay (mid=2)
08-24/14:55:43 DEBUG [http-8080-2] server - load module actions for module rscm (mid=8)
08-24/14:55:43 INFO [http-8080-2] EventProcessor - Add listener bitel.billing.server.Executer$1@157bf4c to BG.Event.ru.bitel.bgbilling.kernel.module.api.common.bean.ModuleAddedEvent
08-24/14:55:43 DEBUG [http-8080-2] server - executing bitel.billing.server.admin.action.ActionGetUserEmail; time => 2 ms.
08-24/14:55:43 DEBUG [http-8080-2] server - executing bitel.billing.server.npay.action.ActionRecalculatePay; time => 34 ms.
08-24/14:55:43 INFO [http-8080-2] Setup - Load config for mid=2
08-24/14:56:42 DEBUG [http-8080-2] server - Web auth modes:
08-24/14:56:42 DEBUG [http-8080-2] server - 0 => 1
08-24/14:56:42 DEBUG [http-8080-2] server - 1 => 1
08-24/14:56:42 DEBUG [http-8080-2] server - 4 => 1
08-24/14:56:42 DEBUG [http-8080-2] server - clid=null
08-24/14:57:05 DEBUG [http-8080-2] server - executing bitel.billing.server.admin.action.ActionShowCurrentTasks; time => 2 ms.
Код:
08-24/14:55:35 INFO [main] DefaultServerSetup - Binding javax.jms.ConnectionFactory[org.apache.activemq.ActiveMQConnectionFactory@1d86fd3] to java:comp/env/mq/connectionFactory
08-24/14:55:35 DEBUG [main] JNDIReferenceFactory - Creating reference: org.apache.activemq.ActiveMQConnectionFactory,org.apache.activemq.ActiveMQConnectionFactory@1d86fd3
08-24/14:55:35 INFO [main] DefaultServerSetup - Init DB connection pools
08-24/14:55:35 INFO [main] DefaultServerSetup - Binding JDBC pool "master" to java:comp/env/jdbc/master
08-24/14:55:35 INFO [main] DefaultServerSetup - Init trash pools..
08-24/14:55:35 INFO [main] LoggingPrintStream - Starting TEProccessManager on 9066
08-24/14:55:35 INFO [main] TaskExecuter - Start TaskExecuter
08-24/14:55:35 INFO [Thread-8] LoggingPrintStream - Creating socket on 9066
08-24/14:55:35 INFO [Thread-6] TaskExecuter - TaskExecuter => reloadTasks()
08-24/14:55:35 INFO [Thread-6] TaskExecuter - Task: bitel.billing.server.npay.Calculator
08-24/14:55:35 INFO [Thread-6] TaskExecuter - Task: bitel.billing.server.ipn.IPNTestGates
08-24/14:55:35 INFO [Thread-6] TaskExecuter - Task: bitel.billing.server.ipn.LogCalculator
08-24/14:55:35 INFO [Thread-6] TaskExecuter - Task: bitel.billing.server.rscm.Calculator
08-24/14:55:35 INFO [Thread-6] TaskExecuter - Task: ru.bitel.bgbilling.modules.drweb.server.tasks.ProlongerAVDAgent
08-24/14:55:35 INFO [Thread-6] TaskExecuter - Task: bitel.billing.server.contract.ContractStatusSetter
08-24/14:55:35 INFO [Thread-6] TaskExecuter - Task: bitel.billing.server.contract.LimitRestorer
08-24/14:55:35 INFO [Thread-6] TaskExecuter - Task: bitel.billing.server.script.TimerEventGenerate
08-24/14:55:35 INFO [Thread-6] TaskExecuter - Task: ru.bitel.bgbilling.modules.drweb.server.tasks.Calculator
08-24/14:55:35 INFO [Thread-6] TaskExecuter - Task: bitel.billing.server.script.TimerEventGenerate
08-24/14:55:35 INFO [Thread-6] TaskExecuter - Task: ru.bitel.bgbilling.kernel.task.server.Validator
08-24/14:55:35 INFO [Thread-6] TaskExecuter - Task: ru.bitel.bgbilling.modules.npay.server.task.DebetStatusManageLocker
08-24/14:55:35 DEBUG [Thread-6] TaskExecuter - Looking tasks
08-24/14:56:00 DEBUG [Thread-6] TaskExecuter - Looking tasks
08-24/14:57:00 DEBUG [Thread-6] TaskExecuter - Looking tasks
08-24/14:58:00 DEBUG [Thread-6] TaskExecuter - Looking tasks