вот только сейчас. при переобсчете стало тормозить, упал activemq
Код:
[root@phone log]# ps auxw | grep java
root 16785 1.7 9.4 974936 97944 ? Sl 11:12 1:00 /usr/java/jdk/bin/java -Dnetworkaddress.cache.ttl=3600 -Djava.net.preferIPv4Stack=true -Djava.endorsed.dirs=./lib/endorsed:/usr/java/jdk/lib/endorsed -Dboot.info=1 -Dapp.name=BGBillingServer -Dlog4j.configuration=data/log4j.xml -Dlog.dir.path=log/ -Dlog.prefix=server -Xmx768m -cp .:./lib/ext/bgcommon-boot.jar ru.bitel.common.bootstrap.Boot bitel.billing.server.Server start
root 16788 0.6 1.8 434204 19396 ? Sl 11:12 0:24 /usr/java/jdk/bin/java -Dnetworkaddress.cache.ttl=3600 -Djava.net.preferIPv4Stack=true -Djava.endorsed.dirs=./lib/endorsed:/usr/java/jdk/lib/endorsed -Dboot.info=1 -Dapp.name=BGScheduler -Dlog4j.configuration=data/log4j.xml -Dlog.dir.path=log/ -Dlog.prefix=scheduler -Xmx256m -cp .:./lib/ext/bgcommon-boot.jar ru.bitel.common.bootstrap.Boot bitel.billing.server.TaskExecuter -estart
root 16791 17.2 76.0 1230632 787240 ? SNl 11:12 10:10 /usr/java/jdk/bin/java -Dnetworkaddress.cache.ttl=3600 -Djava.net.preferIPv4Stack=true -Djava.endorsed.dirs=./lib/endorsed:/usr/java/jdk/lib/endorsed -Dboot.info=1 -Dapp.name=BGDataLoader -Dlog4j.configuration=data/log4j.xml -Dlog.dir.path=log/ -Dlog.prefix=dataloader -Xmx1024m -cp .:./lib/ext/bgcommon-boot.jar ru.bitel.common.bootstrap.Boot bitel.billing.server.DataLoader -estart
root 20875 0.0 0.0 4016 692 pts/2 R+ 12:11 0:00 grep java
activemq.log
Код:
2012-07-18 11:45:20,242 | INFO | Transport failed: org.apache.activemq.transport.InactivityIOException: Channel was inactive for too (>30000) long: /127.0.0.1:44804 | org.apache.activemq.broker.TransportConnection.Transport | InactivityMonitor Async Task: java.util.concurrent.ThreadPoolExecutor$Worker@164804
2012-07-18 11:48:41,114 | INFO | Transport failed: org.apache.activemq.transport.InactivityIOException: Channel was inactive for too (>30000) long: /127.0.0.1:44806 | org.apache.activemq.broker.TransportConnection.Transport | InactivityMonitor Async Task: java.util.concurrent.ThreadPoolExecutor$Worker@18f127c
wrapper.log
Код:
INFO | jvm 1 | 2012/07/18 11:45:25 | INFO | Transport failed: org.apache.activemq.transport.InactivityIOException: Channel was inactive for too (>30000) long: /127.0.0.1:44804
INFO | jvm 1 | 2012/07/18 11:48:41 | INFO | Transport failed: org.apache.activemq.transport.InactivityIOException: Channel was inactive for too (>30000) long: /127.0.0.1:44806
ERROR | wrapper | 2012/07/18 11:52:34 | JVM appears hung: Timed out waiting for signal from JVM.
ERROR | wrapper | 2012/07/18 11:52:35 | JVM did not exit on request, terminated
INFO | wrapper | 2012/07/18 11:52:36 | JVM exited on its own while waiting to kill the application.
STATUS | wrapper | 2012/07/18 11:52:36 | JVM exited in response to signal SIGKILL (9).
STATUS | wrapper | 2012/07/18 11:52:40 | Launching a JVM...
ERROR | wrapper | 2012/07/18 11:53:10 | Startup failed: Timed out waiting for a signal from the JVM.
ERROR | wrapper | 2012/07/18 11:53:10 | JVM did not exit on request, terminated
INFO | wrapper | 2012/07/18 11:53:10 | JVM exited on its own while waiting to kill the application.
STATUS | wrapper | 2012/07/18 11:53:10 | JVM exited in response to signal SIGKILL (9).
STATUS | wrapper | 2012/07/18 11:53:14 | Launching a JVM...
ERROR | wrapper | 2012/07/18 11:53:45 | Startup failed: Timed out waiting for a signal from the JVM.
ERROR | wrapper | 2012/07/18 11:53:46 | JVM did not exit on request, terminated
INFO | wrapper | 2012/07/18 11:53:46 | JVM exited on its own while waiting to kill the application.
STATUS | wrapper | 2012/07/18 11:53:46 | JVM exited in response to signal SIGKILL (9).
STATUS | wrapper | 2012/07/18 11:53:50 | Launching a JVM...
ERROR | wrapper | 2012/07/18 11:54:20 | Startup failed: Timed out waiting for a signal from the JVM.
ERROR | wrapper | 2012/07/18 11:54:20 | JVM did not exit on request, terminated
INFO | wrapper | 2012/07/18 11:54:21 | JVM exited on its own while waiting to kill the application.
STATUS | wrapper | 2012/07/18 11:54:21 | JVM exited in response to signal SIGKILL (9).
STATUS | wrapper | 2012/07/18 11:54:25 | Launching a JVM...
ERROR | wrapper | 2012/07/18 11:54:55 | Startup failed: Timed out waiting for a signal from the JVM.
ERROR | wrapper | 2012/07/18 11:54:56 | JVM did not exit on request, terminated
INFO | wrapper | 2012/07/18 11:54:56 | JVM exited on its own while waiting to kill the application.
STATUS | wrapper | 2012/07/18 11:54:56 | JVM exited in response to signal SIGKILL (9).
STATUS | wrapper | 2012/07/18 11:55:01 | Launching a JVM...
ERROR | wrapper | 2012/07/18 11:55:30 | Startup failed: Timed out waiting for a signal from the JVM.
ERROR | wrapper | 2012/07/18 11:55:30 | JVM did not exit on request, terminated
INFO | wrapper | 2012/07/18 11:55:30 | JVM exited on its own while waiting to kill the application.
STATUS | wrapper | 2012/07/18 11:55:30 | JVM exited in response to signal SIGKILL (9).
FATAL | wrapper | 2012/07/18 11:55:30 | There were 5 failed launches in a row, each lasting less than 300 seconds. Giving up.
FATAL | wrapper | 2012/07/18 11:55:30 | There may be a configuration problem: please check the logs.
STATUS | wrapper | 2012/07/18 11:55:30 | <-- Wrapper Stopped
dataloader.error.log
Код:
07-18/12:11:35 ERROR [pool-1-thread-8] dataloader - Communications link failure
The last packet successfully received from the server was 39,131 milliseconds ago. The last packet sent successfully to the server was 39,131 milliseconds ago.
com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure
The last packet successfully received from the server was 39,131 milliseconds ago. The last packet sent successfully to the server was 39,131 milliseconds ago.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1116)
at com.mysql.jdbc.MysqlIO.send(MysqlIO.java:3364)
at com.mysql.jdbc.MysqlIO.sendFileToServer(MysqlIO.java:3456)
at com.mysql.jdbc.MysqlIO.readResultsForQueryOrUpdate(MysqlIO.java:2629)
at com.mysql.jdbc.MysqlIO.readAllResults(MysqlIO.java:1800)
at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2221)
at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2624)
at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:2127)
at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2427)
at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2345)
at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2330)
at org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:105)
at ru.bitel.bgbilling.modules.phone.server.DataProcess$Inserter.run(DataProcess.java:405)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.net.SocketException: Broken pipe
at java.net.SocketOutputStream.socketWrite0(Native Method)
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
at java.io.BufferedOutputStream.write(BufferedOutputStream.java:105)
at com.mysql.jdbc.MysqlIO.send(MysqlIO.java:3343)
... 14 more
07-18/12:11:36 ERROR [pool-1-thread-8] dataloader - No operations allowed after connection closed.
com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.Util.getInstance(Util.java:386)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1013)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:987)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:982)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:927)
at com.mysql.jdbc.ConnectionImpl.throwConnectionClosedException(ConnectionImpl.java:1205)
at com.mysql.jdbc.ConnectionImpl.checkClosed(ConnectionImpl.java:1197)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4186)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4152)
at org.apache.commons.dbcp.DelegatingConnection.prepareStatement(DelegatingConnection.java:281)
at ru.bitel.bgbilling.server.util.PoolGuardConnectionWrapper.prepareStatement(PoolGuardConnectionWrapper.java:200)
at ru.bitel.bgbilling.modules.phone.server.DataProcess$Inserter.run(DataProcess.java:424)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Caused by: com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure
The last packet successfully received from the server was 39,131 milliseconds ago. The last packet sent successfully to the server was 39,131 milliseconds ago.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1116)
at com.mysql.jdbc.MysqlIO.send(MysqlIO.java:3364)
at com.mysql.jdbc.MysqlIO.sendFileToServer(MysqlIO.java:3456)
at com.mysql.jdbc.MysqlIO.readResultsForQueryOrUpdate(MysqlIO.java:2629)
at com.mysql.jdbc.MysqlIO.readAllResults(MysqlIO.java:1800)
at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2221)
at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2624)
at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:2127)
at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2427)
at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2345)
at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2330)
at org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:105)
at ru.bitel.bgbilling.modules.phone.server.DataProcess$Inserter.run(DataProcess.java:405)
... 3 more
Caused by: java.net.SocketException: Broken pipe
at java.net.SocketOutputStream.socketWrite0(Native Method)
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
at java.io.BufferedOutputStream.write(BufferedOutputStream.java:105)
at com.mysql.jdbc.MysqlIO.send(MysqlIO.java:3343)
... 14 more
server.error.log
Код:
server 07-18/11:45:27 ERROR [Thread-16] LoggingPrintStream - Exception in thread "Thread-16"
server 07-18/11:45:30 ERROR [Thread-16] LoggingPrintStream - java.lang.NullPointerException
server 07-18/11:45:30 ERROR [Thread-16] LoggingPrintStream - at com.mysql.jdbc.StatementImpl$CancelTask$1.run(StatementImpl.java:108)
server 07-18/11:45:30 ERROR [Thread-17] LoggingPrintStream - Exception in thread "Thread-17"
server 07-18/11:45:32 ERROR [Thread-17] LoggingPrintStream - java.lang.NullPointerException
server 07-18/11:45:32 ERROR [Thread-17] LoggingPrintStream - at com.mysql.jdbc.StatementImpl$CancelTask$1.run(StatementImpl.java:108)
server 07-18/11:53:47 ERROR [Thread-18] LoggingPrintStream - Exception in thread "Thread-18"
server 07-18/11:53:59 ERROR [Thread-18] LoggingPrintStream - java.lang.NullPointerException
server 07-18/11:54:00 ERROR [Thread-18] LoggingPrintStream - at com.mysql.jdbc.StatementImpl$CancelTask$1.run(StatementImpl.java:108)
server 07-18/12:01:36 ERROR ["http-bio-/0.0.0.0-8080"-exec-3] XSLManager -
ClientAbortException: java.net.SocketException: Broken pipe
at org.apache.catalina.connector.OutputBuffer.doFlush(OutputBuffer.java:333)
at org.apache.catalina.connector.OutputBuffer.flush(OutputBuffer.java:299)
at org.apache.catalina.connector.CoyoteOutputStream.flush(CoyoteOutputStream.java:103)
at ru.bitel.bgbilling.kernel.container.web.action.XSLManager.transform(XSLManager.java:310)
at bitel.billing.server.PublicExecuter.doPost(PublicExecuter.java:96)
at bitel.billing.server.PublicExecuter.doGet(PublicExecuter.java:32)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:621)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:304)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:684)
at org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:471)
at org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:402)
at org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:329)
at bitel.billing.server.filters.BGAuthFilter.error(BGAuthFilter.java:456)
at bitel.billing.server.filters.BGAuthFilter.doFilter(BGAuthFilter.java:290)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at bitel.billing.server.filters.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:48)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at bitel.billing.server.filters.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:48)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:240)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:164)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:462)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:563)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:164)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:100)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:403)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:301)
at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:162)
at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:140)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.net.SocketException: Broken pipe
at java.net.SocketOutputStream.socketWrite0(Native Method)
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
at org.apache.coyote.http11.InternalOutputBuffer.realWriteBytes(InternalOutputBuffer.java:218)
at org.apache.tomcat.util.buf.ByteChunk.flushBuffer(ByteChunk.java:437)
at org.apache.coyote.http11.InternalOutputBuffer.flush(InternalOutputBuffer.java:121)
at org.apache.coyote.http11.AbstractHttp11Processor.action(AbstractHttp11Processor.java:738)
at org.apache.coyote.Response.action(Response.java:170)
at org.apache.catalina.connector.OutputBuffer.doFlush(OutputBuffer.java:328)
... 38 more