Problem: SBMservice unresponsive

For technical support visit http://support.2brightsparks.com/
hhh
Advanced
Advanced
Posts: 48
Joined: Tue Nov 22, 2011 3:06 pm

Re: Problem: SBMservice unresponsive

Postby hhh » Mon Jul 23, 2012 8:00 am

Good news!
No freezes since thursday using the new version!

thanks,

henrik

User avatar
mickyj
2BrightSparks Staff
2BrightSparks Staff
Posts: 906
Joined: Mon Jan 05, 2004 6:51 pm

Re: Problem: SBMservice unresponsive

Postby mickyj » Mon Jul 23, 2012 8:41 am

Excellent news! Fingers crossed.

hhh
Advanced
Advanced
Posts: 48
Joined: Tue Nov 22, 2011 3:06 pm

Re: Problem: SBMservice unresponsive

Postby hhh » Wed Jul 25, 2012 6:28 am

this morning the service had frozen and had to be restarted. :-(

User avatar
mickyj
2BrightSparks Staff
2BrightSparks Staff
Posts: 906
Joined: Mon Jan 05, 2004 6:51 pm

Re: Problem: SBMservice unresponsive

Postby mickyj » Wed Jul 25, 2012 7:01 am

That's very depressing news. We've already exhausted all possible avenues to resolve this issue so I really don't know where we go from here. Ultimately we my have to simply start again using a different technology.

hhh
Advanced
Advanced
Posts: 48
Joined: Tue Nov 22, 2011 3:06 pm

Re: Problem: SBMservice unresponsive

Postby hhh » Wed Jul 25, 2012 7:06 am

It has been running for 6 days straight though, I restarted it this morning and we'll see whether it freezes again.

As described in my other post the service has regarded most incoming connections as coming from banned addresses, with up to four rejected connections per second, which may have caused this crash?
I'm currently running at least 60-70 profiles against the service.

hhh
Advanced
Advanced
Posts: 48
Joined: Tue Nov 22, 2011 3:06 pm

Re: Problem: SBMservice unresponsive

Postby hhh » Wed Jul 25, 2012 8:00 am

looking through the status logs now, 28000 + rows of status logs the last 24 hours might have helped the crash :-)

hhh
Advanced
Advanced
Posts: 48
Joined: Tue Nov 22, 2011 3:06 pm

Re: Problem: SBMservice unresponsive

Postby hhh » Thu Jul 26, 2012 7:50 am

looks stable since yesterday, I'm guessing it was the huge amounts of rejected connections and corresponding log messages that caused the service to hang.

hhh
Advanced
Advanced
Posts: 48
Joined: Tue Nov 22, 2011 3:06 pm

Re: Problem: SBMservice unresponsive

Postby hhh » Mon Aug 06, 2012 12:10 pm

FYI - no freezes since last restart (25th of july)

Dave Wilkins
2BrightSparks Staff
2BrightSparks Staff
Posts: 1879
Joined: Thu Jan 04, 2007 10:02 am

Re: Problem: SBMservice unresponsive

Postby Dave Wilkins » Mon Aug 06, 2012 12:25 pm

Thanks for letting us know (MickyJ is on holiday until later this week but sounds good to me!)

hhh
Advanced
Advanced
Posts: 48
Joined: Tue Nov 22, 2011 3:06 pm

Re: Problem: SBMservice unresponsive

Postby hhh » Mon Sep 17, 2012 8:08 am

we're experiencing this problem once again every two-three days.
Right now we're running 120 accounts with 3-5 jobs each.

I'm using a monitoring tool to keep track of what's happening to the service and should be able to post some detailed info in a day or two on what happens when it becomes unresponsive.

User avatar
mickyj
2BrightSparks Staff
2BrightSparks Staff
Posts: 906
Joined: Mon Jan 05, 2004 6:51 pm

Re: Problem: SBMservice unresponsive

Postby mickyj » Tue Sep 18, 2012 4:59 am

Thanks for reporting. This bug is driving us nuts. Any and all information will help.

hhh
Advanced
Advanced
Posts: 48
Joined: Tue Nov 22, 2011 3:06 pm

Re: Problem: SBMservice unresponsive

Postby hhh » Wed Sep 19, 2012 9:13 am

I think I have some info that might lead you to solving the problem!

We started monitoring the service and the morning after the service had become unresponsive. This is what the monitoring gave us:

Date/ Time/ Working Set/ Pagefile use/ Threads/ Handles
09-14/ 09:00-10:00 /33 MByte /30081024 KByte /20 # /358 #
09-14/ 08:00-09:00 /33 MByte /30081024 KByte /20 # /358 #
09-14/ 06:00-07:00 /33 MByte /30081024 KByte /20 # /358 #
09-14/ 05:00-06:00 /33 MByte /30080399 KByte /20 # /359 #
09-14/ 04:00-05:00 /33 MByte /30073179 KByte /20 # /366 #
09-14/ 03:00-04:00 /33 MByte /30061585 KByte /20 # /371 #
09-14/ 02:00-03:00 /33 MByte /30051328 KByte /20 # /388 #

Somewhere between 06:00 and 07:00 the service froze; the Pagefile use became constant at 30081024Kbyte, and Handles became constant at 358#. Number of threads also remained constant at 20#, but the service seems to reach 20# after running a few hours and then stays there.

This gave us the idea to change some values in the Service Configuration window. We increased the "Threads" value from 10 (default) to 150 to see if that had any effect.

The service has now been running fine since we restarted it around noon on friday (14th) after changing the Threads value.

In the monitoring tool we can now see that the Working set is around 62MB, Pagefile use at 60 450 611 Kbyte (although this varies), Threads constant at 20#, and Handles value changes between 200-540.

It seems that we've found a workaround in changing the threads value, but you might find this information even more useful :)

User avatar
mickyj
2BrightSparks Staff
2BrightSparks Staff
Posts: 906
Joined: Mon Jan 05, 2004 6:51 pm

Re: Problem: SBMservice unresponsive

Postby mickyj » Wed Sep 19, 2012 9:44 am

This is extremely helpful.

As you're using threads, you must be using the TCP connection?

What would be the maximum concurrent connections you may have at any one time? For example, do you have many client computers that all run a profile at the same time, e.g. 9am?

hhh
Advanced
Advanced
Posts: 48
Joined: Tue Nov 22, 2011 3:06 pm

Re: Problem: SBMservice unresponsive

Postby hhh » Wed Sep 19, 2012 10:12 am

In Service Configuration, HTTP is selected.

I'm not entirely sure how many concurrent connections we would have, but all our 120 accounts have their profiles scheduled to start somewhere between 19:30 and 22:30 every night, so it might be 100 connections.

User avatar
mickyj
2BrightSparks Staff
2BrightSparks Staff
Posts: 906
Joined: Mon Jan 05, 2004 6:51 pm

Re: Problem: SBMservice unresponsive

Postby mickyj » Thu Sep 20, 2012 2:42 am

Now I'm really confused :) The threads setting isn't used if you're using HTTP. It's only used for TCP connections, so changing it shouldn't make any difference at all.

EDIT: I think we've found the problem here. We've recently updated the component we use for the service & console network communication and I see they've made the thread setting available for HTTP as well. Previously it didn't apply. We'll upload a new beta soon.


Return to “SBM Service and Console”



Who is online

Users browsing this forum: No registered users and 1 guest