<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=iso-8859-1">
<META NAME="Generator" CONTENT="MS Exchange Server version 5.5.2653.12">
<TITLE>RE: [JDEV] Distributed design of jabber</TITLE>
</HEAD>
<BODY>
<P><FONT SIZE=2>Thanks! That'll work.</FONT>
</P>
<P><FONT SIZE=2>One thing, do you mean "dpsms" rather than "jpollds" down there? (I remember jpolld was the old scaling attempt...)</FONT>
</P>
<P><FONT SIZE=2>> -----Original Message-----</FONT>
<BR><FONT SIZE=2>> From: temas [<A HREF="mailto:temas@box5.net">mailto:temas@box5.net</A>]</FONT>
<BR><FONT SIZE=2>> Sent: Wednesday, May 02, 2001 7:36 PM</FONT>
<BR><FONT SIZE=2>> To: jdev@jabber.org</FONT>
<BR><FONT SIZE=2>> Subject: RE: [JDEV] Distributed design of jabber</FONT>
<BR><FONT SIZE=2>> </FONT>
<BR><FONT SIZE=2>> </FONT>
<BR><FONT SIZE=2>> Ok, well...</FONT>
<BR><FONT SIZE=2>> In short: dpsm is the devpoll socket manager. It handles sockets in</FONT>
<BR><FONT SIZE=2>> the same manner as c2s currently, but does it in a higher scaling</FONT>
<BR><FONT SIZE=2>> fashion.</FONT>
<BR><FONT SIZE=2>> </FONT>
<BR><FONT SIZE=2>> In long, normal c2s only handles 1024 sockets, that sucks. </FONT>
<BR><FONT SIZE=2>> So I looked</FONT>
<BR><FONT SIZE=2>> at the latest and greatest socket technology and saw devpoll </FONT>
<BR><FONT SIZE=2>> to probably</FONT>
<BR><FONT SIZE=2>> be the best option. I then designed dpsm around devpoll and </FONT>
<BR><FONT SIZE=2>> around the</FONT>
<BR><FONT SIZE=2>> idea of running it in front of the main jabberd to handle a lot of</FONT>
<BR><FONT SIZE=2>> sockets. </FONT>
<BR><FONT SIZE=2>> </FONT>
<BR><FONT SIZE=2>> Example: two mid size boxes in front of a larger backend box, the</FONT>
<BR><FONT SIZE=2>> smaller running the jpollds, and the larger only jabbed.</FONT>
<BR><FONT SIZE=2>> </FONT>
<BR><FONT SIZE=2>> So there is a lame summary of it and an example setup. It's still</FONT>
<BR><FONT SIZE=2>> growing, but should be functional.</FONT>
<BR><FONT SIZE=2>> </FONT>
<BR><FONT SIZE=2>> --temas</FONT>
<BR><FONT SIZE=2>> </FONT>
<BR><FONT SIZE=2>> On 02 May 2001 15:06:46 -0500, Colin Madere wrote:</FONT>
<BR><FONT SIZE=2>> > temas,</FONT>
<BR><FONT SIZE=2>> > </FONT>
<BR><FONT SIZE=2>> > Any chance you could give us a quick run-down of what dpsm </FONT>
<BR><FONT SIZE=2>> does and how it</FONT>
<BR><FONT SIZE=2>> > should be used? I scanned the source and such, but it </FONT>
<BR><FONT SIZE=2>> would be nice to get</FONT>
<BR><FONT SIZE=2>> > a clear picture from the author about it :)</FONT>
<BR><FONT SIZE=2>> > </FONT>
<BR><FONT SIZE=2>> > colin</FONT>
<BR><FONT SIZE=2>> > </FONT>
<BR><FONT SIZE=2>> > > -----Original Message-----</FONT>
<BR><FONT SIZE=2>> > > From: temas [<A HREF="mailto:temas@box5.net">mailto:temas@box5.net</A>]</FONT>
<BR><FONT SIZE=2>> > > Sent: Wednesday, May 02, 2001 1:22 PM</FONT>
<BR><FONT SIZE=2>> > > To: jdev@jabber.org</FONT>
<BR><FONT SIZE=2>> > > Subject: RE: [JDEV] Distributed design of jabber</FONT>
<BR><FONT SIZE=2>> > > </FONT>
<BR><FONT SIZE=2>> > > </FONT>
<BR><FONT SIZE=2>> > > dpsm is me. It works right now (requires kernel module </FONT>
<BR><FONT SIZE=2>> for devpoll</FONT>
<BR><FONT SIZE=2>> > > support). It's not fully tested, but that should be </FONT>
<BR><FONT SIZE=2>> > > happening more this</FONT>
<BR><FONT SIZE=2>> > > week. Give it a go and help develop it and I'll love you =)</FONT>
<BR><FONT SIZE=2>> > > </FONT>
<BR><FONT SIZE=2>> > > Not sure on mod_farm right now, haven't looked in a while.</FONT>
<BR><FONT SIZE=2>> > > </FONT>
<BR><FONT SIZE=2>> > > --temas</FONT>
<BR><FONT SIZE=2>> > > </FONT>
<BR><FONT SIZE=2>> > > On 02 May 2001 09:56:50 -0500, Colin Madere wrote:</FONT>
<BR><FONT SIZE=2>> > > > Another note:</FONT>
<BR><FONT SIZE=2>> > > > </FONT>
<BR><FONT SIZE=2>> > > > According to jabber.com, they charge based on concurrent </FONT>
<BR><FONT SIZE=2>> > > users on the</FONT>
<BR><FONT SIZE=2>> > > > server. Currently they are in a state which it is not </FONT>
<BR><FONT SIZE=2>> > > profitable for them</FONT>
<BR><FONT SIZE=2>> > > > to deal with small companies(they didn't really give me </FONT>
<BR><FONT SIZE=2>> a number) or</FONT>
<BR><FONT SIZE=2>> > > > companies that did not have a _gaurenteed_ high number of </FONT>
<BR><FONT SIZE=2>> > > concurrent users.</FONT>
<BR><FONT SIZE=2>> > > > </FONT>
<BR><FONT SIZE=2>> > > > Going on three weeks now that I'm waiting for answers to </FONT>
<BR><FONT SIZE=2>> > > technical questions</FONT>
<BR><FONT SIZE=2>> > > > to see if the jabber.com server is a viable solution </FONT>
<BR><FONT SIZE=2>> for my company.</FONT>
<BR><FONT SIZE=2>> > > > </FONT>
<BR><FONT SIZE=2>> > > > IOW, until they get some big sales and can beef up on </FONT>
<BR><FONT SIZE=2>> > > resources (read: more</FONT>
<BR><FONT SIZE=2>> > > > employees), I wouldn't waste your time or theirs unless you </FONT>
<BR><FONT SIZE=2>> > > have a need for</FONT>
<BR><FONT SIZE=2>> > > > a server (and can afford it - once again, I didn't get any </FONT>
<BR><FONT SIZE=2>> > > prices) that will</FONT>
<BR><FONT SIZE=2>> > > > have a constant concurrent user count above 10K (that's my </FONT>
<BR><FONT SIZE=2>> > > guess, since they</FONT>
<BR><FONT SIZE=2>> > > > didn't give me any solid numbers).</FONT>
<BR><FONT SIZE=2>> > > > </FONT>
<BR><FONT SIZE=2>> > > > (Don't get me wrong, I understand their need to focus on </FONT>
<BR><FONT SIZE=2>> > > customers that can</FONT>
<BR><FONT SIZE=2>> > > > bring in the big cash until they have good income and are </FONT>
<BR><FONT SIZE=2>> > > stabilized)</FONT>
<BR><FONT SIZE=2>> > > > </FONT>
<BR><FONT SIZE=2>> > > > WHILE I'm on the subject, hey JER and whoever else has </FONT>
<BR><FONT SIZE=2>> > > worked on it, what's</FONT>
<BR><FONT SIZE=2>> > > > the status of dpsm and.... 'mod_farm' is it?</FONT>
<BR><FONT SIZE=2>> > > > </FONT>
<BR><FONT SIZE=2>> > > > > -----Original Message-----</FONT>
<BR><FONT SIZE=2>> > > > > From: dizzyd@dizzyd.com [<A HREF="mailto:dizzyd@dizzyd.com">mailto:dizzyd@dizzyd.com</A>]</FONT>
<BR><FONT SIZE=2>> > > > > Sent: Wednesday, April 25, 2001 8:24 PM</FONT>
<BR><FONT SIZE=2>> > > > > To: jdev@jabber.org</FONT>
<BR><FONT SIZE=2>> > > > > Subject: Re: [JDEV] Distributed design of jabber</FONT>
<BR><FONT SIZE=2>> > > > > </FONT>
<BR><FONT SIZE=2>> > > > > </FONT>
<BR><FONT SIZE=2>> > > > > Lemme just translate this marketing stuff to </FONT>
<BR><FONT SIZE=2>> engineering speak:</FONT>
<BR><FONT SIZE=2>> > > > > </FONT>
<BR><FONT SIZE=2>> > > > > > >"Enables Distributed Processing across multiple server </FONT>
<BR><FONT SIZE=2>> > > > > "farms" which in</FONT>
<BR><FONT SIZE=2>> > > > > > > turn may support multiple CPUs."</FONT>
<BR><FONT SIZE=2>> > > > > </FONT>
<BR><FONT SIZE=2>> > > > > Jabber.com reworked the server to be pre-emptively </FONT>
<BR><FONT SIZE=2>> multi-threaded</FONT>
<BR><FONT SIZE=2>> > > > > (pthreads). Additionally, some work on JSM was done to </FONT>
<BR><FONT SIZE=2>> > > permit multiple</FONT>
<BR><FONT SIZE=2>> > > > > JSMs to be fully meshed across a network. </FONT>
<BR><FONT SIZE=2>> > > > > </FONT>
<BR><FONT SIZE=2>> > > > > > >"Allows components of a Jabber server to be distributed </FONT>
<BR><FONT SIZE=2>> > > > > across multiple</FONT>
<BR><FONT SIZE=2>> > > > > > > machines, enabling a greater degree of inherent </FONT>
<BR><FONT SIZE=2>> redundancy."</FONT>
<BR><FONT SIZE=2>> > > > > </FONT>
<BR><FONT SIZE=2>> > > > > Not sure what this means. :) </FONT>
<BR><FONT SIZE=2>> > > > > </FONT>
<BR><FONT SIZE=2>> > > > > > >"Enables groups of "socket" connections to be </FONT>
<BR><FONT SIZE=2>> > > distributed across</FONT>
<BR><FONT SIZE=2>> > > > > > >mini-servers</FONT>
<BR><FONT SIZE=2>> > > > > </FONT>
<BR><FONT SIZE=2>> > > > > The component formerly known as jpoll. Open source now has an</FONT>
<BR><FONT SIZE=2>> > > > > equivalent called dspm (or dpsm, never can get it straight).</FONT>
<BR><FONT SIZE=2>> > > > > </FONT>
<BR><FONT SIZE=2>> > > > > As it stands, j.com has pretty much rewritten most of jabberd </FONT>
<BR><FONT SIZE=2>> > > > > to be super</FONT>
<BR><FONT SIZE=2>> > > > > efficient and thread-safe. This was _not_ a minor </FONT>
<BR><FONT SIZE=2>> > > undertaking, but was</FONT>
<BR><FONT SIZE=2>> > > > > well worth the effort. Jabber.com provides a super-fast, </FONT>
<BR><FONT SIZE=2>> > > fully QA'd</FONT>
<BR><FONT SIZE=2>> > > > > and peer-reviewed implementation of jabberd/jsm/etc. They've </FONT>
<BR><FONT SIZE=2>> > > > > worked very</FONT>
<BR><FONT SIZE=2>> > > > > hard to make it scalable and robust. :) Doing these sorts </FONT>
<BR><FONT SIZE=2>> > > of things</FONT>
<BR><FONT SIZE=2>> > > > > (scalability and robustness) have not been things that </FONT>
<BR><FONT SIZE=2>> > > the Open Source</FONT>
<BR><FONT SIZE=2>> > > > > movement has shown much interest in this far (with good </FONT>
<BR><FONT SIZE=2>> > > reason). Very</FONT>
<BR><FONT SIZE=2>> > > > > few people need to run a Jabber server for 200k+ </FONT>
<BR><FONT SIZE=2>> concurrent users;</FONT>
<BR><FONT SIZE=2>> > > > > these are (some of) the people that Jabber.com caters to.</FONT>
<BR><FONT SIZE=2>> > > > > </FONT>
<BR><FONT SIZE=2>> > > > > Hope that helps. :)</FONT>
<BR><FONT SIZE=2>> > > > > </FONT>
<BR><FONT SIZE=2>> > > > > Diz</FONT>
<BR><FONT SIZE=2>> > > > > </FONT>
<BR><FONT SIZE=2>> > > > > _______________________________________________</FONT>
<BR><FONT SIZE=2>> > > > > jdev mailing list</FONT>
<BR><FONT SIZE=2>> > > > > jdev@jabber.org</FONT>
<BR><FONT SIZE=2>> > > > > <A HREF="http://mailman.jabber.org/listinfo/jdev" TARGET="_blank">http://mailman.jabber.org/listinfo/jdev</A></FONT>
<BR><FONT SIZE=2>> > > > > </FONT>
<BR><FONT SIZE=2>> > > </FONT>
<BR><FONT SIZE=2>> > > </FONT>
<BR><FONT SIZE=2>> > > _______________________________________________</FONT>
<BR><FONT SIZE=2>> > > jdev mailing list</FONT>
<BR><FONT SIZE=2>> > > jdev@jabber.org</FONT>
<BR><FONT SIZE=2>> > > <A HREF="http://mailman.jabber.org/listinfo/jdev" TARGET="_blank">http://mailman.jabber.org/listinfo/jdev</A></FONT>
<BR><FONT SIZE=2>> > > </FONT>
<BR><FONT SIZE=2>> </FONT>
<BR><FONT SIZE=2>> _______________________________________________</FONT>
<BR><FONT SIZE=2>> jdev mailing list</FONT>
<BR><FONT SIZE=2>> jdev@jabber.org</FONT>
<BR><FONT SIZE=2>> <A HREF="http://mailman.jabber.org/listinfo/jdev" TARGET="_blank">http://mailman.jabber.org/listinfo/jdev</A></FONT>
<BR><FONT SIZE=2>> </FONT>
</P>
</BODY>
</HTML>