Please create an account to participate in the Slashdot moderation system

 



Forgot your password?
typodupeerror
×
Programming IT Technology

Who Has Faster Pipes? Linux, Win2000, WinXP Compared 534

SeaBait writes: "This revealing article about the High-performance programming techniques on Linux and Windows shows that Linux rules. The performance testing was on Pipes(interprocess communication mechanism available on both Windows and Linux and UNIX). Although I new Linux would fare the best, the poor performance of Windows XP was a surprise. Windows 2000 actually did better than XP!"
This discussion has been archived. No new comments can be posted.

Who Has Faster Pipes? Linux, Win2000, WinXP Compared

Comments Filter:
  • by DrPascal ( 185005 ) on Wednesday October 03, 2001 @12:17PM (#2384020) Homepage
    I'm a fan of Slashdot, but I get a little sick of the Windows/Linux comparisons, -especially- when the post includes something like "but THIS test shows that Linux rocks!" Yay. Are we going to argue over PCs vs. Macs next?
    • Especially when other systems (like NetBSD, FreeBSD,Solaris) were omitted.
    • Microsoft has a well funded PR department to put out benchmarks that show Windows in a positive light. The Linux community doesn't. If we want to compare OSes in areas in which Linux excels (and admittedly there are some who don't) we have to use grassroots methods, such as posting it to Slashdot.
    • we argue about processors, is that close enough?
    • by little alfalfa ( 21334 ) <cohen.joel@[ ]il.com ['gma' in gap]> on Wednesday October 03, 2001 @12:25PM (#2384080)
      The big deal about this one is that the testing is done by a real company. It's written by a senior programmer at IBM. Many of us would hesitate to dismiss what he says here. This is not some sponsored study as were many tests that have been done in the past.
      • And IBM has a vested interest in the success of what operating system? Maybe ... Li-NUX?

        It all depends on who you trust - me, I don't trust any camp, MS or OS. There's just too much religious fanaticism and not enough rational discussion on either side.

        Well, at least not here anyway.
      • by Telek ( 410366 ) on Wednesday October 03, 2001 @05:41PM (#2386054) Homepage
        But this guy doesn't appear to know what he's talking about... He's comparing apples to oranges here... No, apples to watermelons... Now I'm not all that up to speed on linux pipes, but from what I can tell they are completely different from windows pipes. At least from windows named bi-directional pipes, which is what he tested them against. (And lets completely forget here for a second that he works for IBM, which has all but pronounced vendetta on Microsoft... No possible bias there.)

        Under windows, there are many things the he "neglected" to notice:

        • pipes in Windows have ACLs (access control lists).
        • There are two types of pipes: Anonymous pipes [microsoft.com] and named pipes [microsoft.com]. Anonymous pipes require less overhead than named pipes, but offer limited services. He "neglected" to test anonymous pipes on Windows platforms (which BTW are faster).
        • Windows Named pipes can be used to provide communication between processes on the same computer or between processes on different computers across a network.
        • Windows XP can provide encryption for pipes, which might explain the drastically lower rates. Since XP is based on the same kernel as Windows 2000 there's obviously some additional setting that is on by default now that is causing the decreased rates.


        Also:

        the term pipe server refers to a process that creates a named pipe, and the term pipe client refers to a process that connects to an instance of a named pipe. This is why you have one method to Create the pipe, and one to Open it. BTW -- the Opening method is a universal resource opening method on windows PCs.

        You can go here [microsoft.com] if you want to know more about pipes on windows.

        AND

        I also tried his programs, and you don't need that mystical +24 to get it to work. I don't know why he needed it. Perhaps because he was using some old or wierd cl? I'd also suggest that he try to compile it with MSVC (unless he got the cl.exe from there) as I would bet that would make it faster as well.

        So, from what I read he basically said "Well, I'm gonna compare this thingy called a 'pipe' over here on windows to this really old and simple 'pipe' thingy over here on linux" without checking to see what was actually under the hoods of the two beasts he was comparing.

        Man, /. really has turned into a tabloid lately.
    • Well, the "linux rules" statement was made by the submitter, not the editors. The editors just posted a story they though some of us might be interested in. Some submitters write better stories than others, but I like the way the editors quote the submitter - it gives a little flare and sense of community to the front page.
  • Written by IBM? (Score:2, Redundant)

    by FortKnox ( 169099 )
    Tests written by IBM (who just put more investment in Linux) shows that Linux is best?

    Are they a little biased?

    I'd prefer a neutral party to do the test and the results placed on a neutral site, personally...
    • by iceT ( 68610 )
      IBM's interest in LINUX is primarily on the S/390 platform, not an INTEL platform. Windows 2k/XP isn't available on the primary platform that IBM is touting LINUX for...

      IBM has every bit as much to gain or lose as any other PC/Server manufacturer does in an 386 platform.
    • Re:Written by IBM? (Score:2, Insightful)

      by ChadAmberg ( 460099 )
      Lets see... IBM supports Linux... but guess what? They make a hell of a lot more money selling Windows systems. Both Desktop and Server. And look at IBM services? They're just going to suddenly roll over and say we don't support Windows anymore?

      Sheesh people. IBM is way too big. This guy writing the article has nothing to do with marketing, he's a programmer or in R&D. Sure he's a Linux advocate. But something this minor doesn't make it in the conspiracy business...
    • I'm a big linux fan, so I guess you could claim I'm biased, but at the time we did the tests 95% of my development was on windows, so...

      back before 2k, we did tests on loopback device performance on win95 and winNT. win95 was really bad, NT wasn't great. we ended up writing our own support using shared memory on windows to get the speed we needed. IIRC linux on a 486 beat win95 on a P-233 and I think it was on par with winNT on a PPro-200. The code to do this was in C++ and we abstaracted it behind a generic interface and on linux we used the straight OS support since it was plenty fast.
    • Re:Written by IBM? (Score:4, Insightful)

      by johnnyb ( 4816 ) <jonathan@bartlettpublishing.com> on Wednesday October 03, 2001 @12:35PM (#2384158) Homepage
      The nice thing about the tests is that all of the information about the tests are published, as well as the scope of what the test means (it has a very small scope of applicability). So, it's easy for anyone to reproduce the tests, and mention any problems with the tests.
  • by gosand ( 234100 ) on Wednesday October 03, 2001 @12:20PM (#2384044)
    What good are pipes anyway? Unless there is a GUI attached to them, they are worthless, right?

    Ask your local MCSE, they'll tell you.

    ROFL.

  • by cOdEgUru ( 181536 ) on Wednesday October 03, 2001 @12:20PM (#2384045) Homepage Journal
    From the article..

    Another distinction might the the "feature" of Windows pipes where there is no fixed buffer size. For the first test we stopped at a 4K buffer size in deference to the Linux buffer. Windows advocates might suggest that the arbitrary buffer sizes associated with Windows named pipes are a benefit. To demonstrate the arbitrary size of the Windows named pipe buffers, we can simply run the single threaded program with arbitrarily large block sizes. I did a run with pipespeed2.cpp on Windows and specified a 256 MB buffer size. Windows obliged by swelling the buffer size to hold 256 MB of data before the ReadFile() was issued. The system slowed to a crawl and I didn't wait until the operation completed. Whether this "feature" of Windows is useful or not is up to the public.

    Well, i am sure it started out as a feature..
    • The moderation on the parent shows the breakdown in the moderation system. "Funny"? Perhaps. But not interesting at all.

      I unix admin for a living, I hold no special love for Windows. But for fucks sake... does demonstrating that an OS allows a developer to be a fucking cretin highlight a failure in the OS or a failure in the developer?
  • Premature (Score:4, Insightful)

    by johnnyb ( 4816 ) <jonathan@bartlettpublishing.com> on Wednesday October 03, 2001 @12:20PM (#2384047) Homepage
    This is very premature. This was only testing ONE aspect of Windows vs Linux, which is not even used very much in the Windows world. This is meant to be an overall test of Windows vs Linux in performance, but the article is going to span over several weeks/months. Only after the series is finished will a good comparison be made. To say that Linux rocks just because it's pipes are faster means jack squat. What if Windows sockets are faster? What if Windows Disk IO is faster? What about Windows Asynchronous I/O? Eventually, this article series will answer such questions. However, this article ONLY answered the question of whose pipes are faster. Nothing else should be read into it.
    • Re:Premature (Score:5, Insightful)

      by tmark ( 230091 ) on Wednesday October 03, 2001 @12:33PM (#2384147)
      What if Windows sockets are faster? What if Windows Disk IO is faster? What about Windows Asynchronous I/O?

      I would expect that if any benchmarks came out favoring Windows, and if they were reported here, they would be roundly and loudly shot down with 1) criticisms of the testing protocol, and/or 2) criticisms of the bias of the testing agency. Of course, the same criticisms are just as valid in this case, but of course they are here largely ignored (one poster so far excepted).

      All of which just goes to show that the essence of the whole 'Linux-rocks/Windows-sucks' horse that is always being flogged here is that this horse is ultimately flogged by (sometimes blind) faith. Few of the Linux zealots here are going to believe any benchmark/test unless it favors Linux (in which case, they will all praise the study to high heaven) - just look at the lengths people here go to argue that GNOME/KDE provide better-than-mediocre desktops. Similarly, few Windows advocates are going to be convinced that their platform of choice is inferior.

      Since all these articles thus amount to preaching to the converted, I suggest that the Slashdot editing team hereafter mark all such articles of theirs as 'Redundant'.

      Hey, why can't we rate parent Slashdot articles, anyways ??
      • Re:Premature (Score:3, Insightful)

        by jgerman ( 106518 )
        Uh the reason so many people will pick apart studies claiming Windows superiority is because heistory has shown us that they are usually untrue. I know Linux is technically superior to Windows I know Linux is more powerful than Windows, I don't need a study to prove it. And as far as Linux desktops being mediocre, that's entirely a matter of opinion. I love my GNOME desktop, I love the fact that it's more powerful, flexible, and customizable than Windows. And I really love the fact that my linux workstation works the way it's supposed to and doesn't constantly crash.
        • Re:Premature (Score:4, Interesting)

          by Score Whore ( 32328 ) on Wednesday October 03, 2001 @02:20PM (#2384921)
          Would you care to elucidate on the power, flexibility, and customizability of your GNOME desktop wrt how it stacks up against Windows in those areas. Also please expand on how linux doesn't constantly crash. You see I find that Windows as a whole is more stable than the components of linux. Just because the webserver in my workstation doesn't go down, it doesn't mean that my work isn't interrupted when my X server/web browser/email client/cd burning software/etc. crashes. So how is it better for me that some parts of the OS are still functional? Particularily parts that are almost entirely fluff for my day to day desktop use? It would probably be wise for the Unix community to stop generalizing its arguments into pointlessness. Instead we should focus on actual strengths that can be shown as real benefits.
        • "Windows superiority is because heistory has shown us that they are usually untrue. "

          *cough* Mindcraft

          What Mindcraft proved was that there were signifigant problems with Linux and it performed horribly compared to Windows.

          Yeah, it was picked apart... but they used the pickings to solve real issues.
      • I would expect that if any benchmarks came out favoring Windows, and if they were reported here

        Benchmarks did come out [slashdot.org] favoring Windows. They were indeed loudly shot down with criticisms of the testing protocol, and with criticisms of the (Microsoft-funded, in this case) bias of the testing agency. And yes, both those criticisms were just as valid: e.g. not very.

        The testing protocol, just as in this case, deliberately chose an aspect of performance that didn't have much practical meaning (load balancing between many 100MB NICs rather than using one GB card; using pipes on Windows instead of sockets/COM).

        The testing agency, just as in this case, was horribly biased.

        So what was the difference? Well, first of all, the biases were a lot more real before. People [lwn.net] pointed out hand-tuning that was applied to NT and not Linux, hardware choices that seemed to deliberately use the least supported options, and misconfigurations of the Linux software. Do you have any similar things to point out here, other than "Everybody knows you shouldn't use pipes on Windows"?

        The second difference? Even after those biases were taken into account, there was still aspects in which Linux's performance could be improved, and so it was [kegel.com], gradually over the next 18 months, until it now beats Windows in the same configurations. Do you think that the converse will be true, and Windows 2003 will have blazing performance in all forms of IPC? Would you like to bet money?
      • I would expect that if any benchmarks came out favoring Windows, and if they were reported here, they would be roundly and loudly shot down with 1) criticisms of the testing protocol, and/or 2) criticisms of the bias of the testing agency.

        I don't agree, or at least I think you're leaving out a significant point. I think the /. community rails against Microsoft-funded tests, but otherwise takes these tests to heart. Just look at the recent ZDNet testing that showed NT could barf out static Web pages faster than Linux. There were calls of bias, to be sure, but what actually happened was a bunch of Linux users jumped up and re-did the tests, and then a few leaders in the community went to ZDNet to watch the tests being run. And guess what? The tests were right, and rather than poo-poo the results, the developers actively worked to fix the errors. This community is self-correcting. Give us real results that we can reproduce, and we'll take it not as an attack but as a springboard for improvement. Or at least, that's what recent history indicates.

  • by kangasloth ( 114799 ) on Wednesday October 03, 2001 @12:21PM (#2384049) Homepage
    Who you kidding? I'm no windows developer, but even I know you don't use pipes for IPC in windows, it's all COM. COM on windows versus CORBA or DCOP might be interesting.
    • Who you kidding? I'm no windows developer, but even I know you don't use pipes for IPC in windows, it's all COM. COM on windows versus CORBA or DCOP might be interesting.

      While I agree with most people that it's a rather silly comparison, pipes aren't quite as dead as people think. Many "enterprise" systems still use pipes on windows. Database systems in particular...

      I'm not a conspiracy kind of guy, but you could almost argue that Windows pipes are being slowed on purpose. I doubt SQL Server uses them (espescially if they're degrading this quickly) but many of MS's competitors still do (Including IBM's DB2).
    • COM and CORBA are probably 10 or so levels higher up as far as abstraction goes over pipes. Pipes are down and dirty C style IPC mechanisms, COM and CORBA most likely utilize them (or IP sockets) to actually get the job done.

      People use COM not understanding the performance hit they're getting. Sure, it's the "Right" way to do it by MS standards these days but why diddle with it when all you really need is a few functions to wrap up some pipe() calls to get your two components speaking?
      • But then you have to design protocols and worry about blocking and aborting and so on. The good thing with COM is that they all speak the same language, and you can even find out everything you want to know about what the other end supports at runtime
    • Yes and no. Sure, I never used pipes on windows but I did use the message passing mechanism some times. Interestingly enough this is the low level mechanism used by COM to do interprocess comms.

      That would have been a better test.

      BTW, The source code examples in the article did a great job of reminding me why I hate coding for windows :)

      Dave
  • by MosesJones ( 55544 ) on Wednesday October 03, 2001 @12:22PM (#2384060) Homepage
    You'd almost think that a half-decent GUI and a huge set of tools were the most important things rather than inter-process communication.

    Amazing. Stunningly the IBM OS/390 wipes the floor with all of these entries. Great desktop machine. Linux is a good OS, its not the best, it doesn't beat Solaris for reliability, it doesn't beat Windows for usability, and it doesn't come near the Mainframe architectures for speed. But it does have its place, but petty things like this are surely pointless. If a HCI group found that Linux was _easier_ to use, then that would be something to applaud but in the days of Gigabit networks and massive processor speeds and huge RAM these sorts of performance things are less important than ever.

    The key to success is ease of use, ease of deployment, Linux is getting there, but having fast pipes won't progress it.
    • Inter-process communication is an extremely important factor. Specifically, if your application uses a lot of it.

      It's not the only thing, but it is pretty major.

      If there's a bottleneck, that means poor scaling of applications to larger loads.

      There's a lot that's not in the article, and the article itself says so. There's no information on sockets, RPC, or other means of IPC. That is all coming in future articles. However, it is silly to say that IPC speeds are not worthwhile.
    • having used Linux and WIndows for years, can assure the recent Suse distro is at least as easy to use as Windows. Linux is ready for the desktop, and so is KDE2.

      2 points 1)this was the first Suse distro I have ever tried, and I'm not into any type if Distro wars.
      2)I have used both Gnome and kde, until KDE2 I found gnome to be my preference, but KDE is really easy to use. My wife figured out how to get to all the 'desktop user' stuff(spreadsheet, browser etc...) w/o any help. My wife only other computer experience consists of Windows, and the Apple ][ c.
      • "having used Linux and WIndows for years, can assure the recent Suse distro is at least as easy to use as Windows."

        You just shot down your own statement. Of course an operating system is "at least as easy to use as Windows" if you've been using it for years. Heck, I thought the menu screen on the TI-99/4A was just dandy.

        I think from a "this metaphor works" standpoint, Mac OS got it right the first try (too bad the underlying code sucks -- we'll see with OS X slowly gaining popularity). Windows 95 was pretty revolutionary on a few fronts. XP is bar none the easiest Windows system to use, with the task panes on the folders saying "here you can delete, here you can write to this CD". I showed that to my mom and she instantly understood it (even though, like most of America, she still doesn't know what a "shortcut" in the Start Menu means).

        On the *NIX side, I find KDE to be my desktop of choice. But I've noticed something -- I think I like it because it's so close to Windows. You tend to like OS's you work with often enough, once you learn the underlying tricks (that's one of the reasons I installed POSIX utilities for the command line in Windows 2000/XP). :)

    • by jgerman ( 106518 ) on Wednesday October 03, 2001 @01:09PM (#2384364)

      , but petty things like this are surely pointless. If a HCI group found that Linux was _easier_ to use, then that would be something to applaud but in the days of Gigabit networks and massive processor speeds and huge RAM these sorts of performance things are less important than ever.


      Thus spake the virgin programmer. That bullshit about hardware invalidating the need for fast efficient code, is the bullshit rhetoric taught in college classes that brought us the blue screen of death in the first place. Speed and performance do matter as does not hogging memory and efficiency. You will always run into limits on what a machine can do, and in the case of business, writing code that allows 5 servers to do the work of ten at helf the bandwidth is a big deal.


      The key to success has already been gained by Linux, it is used by the people who matter (not matter as in personal worth but matter as in matter to the advancement of computing). I couldn't give two shits about Joe Schmoe who wants to check his email and surf for porn, let him use Windows, it's not necessary for everyone to use the same operating system. Use the right tool for the job, and for developement *nix is the best tool.

  • Wasn't there a similar article a couple years ago that shows conclusively that Windows NT 4.0 was faster than Windows 2000 and a wide range of tasks?

    I think Windows NT 4.0 marked Microsoft's pinnacle of acheivement. If it wasn't for the lack of USB support I would have never upgraded. Even for a server role, there are a lot of USB devices that a modern server needs to access (like DSL modems, many newer UPS's, cameras for security, additional serial/parallel devices, etc).

    Why oh why can't someone develop a third party solution? Or does one exist? DirectX and translucency I can do without...but USB is just too useful to do without.

    - JoeShmoe
    • The NT4 to Win2k comparisons are very close to the Win2k to WinXP comparisons. The flaw in the logic is that the tests tend to take place with the Beta of the new OS or right after the release has gone gold. Either way, the apps tend to be optimized for the previous release. Once the new optimized versions of apps come out, performance starts to increase. Also, the bugginess of NT4 or Win2k without service packs is pretty well known (but then who uses the x.x.0 release of the linux kernel in production anyway?)

      NT4 is the best OS MS ever made, but Win2k is a good update to NT4. USB support is uber useful: serial and parallel are too slow and scsi and firewire are too expensive.
      • NT4 is the best OS MS ever made

        Maybe at it's current service pack state, but holy shit did it take them a long time and a lot of service packs to get it into that state! In fact, the original release of NT4 was a bag of shite - constantly rolling over and dying. Not until service pack 3 did it become stable. And then we had service pack 4 - what a joy that was *NOT!*.
        • Oh, true, I should have qualified that. NT4:SP3 is what I install standard from my installation source. I very rarely even bother to apply SP6 (7 now?) because I don't need Access Y2K bugfixes and I refuse to touch NTFS 5.0 with a ten foot pole at the end of another ten foot pole.

          I made the mistake of copying some data to a NTFS 5.0 drive, got an error message, rebooted and found my $volume had become corrupt. Microsoft's attitude was "Shit Happens, restore from backup". That's all fine well and good, if the hard drive had physically died I would have accepted the data loss...but Microsoft's whole attitude is that it's more important to have new features than reliability. Backups should never been my first line of defense. The OS should have the smarts to recover SOME portion of the data. Given that OnTrack EasyRecovery wasn't able to find anything, I had to lose the data...but I swore I would never again touch NTFS 5.

          - JoeShmoe
  • by szcx ( 81006 ) on Wednesday October 03, 2001 @12:25PM (#2384081)
    Dell announces that Windows XP outperforms Linux. Slashdot denounces study as biased.
  • by sting3r ( 519844 ) on Wednesday October 03, 2001 @12:25PM (#2384082) Homepage
    Windows pipes are much lower on the evolutionary ladder than Linux IPC mechanisms. Consider:

    • Windows pipes cannot exist in arbitrary places on the filesystem. Therefore service hijackings are easy if you can DOS the existing service into dying. On Linux, an ordinary user can't create /dev/log or /dev/printer (even if they kill syslogd/lpd), but on Windows anyone can name a pipe whatever they want (as long as it doesn't already exist).
    • Windows pipes have no access control. Hmm, didn't SANS just report on the sorry state of Windows security?
    • Windows pipes do not support ancillary data or OOB data. This makes them limited communication facilities.
    • Linux pipes use copy-on-write instead of straight out copying. Therefore the paging mechanisms enhance speed because the data is simply remapped, not manually copied.
    • Linux provides a much richer set of IPC mechanisms, such as semaphores, shm, messages, as well as the socket based facilities.
    • Linux pipes are much easier to write for. Win32 pipes are difficult to use in a C program and subtle programming errors can cause many problems in unrelated modules.

    As is often the case, Microsoft just threw something together and called it "infrastructure." Linux developers drew on 25 years of UNIX evolution and experience, and made a better product as a result.

    -sting3r

    • Linux developers drew on 25 years of UNIX evolution and experience

      So true, so true. My experience with kernel-level *n?x programming (no MS kernel experience, call me biased...) has instilled great respect for their reliance on developing from a clean, tight model. Because an entity can only be a file or a process, access control is intrinsic, never an afterthought.

      A good analogy is the difference between the DoD TCP/IP and OSI networking layer models. The TCP/IP model was developed to accomodate an application; OSI applications are developed to fit the model. Like POSIX, the OSI model ensures clean separation between layers in applications. POSIX, etc. dictates a true multiuser multimachine system, whereas Windows (pre-2K) is a kludge built to extend DOS--a single user, single machine O/S that was actually good for its time (early 1980's).

      A valid point against the strictly layered models is the potential performance penalty from inter-layer communication. I think it's a small price to pay in this age, where the potential cost of vulnerabilities is exorbitant.

    • by Anonymous Coward
      First of all IPC isn't as important in Windows because Windows developers drew on many years of experience of other OS developers and wrote it to support threads from the start. Yes we still need IPC but we can also choose to have code run in the same process and avoid a lot of overhead.

      Second, pipes aren't the prefered IPC mechanism in Windows like i'm guessing they are in Linux. So you're only complaing that Windows doesn't work like Linux.

      Pipes do have access control. And it's a lot more flexible than three sets of RWX flags.

      Windows also provides semaphores, shm, messages, as well as the socket based facilities for IPC.

      OOB may be provided by sockets. Not sure here.

    • by Anonymous Coward
      A few points of order:

      Windows pipes aren't in the filing system, they are in the kernel namespace - which is to all intents and purposes equivalent to /dev.

      Windows kernel objects all have full access control, including pipes.

      Windows provides all those IPC mechanisms you mention, and more, including IO Completion Ports which are VERY fast [a friend just implemented a 160us turnaround on a raw socket under WinNT in user space using IO Completion Ports].

      Windows pipes are files just like Linux pipes, so they are not at all harder to program. In fact, with variable buffer sizes they can be a lot easier to manage.

    • by TummyX ( 84871 ) on Wednesday October 03, 2001 @05:06PM (#2385903)

      Windows pipes have no access control. Hmm, didn't SANS just report on the sorry state of Windows security?


      It does so. You pass the SECURITY_ATTRIBUTES to CreatePipe or CreateNamedPipe.


      Linux provides a much richer set of IPC mechanisms, such as semaphores, shm, messages, as well as the socket based facilities.


      Duh. So does Windows and every other real OS.
      Windows provides much more (like completion ports, events, mutexes etc). Also, it is MUCH easier to use them from Windows than linux. sem_init, pthread_create etc are complex to use compared to CreateSemaphore, CreateThread etc.

      And threads, semaphores, mutexes, events, processes etc in windows are all waitable. You use the SAME functions to wait on one or more of them. In linux you have to use pthread_wait, wait(), sem_wait() etc...all different functions for different types (what's worse is some certain object types don't have certain wait functions). In windows, you just use WaitForObject() or WaitForMultipleObjects() on EVERY type of handle.


      Linux pipes are much easier to write for. Win32 pipes are difficult to use in a C program and subtle programming errors can cause many problems in unrelated modules.


      Um. Like how? Why are Win32 pipes difficult to use in a C program? Huh? You just made that up didn't you?


      subtle programming errors can cause many problems in unrelated modules.


      Like? Give me an example. What do you mean by "unrelated modules" and "subtile programming errors"? What kind of crap is that? Why don't you just say: "The sky is blue therefore microsoft sucks".

      How is this hard?

      // create a pipe with 1K buffer
      CreateThread(&read, &write, NULL, 1024);
      WriteFile(write, buffer, 1024, &d, 0);
  • Do the tests include micro-grained security?

    Pipes are only useful for outdated programming techniques. Sure, there are prob. design patterns for it, but no large system would base it's communication on it.

    Pipe's moto: The world's a File.
    -sigh-
  • IBM has alot to gain by proving Linux superiority. If this were Microsoft's test and they showed the opposite, I'm sure that the /. community would immediately write it off as a rigged test.

    Although in this case, it does like like they at least tried to find a regime in which Windows would do better, which is admirable, but there's still room for skepticism.
  • Windows XP may have fared poorly because it's brand new and so is it's API. On the other hand, Linux and Win2K have had a few years in which their APIs have matured/improved and some of their kinks or other bottlenecks straightened out. Point being that the XP API may still have those kinks in their code, causing some slowness compared to other systems.

    Of course, MS could be simply re-using the 2K API in XP, something they should REALLY take a second look at doing given these results.

  • "... the poor performance of Windows XP was a surprise. Windows 2000 actually did better than XP!"

    This has been happening since the days of the VAX minicomputers, and probably before. Hardware manufacturers want slow, poor performing software, because that makes users buy more hardware. Most of Microsoft's sales are to hardware manufacturers, not to users.


    Secrecy destroys democracy: What should be the Response to Violence? [hevanet.com]
  • by szcx ( 81006 ) on Wednesday October 03, 2001 @12:31PM (#2384134)
    It's not like IBM has anything [ibm.com] to gain [ecommercetimes.com] from publishing a comparison of this kind.
    • If you actually thought that there was an ounce of deceit in IBM's comparison, you would download their published source code, install Linux (I'm guessing that step isn't something you've done already - am I right?) and try the well-documented tests yourself.

      That way, you would find yourself being quoted in all sorts of national tech magazines about IBM's fraudulent benchmarks, rather than just being modded up for some dumbass insinuations on Slashdot.

      Go on. We're waiting.
  • by cppgodjavademigod ( 447528 ) on Wednesday October 03, 2001 @12:31PM (#2384137)
    Let me first say I love Linux. I have 2 Linux boxes and 2 Windows boxes here. I use Linux every day.

    But the Windows code does not use completion ports to do the I/O. If you want the best performance of Windows I/O, completion ports are the way to go. I'm Windows would do much better if the code was optimized for Windows.

    I have writen high speed data I/O applications for Win2K and it performed as well or better than the *nix boxes, when completion ports were used.
  • Its no wonder that XP is performance-wise worse than anything before. Performance in today's world largely deppends on memory and thus OS who does not clutter the memory too much is usually faster in result. But..

    Now that MS has monopoly, they just "improve" their OS by adding all this fancy stuff and trying to hold the monopoly. Once they will lose it, there will be plenty of space (that they help to create now, but crippling their products) to improve their performance.

  • ..will it ever register on the consumers radar? How about applications in use?

    For consumers: we all know that MHz is not all that you should be looking for and yet if you ask any consumer about a PC, their mouth and eye will open wide once they hear about a faster MHz.

    For applications: well, how many applications use pipe? Even those that do use them, what % of the time do they spend in pipes?

    So, yes, this is good news for techies, but that is about it.

    And yes, I may sound like flamebeat -- but, its is time to see the bigger picture for what Linux needs to bring it to the main stream. Mr. Torvalds already recognized this some time ago. This is why he is now focusing on stuff that consumers react to, such as UI.
  • by maroberts ( 15852 ) on Wednesday October 03, 2001 @12:36PM (#2384166) Homepage Journal
    If you've read the the other article(s) (how long it takes to perform a memcpy) in this series, it seems he is trying to desparately find holes where he can say "Linux is better".

    For the record I have 4 PCs, 1 of which runs Linux permanently, the other 3 being dual boot. Desipite being in favour of Linux, these articles give benchmarking a bad name. Most rounded benchmarks show Linux about equal (with some pluses and minuses) to Windows performance, which for me is good enough, since given you can have Linux for free, why pay for an OS that is only just as good ?
    • No, they are stepping stones. He himself says that he hasn't written anything of use yet, but that he is building the foundation for it.

      Each article goes into depth over a single API call, and compares the systems.

      When he gets through about 10-15 articles, he will probably have something useful. Especially since he carefully explains his methodology and reasoning behind each step. This is much better than the traditional benchmarks which do 1 mammoth test and say X is better than Y. In this article series, he's going down and testing, in depth, feature by feature.
  • They compared the Win2k Advanced Server version to the WinXP Desktop version. As we all know, IBM isn't biased at all :)

  • AIX (Score:2, Funny)

    by kireK ( 254264 )
    So why didn;t IBM show the specs for AIX as well? Did AIX do even worse than XP?
  • Pipe speeds (Score:5, Insightful)

    by jd ( 1658 ) <`imipak' `at' `yahoo.com'> on Wednesday October 03, 2001 @12:50PM (#2384204) Homepage Journal
    The relevence of this comparison escapes me, for the moment. Hey, I'm no Windows fan, but most benchtests for ANY one parameter invariably produce a wildly misleading result.


    Some things to ponder:

    • How fast are Linux pipes, if you patch the kernel with LSM? MOSIX? A different scheduler? (eg: RTSCHED, RT-Linux, RTHAL, HP's Scheduler Plugin Architecture?)
    • How long can a given OS sustain a given data rate, under different conditions? (eg: Many processes running, non-interruptable events, miltiple processors, etc.)
    • What kind of resources are consumed, per pipe, per unit of data, per unit time? Do any of the OS' allow/use smoothing, to reduce system load?
    • What results do you get for architectures at the extreme ends of each OS? (ie: Compare ALL the OS' on the minimum suggested and maximum usable settings for Linux, Windows XP, Windows 2000. See if there is a range in which one OS has the advantage, rather than assuming that if it has the advantage at one point, it must have the advantage always.)


    This is not to diss IBM, or even to suggest Windows XP/2000 would even win in such a battle, although I suspect they would for massive SMP arrays, simply because Linux doesn't handle those as well.


    I also suspect Linux would find itself struggling, when put into a hard real-time setting, an ultra-secure setting, or a distributed setting. The overheads involved would not be huge, but if you have a huge number of processes, each with the maximum number of open pipes, the overheads are being applied a huge number of times. That adds up.


    All in all, this suggests that some really severe, rigorous benchmarking needs to be done, under a wide enough variety of conditions to be meaningful. This test just doesn't meet the kinds of conditions I'd expect from a truly determined test.


    Now, if I can only convince IBM to loan me a few dozen boxes, I'd be more than happy to do the testing for them... :)

  • Well, first I wonder why the author would do something like

    x = mult*nbytes + 24;
    when he sets mult=1
    but this only explains for one wasted instruction. On the other handside I would take a close look at the Windows ReadFile and WriteFile functions. These, IMHO, could very well account for the poor performance the author is seeing. There are too many variables mixed into his test program to tell whether this is only the named pipes performing bad ...
  • Hey, I want to see more articles where *Windows* compares more favorably than Linux at something. Seriously. It doesn't help to have totally one-sided technical reviews all the time, for either platform.

    That said, I was kind of expecting XP to perform slower than 2000. 2000 is a modicum of strong engineering -- the only example of truly great software I've ever seen come out of Microsoft. Now, they add the sheen which -- while more user-friendly -- is sure to drag everything else down.

  • "tell me again why we pay this Dr. to test pipes? And howcome half of his budget goes towards delivery pizza??"
  • by lcsjk ( 143581 )
    The article mentioned is well written and informative. Based on the comments, many people comment on the substance based on the lead-in Slashdot posting. I say, before you comment on things like "Home version" or "biased", you should learn to read.
  • ...it's not the size of the pipe that matters but its speed.
  • 'Named pipes' on Win32 and 'pipes' on POSIX do not have much in common, except the name and the fact that you can send data over it. Win32 pipes are more similar to UNIX domain sockets, and while GNU/Linux might still be faster even if UNIX domain sockets are used, it wouldn't be by that much. It would have been interesting to see how real POSIX pipes behave on Windows (for example, in the POSIX subsystem or on Interix, or even on Cygwin).

    Finally, as far as I know, the Win32 API provides other IPC mechanisms, and for transferring large amounts of data, other interfaces are usually used by Win32 programs. That's why the throughput of pipes is not so important on Win32 systems, and performance has not been optimized.

  • by Jeremy Allison - Sam ( 8157 ) on Wednesday October 03, 2001 @01:06PM (#2384329) Homepage
    Unfortunately this article is
    comparing apples and oranges.

    The Win32 call you need to use is

    CreatePipe(), not CreateNamedPipe().

    CreatePipe is exactly equivalent to
    the UNIX pipe() call. CreateNamedPipe
    with the \\pipe prefix is equivalent
    to mkfifo on UNIX.

    No wonder Win32 is much slower, you're
    going through many more layers in the
    kernel.

    Regards,

    Jeremy Allison,
    Samba Team.
    • Wrong, Jeremy (Score:5, Informative)

      by throx ( 42621 ) on Wednesday October 03, 2001 @01:56PM (#2384765) Homepage
      I thought the same thing initially, but when I tried using CreatePipe() instead of CreateNamedPipe() I actually got a performance degradation of about 5%. Looking deeper into this, I found that CreatePipe() actually creates a named pipe and places security descriptors on each end which restrict it to unidirectional access (hence the slowdown).

      From the MSDN documentation:

      Windows NT/2000: Anonymous pipes are implemented using a named pipe with a unique name. Therefore, you can often pass a handle to an anonymous pipe to a function that requires a handle to a named pipe.
    • Me thinks the WIN32 API has changed some rules. From MSDN page about Create Pipe [microsoft.com]:


      Windows NT/2000 and later: Anonymous pipes are implemented using a named pipe with a unique name. Therefore, you can often pass a handle to an anonymous pipe to a function that requires a handle to a named pipe.

  • Read the Headline (Score:3, Insightful)

    by Kaypro ( 35263 ) on Wednesday October 03, 2001 @01:10PM (#2384374)
    This is just saying which OS has faster pipes:

    Linux or Win2K

    (We can eliminate IBM's so called XP comparison....doesn't seem to have much basis)

    All IBM is saying is that if you have some specific app that absolutely needs to have best pipe speed/bandwidth then install LINUX damn it!

    This is not:

    Linux vs Windows
    Linux is harder/easier than Windows
    Linux Rox, Windows Sux
    Windows Rox, Linux Sux
    Tux smashes Windows, news at 11

    Grow up people: When will people realize that there is not one defacto OS standard.

    I love Linux
    I love Windows

    I use Linux for Web Server/FTP Server/IMAP server/DNS/filesharing/

    I use Windows for browsing the web, playing games, Designing web pages, etc.

    Why? Simply because I use the whatever works for whatever I need.

    Why must we have one OS that does everything?

    Seriosly.... if there is some solid reason please tell.

    Just my 2 cents...

    • Generally agreed. However, one point:

      "Why must we have one OS that does everything?"

      Are you kidding? I'm a professional computer admin and serious geek, and I don't like switching between OSes any more than necessary. I don't like rebooting. I don't like any excess (i.e. unnecessary) work just to switch applications. You can imagine how much the average user is thrilled by the idea of needing multiple OSes just to browse the web, write memos, and play games.
  • Run on a Thinkpad? (Score:4, Insightful)

    by corky6921 ( 240602 ) on Wednesday October 03, 2001 @01:21PM (#2384475) Homepage
    In the discussion forums [ibm.com], the guy who posted these results admits, "I ran the tests on a thinkpad."

    I'm sorry, but what does this prove? Linux runs better on a laptop? Is he comparing Linux, the server OS, to Windows 2000 Pro, the consumer OS? What version of Windows XP is he running?

    These tests are really subjective, not only because pipes aren't really used in Windows, but also because he used a laptop to test it (and didn't give details of the Windows OSes he was running.) If anything, I wish he would have used some bigger iron (a Xeon-based system, perhaps, or some of IBM's middle-of-the-line servers.)

    I think the best conclusion we can draw from this is that Linux may indeed be a better OS than Windows in some ways, but that this test doesn't prove it.
  • by eyeball ( 17206 ) on Wednesday October 03, 2001 @01:23PM (#2384489) Journal
    As a systems architect at a very large (non dot-com company I might add), when considering platforms and technology for adoption, speed of certain aspects of an os are usually pretty low on my list of priorities. Tops are:

    - Available human resources: do we have developers that know x technology. If not, how available are they?
    - Business: are there any benefits to adopting a certain technology, such as existing or potential partnerships? i.e.: existing support contracts, brand name recognition
    - Liability: is there someone to blame when things go wrong? (like it or not)
    - Scalability: can the adoption of a technology come with a guarantee that some aspect of performance doesn't hit a brick wall?

    Among others.

  • Unix Sockets (Score:2, Insightful)

    by rootmonkey ( 457887 )
    I think an intersting comparison would be winxp's implemention of unix sockets compared against Linux's implementation.
  • Anyone else bothered by the fact that the tests on Windows were using named pipes while the Linux ones were using unnamed pipes? I'm rather certain that named pipes would be slower in the first place...
  • Although I new Linux would fare the best

    I know this my sound a little.....stupid coming from me, for those that know my postings, but even I am not this bad.
  • Unfortunately this article is
    comparing apples and oranges.

    The Win32 call you need to use is

    CreatePipe(), not CreateNamedPipe().

    CreatePipe is exactly equivalent to
    the UNIX pipe() call. CreateNamedPipe
    with the \\pipe prefix is equivalent
    to mkfifo on UNIX.

    No wonder Win32 is much slower, you're
    going through many more layers in the
    kernel.

    Regards,

    Jeremy Allison,
    Samba Team.
  • Sigh. At one time the Amiga was the pinnacle of personal computer design, but the Amiga community degenerated into an inbred group that other people couldn't stand to be around. I kept wanting to scream "If you like your Amiga, then that's great, but if you think it's so superior then why do you have such a defensive tone?"

    So, yay, Linux fanatics can start bragging that they have faster pipes. And the rest of the world can get even more annoyed with the weird rantings of said Linux fanatics.
  • The real surprise (Score:2, Insightful)

    by Baconator ( 240452 )
    ...is the Win2K vs. Win XP results. As everyone (including the author of the article) has pointed out, pipes don't play a very important role in Windows -- so it's perhaps true that the Linux vs. Windows comparison isn't very meaningful.

    However, the significant performance degradation in any feature from one version of Windows to the next is a pretty damning result. It would seem to legitimize the feeling that many Windows users have that XP is a big downgrade from 2K.

  • Well, Linux may have better pipes, but we all know that Microsoft has lots of more money so they can afford to buy much better crack which more than makes up for the poor quality pipes.

  • The CreateNamedPipe call creates a pipe that can be connected to a pipe potentially on another host addressed by UNC name. MS admits that this is slow and that sockets should be used instead if raw performace is desired. The benifits are that they are authenticated and mediated by the CIFS networking layer (thus the slow down).

    To more accurately compare pipes as IPC mechanisms they should have used the CreatePipe call which creates an anonymous named pipe that only goes through the Kernel and back. These should be quite fast by comparison. Of course a much more interesting comparison would be to compare shared memory -- a much more critical IPC mechanism used by high performace appclications like databases.

    BTW if you want to access NamedPipes and TransactNamedPipes in 100% Java the http://jcifs.samba.org [samba.org] project has implemented everything necessary to interoperate with MS NamedPipe servers.

  • by Tord ( 5801 ) <{tord.jansson} {at} {gmail.com}> on Thursday October 04, 2001 @02:39AM (#2387410) Homepage
    I see a lot of comments here bashing the article for not giving the whole picture and you're right, it doesn't give the whole picture, but neither was it intended to.

    As a programmer doing cross-platform software development I find it interesting and useful. What I want to know is that if I use pipes for IPC, how does it affect performance on the different platforms? I'm not interested in any additional features of Microsoft's implementation of it, because in my project I just want an easy, simple and fast way for cross-program communication that works very similarly on all platforms.

    When I wrote BladeEnc I envisioned that the pipe-support I included in around 0.80 would be useful for using BladeEnc in for example realtime recording applications. Now I know that solution would give quite some performance penalty on WinXP systems and thanks to the detailed graphs I also know better how to tweak the size of the chunks I send/receive to gain some performance.

    Take this article for what it is, a guiding light for software developers that helps them to write better and more efficient applications. It was written by a programmer for programmers (it's on developerWorks) and doesn't make any claims to be a valid benchmark between the platforms in general. It just shows what performance you can expect on different platforms if you use pipes in the most simple way for IPC, combined with different chunksizes.

Top Ten Things Overheard At The ANSI C Draft Committee Meetings: (1) Gee, I wish we hadn't backed down on 'noalias'.

Working...