Alternatives To SF.net's CompileFarm? 186
cronie writes "Not long ago, SourceForge.net announced the shutdown of the Compile Farm — a collection of computers running a wide variety of OSes, available for compiling and testing open source projects. SF.net stated their resources 'are best used at this time in improving other parts' of the service. I consider this sad news for the OSS community, because portability is one of the strengths of OSS, and not many of us have access to such a variety of platforms to compile and test our software on. As a consequence, I expect many projects dropping support for some of the platforms they can't get access to. Are there any sound alternatives with at least some popular OS/hardware combinations? Any plans to create one? (Perhaps Google or IBM might come up with something?)"
not to be a jerk but... (Score:3, Interesting)
Maybe the project has ended because that's not where the future of computing is headed. Maybe the future is something more like "write once, run anywhere".
Vendor support... (Score:5, Interesting)
How about vendors supply compile farm gateways linked from SF.NET for use by SF members. Great way for hardware vendors to show off their new stuff to folks that might be inclined to buy or have influence in the purchase decision.
Kinda like a hands-on remote(?!) demo.
SciTechPulse. Geek News Netcast. Hot Polynesian Geek Chick Host Silulu. [scitechpulse.com]
Re: (Score:3, Insightful)
Re: (Score:2, Insightful)
True, but remember that the more software that eventually runs on your platform, the more people who are likely to adopt it.
Re: (Score:3, Insightful)
Re:Vendor support... (Score:5, Informative)
Re: (Score:2, Insightful)
Re:not to be a jerk but... (Score:5, Funny)
Re:not to be a jerk but... (Score:5, Interesting)
Re: (Score:2)
LOL! You crack me up! No, really!
It's no big deal (Score:3, Informative)
Most projects are staffed by people using multiple platforms anyway and anyone coming along with a requirement to support some odd-ball OS might just get pulled in to do compiles and tests. For example, the SF project I work on is mainly staffed by Linux people with a few Windows and this project does not use the compile farm. Those using OSX just ne
Re: (Score:2)
Re: (Score:3, Informative)
And on that insight you have: Not even Java or
Re: (Score:2)
And on that insight you have: Not even Java or .NET really work that way, so we are kind of far, far away from that.
This really *is* getting old these days... Java has gotten to the point where we feel comfortable developing systems under Windows that will be deployed under Linux. I haven't seen any issue caused by this in *years*.
Got any "640k" references you want to drag out? Or perhaps there is an "AMD is kicking Intel's butt" comment you want to make too?
Re: (Score:2)
Unnnghh... why would you want to do that? Glad that for me it's the other way round. (Unless I have to test our COM-based MS Office integration. Funnily enough that doesn't work to well on my ubuntu box.)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
There definitely are swing gui problems from time to time. Not fatal ones usually, but ones that need to be fixed.
Re:not to be a jerk but... (Score:5, Informative)
Their entire service was off-line for a while last week, not fun.
I've moved my project to google code project hosting. Their service is simpler, but reliable. The addition of a wiki is really helpful, and uploading new releases is trivially easy.
google could offer a compile farm with ease. I expect it won't be long now that sourceforge have removed theirs.
When I first started using sourceforge four years ago I liked the service, but when they moved to having paying customers, everything started to decline for the free hosted projects. They said it wouldn't but it still occurred.
I'm of the opinion that sourceforge got too complex, and now they can't manage all the aspects they wanted to include. No doubt if everyone paid it would be easier, but not many open source developers have free funds for such things. If people had to pay then small incomplete projects might not even get off the ground. Mine certainly wouldn't have, since I was a student, and financially limited.
Re: (Score:2)
Yeah, too bad that any attempt at that so far has been an abject failure. This was the big promise of Java, and Java code does not work predictably across platforms, even after Sun essentially abandoned the desktop and focused on the much simpler domain of server-side applications.
Re: (Score:2)
Emulation? (Score:3, Interesting)
Bugs (Score:2)
Cost of obtaining the operating systems? (Score:2)
Clicking a download link for a prebuilt virtual machine image hardly requires a massive time investment.
This doesn't solve the problem facing developers of ports to Windows OS. For development of ports of free software to proprietary operating systems that are not freeware, performing a day job for several hours of overtime in order to buy an OS license for each developer does require a massive time investment. How many hours of flipping burgers is Windows Vista Ultimate (or an MSDN subscription) worth to you? Besides, a lot of proprietary operating systems have EULA restrictions against virtualization at
VMs (Score:3, Interesting)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Also, QEMU is able to emulate other CPU architectures, so you can test those out as well.
Re:VMs (Score:4, Informative)
QEMU won't do POWER, and it certainly won't run anything other then the normal OS configurations.
VMware is excellent for development, but has nothing to do with a render farm.
Re:VMs (Score:4, Insightful)
I believe he meant this [ibm.com] kind of power.
Power != POWER; Sparc != SPARC (Score:3, Informative)
QEMU won't do POWER
The SF.net CompileFarm was not there to provide 'power'. It was there to provide access to different systems for compilation of your project. Anyone using it for 'power' was abusing it.
cbreaker said POWER; you said "power". There is a difference between "power" and the POWER architecture [wikipedia.org], and QEMU doesn't emulate the 64-bit POWER architecture. There is also a difference between "spark" and the SPARC architecture [wikipedia.org], and QEMU's support for SPARC is still very immmature. (Source: QEMU Status [bellard.free.fr])
Re: (Score:2)
You see, VM is not a solution for most cross compilation.
Re: (Score:2, Interesting)
Basilisk on a NetBSD/i386 box, running NetBSD/68k. Hmm. I suppose you could run it another layer deeper by running the NetBSD/i386 on bochs on a NetBSD/sparc box. Make it a SparcStation IPC just for fun.
Virtualisation negates the need for a compile farm (Score:5, Interesting)
Who needs a compile farm when most of what we need can be run from a single moderately decent workstation?
Re:Virtualisation negates the need for a compile f (Score:5, Insightful)
Re: (Score:2)
We have... Windows, MacOS, Linux, and BSD.
Anyone else?
I spose there's still people working with Sun/Solaris and HP/UX and AIX, but for the most part, open source devs care that it works on their stuff, and to heck with whatever else.
Re: (Score:2, Insightful)
All of them in numerous different versions, and in the case of OS X, Linux, and BSD, running on a variety of hardware. (There's still PLENTY of PPC-based Macs around, for one.)
Damn right. More than you'd think, in fact.
Re: (Score:2)
Re: (Score:3, Insightful)
Yes, such as the entire banking industry and almost all it's associated software vendors. Admittedly there's been a move towards Solaris/x86 but there's still a huge market for UltraSparc machines; not all jobs can efficiently distributed across multiple machines and Intel architecture can't provide more than 16 cores. The Cell processor is attracting a lot of attention as a potential replacement for Sparc and requires specialist development machines.
Re:Virtualisation negates the need for a compile f (Score:4, Informative)
IBM sells a 64 core Intel based system.
The Cell processor is attracting a lot of attention as a potential replacement for Sparc and requires specialist development machines.
Unlikely. The Cell is PPC, not Sparc. And Sun already has their own highly parallel designs - Niagara (eights cores) and Rock (four cores with four processing engines each).
As much talk as there is about Cell's potential, I'm not convinced. It's not a particularly good general CPU - most of the die space is dedicated with SIMD instructions, which are only useful for a certain class of application. The most obvious market outside real-time video processing would be scientific applications, but the Cell throughput drops from a claimed 218 gigaflops to about 26 gigaflops when you put it in double percision mode (which also enables IEEE standard rounding). Still fairly impressive but you'll only reach that number if you're doing strictly vector math.
Re: (Score:2)
Really? I couldn't find any on their website and have never heard of IA-32/64 architecture being pushed that far. According to their products site only their POWER based machines are 64-way, their Intel/AMD units are four socket (16 cores at most).
The Cell is being looked at by large banks a
Re: (Score:2)
Most open source software development is done on Linux and *BSD, which support the POSIX standard. There's no good reason why open source software couldn't run on almost every POSIX system under the sun, except that you need a testing ground to find and eliminate a few quirks resulting from unspecified behaviour.
Re: (Score:2)
Re: (Score:2)
SPARC's on death row and HP buried the Alpha (poor thing was still kicking and screaming
People who pick "one vendor" platforms should be well used to paying lots of money for anything.
Anyway, the only one who should build an expensive SPARC compile farm should be Sun. It's crazy for anyone else to do so. Are people going to suggest some company/organization buys lots of _expen
Well Qemu could help with a few more ISA's (Score:2)
Re:Virtualisation negates the need for a compile f (Score:2)
The single reason I have ever used SF's compilefarm is to test my code on 64 bit architecture. For testing on different distros, I indeed do it all locally (using chroot environments). But for testing x86_64, if you don't happen to have a 64 bit CPU, VMWare is not going to help.
Re: (Score:2)
They announced this AFTER the shutdown? (Score:5, Interesting)
Posted By: wdavison
Date: 2007-02-16 00:13
Summary: Compile Farm News
As of 2007-02-08, SourceForge.net Compile Farm service has been officially discontinued.
Shutdown on Feb. 8, announcement on Feb. 16th?
With behavior like that, SourceForge can't be considered a safe location for important code. I'd suggest that it's time to get projects off SourceForge. Make offsite backups of anything important now.
Latest announcement from VA Software [yahoo.com], which owns SourceForge:
VA Software Corp., whose software and online media are targeted for the open-source software community, said Thursday it named Scott E. Howe to its board of directors.
Howe is president of a division of digital marketing company aQuantive Inc.
"Scott's extensive knowledge of the media markets will be invaluable as we continue to focus on our core media assets and strive to secure alliances in the global competitive landscape," VA Software President and Chief Executive Ali Jenab said in a statement.
VA Software slipped a penny to close at $4.24 on the Nasdaq Stock Market.
If VA Software thinks they're now a "media company", it's time to get off SourceForge.
Dummy - Slashdot IS VA Software (Score:5, Interesting)
VA Software owns Slashdot:
http://www.ostg.com/about/index.htm [ostg.com]:
Ergo, VA Software is a media company.
Time to get off Slashdot.
Re: (Score:2)
Re:They announced this AFTER the shutdown? (Score:4, Insightful)
It was announced afterwards for a reason. They're not really taking it down because nobody wants it or anything, it's because they lack manpower to keep it working. It basically needs a lot of work to get it back in a usable state, and it's not widely used, so they're just dropping it.
This is the classic downside of "software as a service".
Re: (Score:2)
I see it more that if someone likes a certain fringe platform so much that he wants to see Linux software ported to it, he should maintain a compiler/test machine with the help of standardized deployment software. Sourceforge could release the tools they were us
Re: (Score:2)
Re: (Score:2)
That's more than a month of downtime, slightly more than sourceforge's 4 days..
One Nine? (Score:2)
Re: (Score:2)
Industry moving forward (Score:3, Insightful)
Re:Industry moving forward (Score:5, Funny)
--S
Re: (Score:2)
Re:Industry moving forward (Score:5, Insightful)
There are so many exceptions to what software-as-a-service can reasonably do that the majority of people who are reading this do on a daily basis that I just have to laugh when people bring this up. Beyond a wet dream for Microsoft where they lovingly sit back and watch the monthly subscription dollars roll in, this is never going to happen.
Re: (Score:2)
Your post is mostly in the bullseye, but I'd replace Microsoft with Google on that sentence
Re: (Score:3, Insightful)
Now implement a cryptography library on the "software as a service" model. Oops, you're sending plain text data through the cables...
Now implement a real time application on the "software as a service" model.
Now implement an application which requires near-100% availability on the "software as a service" model.
Now implement a high-end game on the "software as a service" model.
Are you done? Do you like the results?
Re: (Score:2)
Umm... YouTube?
Now implement a cryptography library on the "software as a service" model. Oops, you're sending plain text data through the cables...
Encryption of the communication channel is part of the stack (TLS). In a "software as a service" model, data storage would be server-side, so a crypt library beeyond that is pointless. It's like asking where you put the port hole on a bicycle.
Now implement a real time application on the "software as
Re: (Score:2)
Youtube is just a site which stores and transfers flash video format files to you, it's not a media player by any means. The media player is stored locally, and its name is "Macromedia Flash Player".
What if you want to encrypt data on your hard disk?
Re: (Score:2)
Flash is no more a video player than a java or visual basic runtime is. The virtual machine does include the codecs for displaying the video, but a codec is not a media player.
What if you want to encrypt data on your hard disk?
Then you're a poor market for web services.
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Can we start a replacement project (Score:4, Interesting)
Re: (Score:3, Insightful)
Re: (Score:2)
Re: (Score:2)
"Hey, hackers! Wanna try out your 0-day privilege escalation attacks? Here's a username and password to my computer on this IP address! Don't worry about brute-forcing the root password, I've got plenty of spare processing time!"
The world has changed since RMS let people use his MIT account. Sorry, but in this day and age, unless you're a security expert, you'd be asking for troub
Re: (Score:2)
Remember, various sourceforge tools have various dependencies: compiler, web server, glibc and gcc PHP and perl and regexp and make, all of which may affect compilation and proper behavior. That's a nightmare to predict on someone's private server. If folks were willi
Debian build daemons (Score:5, Informative)
Re: (Score:2)
Re: (Score:2)
There is a manual at www.debian.org, it shows how to include your project at Debian. You'll basicaly need to pack your code acordingly (what includes instalation procedures and minimal documentation) and get in touch with some Debian developer.
Keep in mind that Debian people is very anoyed with projects that are once included and never updated, so people may be a bit suspicious about you on the beginning.
Solution: Rent some zombies from some hax0rz! (Score:2, Funny)
Re: (Score:2)
CPAN Testers (Score:2)
http://www.testdrive.hp.com/ (Score:5, Informative)
HP dude Bdale Garbee has said HP is delighted if people use testdrive to test their code on different architecture and OS combinations.
I'll do it. (Score:5, Informative)
4x Sgi o2 (MIPS both R10k and r5k) currently running IRIX, but I could install Linux, NetBSD or OpenBSD
Compaq with Xeons (eight way SMP 4GB RAM) Debian or FreeBSD
Sun (four way SPARC64 SMP 2GB RAM) running Solaris, but I could install Linux
Sgi octane2 (MIPS R14k 1GB RAM) IRIX
HP visualize J6700 (dual SMP PA-RISC64 4GB RAM) running Debian, could install HP-UX
HP precision book (PA-RISC32) running HP-UX, could install Linux or OpenBSD
Sun (SPARC64) running OpenBSD, could install Linux or Solaris
Plenty of boring x86 machines, some older PA-RISC32 junk, and probably other RISC boxen that I forgot about....
Send an email to
unixclan
REMOVE THIS IF YOU ARE NOT A BOT
@
gmail.com
If you think you can help me host an alternative compile farm.
Re: (Score:2)
Apple Mac OS X??? (Score:2)
I used the Compile Farm for Apple Mac OS X.
Now where do I go?
Re: (Score:2)
HP TestDrive has many of the platforms (Score:2)
You might want to look into HP's TestDrive [hp.com] program. You get access to wide range of OS's, on x86, Itanium and PA-RISC. Sign up, log in, and play.
IIRC, it's not quite such a range of hardware as SF provided, but it is a wider range of OS's on the hardware they do provide.
The openSUSE Build Service (Score:4, Informative)
Usage stats? (Score:3, Insightful)
Do we have any actual data on how popular the service was? I think this was a neat idea, but if it wasn't being used it won't be missed...
To sum it all up: alternatives for SF Compile Farm (Score:2, Informative)
at the moment, and it will be missed a lot.
The suggested alternatives can partially alleviate the problem:
http://www.testdrive.hp.com/ [hp.com]
[FreeBSD, HP-UX, HP OpenVMS, HP Tru64 Unix,
Mandriva, Debian, RedHat]
http://www.blastwave.org/ [blastwave.org] [Solaris]
But a lot of stuff is left out (at least NetBSD, OpenBSD, Darwin,
Linux on POWER, AIX).
Please prove me wrong and provide links for alternatives to the CF for those
systems.
Re:To sum it all up: alternatives for SF Compile F (Score:3, Interesting)
Re:To sum it all up: alternatives for SF Compile F (Score:4, Informative)
Google source control (Score:2)
Re: (Score:2)
http://code.google.com/hosting/ [google.com]
GCC Compile Farm (Score:4, Informative)
http://gcc.gnu.org/wiki/CompileFarm [gnu.org]
See "How to get involved" chapter to get an account.
99.9% (Score:2, Redundant)
So you setup an Intel Mac, VM Win/Linux, write Python, Perl, PHP, or C, to minimize the testing needed and you're done. Add another 3-5 flavors of Linux because the various distributions are complete assh*les and can't standardize on all the libraries of course, so your code won't run on Redhat and SUSE w
ec2 (Score:2)
DIY (Score:2)
Re:Obvious (Score:4, Informative)
- compiling the software on all platforms
- running automated test suite
- automatically building packages periodically
- determining what percentage of the code your test suite covers
- verifying the built package works
Patches from users cant reproduce all of these things, and this is where compile farms come in handy. Whether it makes sense for something like sourceforge is another matter.