Mo' Beta Testing Blues 117
theodp writes "Wired picks up on the observation made by Jason Fried that more and more sites and tools are launching and remaining in 'beta' mode. Prominent sites like Google News, A9, Froogle, Friendster, Tribe, and Orkut all sport 'Beta' disclaimers. Is this to get users to do the testing, a subtle way of saying 'don't expect support', or simply a marketing ploy to generate buzz by making users feel 'exclusive'?"
Beta Stuff (Score:3, Interesting)
Maybe it signifies, like in the case of my site Slashster [slashster.com], that it actually IS in alpha.
The problem, I think, is what companies consider to be alpha / beta / whatnot. Alpha is when a product is still in development / testing. Beta is when the project is feature complete, and all that's going on is bugfixing.
Sites like Friendster, Tribes, Orkut, Slashster, do not have a concrete definition of "complete". There's always more functionality to add, always stuff to incorperate, and is ever-evolving. Therefore, it never gets out of alpha / beta phase.
As for my site, as long as there's no true commercial interest within my work, it will most likely stay as "alpha." Not to say that people shouldn't expect support, but rather that they shouldn't expect things to necessarily work either ;)
Re:Beta Stuff (Score:5, Funny)
Maybe not "commerical interest", but nonetheless you are trying to get some. I haxxored your site and found the following psuedo-SQL code:
Re:Beta Stuff (Score:3, Funny)
Re:Beta Stuff (Score:2, Informative)
Re:Beta Stuff (Score:3, Funny)
because of them we can't store the gender as bool
Re:Beta Stuff (Score:1)
Oh... did you mean you wanted to store more about their gender than whether they're dateable or not?
Re:Beta Stuff (Score:3, Insightful)
Actually, the strict defenitions of alpha and beta testing are internal (developer) and external (customer) testing, respectively, prior to release of a product.
Re:Beta Stuff (Score:1, Informative)
Re:Beta Stuff (Score:1)
heh, my Simpy (sig) is in..... BETA, too
Information On Why Froogle Is Beta (Score:1, Informative)
Re:Beta Stuff (Score:1)
Simple explanation (Score:5, Insightful)
today you have to develop things fast
faster development = more bugs
beta version= decreased liability (because of the bugs) while still collecting profits/'name-building'/etc
For example Google API is in a 'forewer beta', they state: "The Google Web APIs service is currently in beta form and has not been fully tested or debugged. Accordingly, Google disclaims any responsibility for any harm resulting from your use of Google Web APIs. "
Imagine if a bridge building company would say something like this. It's plain scary. I mean, get some IT marketing guy and he'll find a way how 'the drivers should do the initial bridge testing'.
What's scary is that even the free projects lately are starting be quite-Beta-excusable for the bugs. Which is bad, since, as we all know, there isn't any valid excuse for having bugs
Now, the thing to do is to patent this Beta concept for selling out half baked potatos for the full price, if you live in Europe that is.
The Bridge Analogy (Score:4, Insightful)
You need to save that analogy for the air-traffic control and space shuttle software. Which, by the way, is not released in beta form.
Re:The Bridge Analogy (Score:3, Interesting)
Some new air-traffic control software went live in the Munich area just before christmas. The controllers who had to use it went bananas and their protests made German television.
One bug I remember: when planes land they can no longer be tracked by radar - doh - surprise! The software sometimes had them heading off the radar screen at mach 2.
Another: the system died and had to be rebooted. When it came back up again, all aircraft were in the system twice. One controller threatene
Re:The Bridge Analogy (Score:1)
Most of these bugs seems to be "fixable". The problem with Traffic Control systems is they rarely change, making the operators pretty aggressive towards the new features or options. Developing user-driven software is quite simple. For example we are developing a software which replaces our customer's old software. Instead of getting rid of annoying feature, il-logic-flow within
Re:Simple explanation (Score:4, Interesting)
how's that for developer responsibility?
Re:Simple explanation (Score:1)
Re:Simple explanation (Score:4, Informative)
today... beta version= decreased liability (because of the bugs) while still collecting profits/'name-building'/etc
Exactly, on the sentiment, but this is hardly new, and hardly just software. I've seen plenty of microprocessor manuals printed with "PRELIMINARY INFORMATION" long after the procesors were shipping and built into production systems. In the few cases I was able to get an authoritative reason, it was closely related to CYA (such as not wanting to be legally held to the specification if a sufficiently nasty bug in was discovered after shipment). And when this wasn't enough, some then added the "Do not use in life-support applications" disclaimers.
Re:Simple explanation (Score:1)
Re:Simple explanation (Score:5, Insightful)
Not true. Bugs are a resource problem. Take a fixed team of developers and a fixed time for development and you have to sacrific either stability, security, or features.
Desktop and most corporate customers demand features far more than they demand stability. It's a fact of life. Everybody complained about bugs in the 9x branch of Windows, but stayed with it because of the exclusive features (including market penetration).
The solution is to supply more resources, which means that your product must involve more developers, and/or take more time. So there's a plenty good excuse: nobody wants to wait for progress in software.
For the few markets that do, like some financial and government projects, stability is very important, and so these projects take a hell of a lot more time and money to develop.
Re:Simple explanation (Score:1)
Re:Simple explanation (Score:2)
On the other hand, I've used CBuilderX...and it seems vast improvement in usuability. I don't know about compiler bugs, but the pro version comes with about 300 other compilers as well, it would seem.
Re:Simple explanation (Score:1)
If GM was designing cars as software
Re:Simple explanation (Score:2)
Re:Simple explanation (Score:4, Insightful)
You're on the right track, but it's more than that:
1) Risk management. Beta software is a way to manage the risks of rolling out a piece of software or a web site. Does the software have a subtle bug that can't be reproduced in the lab? Does the web site have unexpected scalability problems? Software can get deployed very quickly, and once the floodgates are open it can be tricky to fix these types of issues.
2) Customer feedback. Do the customers love the software but find a few important features awkward? Usability testing and focus groups will discover some issues, but others may require real customers to use the software for an extended period of time.
3) Early availability. The best software isn't software that has "no bugs", it's the software that's good enough and released soon enough to start being useful (and, potentially, grab market share). Beta versions make the software available sooner than normal, with the caveat that the customer will run into more bugs. The customer can decide whether this tradeoff is worth it.
(Clearly, this isn't appropriate for all types of software.)
4) Partner integration. Massive software rollouts, such as a new operating system or service pack, require an extended beta testing period in order to give partners time to prepare for and take advantage of the changes.
For example, XP SP2 contains many security enhancements that can break some software and web sites. These are impossible for Microsoft to fix on their end, so the betas give vendors some time to address the problems. Similarly, Longhorn adds a significant amount of functionality to the Windows platform, so providing early access (not even beta yet!) gives partners time to learn the new technology and start creating products that take advantage of it.
5) Customer integration. Complex software systems require time to plan, evaluate, and learn. Beta releases give customers additional time to figure out how (and whether) the software will fit into their existing infrastructure. It also gives them time to learn the new software and create training materials, procedures, etc. for the people that need it.
No Risk (Score:4, Insightful)
I miss (Score:5, Funny)
Brak was his name, wasn't it? Oh, we had some good times together. Crazy stories, everyone had mod points. Ah yes, that was the day.
It's not limited to those. (Score:3, Informative)
To be fair it may just be more of a "work in progress" than beta but still you have to live with the bugs or move onto another game which will be in the same situation.
eBay (Score:5, Interesting)
More information about eBay's workshops can be found at....
http://www2.ebay.com/aw/marketing.shtml
Re:eBay (Score:2, Insightful)
Anyway, I actually replied to tell that eBay/PayPal sucks as a company. They don't care for the users, their eBay and PayPal fees are quite high, they do not stop increasing the profit volume and they do not make fees cheaper.
I sometimes buy stuff in eBay, and some guy ripped me off. I bought
good for them (Score:2, Insightful)
I would much perfer a site say they are beta instead of putting out non working features.
Re:good for them (Score:1)
I would much perfer a site say they are beta instead of putting out non working features.
I'm going to send this comment to microsoft...
Re:good for them (Score:1)
In software one could perpetually claim that there is "work to be done" (`maybe emacs could use a object model of a kitchen sink..') which is why the standard is that you choose a feature-set for a release, go through the various refinement steps of alpha/beta/rc, and then release. You're then free to move to the next version number.
What we're seeing instead is a large number of organizations using "beta" as a rath
So, what's new? (Score:2, Interesting)
Let me suggest (Score:1)
'Beta' Has Become Fashionable (Score:2)
nothing fashionable about database errors (Score:2, Funny)
These sites are free. (Score:5, Insightful)
Open source software does this a lot as well. And it touches stuff that I use right now: the Scons build system is stuck at version 0.95. Mozilla Thunderbird is at version 0.6. Mozilla Firefox is at 0.8. Does this mean that there's anything glaringly wrong about the functionality that they provide? No. It means that there may be a couple of rough edges and that work is still ongoing to finish less important features and to polish up the project. If they were boxed products on the shelf I'd be upset, but since I paid a total of $0 - and they work for me - I don't care what the version number is.
Anyway, I think this is a reflection of the development model more than anything else. Commercial software tends to have a "really big design up front", followed by a bunch of milestones to implement. Open source software (and web-based applications like Google) tend to be more organic. More a work of sculpting one feature at a time than a messy work of planned burocracy. The features that are important tend to be implemented first. And given that the core 10% of most software's features is used 90% of the time - this isn't a problem to most users.
Damned Firefox crashing all the time (Score:1)
(For me, crashing all the time >= once every three days)
Don't have a crappy Win98 box (Score:1)
Re:These sites are free. (Score:2)
What is needed is a clear definition for a given project. Basically, someone saying we're going to implement X-and-such features and anything else can wait for the next release.
lowered expectations (Score:4, Insightful)
Many companies (mine included) are under constant pressure to release new products with more features. Often this means that instead of fixing bugs making products better, we are working on the next release.
Perhaps the constant *beta* is a marketing ploy. Tell people its beta and they can't complain when bugs are found. So what if the product never comes out of beta.
Classic example. Has there ever been a non-beta version of ICQ?
Re:lowered expectations (Score:4, Informative)
Yes. The OS X version is currently at 3.4 - non-beta.
Re:lowered expectations (Score:2)
Yup, remember 99 alpha?
It's overused because everything's in beta (Score:3, Interesting)
To me, beta always signified that a company was to release the software soon and I could get a "preview" for free. However, as the article points out, marketting departments are trying to alter the definition of the word to suit them. I don't know if this is good or bad, it's just more marketting.
Re:It's overused because everything's in beta (Score:5, Insightful)
A project that always adds features and fixes bugs at the same time is a very badly managed project. Beta testing is a phase in the software development lifecycle. It's a cycle for a reason: people want features and don't want bugs, but new features introduce new bugs. Every time you add features, you have to text and fix and get it back to a point of stability.
Any decently managed project has a cutoff period where new features are not allowed, so that bugs can be fixed to a point where the team decides that it's OK to release the software. Sometimes this is an ad-hoc decision balancing bug counts with market pressure, and sometimes it's just a threshold of bug counts of various severities. Then, when the release is done, the feature wish list is examined and the feature list for the next release is set.
Open source projects that rely mainly on code donors still do this, but they don't necessarily know exactly what features are going into the next version since they can't predict what code will be donated. Still, the folks managing the project must at some point decide that a release is needed, and work toward a stable, release-worthy point, or else the project will just be an ongoing death march of brokenness and half-completed features.
Beta means that the project team doesn't think that the code is releaseable yet, but it's past the point of feature cutoff, and past the internal testing phase. They're giving the users a chance to beat on the software to find any esoteric bugs that internal testing missed, before telling the world that the software is believed to be stable and correct.
Beta = Better (Score:5, Funny)
Hmm, wait a minute, this piece of beta software I have running seems to be misbehaving...
Icq beta (Score:2, Informative)
Icq weren't a site, but stayed a long time in beta (still are?), but it was because Mirabilis was thinking about charge for the service.
Maybe it's some sort of legal move to do anything you want with the service without people complaing...
Re:Icq beta (Score:1)
this way (Score:1)
if its broken... (Score:1, Interesting)
Make $5250 Guaranteed!!! All you need is a PayPal account and $25. We'll do the rest. Click here to find out how. [dollarrandomizer.com]
Proper testing nomenclature (Score:5, Interesting)
Too many companies and programmers seem to lack a good understanding of what "beta" software really is, because a lot of software they release as beta-grade is really alpha-grade. While there are fairly extensive breakdowns of the development process [sqatester.com], I think you can basically divide the quality assurance cycle of a product into four main points.
Pre-alpha grade software is software that is only being tested internally. It probably doesn't work at all. Perhaps some modules work, but it'll mostly be broken until later builds.
Alpha-grade software is software with new features that has yet to be tested, perhaps with the exception of some internal testing. As a result, when you participate with in an alpha test for a piece of software, you're getting a bug-ridden product to say the least. Things probably won't work the way they should; the software will probably crash; and to say the very least, that build shouldn't be rolled out onto a production machine.
Beta-grade software is software that is more-or-less finished, but is being released for a wider test to work out any undiscovered bugs from the previous development stages. A beta-grade product should be production ready, but generally you won't want to roll it out until the final release builds are made.
Your post-beta, or gold stage, is really just the final builds of the product. By that time, any of those builds are ready for market, but they may run through a few compilations just to do last-minute checks.
A lot of companies attach the term "beta" on alpha-grade software simply because they think it'll drum up more PR for the product. In reality, they're just giving their customers a load of bull. That being said, I've found a lot of beta products to be incredibly solid. Mozilla and Opera are two great examples. While they may crash occasionally, or I might find a bug or two if I dig really hard, I could see those beta builds being out on the market.
Beta Could Mean Beta (Score:2, Insightful)
Another site in beta... (Score:1)
It's not complete enough to launch, but enough is there to show something to the public.
I labeled it as "Preview" instead of "beta" because most non-techie people don't know what beta means.
Re:Another site in beta... (Score:2)
Top ten reasons (beta version) (Score:5, Insightful)
2. Plan and code has been changed to 'guess and check'
3. Companies want to see if somthing will be popular and generate revenue before they put money into making it work.
4. Another way of disclaiming liability.
5. Sounds 'techie.'
6. Peer pressure.
7. People want customers to help with debugging.
8. Change is constant. So is Beta testing.
9. Dotcom crash has scared people. Folks want to 'see the money' as soon as possible.
10. Companies realize that because of revisions to UCITA, enforcement of shrinkwrap liscenses, etc. that they're not going to be held liable for the problems that they cause, above the price a customer has paid for the product which is almost never enough to justify any kind of lawsuit in the first place.
Surrender all privacy to try our beta service! (Score:1, Interesting)
Re:Surrender all privacy to try our beta service! (Score:4, Interesting)
You mean like Name, Date of Birth, Country or State of origin, and Email address?
You did realise the rest was optional didn't you?
Most fields can be left blank, and most dropdowns have a "no answer" value.
But remember, it _is_ a personal networking site. The whole point of these sites is for people to see whether or not you might interest them by the answers you give to the questions...
Regarding Beta Testing (Score:4, Insightful)
Software engineering really is that, engineering, but it is often not looked at this way. Writing code is the easiest part of it all but many steps and procedures should be used to ensure the highest quality and robustness of software possible. We have way too many under-educated, non-read and undisciplined developers/managers that really need to observe other fields of engineering, such as civil enginering/construction to see what we need to do to make software development of higher quality.
I will now step down from my soap-box.
Orkut (Score:2, Interesting)
Almost as silly as "Under Construction" gifs (Score:5, Insightful)
Google News, on the other hand, might as well use a stupid animated "Under Construction" gif for their pages, since it seems to be in perpetual beta. The service launched (ie. left the Google Labs) all the way back in September, 2002 [com.com]!
Re:Almost as silly as "Under Construction" gifs (Score:2)
I really think it's a support issue. Or perhaps users are still having problems, and they haven't ironed everything out yet. It's a way of saying "Look, we think this is useful for a bunch of people, but we can't say nothing will ever go wrong just yet".
I remember when Google bought the DejaNews arch
Umm infrastructure? (Score:1)
R and D, and $ (Score:4, Interesting)
You can say something similar about A9. It extends Google, and adds in-book searching, search history features, the toolbar diary, etc. It is a good place for them to work on features before deploying to the actual Amazon site.
And a major reason why these might just be testbeds is that they generate no revenue. The technologies developed may be useful in their revenue-generating products. Having the public test your stuff is a great way to see how it really works.
no real deploy phase (Score:3, Interesting)
Who cares! (Score:1, Redundant)
Be patient and wait for the official release. Pretend the product never got released.
Sometimes it is about roll out speed. (Score:1)
Best way to test (Score:2, Insightful)
beta is just more honest? (Score:4, Insightful)
The point is that I don't think companies are releasing software any earlier than they used to, they're just being more honest about the quality of it. Google news still being beta means they can mess around with it and not piss anyone off. The article seems to imply there's something wrong with lowering peoples expectations.
Has ICQ ever come out of beta? (Score:1)
Crash (Score:1)
Google (Score:2)
On the other
Ahead of the game (Score:1)
Re:Fucking Linux Nuts (Score:1, Funny)
Make up your mind, will you: does it fuck or does it suck? Unless it's a threesome, you can't do both, you know.
Re:Fucking Linux Nuts (Score:2)