Stories
Slash Boxes
Comments

News for nerds, stuff that matters

Slashdot Log In

Log In

Create Account  |  Retrieve Password

Server CE Database Development with .NET

Posted by timothy on Wed Dec 17, 2003 11:30 AM
from the select-where-as dept.
William Ryan writes "SQL Server CE is Microsoft's preferred database backend for its Compact Framework initiative. Compact Framework is a cool technology, but it's still in its infancy. This book does a lot to help you get started using SQL Server CE." Read on for the rest of Ryan's review, or revisit his November review of a related book, The Definitive Guide to the Compact Framework .

This book comprises 10 Chapters in just under 450 pages, including the indexes and usual book stuff. Since CE supports ASNI Sql, there are a few chapters that discuss using SQL to manipulate databases, which are probably not necessary for most database programmers. Chapters 4-8 are dedicated to DDL (data definition language), DML (data manipulation language), and taking advantage of metadata. It's a good discussion of these subjects, and I guess an author must include them to be thorough, but if you aren't that familiar with SQL, you probably have some learning to do before diving into data-driven PDA apps.

Enough about the background, though. The book really excels in two areas, one of which I think is probably useful to any developer, even if you don't use the Compact Framework or Microsoft Products. That area is security.

Far too many developers blow off security concerns, or claim to care but do little or nothing about actually increasing security. Let's face it: no matter how secure your OS is, no matter how killer your firewall is, today there are a lot of people trying to break your app and they aren't always outside of your company. Tiffany points to a GIGA Information Group article criticizing the industry for ignoring security on mobile devices.

A lot of what he says is focused on security issues that are 'common sense,' and yet ones that people ignore all the time. It's kind of a shame that a writer needs to explain the benefits of using 'Strong Passwords,' but let's face it, no matter how well you write your app, it won't be secure if you leave the front door open.

In no way am I saying that the author's discussion of security is limited to such elementary topics, but he does a great job of bringing many issues into focus and suggesting ways to deal with them.

The other area that this book really excels in is getting you through replication. This is not a fun topic if you don't know what you are doing and there isn't a lot of literature out there to help you get through PUSH/PULL subscriptions and the like. Pragmatically speaking, of the topics this book covers, Tiffany's coverage of replication is probably going to benefit people the most, because if you can't sync your PDA with your server, you are effectively out of gas. If you aren't a Sql CE user you won't appreciate the value of this chapter, but love MS or hate them, the newsgroups and forums are filled with folks with the same sorts of problems that the author works diligently to get you through.

It's hard to know what will and won't work yet on the Compact Framework and CE. It's quite helpful to have a list of common functions that are supported listed in depth -- another thing I liked about this book.

What else? Well, the text was well written, very similar to his last book on Pocket Access (Pocket PC Database Development with eMbedded Visual Basic) and easy to read. If you are a total newbie to CE, you can use this book and hit the ground running. Everything that you need to write professional apps is included, and I can't find anything that Tiffany omitted.

I really appreciate the fact that the author wrote an entire book on such a niche subject. Many areas, particularly the Compact Framework, don't have a lot of literature on them and if you are writing SQL Server CE, you are on your own...until now.

If you develop in CE, or plan to, this book is a Must Have.


You can purchase SQL Server CE Database Development with the .NET Compact Framework from bn.com. Slashdot welcomes readers' book reviews -- to submit a review for consideration, read the book review guidelines, then visit the submission page.

+ -
story
This discussion has been archived. No new comments can be posted.
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
 Full
 Abbreviated
 Hidden
More
Loading... please wait.
  • by Anonymous Coward
    no, really, i can't. bashing things out of ignorance is fun and easy.
    • by Anonymous Coward on Wednesday December 17 2003, @12:08PM (#7746088)
      "no, really, i can't. bashing things out of ignorance is fun and easy."

      (Posting anonymously to protect myself and my employer).

      No ignorance here. I worked on a .NET Compact Framework (via VB.NET) + SQL Server CE application in the earlier part of 2003. Note that while they integrate with their namesakes, .NET CF and SQL CE's implementations appear to share almost nothing with their desktop counterparts.

      I cannot emphasize strongly enough how much this stuff sucks.

      Let's display a form with maybe 10 elements (a few text fields, a few static text labels, a few command buttons). It takes maybe half a second to a second, highly visible control-by-control drawing that the user can see.

      Let's perform a simple query, like SELECT id, name FROM items WHERE parentid = , returning a dozen or so rows. Yep.. half a second. From what I could see a lot of overhead was involved in passing the data from SQLCE to .NET, representing it all as ADO.NET or whatever objects along the way..

      By the time you're bringing up a form, performing a couple of queries and throwing that data in said form, the user is waiting a couple of seconds. Every. time. they. tap. something. It is not good enough. The resulting application is a joke.

      Databases can be big, so you might want to put them on external media ie a compact flash card. Except you point SQLCE at a db on a card and it just doesn't frickin work!

      This is all based on a fastish (400MHz XScale CPU iirc) Dell Axim. Don't even think about throwing this stuff on an older device.

      By the way, Microsoft .. requiring a total of about 8 megs of runtimes (.NET CF + SQL CE) is not something handheld users are accustomed to.

      • Works fine for me on a 400 MHz PXA255'd XScale. It's running WinCE.NET 4.1, which includes the .NET CF. I've never used SQL CE, I've used the built-in db system. You must be working with older software, PPC2k or 2k2. Things move forward- yeah, it's a bitch, but would you have us all writing code in assembler instead?

        If your company has any other .NET CF jobs, send 'em my way- I'd be happy to do some consulting.
      • It's a friggin' file-based RDBMS - if you can even call it that - on an extremely compact piece of hardware. What do you expect? There is no service that runs and takes care of memory and performance issues, it loads the DB file when needed and pulls data directly from the file.

        Frankly, I agree it isn't a great RDBMS for what you're probably used to, but it's great on a Pocket PC.

      • Take a look at Sybase SQL Server Anywhere [ianywhere.com]. It is a very fast embedded SQL DBMS. Very nice.
  • Sql Server CE? (Score:5, Informative)

    by Hayzeus (596826) on Wednesday December 17 2003, @11:36AM (#7745797) Homepage
    Geez -- a crippled db platform if there ever was one. Calling it "SQL Server" is really a major misnomer -- the two are not even remotely similar in even basic features. Obviously, this would be expected to some extent -- but the name tends to mislead. I had the misfortune of working for an employer who wanted the same application working on both SQL Server and a handheld version on CE. They expected significant code to be shared between the two, and ultimately got a nasty surprise when this proved infeasable, given the alotted dev time frame.
    • Informative? Really??? The documentation spells out very clearly the similiarities and differences - you did read the documentation right? Not just the marketechture brochurementation? There is a great deal of Transact SQL that is compatible between the two, and they are ANSI compliant. What more did you expect out of a db engine running on this class of processors? I'm sorry your management is gullible, but that isn't SQL CE's fault.
    • Re:Sql Server CE? (Score:4, Insightful)

      by Unordained (262962) <unordained_slash ... @pseudotheos.com> on Wednesday December 17 2003, @01:15PM (#7746684) Homepage
      That's why I look forward to the completion of a few last (for this) features in Firebird [ibphoenix.com] (the database server) -- they have an 'embedded' version that sits in a .dll and acts exactly like the server version as far as the calling program is concerned. It's the same engine code, so the same SQL is supported, the same features available. It can still load UDF libraries (the same ones it loaded as a server) but won't accept connections from other programs. If you want several programs to access the same file at the same time, you'll have to do that yourself. It's already great for building single-user programs to be distributed to clients who wouldn't want a "full-blown" database server running (really, it is, but at least it's not listening to any ports.)

      Firebird/Interbase has always been rather small -- 10 meg install, very little memory usage. The main problem porting it to PDA's and other embedded devices was its loopback / inter-process-communication systems. Its shared-memory method wasn't completed (though from what I hear, they have it working in development versions, and the new method speeds up the server quite a bit as well) and it relied on 127.0.0.1 loopback. Windows CE didn't allow for that (no ethernet interfaces at all by default, not even lo) and thus the server couldn't talk to itself. (It tends to use multiple processes.)

      Regardless, Firebird will most likely be available for embedded devices soon, run quickly and quietly, and won't be a stripped-down version at all. Code written for large multi-user environments would still work, but you might have to wait a bit longer for your huge reports.

      (And yes, I feel fine writing this without being too concerned about vaporware -- it's already proven technology, it's actively worked on, and the Microsoft thing isn't any closer.)
      • If you read the small print, you'll find that SQL Server is only claimed to support SQL-92 Entry, which is a tiny subset of SQL-92 that doesn't even include VARCHAR. Yet it still fails to conform to that; it follows SQL-89 in some cases where SQL-92 differs. If you care about ANSI conformance I think you'll be better off with PostgreSQL.
      • so then why not call it Access CE or something similar?
      • Heh, that's what I was thinking. The fact that it serves databases out to apps and uses real-live SQL seem to be the most important features. I'm sure it doesn't do any of the fancy-pants enterprise stuff of MS SQL or DB2 or Oracle, but it is still an SQL ... server.
  • by heironymouscoward (683461) <heironymouscowar ... OTcom minus poet> on Wednesday December 17 2003, @11:39AM (#7745824) Journal
    Do we really need more technologies in their infancy? Is it not one of the biggest problem in this industry that we keep inventing new ways of doing the same stuff, throwing out entire generations of products and developers each time?

    We need ways to make existing good code last longer, not new frameworks to waste time on.

    But... sigh... I don't expect that kind of attitude from Microsoft. One more reason to avoid such platforms like the pest.
    • by GoofyBoy (44399) on Wednesday December 17 2003, @11:57AM (#7745995) Journal
      >Do we really need more technologies in their infancy?

      >But... sigh... I don't expect that kind of attitude from Microsoft.

      Why do you think that this is a MS issue?

      What about IBM? Sun? Oracle? What about over half OpenSource projects?

      (Or perhaps I should be used to the mindless MS bashing around here)
      • I agree about many software vendors.

        The Microsoft bashing is definitely present, and I would argue well-deserved, but it is not mindless. Microsoft are easily the world leader in the invention of new software development platforms that provoke huge investment in time and work by millions of developers, and which are then discarded after 2-4 years. Sun produced a couple of versions of Java. IBM... some C++ platforms, and then websphere. Oracle? OK, a bunch of platforms but mainly just Developer and Des
        • FUD (Score:3, Insightful)

          by GeckoX (259575)

          Microsoft? Dozens, maybe as many as fifty huge platforms produced, promoted, sold, and then abandoned in the last ten years. Visual Basic. C++. Office. ASP. COM. .NET. SQLServer. Access... ad nauseam. And every single version of every platform incompatible with the last.

          This is pure and simple FUD.
          Not ONE of these technologies listed is obsolete or not used any more.

          Bash MS all you want, when you can back it up.
          When you bash MS and don't back it up, it kinda null and voids all of your other arguments.

        • No really this is mindless bashing.

          >Visual Basic. C++.

          Two languages which are incompatible as with any company. How many langauges has IBM pushed? And the end product are insanely compatable since you can create DLL/COM/ActiveX objects and work with each other.

          How many OpenSource FORTRAN, LISP, PROLOG, Perl compiler/translator projects out there? How much better compatiblity do they have with each other?

          >Office.

          Their SINGLE office suite for the past 10 years. What makes you think that they ar
          • And yet they are as powerful as computers 10 years ago. What is the problem? Basic operating system, simple database, tight, efficient programming language... all these things exist and do not require more new platforms.

            I do not accept that the resolution of the screen or the size of the device requires a new development platform (especially at the database level).
            • I don't know about you, but there is no way I'm going to be running what your average DOS PC was running 10 years ago on my PDA, in the area of OS, networking/web or databases. Sorry.

              SQL is nothing new. What is so scary about having an embedded SQL server for CE, Linux, etc? There are number of them, it's not like MS thought of it.

              We could go back to running DOS database apps. Paradox! dBase! YAY! Knock your socks off, do as ye will- but I want a more modern platform, with a more modern API and language
    • Do we really need more technologies in their infancy?
      Everything has a beginning. Second, yes we do need new technologies. The day we stop innovating and inventing we've become no more intelligent than the rest of the species on this planet. Mind as well we should start walking backwards.

      Is it not one of the biggest problem in this industry that we keep inventing new ways of doing the same stuff, throwing out entire generations of products and developers each time?
      I would disagree. It is not the big
      • We agree that progress is good. No-one regrets the passing of days when we hand-coded interface languages because XML had not been invented.

        But you make the mistake of many people, namely to assume that change is equal to progress.

        Change is only part of the cycle. The other part of the cycle is the refinement of techniques and maturation of knowledge that lets you exploit change to the fullest.

        Imagine if every three years we had to discard languages like HTML and XML and start with new, incompatible co
        • We agree that progress is good. No-one regrets the passing of days when we hand-coded interface languages because XML had not been invented.
          Part of my point.

          But you make the mistake of many people, namely to assume that change is equal to progress.
          Change in itself can be tied to progress. Changes can happen based on progress, especially when it comes to new technologies (in their infancy) like the internet. The invention of HTML (the most simplistic example) lead to the first sharing of information
    • Do we really need more technologies in their infancy?

      Yes. It keeps geeks like myself employed.

    • I'm sure I'll be modded down for 'flaming' for this, but it needs to be said, despite my love for open software.

      Do you really think that the attitude of replacing old frameworks is exclusive to MS, who does it for financial gain? No. Open source communities are -constantly- reinventing the wheel - look at all the open source projects out there just for word processing; don't you think they could share a little bit more of a common codebase, say, for the inport/export of 3rd party file formats? That would m
  • by Mean_Nishka (543399) on Wednesday December 17 2003, @11:39AM (#7745828) Homepage Journal
    I'm so desperate to see a Mysql port to Windows CE.. I've been running this along with PHP/Apache on my Sharp Zaurus [techfornewbies.com] and that platform proves it's possible to do this stuff with open source software and 206mhz Strongarms.

    While I haven't been interested in shelling out the $$$ for Microsoft's server product (getting data back to the desktop database is important to me) I can say that I haven't found any database solution that operates as quickly as MySql on a PDA.

    My Zaurus is running as a full fledged server and its rock solid. Even the desktop ODBC connector is able to pull data into my windows apps at a surprisingly fast rate of speed. In a word it's simply awesome. I just wish my PHP skills were better.

    For the mortals Microsoft offers an Access compatible format (pocketAccess) that's horribly limited and slow. There are some great PocketPC database apps [kaione.com] that are crippled by this horrific database solution that could be killer apps with a free backend.

    • Try this instead:

      http://www.sqlite.org/

      Enjoy,
    • Some one please don't. It's in a half stage of trying to be big while not being small. It has a lot of flaws in it that don't make it a large RDBMS. PostgreSQL comes a lot closer, but there are a lot of larger databases that can pound both of them out for reliability and overall performance.

      Please don't post that link about mysql's supposed better performance. It likes to choke after dealing with much MUCH larger sets of data. But I digress.

      I'd imagine something MUCH smaller, like mini sql [hughes.com.au] or SQLLite
    • As a longtime user of PDAs, Newton, WinCE and Zaurus, I feel I can safely say for most apps, MySQL is pretty sucky on the Z. It wastes precious resources on the Zaurus- especially precious considering how much the setup- Linux+Qtopia- eats up as it is. Far worse than CE.

      I can't say I've used this particular MS SQL for CE product- but I have used the built-in database, which allows happy queries. As well as SQLlite on the Zaurus. Both seemed a lot faster and provided more enjoyable solutions for me, the de
  • by burgburgburg (574866) <splisken06@nospAM.email.com> on Wednesday December 17 2003, @11:50AM (#7745933)
    let's face it, no matter how well you write your app, it won't be secure if you leave the front door open.

    It will be secure if you leave the front door open, but have a tiger pit cleverly disguised just inside the doorway.

    Thieves tend to go to the path of least resistance, and unless they see one of their criminal compatriots plummeting into the tiger pit, or hear the horrible screams that follow, this is their most likely point of attack.

    Or was that just a metaphor?

  • by e4liberty (537089) on Wednesday December 17 2003, @11:51AM (#7745939)

    The very high quality embeddable SQLite database has several ports to .NET -- see the web site [sqlite.org].

  • by Dr. Bent (533421) <ben AT int DOT com> on Wednesday December 17 2003, @11:55AM (#7745970) Homepage
    After all, unless you are simply playing games on the PDA, it probably needs to interact with a database somewhere and I can assure you, just about every common task that you may encounter is discussed in depth. The show you how to bind controls to data, retrieve it from a Web Service, retrieve it from a SQL Server on a local network, use SQL CE to take advantage of replication and using XML as a Data Access technology.

    So, if I'm reading this right, the way this is supposed to work is:

    1) You bind your GUI controls to a SQL server database using the SQL CE library installed on your PDA.

    2) When a GUI control needs to update the data, or refresh it's view of the data, it performs a query using SQL CE.

    3) SQL CE then transforms that request into an XML document, sends it over a (presumably) wireless network connection, to SQL Server.

    4) SQL Server then processes the request, generates an XML response, and then the whole thing runs in reverse until the response gets back to the control, which can then update itself with the new information.

    Is this really the way this thing is supposed to work? Please somebody tell me that I'm reading this wrong.

    SQL statements are great when you're trying to optimize for query efficency, but they're awful when you're trying to optimize for network latency/bandwidth. This is because SQL is based on the idea that you perform operations over a persistant connection, because establishing that connection and performing the query is usually the bottleneck.

    But any wireless developer will tell you that latency/bandwidth is the major bottleneck in a mobile application. When you're sending data over CDMA/GSM networks, the best data rate you can hope for is 192kbps, and forget about low latency. This means you have to package your requests in a big bundle and do them all at once. Which means you need something a little more coarse-grained than SQL.

    I suppose if you assume that your application will always have 802.11 access, this could be a good model. But otherwise you're going to be waiting 5-10 seconds every time you click a button, change a setting, or scroll down through a list. Which means nobody is going to actually use your application because it's a grand waste of time.

    • You may not be reading this wrong, but it is wrong nonetheless.

      SQL CE data resides on the Pocket PC, however it can be replicated to a grown up SQL server as needed, and provided proper connectivity.

      A typical use of this technology is a driver in the field. They get their data replicated down from the SQL Server, then they head off for a day off deliveries. Transaction are then done by the driver on the SQL CE side. He/she brings it back to the loading dock at the end of the day and replicates his/he
    • No, you're reading it wrong. See how he mentions getting data from SQL Server on a "local network," and then use the SQL CE server from when you're away from said local network. You know, like when you're out of the office, away from the office LAN or wifi network. You use the built-in server for the time you're away- the latency and bandwith issues are moot. You come back to work the next day with the new data you collected and new data from the mothership- you sync and that's that.

      It's not a new approa
  • by Anonymous Coward
    to store the english alphabet.
    Performance was good unless you wanted the results sorted :)
  • When I was working on a mission critical application for an insurance company, the customer wanted applications that would enable folks to continue to handle essential business functions even if their network or database servers were down. The network connections to CE type devices are largely wireless-and you just can't assume they'll always be available. In that situation, having a database that will cache important items locally in a way they can be actually used is quite valuable and allows you to updat
  • So far many of the comments seem to be along the lines of, "SQL Server for a PDA?! WHY?!" Well, why not? Think about where PDA's could be headed. Why not have the PDA be the server for your Personal Area Network?

    PDA's these days are getting more and more powerful. They're already as powerful as what was on the desktop less than a decade ago, and they're catching up fast. It's not unreal that in 5 years we'll have PDA's capable of running Half Life 2 and Doom 3. I mean, today's PDA's can already run Quake 1 [pocketmatrix.com]
    • Because people are pigheaded. Ignorant. etc.

      A PDA should be using a database as it's central store as it is. CE already includes a database system, though the SQL CE has more features. The NewtonOS and PalmOS both do very well by having a database at their core. I don't care if it's a sql-based relational or object database, it just makes more sense.

      The PDA is a chance to start over. With different OSes and CPU archs, compatibility isn't a big deal as it is on the desktop, where it has held back develop
  • Oh no! (Score:3, Funny)

    by aiken_d (127097) <aiken.bondage@com> on Wednesday December 17 2003, @12:12PM (#7746130) Homepage

    Compact Framework is a cool technology

    He's a witch! Burn him!

    Cheers
    -b

  • Why? (Score:2, Interesting)

    by BaronAaron (658646)
    Build your application as a web app using ASP.NET/PHP or whatever. Use whatever SQL backend you want and have it run on a REAL server that is meant to do that work.

    On the PDA, throw a 802.11b card in when at the office and some sort of cellular card for when you are out and about. The only software you need on the PDA is a good web browser. Bandwidth is much less of a issue because all you are transfering back and forth is simple HTML.
  • It took 10 chapters and 450 pages! Damn I can do it in 4 words: Do NOT do that. Yup, MSSQL a ten's of megabytes application, let's dumb it down and use it manage a few hundred megabytes of compact flash on a handheld or embedded device, yup that's a plan. I guess it's like the man said: when all you have is a hammer, everything looks like a nail. I guess Microsoft needs a bigger data management toolbox.
  • Free hint for the reviewer: this is not a high school assignment, there is no minimum word count.

    The other area that this book really excels in is getting you through replication. This is not a fun topic if you don't know what you are doing and there isn't a lot of literature out there to help you get through PUSH/PULL subscriptions and the like. Pragmatically speaking, of the topics this book covers, Tiffany's coverage of replication is probably going to benefit people the most, because if you can't syn

  • by AmazingRuss (555076) on Wednesday December 17 2003, @01:17PM (#7746697)
    ...why separate the database engine from the development tool on a palmtop, where efficiency is paramount? Do they expect people to use a palmtop as a db server or something?

    Something like Foxpro or Access, with integrated database support, would make a helluva lot more sense. The latest version of Foxpro for the PC has a smaller runtime than what they are cramming on there for SQL CE for chrissakes! It's fuggin silly. What gets IN to those people?

    10 years ago, I was putting the entire foxpro for dos development environment on 1 meg HP xxLX palmtops, and it worked really well. Full portability between desktop and palmtop, good performance, and good stability. Why have we taken such a giant step backwards that despite the hardware being 100 times better, we can no longer build decent software to run on it?

    Everything MS does anymore should be accompanied by clown music.

    I am truly starting to believe that MS is going to be a niche player like Apple in 10 years...an idea I would have laughed at a few years back. I don't LIKE this idea...it means I have to spend a lot of time retraining...but the writing is on the wall.
    • Re:CE??? (Score:2, Insightful)

      by grub (11606)

      How's stupid enough to run their database server on Windows CE anyway?

      Don't think this is a huge focus for Microsoft, they're practising their tried and true method of "throw enough shit against the wall and some of it will stick" marketting. Assuming this product gets a decent foothold then you'll see them really push it.