[AccessD] XML

I am just pointing out the insanity of XML as a major data transport.

Let's take an example.  I have an actual job to copy about 70 million names and addresses out to a 
file and send to a processor who is going to process the file and send it back to me with ethnicity 
fields.  Obviously they do not use XML, but if you go with the "XML is the ideal transport mechanism 
for internet transfers" mentality...

Can you imagine some twit writing a web service that takes the name / address fields out of a 
database, wraps it in XML to send over the internet and then tries to process 60 million records.

Another example, I actually received 5 files the other day, downloaded off of an FTP.  Each file 
contained roughly 8 million names and addresses plus some other fields.  The data came in as comma 
delimited CSV files.  Each file was roughly 500 megs of text (zipped of course), and a tiny format 
file.  Now, instead of CSV, do that in XML.  The 500 megs would instantly turn into 5 gigs (or 
almost certainly more than that).

How can you possibly think that XML is superior for such purposes.

I am not interested in a huge debate on this matter.  It is just so obviously silly that I can't 
imagine an argument ensuing.

 >Could it be you're caught in the mdb mode of putting your eggs all in one basket?

I'm caught in whatever asininity the other end imposes on me.  I just pray they don't impose XML for 
these kinds of things.

John W. Colby
www.ColbyConsulting.com


Charlotte Foust wrote:
> On the other hand, why would you even think of using only one file?  We
> write tables or table changes to xml files for each table and read them
> in appropriately at the other end.  Could it be you're caught in the mdb
> mode of putting your eggs all in one basket?
> 
> Charlotte Foust 
> 
> -----Original Message-----
> From: accessd-bounces at databaseadvisors.com
> [mailto:accessd-bounces at databaseadvisors.com] On Behalf Of jwcolby
> Sent: Thursday, September 03, 2009 10:12 AM
> To: Access Developers discussion and problem solving
> Subject: Re: [AccessD] XML
> 
>  >However, for transferring data, storing things like individual
> settings, etc., it is quick, easy and efficient.
> 
> I will give you the quick and easy part, particularly for the individual
> settings part.
> 
> In terms of transferring data, it is just a bumbling mass of
> inefficiencies.  Try sending a hundred million records of 640 fields and
> see if you can even fit the file on a terabyte disk.  The answer will be
> NO!  XML is rapidly being adopted for transferring data across the
> internet and yet it expands the size of the data by a factor of 10, or
> even 100.  It is simply ludicrous for such uses. 
>   Pipe delimited CSV files are an order of magnitude more efficient for
> that kind of thing.  Now I will grant you that you do not get the data
> type etc with that but still...
> 
> John W. Colby
> www.ColbyConsulting.com