[dba-SQLServer] FYI - nVLDB performance

John W. Colby jwcolby at colbyconsulting.com
Tue Sep 14 15:38:54 CDT 2004


Another set of numbers.

I built two queries to pull subsets.  

One pulls every 100th record, JUST the PK column and builds a table from the
results.  This takes about 45 seconds to complete.
The other pulls every 100th record, all the data and builds a table from the
results. This takes 34 MINUTES.

John W. Colby
www.ColbyConsulting.com 

-----Original Message-----
From: dba-sqlserver-bounces at databaseadvisors.com
[mailto:dba-sqlserver-bounces at databaseadvisors.com] On Behalf Of Francisco
Tapia
Sent: Tuesday, September 14, 2004 1:24 PM
To: dba-sqlserver at databaseadvisors.com
Subject: Re: [dba-SQLServer] FYI - nVLDB performance


John,
  Thanks for keeping us updated... It seems logical to me since you are
running backups of your data that it may be wise to switch from FULL
loggging to SIMPLE logging now that you're doing Indexes.  This way you
don't log every event.  Additionally restriciting the size of the log to a
specific size will also help speed things along, this way SQL Server is not
tied up w/ useless things such as creating virtual page files.  In general
this is good practice, but in your case it
will be very much more needed.   I've posted as has Eric and I beleive
others, on how to do this, if you don't have the email, let me know and I'll
post again.

as far as trying to use the 4gb, you may want to take a look at this... this
will obviously help speed up performance, because up until now you've only
been using 2gb, and yes Windows 2000 natively supports 4gb, while XP is
restricted to 2gb... why? I dunno. (but that's one more reason for me to
hold on to 2000 a little longer)

http://www.sql-server-performance.com/awe_memory.asp


On Tue, 14 Sep 2004 12:45:32 -0400, John W. Colby
<jwcolby at colbyconsulting.com> wrote:
> Just to let you know some numbers on the database as it currently 
> stands.
> 
> First, I have two almost identical machines which I built to hold and 
> manipulate the database.  Both machines use an MSI K8N Neo motherboard 
> with built in 4 port SATA and dual channel IDE, gbit LAN.  The 
> processor is the 754 pin Athlon64 at 3ghz.  The server currently has 
> Windows 2K and 3g RAM installed.  Apparently Win2K can use up to 4g 
> ram whereas XP is limited to 2g.  Unfortunately I cannot persuade SQL 
> Server to use more than 2g RAM so I am not sure that more memory than 
> that is really useful in this context.
> 
> The server then has (4) 250g Maxtor SATA drives and (1) 250g Maxtor 
> IDE drive holding the data files and the log file respectively.  The 
> second machine is currently running XP Pro.  Since the two new 
> machines have gbit nics built into the motherboard I bought an 8 port 
> gbit switch so they could talk at full speed.  In general I have found 
> that I can run operations from the second machine to the server over 
> gbit LAN at close to full speed, i.e. the LAN is not a severe 
> bottleneck anymore (it definitely was at 100mbit).


-- 
-Francisco
_______________________________________________
dba-SQLServer mailing list
dba-SQLServer at databaseadvisors.com
http://databaseadvisors.com/mailman/listinfo/dba-sqlserver
http://www.databaseadvisors.com







More information about the dba-SQLServer mailing list