[dba-SQLServer] [AccessD] A real puzzler

[John W. Colby]

I have always been interested in using a cloud to perform the 
calculations.  However:

1) I have about 600 GB of data in 9 different SQL Server databases.
2) I have 2 years of custom C# written development code in a pair of 
applications that directly manipulate SQL Server to perform the work 
that I do.
3) That C# code performs backups to storage local to the C# Server.
4) I keep the database files themselves on SSD, using about 700 GB (of 1 
TB) of Raid SSD storage, on the same system that SQL Server runs on
5) I keep the log files on rotating media, again on the same physical 
machine.
6) I have 16 cores and 80 gb of RAM, and the SQL Server uses it all.
8) I use compression extensively, which requires cores to decompress 
data in memory as it is used.
9) The custom C# code I run is running on a VM, accessing data in SQL 
Server, and shoveling CSV files off to a set of 4 (currently) VMs which 
then run custom third party apps which clean the data, then imports the 
cleaned data back into SQL Server

10) And finally, I am a one man show.  I do not have a million dollar 
budget and a half dozen flunkies to throw at feasibility studies, nor 
migration to the cloud.

To be quite honest, I consider myself quite lucky and quite skilled to 
have designed, coded and built the system I have, over a period of many 
years.  It is a very complex system that does a simple job that requires 
a complex system.  The system as it stands uses a pair of pretty darned 
powerful servers, one running six  VMs, the other running a largish 
instance of SQL Server, all tightly integrated with custom software 
level virtual networks to allow everything to talk to each other.  Every 
month this system exports about 500 MILLION addresses for cleaning, to 
the VMs running the third party software, shipping data across the 
internet from the VMs to their servers in California, then back to the 
VMs and from there back into the SQL Server.  Every two months I have to 
download a 3 gb install disk from the third party software house, and 
install that (upgrade the software) on the VMs.

I built the servers from parts, installed all software from disk or 
downloadable images, tweaked to get things running off of SSDs to get 
the last ounce of speed, created VMs, cloned them, running off of SSDs.  
I designed the C# systems, and coded about 40% myself, with the 
remaining done under my supervision by a kid I hired out of a C# class I 
took.  All of this work done in my home office, over a period of about 4 
years.

And the odd part (to me) is that I am considered unqualified to get a 
job in the IT world because I don't have a BS(!) degree and a laundry 
list of silly software experience check boxes.

Never mind what you have done, which of these things that you will never 
actually be required to do can you say you have extensive experience 
in?  Laundry lists of them!

:)

So could I "run my database up on the cloud?".  If anything goes wrong 
could I fly up into the cloud to fix it?  How much of my non-existent 
million dollar budget could I eat up in tech support because the system 
is hard down for some reason and no one has a clue.

Had the cloud been available when I started this venture I think I would 
have designed it around the cloud.  Now to go back and port it all to 
the cloud is pretty much not happening.

John W. Colby

On 8/10/2015 4:57 AM, Jim Lawrence wrote:
> You can actually run your database up on a Cloud based system.
>
>
> Just a thought.
>
> Jim
>
>