Gustav Brock
Gustav at cactus.dk
Fri Aug 28 14:43:16 CDT 2009
Hi John Yes, much better. But I wonder why CPU power should be the bottleneck - it certainly should be the upload speed to the Internet. Could it be that this Hamagochi thing is a CPU hog? For an FTP transfer, even a Pentium II could feed files at that speed at little CPU usage ... /gustav >>> jwcolby at colbyconsulting.com 28-08-2009 21:29 >>> Gustav, I created a shared directory on my "new" Windows 2008 server and copied the data file directory structure to there. I then remoted in to the client's machine, mapped that new directory on my server back to my client's machine drive Y. Copied my latest version of the FE to his machine and ran. I am therefore now running the application on his server where I do dev work for him when not developing on my machine in my office. I have mapped a directory on my server over Hamachi to Y: on that server in his office. Running the same code: Time to open the file in Notepad 2156 Milliseconds Time to open the file in Notepad 500 Milliseconds Time to open the file in Notepad 594 Milliseconds Import From File took 5000 Milliseconds Cleanup of raw data took 3750 Milliseconds Import From File took 5016 Milliseconds Cleanup of raw data took 3390 Milliseconds Import From File took 4531 Milliseconds Cleanup of raw data took 9031 Milliseconds Import From File took 4547 Milliseconds Cleanup of raw data took 3094 Milliseconds As you can see, my times for the import process is now MUCH faster. The file server is now hosted on my quad core (2 ghz real clock AMD) with 8 gigs of ram running Windows 2008. BTW My upload speed (out of my office to the internet) is not particularly blazing at .5 mbit / second. I have to conclude that the bottleneck is the server processing speed. When I was running the app on my laptop accessing data at his office, the server was a single core Pentium III 500 mhz machine (just checked) running Windows XP SP3 and 256 MB of ram. Obviously having a new server at his end will help! I think these numbers are suddenly very usable. John W. Colby www.ColbyConsulting.com Gustav Brock wrote: > Hi John > > That seems a bit slow to me but when it is set up and running and the price is right it should be fine - I mean, 73 seconds, should it matter? > > /gustav > > >>>> jwcolby at colbyconsulting.com 28-08-2009 19:43 >>> > Gustav, > > I have Hamachi already in place on the client's server as well as my system. I routinely remote > desktop in to his machine already. I had set up the path to the data files (in / out) as a SysVar > and so I mapped his remote database directory (on his server) to y: on my dev machine here at my > office and changed my sysvar to point to the new location. > > I then ran the existing Access application. I set up my timer class to time the import, which uses > a simple docmd.transfertext to pull the data from the CSV file into a first stage processing table. > > Looking at five different runs, the time to import 835 records from a CSV file into a local table, > across the internet using Hamachi is > > Import From File took 72915 Milliseconds > Cleanup of raw data took 2354 Milliseconds > Import From File took 59250 Milliseconds > Cleanup of raw data took 4319 Milliseconds > Import From File took 23369 Milliseconds > Cleanup of raw data took 3307 Milliseconds > Import From File took 23354 Milliseconds > Cleanup of raw data took 3447 Milliseconds > Import From File took 23353 Milliseconds > Cleanup of raw data took 3181 Milliseconds > > I had done a couple of runs before I set up the timer and the times there were approximately 24 > seconds as well. So the "normal" time is around 24 seconds, but it can be quite lengthy as you can > see, 73 seconds in the worst case so far. > > What was going on during those longer time imports is unknown. The server is being used to store > these scan files as well as process them. OTOH the server is also a 750 mhz pentium machine, pretty > slow as servers go. We have a new server ready to go online. > > And of course this assumes fast internet at both ends. > > I also built a button to allow them to open the source CSV files in notepad. That only took > > Time to open the file in Notepad 4930 Milliseconds > Time to open the file in Notepad 4290 Milliseconds > Time to open the file in Notepad 2855 Milliseconds > Time to open the file in Notepad 4274 Milliseconds > > So obviously the import process itself is taking a fair amount of time. > > Anyway... I would guess that for a small company like this, a Hamachi VPN to a central server is > going to work quite well. Low cost, reasonably fast, and easy to set up. > > John W. Colby > www.ColbyConsulting.com