SQLMaster conversion is slow
in [Visual Objects]
|
From: Rene J. Pajaron on 3 Aug 2010 01:28 Hello, I have DBF with more than 2 million rows in it, it seems SQLMaster took ages to convert to SQL Server 2008. Anyone, have faster idea? Actually, we are planning to write our own conversion, but I want to see how fast would SQLMaster. Maybe my PC is slow enough: Win7, 8GB, Quad core, seems fast to me. Rene
From: Stephen Quinn on 3 Aug 2010 05:10 Rene > I have DBF with more than 2 million rows in it, it seems SQLMaster > took ages to convert to SQL Server 2008. Define 'ages' - 1 (hour,day,week,month)?? Same machine or over the network?? > Actually, we are planning to write our own conversion, but I want to > see how fast would SQLMaster. Why don't you export to CSV and import using the SQL management tools?? > Maybe my PC is slow enough: Win7, 8GB, Quad core, seems fast to me. Probably needs more memory<g> > Anyone, have faster idea? All my ideas are fast, I forget them just as quickly<bg> CYA Steve
From: Geoff Schaller on 3 Aug 2010 18:13 Rene. 2 million rows using bulk insert will take about 40 seconds on my PC. Most of that is creating the CSV from the DBF. I presume you used bulk insert? Geoff "Rene J. Pajaron" <rjpajaron(a)gmail.com> wrote in message news:ca00d138-c7c1-4b8a-bf3e-e4887710102a(a)q21g2000prm.googlegroups.com: > Hello, > > I have DBF with more than 2 million rows in it, it seems SQLMaster > took ages to convert to SQL Server 2008. > > Anyone, have faster idea? > > Actually, we are planning to write our own conversion, but I want to > see how fast would SQLMaster. > Maybe my PC is slow enough: Win7, 8GB, Quad core, seems fast to me. > > > > > Rene
From: Rene J. Pajaron on 3 Aug 2010 21:41 On Aug 3, 5:10 pm, "Stephen Quinn" <stevej...(a)bigpondSPAM.net.au> wrote: > Rene > > > I have DBF with more than 2 million rows in it, it seems SQLMaster > > took ages to convert to SQL Server 2008. > > Define 'ages' - 1 (hour,day,week,month)?? > Same machine or over the network?? > > > Actually, we are planning to write our own conversion, but I want to > > see how fast would SQLMaster. > > Why don't you export to CSV and import using the SQL management tools?? > > > Maybe my PC is slow enough: Win7, 8GB, Quad core, seems fast to me. > > Probably needs more memory<g> > > > Anyone, have faster idea? > > All my ideas are fast, I forget them just as quickly<bg> > > CYA > Steve Thanks Steve, For the faster idea.... I think my PC is fast enough... I need to interview Geoff about Bulk Inserts, which do not work here. Rene
From: Rene J. Pajaron on 3 Aug 2010 21:53
Hi Goeff, I do not use BULK INSERT because it does not insert all rows from the table. I left it uncheck, and it works but very slow, and I have 10 tables here that averages 1.5M rows. What does Bulk Insert do? Background info: MS SQL Server 2008 Tables are already created, using SQLMaster. I did not bother to drop the table, because I can right clicked at table, and select "Import Data from DBF/XML->Import Data from DBF". Using Bulk Inserts: Option I checked here are the following: CSV file path: ...valid path.... Server CSV Path: same as above, as I am working on the same PC. Options: 1. Create Table is disabled (because table is already existing). 2. Create Index is checked 3. Upload Data is checked 4. Use Bulk Insert is checked 5. Stop on Error is not checked 6. Fix Illegal Names is not checked 7. Add RECID is check by default 8. Add Del column is not checked 9. Add RLOCK col is not checked Memo Field as : TEXT Upload block Size (rows) 100 DBFCDX Then, GET CSV DELIMITERS String Delimiter is not available Row Delimiter: ||CRLF Field Delimiter: >|< I experimented on changing above two values; but Bulk Inserts do not happen; or do I have to use other tools to import data? Thanks for your help Geoff, Rene On Aug 4, 6:13 am, "Geoff Schaller" <geo...(a)softwarexobjectives.com.au> wrote: > Rene. > > 2 million rows using bulk insert will take about 40 seconds on my PC. > Most of that is creating the CSV from the DBF. > > I presume you used bulk insert? > > Geoff > > "Rene J. Pajaron" <rjpaja...(a)gmail.com> wrote in messagenews:ca00d138-c7c1-4b8a-bf3e-e4887710102a(a)q21g2000prm.googlegroups.com: > > > Hello, > > > I have DBF with more than 2 million rows in it, it seems SQLMaster > > took ages to convert to SQL Server 2008. > > > Anyone, have faster idea? > > > Actually, we are planning to write our own conversion, but I want to > > see how fast would SQLMaster. > > Maybe my PC is slow enough: Win7, 8GB, Quad core, seems fast to me. > > > Rene > > |