From: Rene J. Pajaron on
Hello,

I have DBF with more than 2 million rows in it, it seems SQLMaster
took ages to convert to SQL Server 2008.

Anyone, have faster idea?

Actually, we are planning to write our own conversion, but I want to
see how fast would SQLMaster.
Maybe my PC is slow enough: Win7, 8GB, Quad core, seems fast to me.




Rene
From: Stephen Quinn on
Rene

> I have DBF with more than 2 million rows in it, it seems SQLMaster
> took ages to convert to SQL Server 2008.

Define 'ages' - 1 (hour,day,week,month)??
Same machine or over the network??

> Actually, we are planning to write our own conversion, but I want to
> see how fast would SQLMaster.

Why don't you export to CSV and import using the SQL management tools??

> Maybe my PC is slow enough: Win7, 8GB, Quad core, seems fast to me.

Probably needs more memory<g>

> Anyone, have faster idea?

All my ideas are fast, I forget them just as quickly<bg>

CYA
Steve


From: Geoff Schaller on
Rene.

2 million rows using bulk insert will take about 40 seconds on my PC.
Most of that is creating the CSV from the DBF.

I presume you used bulk insert?

Geoff



"Rene J. Pajaron" <rjpajaron(a)gmail.com> wrote in message
news:ca00d138-c7c1-4b8a-bf3e-e4887710102a(a)q21g2000prm.googlegroups.com:

> Hello,
>
> I have DBF with more than 2 million rows in it, it seems SQLMaster
> took ages to convert to SQL Server 2008.
>
> Anyone, have faster idea?
>
> Actually, we are planning to write our own conversion, but I want to
> see how fast would SQLMaster.
> Maybe my PC is slow enough: Win7, 8GB, Quad core, seems fast to me.
>
>
>
>
> Rene

From: Rene J. Pajaron on
On Aug 3, 5:10 pm, "Stephen Quinn" <stevej...(a)bigpondSPAM.net.au>
wrote:
> Rene
>
> > I have DBF with more than 2 million rows in it, it seems SQLMaster
> > took ages to convert to SQL Server 2008.
>
> Define 'ages' - 1 (hour,day,week,month)??
> Same machine or over the network??
>
> > Actually, we are planning to write our own conversion, but I want to
> > see how fast would SQLMaster.
>
> Why don't you export to CSV and import using the SQL management tools??
>
> > Maybe my PC is slow enough: Win7, 8GB, Quad core, seems fast to me.
>
> Probably needs more memory<g>
>
> > Anyone, have faster idea?
>
> All my ideas are fast, I forget them just as quickly<bg>
>
> CYA
> Steve

Thanks Steve,

For the faster idea....
I think my PC is fast enough...

I need to interview Geoff about Bulk Inserts, which do not work here.

Rene
From: Rene J. Pajaron on
Hi Goeff,

I do not use BULK INSERT because it does not insert all rows from the
table. I left it uncheck, and it works but very slow, and I have 10
tables here that averages 1.5M rows.

What does Bulk Insert do?

Background info:
MS SQL Server 2008
Tables are already created, using SQLMaster. I did not bother to drop
the table, because I can right clicked at table, and select "Import
Data from DBF/XML->Import Data from DBF".

Using Bulk Inserts:

Option I checked here are the following:
CSV file path: ...valid path....
Server CSV Path: same as above, as I am working on the same PC.

Options:
1. Create Table is disabled (because table is already existing).
2. Create Index is checked
3. Upload Data is checked
4. Use Bulk Insert is checked
5. Stop on Error is not checked
6. Fix Illegal Names is not checked
7. Add RECID is check by default
8. Add Del column is not checked
9. Add RLOCK col is not checked

Memo Field as : TEXT

Upload block Size (rows) 100

DBFCDX

Then, GET CSV DELIMITERS
String Delimiter is not available
Row Delimiter: ||CRLF
Field Delimiter: >|<

I experimented on changing above two values; but Bulk Inserts do not
happen; or do I have to use other tools to import data?

Thanks for your help Geoff,

Rene


On Aug 4, 6:13 am, "Geoff Schaller"
<geo...(a)softwarexobjectives.com.au> wrote:

> Rene.
>
> 2 million rows using bulk insert will take about 40 seconds on my PC.
> Most of that is creating the CSV from the DBF.
>
> I presume you used bulk insert?
>
> Geoff
>
> "Rene J. Pajaron" <rjpaja...(a)gmail.com> wrote in messagenews:ca00d138-c7c1-4b8a-bf3e-e4887710102a(a)q21g2000prm.googlegroups.com:
>
> > Hello,
>
> > I have DBF with more than 2 million rows in it, it seems SQLMaster
> > took ages to convert to SQL Server 2008.
>
> > Anyone, have faster idea?
>
> > Actually, we are planning to write our own conversion, but I want to
> > see how fast would SQLMaster.
> > Maybe my PC is slow enough: Win7, 8GB, Quad core, seems fast to me.
>
> > Rene
>
>