The stupid widget keeps messing with the capitalization!
SQL Server OleDb IRowsetFastLoad .net
I am working on developing a simple ETL tool.
Performance isn't really very important overall, but at the moment I'm testing it with a large CSV file and comparing against SSIS' performance.
SSIS with OleDb (Native Client, FastLoad) can load the file into an SQL Server table in about 10 minutes.
SSIS with ADO.net (SQL Client, Bulk Copy) can load the file into an SQL Server table in about 40 minutes.
My process with ADO.net (SQL Client, Bulk Copy) can load the file in about 30 minutes.
The BCP utility (Native Client, ODBC) takes about 10 minutes.
So I'm wondering how I might be able to use OleDb's Fast Load -- from C# and .net rather than C/C++ .
It doesn't look possible, but does anyone out there have any ideas I might pursue?
Might P/Invoke be able to do it?
What I have tried:
I have been using the SqlBulkCopy Class with C#
SqlBulkCopy Class (System.Data.SqlClient) | Microsoft Docs[
^]
I'd like to use IRowsetFastLoad, but the samples are in C/C++
IRowsetFastLoad (Native Client OLE DB provider) - SQL Server | Microsoft Docs[
^]
I have compiled and executed the C/C++ sample program.
I have looked at the OleDb provider in .net , but nothing jumped out at me as being what I want.