MATLAB Answers

JFz
0

datainsert is very slow

Asked by JFz
on 1 Mar 2017
Latest activity Commented on by JFz
on 6 Mar 2017
Hi,
I have a table of 750000 rows by 7 columns. I use datainsert to insert into database. But it is very slow. If I sert 1 row, it is very quick; if it is 100000 rows, it take several minutes, but it take "forever" to insert 750000 rows.
How to speed it up?
Thanks.

  0 Comments

Sign in to comment.

Tags

Products

1 Answer

Answer by Nagarjuna Manchineni on 6 Mar 2017
 Accepted Answer

There are many ways to insert data a database using the command line. You can use datainsert, fastinsert, or insert. For best performance with large volumes of data, it is recommended to use datainsert or fastinsert.
As you are still experiencing performance issues, create a data file with every record in your dataset. Then, you can use this data file as input into the bulk insert functionality of your database to process the large dataset. Additionally, you can insert data with special characters such as double quotes with this file. Bulk insert provides performance gains by using the bulk insert utilities that are native to different database systems. For details about exporting data using bulk insert, see the following link:

  1 Comment

JFz
on 6 Mar 2017
Thanks. I am cutting the data into multiple pieces, each has 100000 records. Seems like it take about 400 seconds for each piece with fastinsert.

Sign in to comment.