Forums - Create a SQL database from csv files

HOME FORUMS BROKERS SOFTWARE BOOKS CONTACT US

Your Account • Become a Member • Help • Search

	Forums ›› Technically Speaking ›› Programming ›› Create a SQL database from csv files

Page 1 of 2: 1 2

lordoftrades

Registered: Jan 2011
Posts: 21

08-21-12 11:18 PM

Hello

I have worked a lot on VBA in Excel, and would like to test how the result would be if I used SQL instead of hundreds of .csv files.

But I have no clue on how to create a SQL database from all my .csv files. I have searched up and down without finding any answers that is relevant.

Does anyone have suggestions on how to create a database in SQL from all the .csv files. I guess they have to be separated into EOD and Intraday?

Kind regards
Espen

Edit/Delete • Quote • Complain

2rosy

Registered: May 2012
Posts: 335

08-22-12 01:16 AM

almost every database has an import utility.

here you go for sqlite.

http://stackoverflow.com/questions/...ile-into-sqlite

Edit/Delete • Quote • Complain

Worx

Registered: Jul 2012
Posts: 2

08-22-12 01:28 AM

Agree with 2rosy.
If you are using Microsoft SQL, it has utility for creating database from Excel file. Sheets are converted individually. Subsequently you can convert Microsoft SQL to other database format. Ideally you'll merge similar CSV files to minimize number of databases.

Edit/Delete • Quote • Complain

newwurldmn

Registered: Apr 2011
Posts: 2614

08-22-12 01:49 AM

I think the SQL server version of bulk import is called bulkdata. It comes with the program and runs on the command prompt. It's pretty fast too.

Edit/Delete • Quote • Complain

PocketChange

Registered: Jul 2008
Posts: 2036

08-22-12 03:26 AM

thecommon.net

dhRichClient: Excel - SQLite library

Checkout their star schema sample.

Edit/Delete • Quote • Complain

scriabinop23

Registered: Jun 2006
Posts: 4019

08-22-12 06:13 AM

Quote from lordoftrades:

Hello

I have worked a lot on VBA in Excel, and would like to test how the result would be if I used SQL instead of hundreds of .csv files.

But I have no clue on how to create a SQL database from all my .csv files. I have searched up and down without finding any answers that is relevant.

Does anyone have suggestions on how to create a database in SQL from all the .csv files. I guess they have to be separated into EOD and Intraday?

Kind regards
Espen

If using Microsoft SQL Express 2012 (free), use Import/Export Data (xx-bit) tool to bring csv straight into your database.

and yes, you will have seperate tables for intraday and EOD. Then you can use SQL queries through VBA and/or outright SQL queries to do what you want with the data...

Edit/Delete • Quote • Complain

Page 1 of 2: 1 2

Receive an email whenever a new post is added to this thread by subscribing to it.

Rate This Thread:

Forum Jump:

Conduct Rules - Privacy Policy - Day Trader - Day Trader Forum - Best Trading Software - Sitemap

WHILE YOU'RE HERE, TAKE A MINUTE TO VISIT SOME OF OUR SPONSORS:
Advantage Futures Futures Brokerage & Clearing AMP Global Clearing Futures and FX Trading Bright Trading Professional Equities Trading CTS Futures Trading Software DaytradingBias.com Professional Trading Analytics ECHOtrade Professional Trading Firm	eSignal Trading Software Provider FXCM Forex Trading Services Global Futures Futures, Options & FX Trading Interactive Brokers Pro Gateway to World Markets JC Trading Group Direct Access Trading MB Trading Direct Access Trading	MultiCharts Trading Software Provider NinjaTrader Trading Software Provider OANDA Currency Trading optionshouse Option Trading & Education Rithmic Futures Trade Execution Platform SpeedTrader Direct Access Trading	SpreadProfessor Spread Trading Instruction thinkorswim by TD Ameritrade Direct Access Trading TradersStudio System Building & Backtesting Trading Technologies Trading Software Provider Trend Following Trading Systems Provider