SSIS Output to Multiple Files

Export a large set of query results into multiple flat files using SSIS.

Let’s say a user asks you to create a flat file output from a database query. Piece of cake. Open SSMS, write the query, run it and copy the results (with headers using SSMS 2008) into a text file. Send the user the file and and you’re done with time left over for a siesta.

But oh wait—they want to be able to open it in an older version of Excel, which will only display ~ 65k rows per sheet. This file has 190k rows. So they ask you to write the output to multiple files, limiting the total rows per file to 60k.

Now what?

You could simply open the raw flat file, go to line 60,001 and cut-paste lines 60,001–120,000 into another file and repeat as necessary. That’s ok for a one-off task but not a good strategy if you are going to be doing this several times. It can be cumbersome and error prone to manually create several files this way.

No—the better approach is to make SSIS do the heavy lifting. I had to do this recently and thought I’d share my solution. [Read more...]

Notes on Marketing and Promotion

I made these notes during last night’s HYPE event: Entrepreneur Roundtable – Marketing & Promotion. The speakers were Caitlin Thayer of Barefoot Media
and Andrew Wood of Mintz & Hoke Communications Group. Caitlin and Andrew discussed brand, marketing, social media and small business success. These notes aren’t their words verbatim so if anything sounds wrong, the blame is mine. [Read more...]

The Well-Dressed DBA

You may not be aware of this fact but DBAs (database administrators) are actually world renowned for their impeccable display of sartorial savvy. What the average man knows about fashion would fit nicely within a CHAR(4) field. What the DBA knows about fashion requires a VARCHAR(MAX) field. At least.

By the way, the author would have you know that he can speak with total and complete authority on female DBA fashion as well as male. But he will let a female DBA tackle her own sex. Today he will tackle only the male.

We will begin at the bottom and work our way to the top. [Read more...]

SQL Server 2005 How to Change Default Backup Location

In SQL Server 2005, you can easily change the default location for log and data files. Open SSMS and connect to the instance you want to configure. Right-click on the instance and choose properties. Then select the Database Settings page and change the Database default locations.

Clickity-click-done. (I know, being a DBA can be tough sometimes.) [Read more...]

The DBA’s Desk

It is Friday and thankfully I’m knee-deep in SQL Server work today (instead of, say, sitting in meetings). It seemed like the perfect opportunity to open the kimono a bit and show you what the DBA’s desk looks like.

The DBA's Desk

This was only partially staged. I got rid of the dust bunnies.

This shot showcases the non-computer tools required by the proficient DBA. Each item was carefully selected and is ABSOLUTELY ESSENTIAL to accomplishing the DBA’s job. I’ll explain. [Read more...]

Secrets to Winning at Office Politics – by Marie G. McIntyre

Like it or not, office politics is an inescapable part of working in a corporate environment. It may not always be visible but it is always there. It is a kind of game. Those that understand it and aren’t personally offended by it often get along well. Those that don’t understand it or are personally offended by it? Not so much. [Read more...]

Resources for Learning More About SQL Server Internals

A while back, I spent about a month working through several SQL Server performance issues after upgrading three systems from SQL Server 2000 to SQL Server 2005. During that time I would realize that my knowledge of how SQL actually manages data at a low level was sketchy. In the process of resolving said sketchiness, I came across a few resources that proved helpful. [Read more...]