Andrew Fiebert, DBA and Developer
The blogfolio of
developer Andrew Fiebert

SQL Server Openrowset Crawler Intro

(in Database, SQL Server on December 17th, 2009 by Andrew)

So, I’m bored and I’m tired of looking at an empty blog, time to share some of the stuff I’ve learned (and built) over the past few years.  A lot of it will be DBA based but I’ve always been a developer at heart so they are tools to help you do the job quicker.  I’m doing a lot of cooler database development work now so hopefully once I work though some backlog I’ll get to writing about more difficult things.

First, lets talk about a crawler briefly as most of the cool stuff I’ve done is based around data collection and storage.  I imagined a single data server being a central point for collecting data from all of the other data servers.  This works for most things in the database world, especially when you don’t have the luxury of pushing a service (application) to thousands of machines.  If you are into the service side, stay tuned, the team I just joined pushes data collection to a new level so hopefully I’ll get to shed some light on the concepts I’m learning.

Now, the central point without an application sitting on every machine can be achieved with openrowset because you can assume credentials between different SQL Servers on the same network (domain can of course be different).  This requires you to enable ad-hoc queries.  The way it is setup in SQL Server is beautiful because here you only have to enable openrowset on your crawler (central point of data collection) and you can leave the settings on the other thousand data servers alone.

sp_configure ‘show advanced options’, 1
reconfigure WITH override
go
sp_configure ‘Ad Hoc Distributed Queries’, 1
reconfigure WITH override
go
sp_configure ‘show advanced options’, 0
reconfigure WITH override
go

There, now we’ve opened the door. The next step is to get the key (which you likely already have) to all the data servers.

Typically if you are managing even a couple hundred instances you will need a DBA functional group. This is a windows domain group where you can stuff all the DBA accounts so this way, when you build out a new server, you just add that group and everyone has access. We can the run the collection instance under one of those accounts and we have access everywhere (while obeying the domain account double-hop rule); OR we can create a common SQL authentication account everywhere and use that as the method to login everywhere. Additionally we can do some tricks via BAT files, but we will talk about that another time.

There you have it, now you’re primed and ready to go. Next post I’ll talk about the queries we can run to start collecting data.

Shuttercal in the news

(in Projects on August 23rd, 2008 by Andrew)

I’ve been spending a fair amount of time on Shuttercal.com lately with Dan and Scott.  It’s a neat site where you can post up a picture a day in a calendar format and communicate with an already vibrant community on photography or just regular nonsense.  I was eating dinner at my parents place last night and all of a sudden I get a ton of calls from Dan and Scott, I figure I can catch up with them later cause I’m spending time with my parents.  No big deal.

It turns out they were calling like crazy cause the site made it on to Fox News.  The Houston local station saw the site and covered it on their cool-site-of-the-day bit.  Just the thought of news anchors making small talk around a project I’m involved in is crazy.  Catch a link to the video here.

The craziest part is we had nothing to do with this, the users of the site love it so much they are constantly getting us exposure in random blogs, you tube, deviantArt, etc… I have a good feeling about this one!

The Large Hadron Collider – The Rap

(in Interesting on August 9th, 2008 by Andrew)

This rap is straight dope yo’

That’s why funerals are so sad

(in Written Word on August 7th, 2008 by Andrew)

So, I’ve been working on version 2 of this site I started to look at what I have uploaded and clean up where necessary. During this process I found a folder called poetry and I rediscovered my favorite poem from my favorite poet, Charles Bukowski.

It turns out forever ago I was talking to some girl about this poem and I couldn’t for the life of me find it online to show her. It has since been uploaded and sitting on my server, I showed it to her of course but I didn’t exactly share it with you guys.

“You have no idea, cousin, how many men can do it but won’t.”
That’s why funerals are so sad.

Enjoy!

"The secret of happiness lies in taking a genuine interest in all the details of daily life, and in elevating them to art." - William Morris