As I promised in a recent blog entry, I will be posting some code up here that shows you how to test out the various components that are used by SQL Server Full-Text Search -- in particular, wordbreakers, stemmers and filters.
Rather than cover all the ground at once, I've split the story into a three-part series (mostly because a one-part series would be enormous) -- the first part, looking at how wordbreakers work, will provide you with a tutorial on how to wrap the right stuff in C# so you can test wordbreaker output. More can be found here (I think this is the right link): http://sqljunkies.com/weblog/acencini/posts/595.aspx
I'll try and get part II posted later this week or early next week. Stay tuned. As always, questions and comments are quite welcome.